Appendix I — Dates and Times

Working with dates and times can be a little tricky, but the lubridate”, “https://lubridate.tidyverse.org/”)package is there to help. Their website has a helpful [cheatsheet](https://rawgit.com/rstudio/cheatsheets/main/lubridate.pdf) and you can view a tutorial by typingvignette(“lubridate”)` in the console pane. The Dates and Times in R for Data Science also gives a helpful overview.

This appendix is a quick intro to some of the most useful functions for making reproducible reports.

# packages needed for this appendix
library(tidyverse)
library(lubridate)

I.1 Formats

While there is only one correct way to write date (The ISO 8601 format of “YYYY-MM-DD”), dates can be found in many formats. When you are reading a data file, you might need to specify the date format so it can be read properly. Date format specification uses abbreviations to represent the different ways people can write. the year, month, and day (as well as hours, minutes, and seconds). For example, the date 2023-01-03 is represented by the formatting string "%Y-%m-%d. The fastest way to find the list of formatting abbreviations is to look in the help for the function col_date().

Run in the console
?col_date
# create a table with some different date formats
date_formats <- tibble(
  best = "2022-01-03",
  ok = "2022 January 3",
  bad = "January 3, 2022",
  terrible = "Mon is 3 22 1"
)

# save it as a CSV file
write_csv(date_formats, "data/date_formats.csv")

# read it in
df <- read_csv("data/date_formats.csv")
Rows: 1 Columns: 4
── Column specification ────────────────────────────────────────────────────────
Delimiter: ","
chr  (3): ok, bad, terrible
date (1): best

ℹ Use `spec()` to retrieve the full column specification for this data.
ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.

You can see that only the first column read as a date, and the rest read as characters. You can set the date format using the col_types argument and two helper functions, cols() and col_date().

ct <- cols(ok = col_date("%Y %B %d"),
           bad = col_date("%B %d, %Y"),
           terrible = col_date("%a is %m %y %d"))

read_csv("data/date_formats.csv", 
         col_types = ct)
best ok bad terrible
2022-01-03 2022-01-03 2022-01-03 2022-03-01

I.2 Parsing

The ymd functions can deal with almost all date formats, regardless of the punctuation used in the format. All of the examples below produce a date in the standard format “2022-01-03”.

# year-month-day orders
ymd("22 Jan 3")
ymd("2022 January 3rd")

# month-day-year orders
mdy("January 3, 2022")
mdy("Jan/03/22")

# day-month-year orders
dmy("3JAN22")
dmy("3rd of January in the year 2022")
Note

See if you can make a date format that one of the parsers can’t handle.

There are similar functions for date/times, too.

ymd_hms("2022 Jan 3, 6:05 and 20s pm")
mdy_h("January 3rd, 2022 at 6pm")
[1] "2022-01-03 18:05:20 UTC"
[1] "2022-01-03 18:00:00 UTC"

The date/time functions can also take a timezone argument. If you don’t specify it, it defaults to “UTC”.

ymd_hm("2022-01-03 18:05", tz = "GMT")
[1] "2022-01-03 18:05:00 GMT"

I.3 Get Parts

You frequently need to extract parts of a date/time for plotting. The following functions extract specific parts of a date or datetime object. This is a godsend for those of us who never have a clue what week of the year it is today.

# get the date and time when this function is run
now <- now(tzone = "GMT")

# get separate parts
time_parts <- list(
  second  = second(now),
  minute  = minute(now),
  hour    = hour(now),
  day     = day(now),  # day of the month (same as mday())
  wday    = wday(now), # day of the week
  yday    = yday(now), # day of the year
  week    = week(now),
  isoweek = isoweek(now), # ISO 8501 week calendar (Monday start)
  epiweek = epiweek(now), # CDC epidemiological week (Sunday Start)
  month   = month(now),
  year    = year(now),
  tz      = tz(now)
)

str(time_parts)
List of 12
 $ second : num 54.5
 $ minute : int 28
 $ hour   : int 7
 $ day    : int 23
 $ wday   : num 3
 $ yday   : num 114
 $ week   : num 17
 $ isoweek: num 17
 $ epiweek: num 17
 $ month  : num 4
 $ year   : num 2024
 $ tz     : chr "GMT"

The month() and wday() functions can return factor labels.

jan1 <- ymd(20220101)
wday(jan1, label = TRUE)
wday(jan1, label = TRUE, abbr = TRUE)
month(jan1, label = TRUE)
month(jan1, label = TRUE, abbr = TRUE)
[1] Sat
Levels: Sun < Mon < Tue < Wed < Thu < Fri < Sat
[1] Sat
Levels: Sun < Mon < Tue < Wed < Thu < Fri < Sat
[1] Jan
12 Levels: Jan < Feb < Mar < Apr < May < Jun < Jul < Aug < Sep < ... < Dec
[1] Jan
12 Levels: Jan < Feb < Mar < Apr < May < Jun < Jul < Aug < Sep < ... < Dec
Note

What day of the week were you born?

birthdate <- ymd(19761118) # put your own birthdate here
wday(birthdate, label = TRUE)
[1] Thu
Levels: Sun < Mon < Tue < Wed < Thu < Fri < Sat

I.4 Date Arithmetic

You can add and subtract dates. For example, you can get the dates two weeks from today by adding weeks(2) to today(). You can probably guess how to add and subtract seconds, minutes, days, months, and years.

today() + weeks(1)
[1] "2024-04-30"
Note

What day of the week will your 100th birthday be?

birthdate <- ymd(19761118) # put your own birthdate here
centennial <- birthdate + years(100)
wday(centennial, label = TRUE, abbr = FALSE)
[1] Wednesday
7 Levels: Sunday < Monday < Tuesday < Wednesday < Thursday < ... < Saturday
Warning

What do you think will happen if you subtract one month from March 31st? You get NA, since February doesn’t have a 31st day.

ymd(20220331) - months(1)
[1] NA

Use the special date operators %m+% and %m-% to add and subtract months without risking an impossible date.

ymd(20220331) %m-% months(1)
[1] "2022-02-28"

I.4.1 First and last of month

For things like billing, you might need to find the first or last days of the current, previous, or next month. The rollback() and rollforward() functions are easier than trying to parse dates.

d <- ymd("2022-01-24")
rollback(d)                          # last day of the previous month
rollforward(d)                       # last day of the current month
rollback(d, roll_to_first = TRUE)    # first day of the current month
rollforward(d, roll_to_first = TRUE) # first day of the next month
[1] "2021-12-31"
[1] "2022-01-31"
[1] "2022-01-01"
[1] "2022-02-01"

I.4.2 Rounding

You can round dates and times to the nearest unit. This can be useful when you have, for example, time measured to the nearest second, but want to group data by the nearest hour, rather than extract the hour component.

ymd_hm("2022-01-24 10:25") %>% round_date(unit = "hour")
ymd_hm("2022-01-24 10:30") %>% round_date(unit = "hour")
ymd_hm("2022-01-24 10:35") %>% round_date(unit = "hour")
[1] "2022-01-24 10:00:00 UTC"
[1] "2022-01-24 11:00:00 UTC"
[1] "2022-01-24 11:00:00 UTC"

I.5 Internationalisation

You may need to work with dates from a different locale than your computer’s defaults, such as dates written in French or Russian. Or your computer may have a non-English locale. Set the locale argument to the relevant language code.

ymd("2022 January 24", locale = "en_GB")
ymd("2022 Janvier 24", locale = "fr_FR")
wday("2022-01-03", label = TRUE, locale = "ru_RU")
[1] "2022-01-24"
[1] "2022-01-24"
[1] пн
Levels: вс < пн < вт < ср < чт < пт < сб

Some of the locale functions only work on unix-based machines, like Macs or machines running linux.

# check your own locale; doesn't work for Windows
locale()
<locale>
Numbers:  123,456.78
Formats:  %AD / %AT
Timezone: UTC
Encoding: UTF-8
<date_names>
Days:   Sunday (Sun), Monday (Mon), Tuesday (Tue), Wednesday (Wed), Thursday
        (Thu), Friday (Fri), Saturday (Sat)
Months: January (Jan), February (Feb), March (Mar), April (Apr), May (May),
        June (Jun), July (Jul), August (Aug), September (Sep), October
        (Oct), November (Nov), December (Dec)
AM/PM:  AM/PM
# check which locales are available on your computer
# doesn't work for Windows
system("locale -a")

I.6 Example

Let’s work through some examples with downloaded tweets from the class data.

# read all metrics files in data/tweets/
tweets <- list.files(
  path = "data/tweets", 
  pattern = "^tweet_activity_metrics",
  full.names = TRUE
) %>%
  map_df(read_csv) %>%
  select(!starts_with("promoted"))

The time column is already in date/time (POSIXct) format, but what if we wanted to plot tweets by hour for each day of the week?

tweets %>%
  mutate(weekday = wday(time, label = TRUE),
         hour = hour(time)) %>%
  ggplot(aes(x = hour, fill = weekday)) +
  geom_bar(size = 1, alpha = 0.5, show.legend = FALSE) +
  facet_grid(~weekday) +
  scale_fill_manual(values = rainbow(7)) +
  scale_x_continuous(breaks = seq(0, 24, 4))
Warning: Using `size` aesthetic for lines was deprecated in ggplot2 3.4.0.
ℹ Please use `linewidth` instead.

A nice side-effect of using the lubridate function to get days of the week or months of the year is that the results are an ordered factor, so display correctly in a plot. Let’s display the months in Greek (if that’s available on your system).

tweets %>%
  mutate(month = month(time, label = TRUE, abbr = FALSE, locale = "el_GR.UTF-8")) %>%
  ggplot(aes(x = month, fill = month)) +
  geom_bar(show.legend = FALSE) +
  scale_x_discrete(name = NULL, guide = guide_axis(n.dodge=2))