Scope of the possible with R

R
overview
Published

May 7, 2025

Session materials

Slides for this session / .pdf slides for this session

No feedback found for this session

Welcome

  • this session is a non-technical overview designed for service leads

Session outline

  • Why R, and why this session?
  • R demo - take some data, load, tidy, analyse
  • Strengths and weaknesses
    • obvious
    • less obvious
  • Alternatives
  • Skill development

R

  • free and open-source
  • multi-platform
  • large user base
  • prominent in health, industry, biosciences

Why this session?

  • R can be confusing
    • it’s code-based, and most of us don’t have much code experience
    • it’s used for some inherently complicated tasks
    • it’s a big product with lots of add-ons and oddities
  • But R is probably the best general-purpose toolbox we have for data work at present
    • big user base in health and social care
    • focus on health and care-like applications
    • not that hard to learn
    • extensible and flexible
    • capable of enterprise-y, fancy uses

R demo

  • this is about showing what’s possible, and give you a flavour of how R works
  • we won’t explain code in detail during this session
  • using live open data
    https://www.opendata.nhs.scot/dataset/weekly-accident-and-emergency-activity-and-waiting-times

Load that data

library(readr)
ae_activity <- read_csv("data/weekly_ae_activity_20240609.csv")

One small bit of cheating: renaming

names(ae_activity) <- c("date", "country", "hb", "loc", "type", "attend", "n_within", "n_4", "perc_4", "n_8", "perc_8", "n_12", "perc_12")

Preview

Preview of data
date country hb loc type attend n_within n_4 perc_4 n_8 perc_8 n_12 perc_12
20220925 S92000003 S08000030 T101H Emergency Department 1176 1008 168 85.7 5 0.4 0 0.0
20170305 S92000003 S08000024 S319H Emergency Department 987 963 24 97.6 0 0.0 0 0.0
20200517 S92000003 S08000032 L302H Emergency Department 794 732 62 92.2 2 0.3 0 0.0
20181125 S92000003 S08000026 Z102H Emergency Department 175 169 6 96.6 1 0.6 0 0.0
20210502 S92000003 S08000031 G107H Emergency Department 1514 1388 126 91.7 2 0.1 1 0.1

Removing data

ae_activity <- ae_activity |>
    select(!c(country, contains("perc_")))
Preview of data
date hb loc type attend n_within n_4 n_8 n_12
20180318 S08000032 L302H Emergency Department 1353 1233 120 17 2
20191201 S08000031 C313H Emergency Department 663 535 128 13 0
20240310 S08000017 Y146H Emergency Department 675 504 171 39 4
20190804 S08000025 R103H Emergency Department 136 131 5 0 0
20221211 S08000022 C121H Emergency Department 154 149 5 0 0

Tidying data

ae_activity <- ae_activity |>
    mutate(date = lubridate::ymd(date))
Preview of data
date hb loc type attend n_within n_4 n_8 n_12
2023-11-12 S08000019 V217H Emergency Department 1089 451 638 275 120
2016-04-03 S08000015 A210H Emergency Department 944 770 174 19 3
2016-07-17 S08000032 L302H Emergency Department 1245 1197 48 4 0
2019-07-21 S08000030 T101H Emergency Department 1040 980 60 1 1
2016-10-02 S08000031 G107H Emergency Department 1840 1666 174 4 0

Subset data

  • we’ll take a random selection of 5 health boards to keep things tidy
ae_activity <- ae_activity |>
    filter(hb %in% boards)
Preview of data
date hb loc type attend n_within n_4 n_8 n_12
2019-10-06 S08000030 T202H Emergency Department 486 458 28 1 0
2022-11-13 S08000026 Z102H Emergency Department 140 129 11 0 0
2019-01-27 S08000031 G107H Emergency Department 1851 1595 256 3 0
2015-09-27 S08000031 G107H Emergency Department 1772 1605 167 3 0
2016-07-31 S08000030 T202H Emergency Department 529 526 3 0 0

Basic plots

library(ggplot2)
ae_activity |>
    ggplot() +
    geom_line(aes(x = date, y = attend, colour = hb, group = loc)) 

Joining data

ae_activity |>
    left_join(read_csv("data/boards_data.csv"), by = c("hb" = "HB")) |>
    select(!any_of(c("_id", "HB", "HBDateEnacted", "HBDateArchived", "Country"))) |>
    ggplot() +
    geom_line(aes(x = date, y = attend, colour = HBName, group = loc))

and again…

Add to a map

ae_activity_loc |>
    leaflet::leaflet() |>
    leaflet::addTiles() |>
    leaflet::addMarkers(~longitude, ~latitude, label = ~HospitalName)

Then make that map more useful

ae_activity_loc |>
    group_by(HospitalName) |>
    summarise(attend = sum(attend), n_within = sum(n_within), longitude = min(longitude), latitude = min(latitude)) |>
    mutate(rate = paste(HospitalName, "averages", scales::percent(round(n_within / attend, 1)))) |>
    leaflet::leaflet() |>
    leaflet::addTiles() |>
    leaflet::addMarkers(~longitude, ~latitude, label = ~rate)

Then add to reports, dashboards…

Strengths

  • enormous scope and flexibility
  • a force-multiplier for fancier data work
    • helps collaboration within teams, between teams, between orgs
    • reproducible analytics
    • modular approaches to large projects
  • decreasing pain curve: the fancier the project, the better

Weaknesses

  • harder to learn than competitors
  • very patchy expertise across H+SC Scotland
  • complex IG landscape
  • messy skills development journey