BI for Beginners Session 3

Previous attendees have said…

• 60 previous attendees have left feedback
• 100% would recommend this session to a colleague
• 97% said that this session was pitched correctly

Three random comments from previous attendees

• I have attended previous KIND Network training: I would try to ‘listen in’ to the training whilst also getting on with some other work - I found this did not work for me due to the live response to Teams chat: however, today I gave the training my full focus (because I had the time for a change) and it was much better - the Teams chatter made sense today and I did gain some useful knowledge. Power BI certainly looks like an interesting tool - but I am concerned that we won’t be able to do anything practical with it due to the licensing / information governance issues
• Great introduction to a powerful tool.
• very useful session - picked up a number of ideas

Session outline

• In this session, we’re going to build part of the GP practice size dashboard from last time
• But we’ll do this from raw data, rather than the play data we used last time
• We’ll bring that data in directly from the web
• We’ll need to wrangle that data to get it to behave

Session files

• BfB_s03.pbix as completed example

Data wrangling

• several different sources needed
  • some real open data about GP practices 🔗
  • Health board names 🔗
  • Demographic data for GP practices 🔗

Load our data

Task

1. Open Power BI and start a new report
2. Use the Get data menu to load data from the web
   
3. Load each of the three URLs supplied in the chat

Inspect our data

• You should have seen a preview during data loading, but you should now inspect each of the data sets via the data view
• What will we need to do to use them to reproduce the dashboard from last time?

Task list

• My data came across with horrible names. Let’s rename to practices, boards, and demographics
• we can discard some of the practices data
• we’ll need to join boards and practices to get nice health board names in our dashboard
• we’ll need to re-shape demographics

Wrangling

• we’ll do our data wrangling using Power Query

Task

1. In the data view, select Transform data
   

Discarding data

• (duty of data minimization)
  
• we can safely lose several columns:
  • TelephoneNumber, PracticeType, Dispensing are all spare
  • HSPC and DataZone are more directly useful, although we actually won’t use them
• you can use the applied steps box in Query Settings to review (or undo) changes to your data

Joining data

• there’s an HB column in both the boards and practices data
• we can link these up so that we can use the actual proper health board names in our dashboard

Task

1. select the HB column and select Merge Queries
   
2. fill in the options in the merge pop-up
   
3. note that this gives us lots of information about how the join is likely to work

• a slight puzzle: the join initially looks pretty unpromising
  
• here, Power Query is effectively telling you that there’s a table row packed into each of these cells. That row is the matching row from the boards data that matched our HB column in the practices data
• we can unpack all or some of the columns from each row using the menu in the column header.
• I think we only want HBName - but feel free to experiment as you can always backtrack from the query settings pane

Task

1. select the column(s) you want to keep from the column header
   

• you can also access lots of other Excel-ish options by right-clicking the column
• something we can do there is to rename this column to give a nicer name (which we’ll need to use later while building our visualisation)

Task

1. please rename your new column to “HBName”
2. note that you can also do this inside the formula bar at the top of the screen
   
   This formula is written in Power Query M, which we’ll discuss later
3. check that you now have nice board names in the practices data
4. remember to close & apply

Re-shaping data

• our demographics data is going to be hard to plot
• we’ll reshape it using Power Query to make our life easier

Task

1. As before, please Transform Data
2. Use the Select columns tool (or delete as before) to remove the id, Date, HSPC, HB, and SexQF columns
3. You can do this in Power Query directly with = Table.RemoveColumns(#"Changed Type",{"_id", "Date", "HB", "HSCP", "SexQF"})
4. Select the PracticeCode and Sex columns, then select Unpivot Other Columns
   

• That should give us something that looks like this:
  
• we can now remove unwanted values by filtering
  

Task

1. From the Attribute column, please remove the QF rows,
2. From the Attribute column, please remove the AllAges rows
3. From the Sex column, please remove the All rows

• the last type of reshaping to show off is about transforming values

Task

1. Split the Attribute column by Digit to Non-digit
   
2. replace values in the new Attribute.1 column to remove the “Ages”
3. then in Attribute.2, two replacements to remove the “to”s and replace the “plus” with 99
4. then rename the columns to age_upper and age_lower
5. finally, change the data type to whole number for each of those new columns

Tidying up

• we should now be able to use this data to re-make our GP bubble map from last time.
• there are some minor bits of tidying up that need to happen first
• there are a few duplicate practice names, which might cause us problems
  
• so we’ll transform each name to include the postcode to avoid this happening

Task

1. select Transform data
2. add a Custom column called Practice Name
   
3. use & to concatenate values: [GPPracticeName] & " (" & [Postcode] & ")"
4. close and apply

• Power BI likes to summarise data wherever possible
• this can cause problems (although I don’t think there’s anything in this example that suffers from it)

Task

1. Go to the data view
2. In the practices table, note that you can change the summary options for the PracticeListSize column
   

Re-making our visualisation

Task

1. Add a map, and set the Postcode to Location, boards.HBName to Legend, PracticeListSize to Bubble Size
2. Format the map to greyscale
3. Rename for this visual to suit
4. add a slicer for Health board
5. add cards for the list size and practice name
6. add a stacked column chart for practice sizes

Finishing up

• next time, we’ll use some of that data we wrangled today to extend our GP dashboard
• please save your file somewhere safe
• if you have time during the week, come back to the visualisations that we sketched today, and play. What would you like to add to the dashboard?
  • there’s a lot of demographic data to play with
• Let me know, and we’ll try adding those things next time