Responsible research methods v2.0: The next generation

Heather Cleland Woods and Phil McAleer
2019 July 7

Introducing reproducible methods at a grassroots level

What does our school and classes look like?

Large class sizes

  • 2018-19: Approx 450-500 in Level 1 and 250 in Level 2

Teaching rankings

  • Top 20 UK and top 50 global tables

High Entry Tariff

  • 5 As in Scottish Highers; 3 As in A-level; 38 points in IB

Diverse and high acheiving student body

Grassroots structure @UofG


First two years of a four year course

1st Year

  • 20 Weekly General Research Methods Lecture (1hr)

  • Bi-Weekly Practical Lab (2hrs – 10 in total) (1 Staff + 2 TAs)

Grassroots structure @UofG


First two years of a four year course

2nd Year

  • 10 Weekly Research Design and Planning Lecture (1hr) Semester 1

  • 10 Weekly Qualitative Analysis Lecture (1hr) Semester 2

  • 20 Weekly Statistics Lecture

  • Weekly Practical Lab (2hrs – 18 in total) (2 Staff + additional TA support)

Time to rethink our approach

Staff and Student feedback

  • Students suggested repetition between years

  • Staff noticed limited understanding of key concepts and issues with handling and visualising data

  • Call for us to review our teaching of research methods

  • Integrate free and open source data analysis software

  • Innovative, taking a wider view of skills

3 main principles

Ethos

  • Focus on the Skills to answer a Question
  • R is only our tool to do a bigger job

Skills

  • Lab structure, writing, reflecting, critical thinking

Community

  • Online and Offline, Practice Sessions, Peer Assisted Learning (PAL), Psych Society, GURU

Ethos

Equipping students to tackle the challenges in our field

Return to focussing students on the question you are answering and the methods you are using

Part of a wider culture shift

Not about finding a significant effect

Ethos

R is our tool as it fits the skills we want our students to have

You have to be clear on what it is you want from your students or it will be harder to bring them along with you

Use your tools where you can to get better at them!

Practice doesn't make you perfect but it will make you better!

Skills

Labs of 2 hours split into

  • 1 hour of writing like a Psychologist – includes finding research
  • 1 hour of practical data skills

Skills

Level 1

  • 1 essay per semester on a topic related to Ethos e.g. Open Science

Level 2

  • 1st semester: Registered Report type submission
  • 2nd semester: Analysis and write-up of Open Database

Skills

Moved away from simply teaching a cookbook of inferential statistics

In a 10 week module, do students really need to learn every possible test they might come across?

Focus in the beginning on data management, data wrangling, visualisation, reproducible scripts, probability

Build the basic skills for a solid foundation

As much as possible used realistic data

Getting data into shape is more than half the battle

Focus on becoming confident and competent with data

Skills


Level 1

  • Using R/R Markdown
  • Data Wrangling
  • Visualisation
  • Probability

Level 2

  • Data Simulation
  • NHST
  • t-tests/correlations
  • GLM – ANOVA/Regression

Wrangling data example

Wrangling data example

Wrangling data example

Community

Moved away from quiet labs with students working on tasks individually

Group work now dominates

Working through tasks with peers as we would

Community

Community

  • Students are asking for help but staff refer back to resources on VLE and previous conversations online

  • Possible for team to provide support in one forum

Student led community

Challenges

Information delivery and timing

  • dont't overload too early or leave things hanging

Diversity of skills

  • acknowledge that not all students are from the same mould

Student expectations

  • of themselves
  • of us
  • of Psychology

Our community is growing - all are welcome

Thank you

@clelandwoods @McAleerP