The RAMESES Projects

Home Page Standards and Training materials Mailing list Project team Acknowledgements Other resources Contact us

Resources

Other resources

Realist research appraoches
Meta-narrative reviews
The relevance of realism in the COVID-19 pandemic
External websites
Video archive
Cartoons with a realist twist

 

Realist research approaches

Realistic Evaluation
Ray Pawson and Nick Tilley 1997
Sage, London

Evidence-Based Policy: A Realist Perspective
Ray Pawson 2006
Sage, London

The Science of Evaluation: A realist manifesto
Ray Pawson 2013
Sage, London

 

Meta-narrative reviews

Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review
Trisha Greenhalgh, Glenn Robert, Fraser Macfarlane, Paul Bate, Olympia Kyriakidou, Richard Peacock
Social Science & Medicine Volume 61, Issue 2, July 2005, Pages 417-430

 

The relevance of realism in the COVID-19 pandemic

The spread of severe acute respiratory syndrome coronavirus has thrown the world into crisis. Public health responses have been prolific, but the success of these interventions is uneven. As ever, we need to know what works for whom in what circumstances and in what respects. Realist approaches have been devised to answer this question and this working paper series is designed to promote this cause.

The series offers immediate readership and has no formal refereeing process. They are working papers in the sense that they are intended to raise hypotheses leading to more productive evidence. They may be developed (or indeed withdrawn), they may go on to be published in journals and books. Above all, they are attempts to provoke dialogue in the realist community and beyond.

 

Working Paper 1: The Coronavirus Response: Known Knowns, Known Unknowns, Unknown Unknowns
The paper makes use an infamous remark of Donald Rumsfeld on the unpredictability of policy choices as a forewarning on the perils that lay ahead in devising the coronavirus response. It was written in Feb 2020, ahead of the actual policy choices made and implemented in the UK. The authors’ guesswork on the challenges of lockdown do not, of course, match the complexities of the real thing. But that is the whole point – the policy response to the virus always involves guesswork and unknow unknows always lurk in wait. In the end we are often left with ‘muddling through’.

 

Working Paper 2: All models are wrong
George Box was a pioneer of statistical model building and so his tongue was partly in cheek when he first used this famous phrase: ‘All models are wrong, but some are useful’. Box’s essential idea was that the worth (or the inadequacy) of a model depended on the veracity (or the deficiency) of the many assumptions and estimates built into it. Epidemiological model builders have a central role in UK Scientific Advisory Group for Emergencies. The UK policy response to the crisis has been guided by their projections on the likely course of the disease. This paper examines in close detail the assumptions built into one particularly influential model.

 

External websites

Additional resources on realist research may be found at:

ICARES - a website containing resources about realist evaluation and realist reviews in French
https://evalrealiste.wixsite.com/icares

The realist hive
http://blogs.exeter.ac.uk/realisthive/

Theory-driven inquiry for health systems research
http://www.itg.be/internet/ds/tde/index.html

Realist synthesis: The website
http://www.leeds.ac.uk/sociology/realistsynthesis/

Realism Leeds
http://realism.leeds.ac.uk/

Literature Searching for Realist Synthesis
http://realistsearch.pbworks.com/w/page/88622804/FrontPage

The RAMESES mailing list Files Area

 

Video Archive

Professor Ray Pawson introducing realist evaluation
Whilst realist evaluation is primary research, many of its underpining principles are shared with realist reviews.

The Basics of realist evaluation - https://vimeo.com/84215487
This 14 min video is an edited down overview of the four video clips listed below and so contains some repetition content-wise.

Realist evaluation Part 1 - key principles (7 minutes) introduces the key elements of realist evaluation. https://vimeo.com/84216696

Realist evaluation Part 2 - tackling complexity (9 minutes) looks at how realist evaluation helps to address complexity in social programmes.
http://vimeo.com/84386879

Realist evaluation Part 3 - types of evidence (8 minutes) looks at how the method makes use of evidence and the value of a multi-method approach.
http://vimeo.com/84227829

Realist evaluation Part 4 - cumulative learning and scientific method (7.5 minutes) looks at how evaluation can better contribute to cumulative learning and employ scientific methods.
http://vimeo.com/84228311

Thanks to Robin Vincent and Ray Pawson for these videos.

 

Professor Ray Pawson's 'Exaugural' Lecture
Ray Pawson compares evidence-based medicine (EBM) and evidence-based policy (EBP) in his entertaining lecture entitled:

Evidence-based Medicine & Evidence-based Policy: The world’s most perfectly developed method & the 79-pound weakling?
http://realism.leeds.ac.uk/ray-pawson-exaugural-lecture/

 

Cartoons with a realist twist

As part of the RAMESES II project we commissioned an illustrator, Chris Lysy of freshspecturm to provide us with cartoons for the resources and training materials for realist evaluations that had a realist twist. Please feel free to use these cartoons (they have been uploaded as full size images which you can save to your computer).

 



























  

©2013-20