Joanna Briggs Institute Comprehensive Systematic Review - Training Programme
CSRTP Workbook The Systematic Review of Evidence Generated by Qualitative Research, Narrative and Text
Joanna Briggs Institute Comprehensive Systematic Review - Training Programme
CSRTP Workbook The Systematic Review of Evidence Generated by Qualitative Research, Narrative and Text
JBI/CSRTP/2012-2013/0003 Published by The Joanna Briggs Institute, Adelaide, South Australia, Australia. First published 2009 © The Joanna Briggs Institute 2013 This Publication is copyright. Apart from any fair dealing for the purpose of private study, research, criticism or review as permitted under the Copyright Act, no part may be reproduced by any process or placed in computer memory without written permission. All inquiries should be made to the Joanna Briggs Institute.
2
Contents Group Work 1������������������������������������������������������������������������3 Group Work 2�����������������������������������������������������������������������4 QARI Trial����������������������������������������������������������������������������7 NOTARI Trial�������������������������������������������������������������������������9
Group Work 1 Define the most appropriate paradigm, methodology and method for the following research questions:
Topic/Question
Paradigm/Methodology/Study Design
1. How effective is personal protective equipment in reducing the transmission of meticillin-resistant Staphylococcus aureus and Vancomycin Resistant enterococci? 2. Medical students’ experiences of using sexual health services. 3. Engaging children in identifying barriers to reducing childhood obesity and developing strategies to overcome such barriers.
Comprehensive Systematic Review Training: The Systematic Review of Evidence Generated by Qualitative Research, Narrative and Text - Workbook
3
Group Work 2 Working in pairs, critically appraise the two qualitative papers using the JBIQARI appraisal tool in your workbook. Report Back.
Paper 1: Chase S.K., Melloni M. & Savage A. (1997) A forever healing: the lived experience of venous ulcer disease. Journal of Vascular Nursing 15, 73–78.
Paper 2: Ebbeskog B. & Ekman S-L. (2001) Elderly persons’ experiences of living with venous leg ulcer: living in a dialectal relationship between freedom and imprisonment. Scandinavian Journal of Caring Sciences 15(3), 235–243.
4
Using the critical appraisal completed previously, enter this data on to the QARI system, and extract findings, assign categories to the findings and develop synthesized findings. You will be in pairs and will need to decide who will be the primary reviewer and who will be the secondary reviewer. You must retain these roles throughout the exercise.
Primary reviewer
Secondary reviewer
Logging on to QARI 1. Launch QARI from the JBI homepage. Use your assigned training username and password. Add your review
Wait for the Primary reviewer to add your review and select you as secondary reviewer Logging onto QARI
1. At the bottom of the main reviews screen. Select to create a new review.
1. Launch QARI. Use your password.
username and
2. Enter the review title, question and year. Your instructor will provide you with a review title for this exercise.
2. Select The "Secondary" radio button on the left hand menu. The review entered by your primary should appear on screen.
3. Click alongside "Secondary reviewer". 4. In the “username” field insert your partner’s username. In the email field insert your partner’s registered email address. 5. Click to complete creating the review. Your review title will appear at the top of the main reviews screen. Add Studies
Add Studies Wait until the Primary Reviewer has added the first study.
1. Click the Title of your new review.
1. Click the Title of your review.
2. Click the button.
2. Click the button.
3. Enter the study details from the Chase et al (1997) article..
3. Enter the study details from the Ebbeskog et al (2001) article.
4. Click the button.
4. Click the button.
Comprehensive Systematic Review Training: The Systematic Review of Evidence Generated by Qualitative Research, Narrative and Text - Workbook
5
Primary reviewer Assessing studies
Assessing studies
1. Click on the author (Chase et al. 1997) of the study you wish to assess.
1. Click on the author (Ebbeskog 2001) of the study you wish to assess.
2. Click . Using the radio buttons complete the questions in the assessment checklist.
2. Click . Using the radio buttons complete the ten questions in the assessment checklist.
3. The comments box can be populated with a specific point for your record.
3. The comments box can be populated with a specific point for your record.
4. Select from the dropdown menu to include the study for this exercise.
4. Select from the dropdown menu to include the study for this exercise.
5. Click the Update button.
5. Click the Update button.
Wait for your secondary to complete the first appraisal of the Ebbeskog et al., 2001 paper!
Wait for your primary to complete the first appraisal of the Chase et al., 2007 paper!
6. In the menu on the left hand side of screen, click the button. Click on the author (Ebbeskog et al, 2001) of the remaining study you wish to assess
6. In the menu on the left hand side of screen, click the button. Click on the author (Chase et al. 1997) of the remaining study you wish to assess
7. Click . Using the radio buttons complete the questions in the assessment checklist.
7. Click . Using the radio buttons complete the questions in the assessment checklist.
8. The comments box can be populated with a specific point for your record.
8. The comments box can be populated with a specific point for your record.
9. Select from the dropdown menu at the bottom of the form to include the study for this exercise.
9. Select from the dropdown menu at the bottom of the form to include the study for this exercise.
10. Click the Update button.
10. Click the Update button.
Wait until your partner has completed the 'secondary' assessment of the remaining paper
Wait until the primary reviewer has completed the 'Final' assessment for both studies
11. In the menu on the left hand side of screen, click the Select button or Click in the top menu bar and then select Chase et al 1997. 12. Click and make your assessment based on the information in primary and secondary reviewers results. 13. Select from the dropdown menu at the bottom of the form to include the study for this exercise. 14. Click the Update button. Repeat steps 11-14 for the remaining study (Ebbeskog et al 2001)
6
Secondary reviewer
QARI Trial Primary reviewer
Secondary reviewer
Click in the “Secondary” radio button. Select your review title.
Extract Data
Extract Data
1. Click on the menu bar at the top of the page.
1. Click on the menu bar at the top of the page.
2. Click on the author of the publication you wish to enter an extraction for (Chase et al., 1997).
2. Click on the author of the publication you wish to enter an extraction for. (Ebbeskog et al, 2001)
After completing the final assessment yesterday you will automatically be presented with the extraction screen. If so go to instruction 4. If you are not in the extraction page begin at instruction 3 below. 3. On the left hand side of the page, click on the button. 4. When you have finished your extraction select yes from the dropdown menu next to ‘complete’. Click the Update button.
3. When you have finished your extraction select yes from the dropdown menu next to ‘complete’. Click the Update button.
Enter Findings
Enter Findings
After completing the ‘Extraction details’ you will automatically be presented with the ‘Findings’ screen. If so, go to instruction 4. If you are not in the Findings page begin at instruction 1 below
After completing the ‘Extraction details’ you will automatically be presented with the ‘Findings’ screen. If so, go to instruction 4. If you are not in the Findings page begin at instruction 1 below.
1. Click on the menu bar at the top of the page.
1. Click on the menu bar at the top of the page.
2. Click on the author’s name (Chase et al., 1997) of the publication you wish to enter ‘findings’ for.
2. Click on the author’s name (Ebbeskog et al., 2001) of the publication you wish to enter ‘findings’ for.
3. On the left hand side of the page click on the button.
3. On the left hand side of the page, click on the button.
4. Click the button.
4. Click the button.
5. Extract the ‘findings’ and ‘illustrations’ from the research paper into the system. Use the dropdown menus for evidence rating (unequivocal, credible, unsupported) and inclusion.
5. Extract the ‘findings’ and ‘illustrations’ from the research paper into the system. Use the dropdown menus for evidence rating (unequivocal, credible, unsupported) and inclusion.
6. Click the button.
6. Click the button.
7. Repeat steps 4-6 for all findings for this publication.
7. Repeat steps 4-6 for all findings for this publication.
Comprehensive Systematic Review Training: The Systematic Review of Evidence Generated by Qualitative Research, Narrative and Text - Workbook
7
Primary reviewer
Secondary reviewer
Category Allocation WORK NOW WITH YOUR SECONDARY REVIEWER ON THIS COMPUTER ONLY
WORK WITH YOUR PRIMARY REVIEWER FOR THE REST OF THE EXERCISE
1. Click the tab in the top menu bar. 2. Click the button and enter a category ‘name’ and ‘summary’ appropriate to group your extracted findings. 3. Click the button. 4. Repeat steps 2-3 for any other ‘categories’ you wish to add. 6. On the menu on the left hand side of screen, select . 7. Click on the first ‘finding’ in list. 8. Select the category from the list of those entered (towards the bottom of the screen), that you wish to assign the ‘finding’ to. 9. Click the button. 10. Repeat steps 7-9 for each of the findings.
Assign Categories to Synthesized Finding 1. Click the tab in the menu bar. 2. Click the Synthesis button. 3. Complete the details of the synthesized finding. 4. Click . 5. Use steps 2-4 to add additional synthesized findings. 6. Click the tab in the top menu bar. 7. Select the category you wish to assign to a ‘synthesized finding’ from your list. 8. From the drop down box next to ‘synthesis’, select the synthesized finding you wish to assign the category to. 9. Click the button. 10. Repeat 7-9 to allocate other synthesized findings. 11. To view your meta-aggregative synthesis, click in the top menu bar.
Log off the system from the menu bar
8
Log off the system from the menu bar
NOTARI Trial Using the critical appraisal completed previously, enter this data on to the NOTARI system, and extract conclusion, assign categories to the conclusions and develop synthesized conclusions. You will be in pairs and will need to decide who will be the primary reviewer and who will be the secondary reviewer. You must retain these roles throughout the exercise.
Primary reviewer
Secondary reviewer
Logging on to NOTARI 1. Launch NOTARI from the JBI homepage. Use your assigned training username and password. Add your review
Wait for the Primary reviewer to add your review and select you as secondary reviewer Logging onto NOTARI
1. At the bottom of the main reviews screen. Select to create a new review.
1. Launch NOTARI. Use your username and password.
2. Enter the review title, question and year. Your instructor will provide you with a review title for this exercise.
2. Select The “Secondary” radio button on the left hand menu. The review entered by your primary should appear on screen.
3. In the “username” field insert your partner’s username. 4. In the email field insert your partner’s registered email address. 6. Click to complete creating the review. Your review title will appear at the top of the main reviews screen. Add Publications
Add Publications Wait until the Primary Reviewer has added the first publication.
1. Click the Title of your new review.
1. Click the Title of your review.
2. Click the button.
2. Click the button.
3. Enter the details from the Wiessinger (2012) article.
3. Enter the details from the WHO (2010) article.
4. Click the button.
4. Click the button.
Comprehensive Systematic Review Training: The Systematic Review of Evidence Generated by Qualitative Research, Narrative and Text - Workbook
9
Primary reviewer Assessing studies
Assessing studies
1. Click on the author (Wiessinger 2012) of the publication you wish to assess.
1. Click on the author (Wiessinger 2012) of the publication you wish to assess.
2. Click . Using the radio buttons complete the questions in the assessment checklist.
2. Click . Using the radio buttons complete the ten questions in the assessment checklist.
3. The comments box can be populated with a specific point for your record.
3. The comments box can be populated with a specific point for your record.
4. Select from the dropdown menu to include the publication for this exercise.
4. Select from the dropdown menu to include the publication for this exercise.
5. Click the Update button.
5. Click the Update button.
Wait for your secondary to complete the first appraisal of the WHO 2010 paper!
Wait for your primary to complete the first appraisal of the WHO 2010 paper!
6. In the menu on the left hand side of screen, click the button. Click on the author (WHO 2010) of the remaining publication you wish to assess
6. In the menu on the left hand side of screen, click the button. Click on the author (WHO 2010) of the remaining publication you wish to assess
7. Click . Using the radio buttons complete the questions in the assessment checklist.
7. Click . Using the radio buttons complete the questions in the assessment checklist.
8. The comments box can be populated with a specific point for your record.
8. The comments box can be populated with a specific point for your record.
9. Select from the dropdown menu at the bottom of the form to include the publication for this exercise.
9. Select from the dropdown menu at the bottom of the form to include the publication for this exercise.
10. Click the Update button.
10. Click the Update button.
Wait until your partner has completed the ‘secondary’ assessment of the remaining paper
Wait until the primary reviewer has completed the ‘Final’ assessment for both studies
11. In the menu on the left hand side of screen, click the Select button or Click in the top menu bar and then select Wiessinger 2012. 12. Click and make your assessment based on the information in primary and secondary reviewers results. 13. Select from the dropdown menu at the bottom of the form to include the publication for this exercise. 14. Click the Update button. Repeat steps 11-14 for the remaining publication (WHO 2010)
10
Secondary reviewer
Primary reviewer
Secondary reviewer Click in the “Secondary” radio button Select your review title.
Extract Data
Extract Data
1. Click on the menu bar at the top of the page.
1. Click on the menu bar at the top of the page.
2. Click on the author of the publication you wish to enter an extraction for (Chase et al., 1997).
2. Click on the author of the publication you wish to enter an extraction for. (Ebbeskog et al, 2001)
After completing the final assessment yesterday you will automatically be presented with the extraction screen. If so go to instruction 4. If you are not in the extraction page begin at instruction 3 below. 3. On the left hand side of the page, click on the button. 4. When you have finished your extraction select yes from the dropdown menu next to ‘complete’. Click the Update button.
3. When you have finished your extraction select yes from the dropdown menu next to ‘complete’. Click the Update button.
Enter Conclusions
Enter Conclusions
After completing the ‘Extraction details’ you will automatically be presented with the ‘Conclusions’ screen. If so, go to instruction 4. If you are not in the Conclusions page begin at instruction 1 below
After completing the ‘Extraction details’ you will automatically be presented with the ‘Conclusions’ screen. If so, go to instruction 4. If you are not in the Conclusions page begin at instruction 1 below.
1. Click on the menu bar at the top of the page.
1. Click on the menu bar at the top of the page.
2. Click on the author’s name (Chase et al., 1997) of the publication you wish to enter ‘conclusions’ for.
2. Click on the author’s name (Ebbeskog et al., 2001) of the publication you wish to enter ‘conclusions’ for.
3. On the left hand side of the page click on the button.
3. On the left hand side of the page, click on the button.
4. Click the button.
4. Click the button.
5. Extract the ‘conclusions’ and ‘illustrations’ from the research paper into the system. Use the dropdown menus for evidence rating (unequivocal, credible, unsupported) and inclusion.
5. Extract the ‘conclusions’ and ‘illustrations’ from the research paper into the system. Use the dropdown menus for evidence rating (unequivocal, credible, unsupported) and inclusion.
6. Click the button.
6. Click the button.
7. Repeat steps 4-6 for all conclusions for this publication.
7. Repeat steps 4-6 for all conclusions for this publication.
Comprehensive Systematic Review Training: The Systematic Review of Evidence Generated by Qualitative Research, Narrative and Text - Workbook
11
Primary reviewer
Secondary reviewer
Category Allocation WORK NOW WITH YOUR SECONDARY REVIEWER ON THIS COMPUTER ONLY
WORK WITH YOUR PRIMARY REVIEWER FOR THE REST OF THE EXERCISE
1. Click the tab in the top menu bar. 2. Click the button and enter a category ‘name’ and ‘summary’ appropriate to group your extracted conclusions. 3. Click the button. 4. Repeat steps 2-3 for any other ‘categories’ you wish to add. 6. On the menu on the left hand side of screen, select . 7. Click on the first ‘conclusion’ in list. 8. Select the category from the list of those entered (towards the bottom of the screen), that you wish to assign the ‘conclusion’ to. 9. Click the button. 10. Repeat steps 7-9 for each of the conclusions.
Assign Categories to Synthesized Finding 1. Click the tab in the menu bar. 2. Click the Synthesis button. 3. Complete the details of the synthesized finding. 4. Click . 5. Use steps 2-4 to add additional synthesized findings. 6. Click the tab in the top menu bar. 7. Select the category you wish to assign to a ‘synthesized finding’ from your list. 8. From the drop down box next to ‘synthesis’, select the synthesized finding you wish to assign the category to. 9. Click the button. 10. Repeat 7-9 to allocate other synthesized findings. 11. To view your meta-aggregative synthesis, click in the top menu bar. Log off the system from the menu bar
12
Log off the system from the menu bar
