Dual Risk of Bias#355

Not sure if this is already in development but a function that would allow more than one person to complete Risk of Bias and a third party adjudicator

Good question - yes! It’s roadmapped behind:

• A general cleanup of how we show data in when in a dual mode (#60)
• Dual extraction (#72). From voting & usage patterns, we see that extraction is in much higher demand that RoB, so it gets first attention.

If I had to give an estimate, we’re hoping to have dual extraction completed by summer, so dual RoB would be on the docket around then :)

Any update to this?

We have shelved immediate development plans on this issue, but do acknowledge it’s a top voted issue. After seeing usage statistics on dual extraction, we lost some of urgency for building dual RoB; sometimes users are more eager to vote on nolt, than with their time/usage :) That said, we know, from directly talking to our users, that dual RoB is an essential part of the workflow for many.

This issue doesn’t have an ETA unfortunately. But we do a monthly review of nolt & issues we’re tracking. We may have a better picture of priority at that time.

I’d appreciate to know if/how much of a blocker this feature is for you & your team.

Hi Karl, the ICER team is in the “Nice to have but not a dealbreaker” camp right now :)

Hey all–

We’ve been discussing priority of some of our requests, with this as one of the key features under discussion. We’ve noticed that Screening, Tagging, and Meta-analytical Extraction are all used much more than Critical Appraisal/Risk of Bias, so we’ve prioritized improvements to those more heavily-used modules.

However, we recognize there may be a catch-22 here: we want to see greater use of Critical Appraisal if we are going to spend time improving it, but you as users may be waiting on improvements to use it. So, want to make we want to make sure we’re not holding back use of the Critical Appraisal module.

So, I’d love feedback on whether dual mode is a blocker against using our Critical Appraisal module as-is, and whether greater use is anticipated if we invest time in this. I’d love feedback on this, and thank you all for your patience!

Thank you,
Kevin