If you’ve ever served on an IRB, or submitted a study to one, this scene will probably sound familiar: IRB members are often researchers themselves, each handed a stack of someone else’s protocols and asked to review them. It’s easy for a reviewer to start weighing in on the sampling plan or whether a qualitative study is “rigorous enough,” even when those critiques wander well past what an IRB is there to do.
Those comments don’t always go over well with the researchers on the receiving end. When reviewers and investigators are both sure they know best about methods, the result can be long email threads, frustrated researchers, and approval delays that have little to do with protecting participants. Anyone who has been on either side of that exchange can probably relate.
Some of our clients have been on the receiving end of an overzealous IRB that treated approval like a dissertation defense. Others have come to us and asked, point blank, for more feedback on their design. This all begs the question: Is research design the IRB’s business?
The short answer is “mostly no, with some important exceptions.” Here’s how we think about where that line sits.
What An IRB Is Responsible For
Institutional Review Boards exist to protect the rights and welfare of people who take part in research. The Common Rule spells out the specific criteria an IRB has to confirm before approving a study in 45 CFR 46.111. Those criteria cover things like risk, informed consent, privacy, and fair participant selection.
What you won’t find in that list is a mandate to make every study as strong as it could possibly be. The regulations ask IRBs to confirm that a study meets ethical and regulatory requirements, and the choice of methodology stays with the researcher. (If you’re curious what reviewers do look for, our post on what happens after you submit an IRB application includes a reviewer’s expectation checklist.)
Your IRB Is Not A Dissertation Committee
An IRB reviewer might think a quantitative survey would produce more useful findings than qualitative interviews. Another reviewer could prefer a randomized sample over a convenience sample. And those are perfectly reasonable opinions! On their own, though, they aren’t grounds for requiring a researcher to change their approach.
Questions about whether a study uses the strongest statistical approach or the most compelling theoretical framework usually belong somewhere else. Academic mentors, scientific peer reviewers, research committees, and the researcher’s own disciplinary expertise are all better suited to that conversation.
Researchers notice when IRBs drift outside their lane. In a survey of NIH-funded principal investigators published in the International Journal of Medical Sciences, some respondents said their IRB didn’t understand the protocols or analytic methods it was reviewing, and several said the system works poorly for social science research. It was a small, exploratory study (28 respondents), but anyone who has sat through a contentious IRB meeting will recognize the frustration.
So when a methodological preference starts turning into a condition of approval, it can be a good idea to pause and ask whether the IRB is still doing its job or doing someone else’s.
When Research Design Becomes An Ethical Concern
But research design isn’t entirely outside the IRB’s reach, and the Common Rule says so explicitly.
Under 45 CFR 46.111(a)(1), an IRB has to find that risks to participants are minimized “by using procedures that are consistent with sound research design and that do not unnecessarily expose subjects to risk.” And under 46.111(a)(2), risks have to be reasonable in relation to any anticipated benefits and to “the importance of the knowledge that may reasonably be expected to result.”
If a study can’t answer its own question, the risks participants take on are hard to justify.
That ties scientific soundness directly to research ethics. A few examples:
Sensitive questions with no clear purpose.
If a study asks participants to share deeply personal information in long interviews, and many of those questions have little to do with the research objectives, the IRB can reasonably ask whether the extra privacy risk and participant burden are justified.
A measurement tool that can’t do the job.
If the proposed instrument is fundamentally unsuited to what the study is trying to measure, the study may not be able to produce meaningful findings. Asking people to take on risk with no realistic chance of useful knowledge coming out the other end is an ethical problem.
Recruitment that puts people in an awkward spot.
An IRB generally shouldn’t dictate convenience sampling versus purposive sampling because one is methodologically preferable. It can require changes when recruitment creates undue influence or puts privacy at risk, or when it raises concerns about whether participants are being selected fairly. (This comes up a lot with groups that need extra protection. Our list of 15 vulnerable populations that are easy to overlook is a helpful gut check.)
Collecting more identifiable data than the study needs.
If a protocol gathers names or home addresses that will never be used in the analysis, the IRB can ask the researcher to trim them, since every extra identifier adds privacy risk without adding knowledge.
What ties these together is that the IRB’s authority comes from the ethical and regulatory implications of the design. A general wish to improve the science doesn’t create that authority on its own.
Advice Versus A Required Change
At its best, IRB review is a reflective tool, first and foremost for ethics and for good community research and evaluation. The experience IRB members bring is an added perk. Imagine getting a peer with their own perspective to look over your work. They may not know your study or your community the way you do, and they might miss some context. But their experience and walk of life might also help you spot something you never would have thought of on your own. That still doesn’t mean every helpful idea should become a condition of approval.
Say a reviewer suggests adding a standardized survey to an interview study to make responses easier to compare across participants. If the interview approach already meets the approval criteria, that suggestion belongs in the “optional feedback” column.
Now say a researcher plans to conduct sensitive interviews somewhere participants can’t reasonably expect privacy. That’s a legitimate reason for the IRB to require a change.
Even then, the best practice is for the IRB to name the underlying concern and let the researcher figure out the fix. They might move the interviews to a different location, add confidentiality protections, revise the questions, or propose a different safeguard altogether. The researcher knows their study and their community best, and the IRB’s job is done once the ethical concern is resolved.
One Question Every IRB Reviewer Should Ask
Before asking for a methodological change, IRB members can save everyone a lot of back-and-forth by asking themselves one simple question:
Which approval criterion does this research design fail to meet?
If the reviewer can point to a specific concern about participant risk, informed consent, confidentiality, equitable selection, or another approval criterion, a required modification may well be appropriate.
If the concern is mostly that a different approach would produce stronger findings, it’s probably better offered as optional feedback or left for scientific review outside the IRB process.
This helps researchers too. When an IRB explains the ethical or regulatory reason behind a requested change, researchers can understand the concern and propose solutions that keep their study intact. It also makes the whole process feel a lot more collaborative and a lot less adversarial. Good IRB review takes both appropriate scrutiny and appropriate restraint.
How VIRB Handles Research Design Feedback
At VIRB, we believe thoughtful, proportionate oversight protects research participants while respecting the expertise of the people doing the work. That’s a big part of why many organizations choose an independent IRB in the first place.
In practice, this means we don’t offer unsolicited methodological critiques or peer review comments beyond what’s needed to meet our regulatory responsibilities. If something in your design affects participant protections, we’ll explain the concern and work with you on a solution.
We also know that researchers come to us with very different levels of experience, and plenty of them would welcome a second set of eyes on their design. If that’s you, just ask! VIRB offers optional feedback on research design and data collection tools as an add-on for a nominal fee. We keep that feedback clearly labeled and separate from formal IRB requirements, so you’ll always know which comments you need to address and which ones are simply suggestions.
Frequently Asked Questions about IRBs and Research Design
Does an IRB review research methodology?
Yes, but only to a point. Under 45 CFR 46.111, an IRB looks at research design as it relates to participant risk and whether the study can reasonably produce useful knowledge. It isn’t meant to judge whether a researcher picked the best possible method.
Can an IRB require me to change my study design?
An IRB can require changes when a design element creates an ethical or regulatory problem, such as unnecessary risk or unfair participant selection. A reviewer’s preference for a different method, on its own, isn’t a sufficient reason.
What’s the difference between IRB review and scientific peer review?
IRB review asks whether a study protects participants and meets the approval criteria in the Common Rule. Scientific peer review asks whether the study is well designed to answer its research question. The two overlap when a flawed design puts participants at risk for little benefit.
Can VIRB give feedback on my research design?
Yes. VIRB offers optional research design feedback when requested, and is kept separate from formal IRB requirements. Request an IRB consultation to talk through your project.
The Bottom Line
An IRB’s job is to make sure a study meets ethical and regulatory requirements. Making every study the best possible version of itself falls outside that job. A study can be methodologically imperfect and still be ethically sound. On the flip side, a poorly designed study can raise real ethical concerns when it exposes participants to unnecessary risk or undercuts the reason they’re taking part at all.
Good IRB oversight means knowing when to step in and when to trust the researcher’s expertise. If you’re looking for an IRB that gets that balance right, learn more about VIRB or reach out to schedule a consultation.