The AI Literature Review Dilemma: Commercial Momentum vs Best Practice Guidelines

The Growing Tension Between Commercial Momentum and Best-Practice Guidelines in AI-Assisted Literature Reviews

ISPOR 2026 exposed a growing tension between commercial momentum and best practice guidelines in AI-assisted literature reviews.

On one side, an expanding commercial ecosystem is increasingly marketing AI-assisted literature reviews, with platforms and vendors touting staggering efficiency and quality claims.1, 2 While accuracy claims at ISPOR Europe six months earlier rested on relatively small and simple data sets, data presented at ISPOR 2026 suggested a higher extraction accuracy for subgroup efficacy and adverse event data, although these findings may not yet be peer-reviewed.

On the other side, ISPOR’s Good Practices Task Force on GenAI for systematic literature reviews (SLR) urges caution, arguing that full end-to-end automation is not yet appropriate for literature reviews.3 In their rapid review assessment, accuracy outcomes for the use of AI in literature reviews were heterogenous. Without a universally positive outcome, they stopped short of issuing a blanket recommendation for AI in literature reviews. Instead, the focus was on AI-assisted triage at screening and first-pass data extraction. This aligns with Costello Medical’s own peer-reviewed research on using AI for data extraction in literature reviews, which demonstrated that human oversight remains essential, particularly for complex and nuanced data extractions.4

A recent opinion piece published in Nature by the Editor-in-Chief of the Cochrane Collaboration calls into question the efficiency gains touted at ISPOR International; it argued that using AI took longer than manual methods due to the training and oversight required.5

There is also a regulatory and governance challenge for AI in literature reviews. Copyright licensing and data-access issues were at the forefront of discussions at ISPOR 2026, more so than at ISPOR Europe. These areas remain uncertain and unresolved. And while position statements have been issued by bodies including NICE,6 there is no precedent for a fully AI-assisted literature review being accepted by a health technology assessment (HTA) body.

So where does this leave those of us seeking to implement AI in literature reviews responsibly, rigorously, and efficiently?

Moving Towards Widespread Commercial Use of AI in Literature Reviews

We can pursue exploratory studies and pragmatic literature reviews that are not intended for regulatory submission, within a human-in-the-loop framework and reporting AI use transparently in line with best-practice guidelines, such as RAISE.7 But until HTA and regulatory bodies and journals are seen to accept AI-assisted literature reviews, and copyright licences allowing content to be using in generative AI become commonplace, AI-assisted literature reviews are unlikely to become widespread for these purposes. Additionally, it remains unclear what the real efficiency savings will be once human review for quality is factored in.

Despite these challenges and questions, Costello Medical welcomes this shift toward governance-aware AI use and will continue to work with clients, regulators and publishers to align innovation with scientific rigour. We urge platform developers and sponsors to embrace external validation, publish limitations, and engage with HTA bodies and publishers to support broader adoption in a compliant and rigorous way. Compliance, rigour and transparent methods, underpinned by robust external validation and clear alignment with HTA, regulatory and publishing requirements, are essential for AI in literature reviews to become a credible, widely accepted commercial tool.

References

  1. Issue Panel. Is there a consensus on the framework for evaluating artificial intelligence (AI)-assisted systematic review tools in HEOR? ISPOR International Congress, Philadelphia, Pennsylvania, United States, 2026.
  2. Issue Panel. Beyond the bots: how AI-enabled literature reviews are maturing, and what HEOR needs next. ISPOR International Congress, Philadelphia, Pennsylvania, United States, 2026.
  3. Member Group Meeting. ISPOR Good Practices Task Force on generative artificial intelligence (GenAI) for systematic literature reviews (SLRs): preliminary recommendations. Paper presented at: ISPOR Congress; 2026; Pennsylvania, United States, 2026.
  4. Murton M, Boulton E, Cross S, Khan A, Kumar S, Magri G, et al. Harnessing large-language models for efficient data extraction in systematic reviews: the role of prompt engineering. Cochrane Evid Synth Methods. 2025 Nov;3(6):e70058.
  5. Sarkar R. Nature. Why AI can’t be trusted to write scientific reviews. Access this article. Last accessed: May 2026.
  6. National Institute for Health and Care Excellence. Use of AI in evidence generation: NICE position statement. Access this guidance. Last accessed: May 2026.
  7. Thomas J, Hair K, Noel-Storr A, et al. OSF Preprints. Responsible use of AI in evidence synthesis (RAISE): recommendations for practice OSF Preprints. Access this guidance. Last accessed: May 2026

If you would like any further information on the summary presented above, please get in touch, or visit our Literature Reviews page to learn how our expertise can benefit you. Liz Lunn (External Engagement Manager) and Saoirse Leonard (Evidence Development Director) created this article on behalf of Costello Medical. The views/opinions expressed are their own and do not necessarily reflect those of Costello Medical’s clients or affiliated partners.

Discover more insights

Cookies Overview
Costello Medical

Our website uses cookies to distinguish you from other users. This helps us to provide you with a good experience when you browse our website and also allows us to improve our site. Cookies are files saved on your phone, tablet or computer generated when you visit a website and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.

You can select to accept or reject non-essential cookies using the toggle below. For full details of the cookies we use, please see our Cookies Policy and Privacy Notice.

Strictly Necessary Cookies

These essential cookies do things like: remembering the notifications you've seen so we do not show them to you again or your progress through a form. They always need to be on.

Non-essential Cookies

We use these to collect information on how our users engage with our website so that we can improve the experience of the website for our users. For example, we collect information about which of our pages are most frequently visited, and by which types of users.