AI has the potential to improve the quality, safety and efficiency of care provided to patients by radiographers. However, when new algorithms are proposed clinicians must be convinced of their safety and effectiveness before implementation. New guidelines (regulatory frameworks, ethics and evaluation) attempt for the first time to provide a way of assessing AI. This paper aims to: i) review and discuss these guidelines for evaluation of AI tools in radiography, ii) consider how these may impact acceptability and adoption by healthcare practitioners,, iii) offer recommendations addressing any gaps in the radiographers’ knowledge on testing and procuring AI medical devices.
1. Malamateniou C, Knapp KM, Pergola M, Woznitza N, Hardy M (2021) Artificial intelligence in radiography: Where are we now and what does the future hold? Radiography (Lond). Oct;27 Suppl 1:S58-S62.
2. Hardy M, Harvey H. Artificial intelligence in diagnostic imaging: impact on the radiography profession. Br J Radiol. 2020 Apr;93(1108):20190840.
3. Lewis SJ, Gandomkar Z, Brennan PC. Artificial Intelligence in medical imaging practice: looking to the future. Journal of Medical Radiation Sciences 2019; 66: 292–295.
4. FUTURE-AI: Guiding Principles and Consensus. Recommendations for Trustworthy Artificial Intelligence in Medical Imaging (pre-print arXiv September 30th 2021)
5. Brady AP, Neri E. Artificial Intelligence in Radiology-Ethical Considerations. Diagnostics (Basel). 2020 Apr 17;10(4):231.
6. Malamateniou C, McFadden S, McQuinlan Y, England A, Woznitza N, Goldsworthy S, Currie C, Skelton E, Chu KY, Alware N, Matthews P, Hawkesford R, Tucker R, Town W, Matthew J, Kalinka C, O'Regan T. (2021) Artificial Intelligence: Guidance for clinical imaging and therapeutic radiography professionals, a summary by the Society of Radiographers AI working group. Radiography (Lond). 2021 Aug 19:S1078-8174
7. NHSx (2020) A Buyer’s guide to AI in health and care.
8. GSTT (2020) AI validation framework
9. FUTURE-AI: Guiding Principles and Consensus. Recommendations for Trustworthy Artificial Intelligence in Medical Imaging (pre-print arXiv September 30th 2021)
10. Kelly CJ, Karthikesalingam A, Suleyman M, Corrado G, King D. Key challenges for delivering clinical impact with artificial intelligence. BMC Med. 2019 Oct 29;17(1):195.
11. EU artificial Intelligence Act (2021) REGULATION OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL LAYING DOWN HARMONISED RULES ON ARTIFICIAL INTELLIGENCE (ARTIFICIAL INTELLIGENCE ACT) AND AMENDING CERTAIN UNION LEGISLATIVE ACTS (published April 21st 2021)
12. https://www.gov.uk/guidance/medical-devices-eu-regulations-for-mdr-and-ivdr (accessed September 2021)
13. van Leeuwen KG, Schalekamp S, Rutten MJCM, van Ginneken B, de Rooij M. Artificial intelligence in radiology: 100 commercially available products and their scientific evidence. Eur Radiol. 2021 Jun;31(6):3797-3804
14. Parums DV. Editorial: Artificial Intelligence (AI) in Clinical Medicine and the 2020 CONSORT-AI Study Guidelines. Med Sci Monit. 2021 Jun 28;27
15. Taylor M, Liu X, Denniston A, Esteva A, Ko J, Daneshjou R, Chan AW; SPIRIT-AI and CONSORT-AI Working Group. Raising the Bar for Randomized Trials Involving Artificial Intelligence: The SPIRIT-Artificial Intelligence and CONSORT-Artificial Intelligence Guidelines. J Invest Dermatol. 2021 Sep;141(9):2109-2111. doi: 10.1016/j.jid.2021.02.744.
16. Larson DB, Harvey H, Rubin DL, Irani N, Tse JR, Langlotz CP. Regulatory Frameworks for Development and Evaluation of Artificial Intelligence-Based Diagnostic Imaging Algorithms: Summary and Recommendations. J Am Coll Radiol. 2021 Mar;18(3 Pt A):413-424.
17. Omoumi P, Ducarouge A, Tournier A, Harvey H, Kahn CE Jr, Louvet-de Verchère F, Pinto Dos Santos D, Kober T, Richiardi J. To buy or not to buy-evaluating commercial AI solutions in radiology (the ECLAIR guidelines). Eur Radiol. 2021 Jun;31(6):3786-3796.