Synopsis
In this presentation, it will be discussed when it is the right time to publish a White Paper. Timing is dependent on whether experts in the field are willing to join forces and reach consensus, whether real consensus is reached on what the right approach is, when the field is confusing for users and vendors and a white paper would provide the much needed guidance, and when the field has reached some kind of stable level, so that the White paper will not be immediately outdated.
According
to Wikipedia a white paper is “a report or guide that informs readers concisely
about a complex issue and presents the issuing body's philosophy on the matter.
It is meant to help readers understand an issue, solve a problem, or make a
decision” (1). This definition also shows that within our community the term
“White paper” is used more loosely. This in contrast to medical societies in
which the terms “White paper”, “Position paper”, “Clinical consensus statement”,
and “Clinical practice guideline” are more strictly applied (see e.g. https://www.jfas.org/article/S1067-2516(15)00004-6/pdf). In our field of research, I think
that a White paper is considered to be a consensus paper from the relevant experts
in the field to describe current knowledge and to provide recommendations on
the use, implementation (both acquisition and post-processing), and
interpretation of techniques. There are therefore two important differences
compared to a review article: 1) it is written by a much broader representation
of experts; 2) it focuses also on recommendations instead of just reviewing
past research (it is therefore also more influential by stimulating vendors/clinicians/researchers
to stick to certain settings, as compared to a review article that is often
more aimed at providing an overview of all relevant developments). Both points
also play an important role to determine when it is time for a white paper:
1) Do the leading experts in a field
wish to join forces?
Frequently a workshop, studygroup, or a webinar is a good opportunity to start
considering to write a white paper. For example, during a workshop it will
become clear whether the leading experts are willing to put their own interest
and ego’s aside and to step back to see the bigger picture and agree with the
other experts about the general direction of the field. When in a workshop all
experts are perfectly willing to agree on a common approach, as long as this
would be their own approach, a white
paper is not going to happen or will not have a considerable impact (no real
recommendations). When experts are still too much attached to their own
approach, one could consider to write a Review article or even to write more in
a ‘Debate’-form than a White paper.
2) Is there general consensus on what
the right approach is?
To have a major impact, a white paper should provide proper guidance to the
readers on how to proceed. This implies that the White paper should provide
essential consensus guidelines on how to implement and apply a certain
technology: the more clear statements, the bigger the impact of the White paper.
Within the perfusion community, it was quite clear that around 2011-2012 a
general consensus was evolving that single PLD pseudo-continuous ASL with
background suppression and a 3D readout was the only candidate to be used as
working horse for clinical applications of ASL. From the start, it was clear
that this would be the basis of the White paper and it also had therefore
considerable impact, in the sense that all major MRI vendors implemented this
consensus sequence. This impact can also be judged from the number of citations
(1599) and the frequent use of sentences like “For ASL a sequence closely adhering to the consensus article (Alsop, et
al, 2015) was used with the following settings…” in the Methods sections,
as well as the frequent discussion that many authors will have had with
reviewers of their manuscript why they did not (completely) adhere to this
consensus statement…
At the same perfusion workshop in Amsterdam that the ASL white paper was
discussed, in a parallel session a similar discussion took place about a DSC-MRI
White paper. Here, it was clear that no real consensus was present and no White
paper was published by the Perfusion Studygroup (the following is based on my
memories from this meeting, which can be quite different from how others
experienced the same meeting). This was partly, because already a Clinical
consensus paper on DSC for Stroke applications was published (3) and that similar
efforts where ongoing for tumor imaging, but starting from clinical societies
(4). No coherent picture emerged when discussing such a white paper within a
more technical oriented society as the ISMRM, and for example quite different
recommendations were proposed for different applications, such as Stroke, brain
tumours, and other brain applications. Moreover, the level of claims (how
quantitative is DSC-MRI) and implementation details (what devonvolution method,
how to select the AIF, how to deal with contrast agent leakage, how many
baseline scans, gradient vs spin echo, single vs multi-echo) were severely debated.
No quick summary (like for ASL “pCASL, single PLD, background suppression, 3D
readout”) emerged, but rather a very long list of insights from the many
experts present. This made it quite clear that it was too early to result in a
White paper, although the discussions were very valuable and may have helped in
formulating the ASFNR recommendations in 2015 (4) and the QIBA profile on
DSC-MRI in 2020 (5) and may have aided the research of the attendees and review
articles written by them in the years after the workshop.
3) Is the field confusing to users and
vendors?
When we started the process of the ASL white paper many different labeling
approaches, readout choices, and settings were used in papers. This led to
quite amusing series of acronyms (FAIR, FAIRER, FAIREST, UNFAIR), but also
confused both clinicians, vendors as well as researchers entering the
ASL-field. After publication of the white paper, the availability of ASL as
commercial products as well as its use increased, most probably because it was
much clearer what sequence (settings) to use.
4) Will the White paper age well?
To have impact, a White paper should set the stage for the next 5-10 years.
This implies that somehow a clear difference with the past is needed to set the
recommendations apart from previous statements, and research & development
should have converged, so that no important changes are expected to emerge in
the near future.
When the
time is right for a White paper, there are many things that need to be solved:
1) Find the correct setting to discuss
consensus.
Past experience have learned that ISMRM Studygroups and workshops organized by
them (2, 8-11) as well as European consortia grants (such as COST-actions (2,6,7))
are great vehicles for bringing together the experts. Workshops and network
meetings have the proper combination of formal and informal meetings to reach
consensus.
2) How to involve the relevant persons?
This will always be a tricky issue: it is important to be inclusive and thereby
to be able to reflect the broader community, but authors also should have a real
contribution and the combined authorship should have the authority to be taken
seriously. White papers are frequently highly cited papers and therefore
researchers might want to push themselves to become a co-author even without
real contributions to the paper or the research-field. Within White paper
discussions that I was involved in, we always started with a core-team, quickly
expanding to a wider, already broadly representing group. Subsequently, in a
final reach-out it was still possible for authors to join this group at the
last moment, but only when they had a real contribution. Similarly, it is
important to pay attention to not only involve the ‘usual suspects’ (frequently
the old people…), but also the more junior talent (although frequently the more
‘junior’ contributors to White papers are already well-arrived and respected
researchers within the field!). The involvement of more ‘junior’ (less senior…)
authors ensures that more recent developments are included and bring the
necessary energy and fresh minds into the process that can also help to bridge
between strong competitors of the past.
3) How to keep on stimulating new
innovations?
A White paper has the risk of stalling developments: when vendors, clinicians
and researchers feel they have to stick to the consensus implementation, new
developments will have a hard time to get tested in practice and thus to be accepted.
It is therefore essential to also provide sufficient openings within the White
paper that make it clear that new developments might very well be better than
the consensus recommendations, but that they just need more validation and
development. This is also where providing a proper Review of new developments
and current shortcomings of the recommendation can actually stimulate new
research directions!
4) To seek official endorsement or not?
To further increase the impact of a White paper one can seek endorsement of
relevant organizations. The ISMRM has a process in place to allow endorsement
by Study Groups involving voting by Study group members on the paper with a
chance to propose changes, and subsequent permission by Board of Trustees (for
official rules, it is advised to contact the ISMRM office). It is also
important to consider endorsement by other clinical organizations; this will
promote the White paper in other communities and reach clinical specialists
that would e.g. not read MRM.
5) How and where to publish?
In recent discussions, I have found it very helpful to contact editors and to
discuss with them what the possibilities are regarding publication. This is not
limited to e.g. open access or going over the maximum word count, but also whether
it is possible to publish multiple White papers back-to-back or to shape a
Special Issue around the same topic. Of course, for the ISMRM it is important
that MRI White papers are published in our home journals: JMRI and MRM.Acknowledgements
MJP van Osch is supported by the Medical Delta Cancer Diagnostics 3.0 and research programme Innovational Research Incentives Scheme Vici with project number 016.160.351, which is financed by the Netherlands organisation for Scientific Research. References
1) https://en.wikipedia.org/wiki/White_paper
2) Alsop DC, Detre JA, Golay X, Günther
M, Hendrikse J, Hernandez-Garcia L, Lu H, MacIntosh BJ, Parkes LM, Smits M, van
Osch MJ, Wang DJ, Wong EC, Zaharchuk G. Recommended implementation of arterial
spin-labeled perfusion MRI for clinical applications: A consensus of the ISMRM
perfusion study group and the European consortium for ASL in dementia. Magn
Reson Med. 2015 Jan;73(1):102-16. doi: 10.1002/mrm.25197. Epub 2014 Apr 8.
PMID: 24715426; PMCID: PMC4190138.
3) Wintermark M, Albers GW, Alexandrov
AV, Alger JR, Bammer R, Baron JC, Davis S, Demaerschalk BM, Derdeyn CP, Donnan
GA, Eastwood JD, Fiebach JB, Fisher M, Furie KL, Goldmakher GV, Hacke W,
Kidwell CS, Kloska SP, Köhrmann M, Koroshetz W, Lee TY, Lees KR, Lev MH,
Liebeskind DS, Ostergaard L, Powers WJ, Provenzale J, Schellinger P,
Silbergleit R, Sorensen AG, Wardlaw J, Wu O, Warach S. Acute stroke imaging
research roadmap. AJNR Am J Neuroradiol. 2008 May;29(5):e23-30. doi:
10.1161/STROKEAHA.107.512319. PMID: 18477656; PMCID: PMC2716734.
4) Welker K, Boxerman J, Kalnin A,
Kaufmann T, Shiroishi M, Wintermark M; American Society of Functional
Neuroradiology MR Perfusion Standards and Practice Subcommittee of the ASFNR
Clinical Practice Committee. ASFNR recommendations for clinical performance of
MR dynamic susceptibility contrast perfusion imaging of the brain. AJNR Am J
Neuroradiol. 2015 Jun;36(6):E41-51. doi: 10.3174/ajnr.A4341. Epub 2015 Apr 23.
PMID: 25907520; PMCID: PMC5074767.
5) https://qibawiki.rsna.org/images/d/d4/QIBA_DSC-MRI_Stage2-Consensus_Profile.pdf
6) Pohlmann A, Back SJ, Fekete A,
Friedli I, Hectors S, Jerome NP, Ku MC, Longo DL, Meier M, Millward JM,
Periquito JS, Seeliger E, Serai SD, Waiczies S, Sourbron S, Laustsen C,
Niendorf T. Recommendations for Preclinical Renal MRI: A Comprehensive
Open-Access Protocol Collection to Improve Training, Reproducibility, and
Comparability of Studies. Methods Mol Biol. 2021;2216:3-23. doi: 10.1007/978-1-0716-0978-1_1.
PMID: 33475991.
7) de Boer A, Villa G, Bane O, Bock M,
Cox EF, Dekkers IA, Eckerbom P, Fernández-Seara MA, Francis ST, Haddock B, Hall
ME, Hall Barrientos P, Hermann I, Hockings PD, Lamb HJ, Laustsen C, Lim RP,
Morris DM, Ringgaard S, Serai SD, Sharma K, Sourbron S, Takehara Y, Wentland
AL, Wolf M, Zöllner FG, Nery F, Caroli A. Consensus-Based Technical
Recommendations for Clinical Translation of Renal Phase Contrast MRI. J Magn
Reson Imaging. 2022 Feb;55(2):323-335. doi: 10.1002/jmri.27419. Epub 2020 Nov
2. PMID: 33140551.
8) Filippi M, Dousset V, McFarland HF,
Miller DH, Grossman RI. Role of magnetic resonance imaging in the diagnosis and
monitoring of multiple sclerosis: consensus report of the White Matter Study
Group. J Magn Reson Imaging. 2002 May;15(5):499-504. doi: 10.1002/jmri.10097.
PMID: 11997889.
9) Zhong L, Schrauben EM, Garcia J,
Uribe S, Grieve SM, Elbaz MSM, Barker AJ, Geiger J, Nordmeyer S, Marsden A,
Carlsson M, Tan RS, Garg P, Westenberg JJM, Markl M, Ebbers T. Intracardiac 4D
Flow MRI in Congenital Heart Disease: Recommendations on Behalf of the ISMRM
Flow & Motion Study Group. J Magn Reson Imaging. 2019 Sep;50(3):677-681.
doi: 10.1002/jmri.26858. Epub 2019 Jul 17. PMID: 31317587.
10) Manduca A, Bayly PJ, Ehman RL,
Kolipaka A, Royston TJ, Sack I, Sinkus R, Van Beers BE. MR elastography:
Principles, guidelines, and terminology. Magn Reson Med. 2021
May;85(5):2377-2390. doi: 10.1002/mrm.28627. Epub 2020 Dec 9. PMID: 33296103;
PMCID: PMC8495610.
11) Weingärtner S, Desmond KL,
Obuchowski NA, Baessler B, Zhang Y, Biondetti E, Ma D, Golay X, Boss MA, Gunter
JL, Keenan KE, Hernando D; ISMRM Quantitative MR Study Group. Development,
validation, qualification, and dissemination of quantitative MR methods:
Overview and recommendations by the ISMRM quantitative MR study group. Magn
Reson Med. 2022 Mar;87(3):1184-1206. doi: 10.1002/mrm.29084. Epub 2021 Nov 26.
PMID: 34825741.