The Case of the FOAM Faux Pas has stimulated interesting discussion over the past week. The FOAM community clearly was interested in discussing this issue, and it most definitely showed. We are now proud to present to you the Curated Community Commentary and our two expert opinions. Thank-you again to all our experts and participants for contributing again this week to the ALiEM MEdIC series.
This follow-up post includes
- The responses of our experts, Dr. Anton Helman and Dr. Tessa Davis
- A summary of insights from the ALiEM community derived from the blog discussions
- Freely downloadable PDF versions of the case and expert responses for use in continuing medical education activities
[su_spoiler title=”Expert Response 1: Dr. Anton Helman” style=”fancy” icon=”chevron”]
Reflective Listening & Handling a Challenge
Most of us who practice Emergency Medicine have encountered similar upsetting situations to the case presented. Here, Stacy was quite sure that her decisions and actions were well founded and reasonable, yet another health care professional disagreed vehemently, and even behaved in an unprofessional manner.
If Stacy approached me after this situation, my first goal would be to show empathy, as I might with a patient who has experienced an upsetting event. While I would be tempted to launch into a rant describing the poor behavior of Dr. Walters and defend the validity of medical podcasts and blogs, instead I would start with Reflective Listening.
There are four steps to effective reflective listening which help to convey empathy
- Echo: repeat what Stacy tells me; this conveys the message that I am listening carefully to what she has to say
- Paraphrase: paraphrase what Stacy tells me; this gives her the message that I understand what she is upset about
- Identify the feeling: for example, I might say ‘you seem upset’ or ‘you seem frustrated’; this produces trust
- Validation: validate Stacy’s feelings by saying ‘I can see why you feel that way’
After I have actively gone through the steps of Reflective Listening, the next steps involve showing Stacy that I can relate to her situation. To this end, I use a mnemonic, ‘RELATE’: Reassure her and Explain to her that she performed a reasonable, evidence-based therapeutic maneuver that I would have done myself (Topical anesthetics in the ‘MOTE’ trial proved to be safe for uncomplicated corneal abrasions as well as provide more effective pain relief than saline placebo , and has been rated highly effective for pain relief by patients in another trial ). Listen, rather than hear what she has to say and Answer by summarizing what she has said. Then, Take Action by suggesting to Stacy to print off the articles that show that Tetracaine can be effective as well as safe, and give them to Dr. Walters, while explaining (in a calm tone) the reason for her therapeutic decision. Finally, Express Appreciation by thanking Stacy for confiding in me.
Stacy appropriately applied knowledge obtained from a podcast to patient care. As a producer of a FOAM podcast, I have come to realize the burden that I bear to ensure that the knowledge being disseminated is high quality, accurate and evidence-based. While podcasts and blogs have proved to have significant impact in terms of knowledge dissemination (ALiEM’s pages have been viewed by tens of thousands of EM providers, and approximately 45,000 EM Cases podcasts are downloaded each month), research to develop quality indicators for these media is only very recently being studied. There are, however, several reasons why FOAM sources are driven to provide high quality material. First, knowing that my podcasts have wide dissemination, I feel a deep responsibility to provide the most accurate information that I possibly can. Second, crowd-sourced, swarm-based, peer review helps to improve quality. One advantage of FOAM over more traditional modes of knowledge acquisition is that immediate feedback from learners across the globe can, and does occur, so that if an error is posted on a blog, the error can be fixed immediately with rapid dissemination to learners. Another advantage of FOAM is that it encourages learners to not only read original journal articles, but to consider multiple differing opinions of researchers, educators and peers from different practice environments, so that the learner can make educated decisions for themselves.
An important distinction that producers of FOAM should make clear to their audience is the one between expert opinion and evidence-based medicine. Expert opinion has educational value as an adjunct to evidence-based medicine; tacit knowledge sharing is vital to effective learning, and FOAM is an excellent vehicle for disseminating the real-life experiences of EM colleagues.
FOAM is not perfect. We need to be careful as FOAM gains popularity that we produce the highest quality material that we can. I hope for a day in the future when the old school (represented here by Dr. Walters) and new school (Stacy) can work together to make quality improvements across all learning modalities, from textbooks through journal articles, to blogs and podcasts, so that we can all learn from each other.
Together, we’re smarter!
- Ting JY, Barns KJ, Holmes JL. Management of Ocular Trauma in Emergency (MOTE) Trial: A pilot randomized double-blinded trial comparing topical amethocaine with saline in the outpatient management of corneal trauma. J Emerg Trauma Shock. 2009;2:(1)10-4. [pubmed]
- Waldman N, Densie IK, Herbison P. Topical tetracaine used for 24 hours is safe and rated highly effective by patients for the treatment of pain caused by corneal abrasions: a double-blind, randomized clinical trial. Acad Emerg Med. 2014;21:(4)374-82. [pubmed]
[su_spoiler title=”Expert Response 2: Dr. Tessa Davis” style=”fancy” icon=”chevron”]
Although Dr. Walters may not have the kindest manner, he is merely expressing a view held by many medical professionals. While those of us creating and using FOAM regularly can see the multitude of benefits these resources provide, there remains a significant proportion of the medical population who are sceptical about the quality and usefulness of these meducation innovations. It’s essential to be mindful of this when discussing this important topic.
One of the frequent criticisms of FOAM is that, unlike primary literature published in renown medical journals, it is not peer-reviewed in the same robust manner . The reality, however, is that one of the main benefits of FOAM is that it has effective post-publication peer review, which allows for a global online discussion with quick feedback and correction of any errors. The utility of this was well illustrated in 2013, when a post on Intensive Care Network resulted in a correction to the statistical analysis of an article in the New England Journal of Medicine .
There is a lot to love about FOAM, but it is important to be realistic and realize that, like all change, not everyone will feel the same passion as Stacy. It will take time to integrate FOAM as a standard of practice. Be prepared to discuss and understand the pros and cons.
Referencing your sources
What Dr. Walters is missing though, is that FOAM is not a source in itself. FOAM is simply a term to encompass the concept that the content is freely available. Just as there are good journal articles and bad ones, there are good and poor quality FOAM resources. Similarly, a podcast is merely a platform to deliver information . Podcasts exist on various ends of the spectrum and can be delivered by my three-year-old child or by the renown physicist Stephen Hawkin as he discusses his latest research. Essentially, whether the information was found on the internet, in a book or in a journal is not the crux of the issue in question; what is important is the quality and reliability of the content.
When discussing a case with a colleague, Stacy should be referencing the primary literature rather than focusing on the platform she used to learn about it. The same information could have been delivered as, “I am aware of a recent article in X Journal which demonstrated that Tetracaine was safe to use in corneal abrasions for short-term relief…” This would encourage some debate around the issue itself, rather than being side-tracked by Dr Walters’ views on the internet and FOAM material.
Clinical debate is a valuable part of practicing medicine, so we should be prepared to defend our decision-making and reference appropriately.
Dealing with difficult colleagues
Finally, it is important to be aware that there will always be times in your career when someone is unreasonable or disrespectful when discussing alternate views of clinical practice. Developing strategies to approach and manage these uncomfortable situations constructively is part of growing as a doctor and a human.
As junior doctors, it is not unusual to rotate between hospitals a few times before finding a permanent position, sometimes changing environments as frequently as every few months . It is a constant adjustment of finding our way, establishing ourselves, trying to gain respect from our colleagues, consultants and superiors. The goal is to find the balance between being inquisitive and enthusiastic whilst still ‘fitting in’. Being mindful of potential areas of friction, considering how to maximise your role within that particular environment, and having a good support network will help ease the transition.
- Nickson CP, Cadogan MD, Free Open Access Medical education (FOAM) for the emergency physician. Emergency Medicine Australasia. 2014;26: 76–83.
- 2+2 = 4, Intensive Care Network blog, accessed online 15 April 2015.
- Thoma B, Joshi N, Trueger NS, Chan TM, Lin M. Five Strategies to Effectively Use Online Resources in Emergency Medicine. Annals of Emergency Medicine. 2014;64(4): 392-395.
- Garelick A, Fagin L. Doctor to doctor: getting on with colleagues. Advances in Psychiatric Treatment. 2004;10(3): 225-232.
[su_spoiler title=”Community Commentary: Eve Purdy” style=”fancy” icon=”chevron”]
Community Commentary Curated by Eve Purdy
Edited by Teresa Chan and Sarah Luckett-Gatopoulos
What is a Legitimate Source?
The ALiEM community largely agreed that, in this particular instance, Stacy should not have cited a podcast to justify her treatment decisions to Dr. Walter. The most commonly cited reason was that Stacy should know the evidence first-hand around practice changing decisions but it was also commonly appreciated that the medical world is not ready to hear “I heard it on a podcast”.
Participants noted that it is impossible to stay up to date on primary literature for all components of practice. In the past, physicians have relied on secondary sources (textbooks, conferences, peers). Free open access medical education (FOAM) simply is a multi-platform way to consume, distribute and translate knowledge in a similar way. Hayes and Swaminathan noted that FOAM sources are often more extensively vetted than other secondary sources.
Lalani and Swaminathan both suggested out that we should redirect the conversation away from the medium, back to the quality of the evidence to most constructively engage with the patient care decision at hand. Participants agreed that engaging with other professionals online is one way to put the evidence in context and engage in the critical appraisal of primary evidence.
How do we critically appraise FOAM?
Jeff Riddell wisely said “FOAM [as a secondary source] isn’t going anywhere” and suggested that we might find ways to help identify high quality FOAM sources. A number of suggestions were put forward:
- FOAM Gate Keepers (Swaminathan): A staff at each residency program can review content and know which sites are reliable. AIR Modules and using impact factors can also be an indicator of quality.
- FOAM Club (Tina Choudri): We learn how to critically appraise Journal Articles at Journal Club but we don’t learn about critically appraising secondary sources. She suggested creating a FOAM Club to encourage similar conversations around the quality of FOAM sources. Jeff Riddell discussed an tool/curriculum his institution is developing to help users critically evaluate their workflow.
- Asynchronous Learning Course (Gita Pensa): Uses modules and FOAM sources to discuss topics each week. Often the conversation revolves around when one needs to return to the primary literature and the quality of the resources used.
Some participants lamented that the traditional critical appraisal skills of many physicians are poor. Without a good critical appraisal toolkit, frequent practice and a skeptical eye, using primary literature is not a foolproof way to make good clinical decisions either. This digression reminded us that while improving the critical appraisal skills around secondary sources is important, so too is the ability to effectively interpret the primary evidence.
Despite agreeing that Stacy might have presented here case more effectively and being unimpressed with Dr. Walters’ unprofessional response, the group felt that Stacy does need to stand her ground and engage with Dr. Walters around the issue, though Rogers suggested that this is likely better done once Dr. Walters’ temper has cooled. The participants unanimously agreed that these two should collaborate and suggested a few ways that Stacy might make that possible.
- Return to the Evidence: Many participants that Stacy provide Dr. Walters with some of the primary evidence she has used to inform her opinion. This could be in the form of links to articles in an email or printed off and left in his mailbox. Either way, an accompanying note, clarifying the earlier confusion would be a nice, collaborative, touch.
- Ask to learn: Taking a page out of the students’ book, generalists have the advantage of asking those we are working with to provide their expertise and ask questions as they do so to improve understanding. While doing so, Stacy could have also provided her own interpretation of the evidence on the subject and this might lead to a productive discussion on the issue at hand.
- Engage consultants in FOAM: One way to help consultants understand the utility of blogs and podcasts is to have them write or review them. Chan gave an example of having a Chief of Nephrology write a post on the management of hyperkalemia for an EM blog.
- Interdisciplinary Grand Rounds (Rezaie): One participant noted that his institution holds interdisciplinary rounds on “hot topics”. An event that brings together an expert from different field to do a review of the evidence on the same topic. This helps develop consensus between groups that started with differing opinions.
Though adamant that Stacy needs to try to find a way to engage Dr. Walters in the evidence on this topic, a number of participants regrettably agreed that, occasionally, one might come across a personality that is not willing to collaborate in this way.
That doesn’t mean we shouldn’t stop trying!
Dr. Walters and Stacy were consulting physicians yet only the male physician held the prefix doctor. Some discussion occurred about why this was the case. It could represent discrimination against female physicians or it might represent the way that Stacy see’s herself in her new role as a junior attending. Alternatively it could portray the difficulty in transition in roles from resident to staff when an individual remains at the same institution. Either way, we would enjoy further discussion on this topic, please feel free to comment below.
A Call to Action
Debate around the responsibility to ensure and rank quality of resources ensued both on the blog and on twitter. Some participants felt that formal rating and quality metrics should be created to define quality. There was reference to ongoing research in this area. Others felt that having individuals at institutions, so-called ‘gatekeepers’, defining quality might be best. Despite the differences in opinion around quality metrics, most participants agreed that consumers of FOAM have a responsibility to truly engage with the resources. The group endorsed a “call to action” to leave comments, provide expertise, correct wrongs and promote high quality resources within the existing online community.
- Morton R. Management of hyperkalemia with ECG changes. BoringEM. Published September 25, 2014. Accessed April 29, 2015.
- Thoma B. Social Media Index (SM-i). Academic Life in Emergency Medicine. Published 2014. Accessed April 29, 2015.
- Hayes B. Is FOAM to blame when a medical error occurs? Academic Life in Emergency Medicine. Published September 18, 2013. Accessed April 29, 2015.
- Thoma B, Chan TM, Paterson QS, Milne WK, Sanders JL and Lin M. Emergency medicine and critical care blogs and podcasts: establishing an international consensus on quality. Annals of EM. 2015; in press. DOI
- Thoma B, Chan T, Desouza N, Lin M. Implementing peer review at an emergency medicine blog: bridging the gap between educators and clinical experts. CJEM. 2014; 16(0): 1-4. DOI
[su_spoiler title=”Participants” icon=”chevron”]
Thank you to our participants
Salim Rezaie (@srrezaie)
Teresa Chan (@TchanMD)
Damian Roland (@Damian_Roland)
Sarah Luckett-Gatapolous (@SLuckettG)
Zack Repanshek (@ZackRepEM)
Ronald Hirsch (@signaturedoc)
Tamara McColl (@mccoll_tamara)
Manrique Umana (@umanamd)
Gita Pensa (@GitaPensaMD)
Jeff Riddell (@Jeff_Riddell)
Bryan Hayes (@PharmERToxGuy)
Nadim Lalani (@ERmentor)
Tim Leeuwenburg (@kangarooBeach)
Anand Swaminathan (@EMSwami)
Rob Rogers (@EM_Educator)
Steve Carroll (@embasic)
Manu Varma (@TransplantHQ)
Anand Swaminathan (@EMSwami)
Bill Fraser (@fraser_DHEM)
Teresa Chan (@TChanMD)
Brent Thoma (@brent_thoma)
Patrick Bafuma (@EMinFocus)
Chris Bond (@socmobem)
Ricuarte Solis (@SolisREMDoc)
Michelle Lin (@M_Lin)
Justin Benoit (@justinleebenoit)
Jason T Nomura (@Takeokun)
Elsevier Emergency Medicine (@ELS_Emerg_Med)
MEdIC Series Case and Responses for Download
Download the case (307 kb PDF)
The post MEdIC Series | The Case the FOAM Faux Pas – Expert Review and Curated Commentary appeared first on ALiEM.