Showing posts with label matthew holt. Show all posts
Showing posts with label matthew holt. Show all posts

Monday, February 18, 2013

Kaiser Health News/Philadelphia Inquirer on InformaticsMD: "The flaws of electronic records"

At my Dec. 2012 post "How an interview for Kaiser Health News rekindled memories of health IT dysfunction in the 90's that persist in the 10's" I mentioned an interview by a reporter from the Kaiser Health Foundation regarding health IT flaws.

His article appeared in both the Philadelphia Inquirer and Kaiser Health News today under the title "The flaws of electronic records":

Philadelphia Inquirer / Kaiser Health News
Feb. 18, 2013
The flaws of electronic records

Drexel University's Scot Silverstein is a leading critic of the rapid switch to computerized medical charts, saying the notion that they prevent more mistakes than they cause is not proven.


 



Scot Silverstein of Lansdale, one of the most ardent critics of electronic medical records, works on an antique computer. A growing collection of evidence suggests poorly designed medical software can obscure clinical data, generate incorrect treatment orders, and cause other problems.

RON TARVER /Staff Photogapher

Jay Hancock, KAISER HEALTH NEWS
Posted: Monday, February 18, 2013, 3:01 AM

Computer mistakes like the one that produced incorrect prescriptions for thousands of Rhode Island patients are probably far more common and dangerous than proponents of electronic medical records believe, says Drexel University's Scot Silverstein.

Flawed software at Lifespan hospital group printed orders for low-dose, short-acting pills when patients should have been taking stronger, time-release ones, the Providence-based system disclosed in 2011. Lifespan says nobody was harmed.

But Silverstein, a physician and adjunct professor of health-care informatics who is making a name for himself as a strident critic of electronic health records, says the Lifespan breakdown is part of a much larger problem.

"We're in the midst of a mania right now" as traditional patient charts are switched to computers, he said in an interview in his Lansdale home. "We know it causes harm, and we don't even know the level of magnitude. That statement alone should be the basis for the greatest of caution and slowing down."

In an ethical world, it would be.  Medicine, though, is in the throes of a loss of ethics, as many stories at this site and many others attest to.

Use of electronic medical records is speeding up, thanks to $10 billion and counting in bounties the federal government is paying to caregivers who adopt them. The consensus among government officials and researchers is that computers will cut mistakes and promote efficiency. So 4,000 hospitals have installed or are installing digital records, the Department of Health and Human Services said last month. Seventy percent of doctors surveyed in September by research firm CapSite said they had switched to digital data.

But the notion that electronic charts prevent more mistakes than they cause just isn't proven, Silverstein says. Government doesn't require caregivers to report problems, he points out, so many computer-induced mistakes may never surface.

The recent ECRI "deep dive" study of "EHR events" (link) is just the latest to raise red flags on that point.

Even Dr. David Blumenthal, former chair of the Office of the National Health IT Coordinator (ONC) in HHS seems to have changed his message about reporting of medical problems.

From a Feb. 16, 2013 New York Times article "Doctors Who Don’t Speak Out":

....  TRADITIONALLY, doctors have brought problems to the attention of colleagues by conducting research and publishing their findings in a medical journal. The advantage of that system helps ensure the credibility of study data and protects a researcher from random attack, said Dr. David Blumenthal, the president of the Commonwealth Fund, a group that studies health policy issues.

But getting a study published can take a year or two; some Johnson & Johnson consultants did publish studies about the hip’s flaws, but they largely appeared after it had been recalled.

Dr. Blumenthal said there was probably a need for more immediate ways for doctors to share their concerns, like forums supported by professional medical organizations.

Back to the Inquirer article:

He doesn't discount the potential of digital records to eliminate duplicate scans and alert doctors to drug interactions and unsuspected dangers.

But the rush to implementation has produced badly designed products that may be more likely to confound doctors than enlighten them, he says. Electronic health records, Silverstein believes, should be rigorously tested under government supervision before being used in life-and-death situations, much like medical hardware or airplanes.

In fact, arguments otherwise are specious.  "Harm to innovation" is the one I've heard most often.  Yet, those proffering such claims cannot point out what aspect of regulation - adherence to GMP's (good manufacturing processes), pre-market safety and quality testing, post-market surveillance, etc. - will "harm innovation."  Indeed, they opine as if innovation in medicine without objective safety and quality checks is a virtue, rather than a potential vice.

Silverstein "is an essential critic of the field," said physician George Lundberg, editor at large for MedPage Today and former editor of the Journal of the American Medical Association. "It's too easy for those of us in medicine to get excessively enthusiastic about things that look like they're going to work out really well. Sometimes we go too far and don't see the downside of things."

(Dr. Lundberg mentioned me in Nov. 2011 at MedPage today in a piece entitled "Health IT: Garbage In, Garbage Out" as here.)

The patients - including ourselves and our own family members, I might add - are the ones who pay the price of our hyper-enthusiasm.

... The FDA's Jeffrey Shuren, a neurologist, has said such cases "likely reflect a small percentage of the actual events that do occur."

"Tip of the iceberg" were his exact words (link).

... At conferences and working from home on the "Health Care Renewal" blog, Silverstein chronicles digital failures and criticizes hospitals in the same dogged way he applied himself to building the 1970s-era Heathkit computers [and amateur radio equipment - ed.] he still keeps in his home, say people who know him.

"His message has been consistent": Health IT "provides far less benefit than is claimed by its proponents and opens new, sometimes potent, routes to failure," said Richard I. Cook, a medical error expert at the University of Chicago who sat on a panel examining electronic record safety at the authoritative Institute of Medicine. "No one wants him to be visible. But his message and tone have not wavered."

Dr. Cook wrote the lone dissent to milquetoast IOM recommendations on health IT risk - the magnitude of which IOM itself admitted is unknown - in their 2012 report "Health IT and Patient Safety: Building Safer Systems for Better Care" available here.  See Appendix E.

The last scientific conference at which I chronicled these failures was at the Health Informatics Society of Australia's HIC2012, as a keynote speaker on health IT trust (link).  I would have been at HIC2011, to which I had been originally invited, but was helping care for a relative injured by bad health IT at that time.  Her death freed me to travel Down Under in 2012.

I have presented at a number of plaintiff attorney's meetings since then, however, such as the American Association for Justice Winter Convention (AAJ, formerly the Trial Lawyer's Association) just last week (link).  Trial lawyers don't seem to mind a very direct approach to the issues, unlike many so-called scientists who, as author Michael Crichton once warned (link), seem to believe in "consensus" rather than science.

The HIMSS Electronic Health Record Association, an industry group, declined to comment on Silverstein. A spokesman for the Office of the National Coordinator for Health Information Technology, the administration's proponent of digital records, said: "It's important to listen to all the voices" in the discussion of the subject. 

Some voices, unfortunately, are louder than others and backed by lobbyists and big money.  See, for instance, the May 2009 Washington Post article by Robert O'Harrow Jr. "The Machinery Behind Health-Care Reform: How an Industry Lobby Scored a Swift, Unexpected Victory by Channeling Billions to Electronic Records" (link to the article and my essay about it is here).

I do point out, however, for the benefit of those at HIMSS and ONC, that knowing of risks, while doing nothing substantive while "listening to all voices in the discussion" can be seen as gross negligence.

Trained as an internist and in medical information technology [Medical Informatics- ed.] as a Yale University postdoc, Silverstein, 55, served as Merck & Co.'s director of scientific information in the early 2000s and then as a full-time Drexel professor, shifting in recent years to part-time teaching and working on medical liability cases for plaintiff attorneys. His insistent warnings about digital health risks over more than a decade have effectively barred him from a lucrative career at a hospital or software vendor.

Perverse as that reality may be, it's also the reverse:  I would not want to work for a hospital or software vendor in 2013, where effecting change to protect patients from bad health IT is hard if not impossible, e.g., as at link, link, and link, and at the other case examples at that site.  I find it a far more effective use of my time to help enact change from the outside - and avoiding the pathological individuals who make such scenarios possible.

"I'm sure Scot would be better off by keeping his mouth shut and getting a job with a hospital that's just put in a big . . . system," said Matthew Holt, a Silverstein critic and cochairman of Health 2.0, which organizes health technology conferences.

I note that the raison d'ĂȘtre for this blog is the impact of many people doing just that sort of thing - "keeping their mouth shut" and making money, no matter what the ethical implications.  (The patients killed by such behaviors are, unfortunately, unavailable for comment.)

Many say he comes on too strong. Even admirers cringed when he began blogging about the 2011 death of his mother, which he blames in a lawsuit on a computer error that allegedly caused Abington Memorial Hospital to overlook a key medication. (Both he and the hospital said they couldn't comment on a pending suit.) Personalizing his campaign, some thought, made him seem less objective.

I'm at a loss here.  "Too strong" - on matters of life and death that affect everyone?  A proficient writer, who had been writing about health IT problems since 1998, should have kept silent about a first hand story of HIT harm in 2010 of potential great relevance towards public safety?  Writing about the incident 'lessens objectivity'?  That makes little sense, and is perverse.  Those who opined as such have their priorities in serious disarray.

Such personalized accounts are common and have caused great change.  Libby Zion's death due to hospital neglect, and her father's making the issues quite public, comes to mind, as do the many laws enacted that are named after people who've gone public after personal tragedy:

... Grieving the loss of their child, Zion's parents became convinced that their daughter's death was due to inadequate staffing at the teaching hospital.  Sidney Zion questioned the staff's competence for two reasons. The first was the administration of meperidine, known to cause fatal interactions with phenelzine, the antidepressant that Libby Zion was taking. The second issue was the use of restraints and emergency psychiatric medication. Sidney's aggrieved words were: "They gave her a drug that was destined to kill her, then ignored her except to tie her down like a dog." To the distress of the doctors, Zion began to refer to his daughter's death as a "murder." Sidney also questioned the long hours that residents worked at the time. In a New York Times op-ed piece he wrote: "You don't need kindergarten to know that a resident working a 36-hour shift is in no condition to make any kind of judgment call—forget about life-and-death." The case eventually became a protracted high-profile legal battle, with multiple abrupt reversals; case reports about it appeared in major medical journals.

An alternate explanation is that, lacking other credible means, this is an ad hominem reaction (of those "some") seeking an angle to attack the message ... and the messenger ... or is simply a reaction of, to put it bluntly, castrati who are more at home in a country club than in the world of ideas.

For a bona fide example of "coming on too strong", there's this:

In the NEJM article "The 'Meaningful Use' Regulation for Electronic Health Records", David Blumenthal, M.D., M.P.P. (ONC Chair) and Marilyn Tavenner, R.N., M.H.A. (10.1056/NEJMp1006114, July 13, 2010) available at this link, the opening statement is (emphases mine):

The widespread use of electronic health records (EHRs) in the United States is inevitable. EHRs will improve caregivers’ decisions and patients’ outcomes. Once patients experience the benefits of this technology, they will demand nothing less from their providers. Hundreds of thousands of physicians have already seen these benefits in their clinical practice.

I think it fair to say those are grandiose statements and predictions presented with a tone of utmost certainty in one of the world's most respected scientific medical journals. 


Even though it is a "perspectives" article, I once long ago learned that in writing in esteemed scientific journals of worldwide impact, statements of certainty were at best avoided, or if made should be exceptionally well referenced.

I note the lack of footnotes showing the source(s) of these statements.

Another bona fide example of "coming on too strong":

“We have the capacity to transform health with one thunderous click of a mouse after another,” said (former) HHS Secretary Michael Leavitt - 2005 HIMSS Summit 


We shall transform health (into what, exactly, is not specified) one thunderous mouse click after another!

It doesn't get any stronger than that, unless, perhaps, the thunderous wrath of God is invoked.

Back to the Inquirer once again:

"His refusal to temper his message makes it sometimes difficult to hear," said Ross Koppel, a University of Pennsylvania sociologist and digital health record skeptic.

As per a recent article by Joe Conn in Modern Healthcare entitled "Health IT Iconoclasts" (link), which wrote of Dr. Koppel, Deborah Peel, Lawrence Weed and me, Dr. Koppel has firsthand experience at his message being found "difficult to hear" by the hyper-enthusiasts:

... Researcher Ross Koppel started an uproar in 2005 when he and a colleague coauthored an article in the Journal of the American Medical Association that found a first-generation computerized physician order entry system (CPOE) at the Hospital of the University of Pennsylvania was simultaneously creating new errors even as it reduced others.

Koppel’s bombshell—he’s now an adjunct professor of sociology at the University of Pennsylvania— brought down the wrath of information technology boosters. The Healthcare Information and Management Systems Society, a health IT trade group, challenged the study’s “methodology and its subsequent outcomes,” and criticized its authors for their “limited view” and not “looking at the big picture.”  [Others wrote that his work was 'disingenuous', although it had similar findings to my own observation of the very same CPOE system at Yale-New Haven Hospital ... in 1992 - ed.]

... In 2009, he revealed in another JAMA article that health IT vendors’ contracts included “hold harmless” clauses that shielded software developers from legal liability for medical errors their systems caused, even if the developers had been warned about the defects. “That got me major upheaval,” the worst of his career, Koppel recalls.

Koppel, a sociologist, has probably done more for health IT transparency and safety than the physicians of the entire academic medical and medical informatics community combined.

... But Silverstein says his position today is the same as it has always been. He believes in the potential power of electronic records for good, he says. But any doctor who feels bound by the Hippocratic oath's injunction to "first, do no harm," he adds, should balk at what's going on.

"Patients are being harmed and killed as a result of disruptions to care caused by bad health IT," he said. "I'm skeptical of the manner and pace" of implementation, "not of the technology itself. . . . My only bias is against bad medicine. And my bias is against people with complacent attitudes about bad medicine."

The issues are actually relatively simple, using terminology coined by Dr. Jon Patrick of U. Sydney at the aforementioned HIC2012 meeting in Australia during our discussions.  Bad health IT must be removed from the market, and good health IT must replace it.

Good Health IT ("GHIT") is defined as IT that provides a good user experience, enhances cognitive function, puts essential information as effortlessly as possible into the physician’s hands, keeps eHealth information secure, protects patient privacy and facilitates better practice of medicine and better outcomes.

Bad Health IT
("BHIT") is defined as IT that is ill-suited to purpose, hard to use, unreliable, loses data or provides incorrect data, causes cognitive overload, slows rather than facilitates users, lacks appropriate alerts, creates the need for hypervigilance (i.e., towards avoiding IT-related mishaps) that increases stress, is lacking in security, compromises patient privacy or otherwise demonstrates suboptimal design and/or implementation.  
  
It is this author's opinion that this change will not happen by "going along to get along" or "listening to all the voices in the discussion of the subject" (especially those with Big Money and Big Lobbyists behind them) while doing nothing.

I also note that "complacent attitudes about bad medicine" are not the sole province of IT personnel or healthcare management.  Physicians and nurses who acquiesce to bad health IT are part of the problem.

-- SS

Thursday, August 9, 2012

My Presentation to the Health Informatics Society Of Australia: "Critical Thinking on Building Trusted, Transformative Medical Information: Improving Health IT as the First Step"

In early 2011 I was invited to present at the annual convention of the Health Informatics Society of Australia (HISA) by its CEO, Louise Schaper, PhD.  HISA was aware of my writings and thought a presentation at their conference would be of interest to the Australian informatics and healthcare governance community.

Dr. Schaper wrote:

From: Louise Schaper
Sent: Thursday, March 24, 2011 10:50 AM
To: Scot Silverstein
Subject: HIC invitation to deliver a keynote presentation

Hi Scot,

I trust this email finds you well and I hope spring is bringing you some warmer weather and cheer.

I wanted to let you know that the Health Informatics Conference committee met recently and expressed a high level of interest in having you deliver a keynote address at HIC and also to form part of a panel presentation. 

I know you may not be able to make a commitment to come to Australia in August, but I wanted to let you know what we would love to have you, if circumstances permit you being here.  I’m confident we could have your trip sponsored (providing you don’t mind spending some face-time with the sponsoring organisation) and generate some media coverage around your visit.

The preliminary program will be advertised in the next few weeks and at the moment I’m leaving a ‘spot’ for you in the hope that you may be able to join us.  I know you are in difficult and upsetting circumstances so please know that I’m not intending to add to any pressure – I just wanted to let you know that we would be honoured if you are able to deliver an address at HIC this year and I will keep a speaking spot reserved for you if you think you may be able to accept our invitation.

Thanks for your time Scot.  I look forward to hearing from you.

Kindest regards,

Louise

Sadly, the "difficult and upsetting circumstances" she mentioned were my involvement in caring for my mother, seriously injured in May 2010 in a healthcare information technology-related medical misadventure and, by this time, dying.

I was thus unable to attend.

My mother passed away June 6, 2011 of her injuries.

In January 2012, Dr. Schaper was gracious enough to re-invite me to the annual 2012 conference in Sydney.  I accepted.

I attended HIC 2012, held in the Darling Harbour Convention Centre in Sydney 30 July - 2 August 2012.


I enjoyed taking pictures like this with my trusty (and portable) Canon SX110 IS.  Click to enlarge.  More photos here.

My powerpoint slides for the presentation entitled "Critical Thinking on Building Trusted, Transformative Medical Information:  Improving Health IT as the First Step" are at this link.


Darling Harbour Convention Centre, Sydney, Australia. Click to enlarge.

Australia has embarked on a national Personally Controlled Electronic Health Record (PCEHR) project under the auspices of Nehta, the National E-Health Transition Authority.  I find this an interesting approach to national health IT; unlike the U.S., whose project is top-down (centrally controlled records), Australia seems to have learned from our mistakes and is initiating health IT as a bottom-up (patient-controlled) initiative.

At the conference last week, I delivered a keynote address on the theme of improving health IT as an essential step in leveraging the capabilities of the technology.

Being that I am anti-"bad IT" and pro-"good IT", implicit in my address was the issue of the technology's untrustworthiness in 2012, largely due to the unregulated free-for-all its market represents and the poor engineering that is the result.

I also participated in a Panel Discussion led by Australian investigative journalist and popular political TV program host Tony Jones.  Mr. Jones hosts the Australian Broadcasting Corporation's "Q&A - Adventures in Democracy."


Panel discussion moderated by Australian political commentator Tony Jones, who hosts the show "Q&A" on the Australian Broadcasting Corporation.  Click to enlarge.


I will highlight several key points I made in my keynote and on the panel:

  • Critical thinking is essential at all times in healthcare ... or your patient's dead.
  • Critical thinking is not mindless criticism; on the contrary, it is reflective, inquisitive, logical thinking that is focused on deciding what to believe or do.
  • Health IT must be trusted by users and patients [and be free of major downsides] - as a primary step before HIT can optimally benefit healthcare 
  • I pointed out I am not suggesting anything new and that, in fact, I am suggesting something old:  "First, do no harm."
  • I pointed out the "revolutions" usually have downsides, and IT always produces winners...and losers (per the empirical research of Social Informatics). 

Me presenting my keynote, driving home the point that IT on its own won't "revolutionize" healthcare; it is a tool to facilitate the true enablers of healthcare - clinicians - a point that should never be forgotten.  Click to enlarge. From the excellent multimedia piece on the conference at this link.


I then posed a series of questions of great relevance to understanding health IT realities.  Click to enlarge:




  










I left it to the audience to answer these questions.

I then posed the question "Is health IT being done well?"

I provided links to various evidence that it was not, such as the National Research Council 2009 report on health IT; AMIA's report on its workshop on healthcare IT failure, the 2012 U.S. IOM report on safety, the 2012 U.S. NIST report on usability, work by Australian Professor Jon Patrick of U. Sydney on health IT defects, and other sources as aggregated at this link.

Again, I did not impose views on the audience.  I didn't need to, as that corpus speaks for itself.

I also clarified terminology that reduces essential caution, such as the terms "electronic medical record" (EMR) and "electronic health record" (EHR) - a source of endless, wasted contention on definitions of which is which - being anachronisms from an earlier age of IT.  I pointed out that in 2012 what these innocuous terms somewhat deceptively and disarmingly represent are in reality complex enterprise clinical resource management and clinician workflow control systems – where many, many things can go wrong.


"EHR":  an innocuous "file cabinet" for records, or something else entirely?  Click to enlarge.


I asked if case reports of health IT unintended consequences (UC’s) were “anecdotal” and to be played down, while studies of health IT benefits to date solid science.  I then asked if the reality might be that studies of health IT benefits to date were mostly anecdotal (e.g., in specialized settings; weak observational studies vs. randomized clinical trials) while reports of UC’s are risk management-relevant incident report “red flags” pointing to possible systemic problems.

I pointed out the common seller marketing memes of beneficence and deterministic efficacy, and asked if these were realistic.  I also pointed out the need for transparency about HIT risks, and the impediments to this transparency.

Finally, I indicated what was the likely problem affecting all countries involved in EHR projects: that the rigor, ethics and skepticism of medical science itself not applied in the domain of health IT.

I suggested a simple solution:  a paradigm shift in thinking about health IT as another medical device, that needed to be subject to the same methodologies and ethical considerations applicable for decades (or more) in the healthcare delivery sector such as medical devices, pharmaceuticals, and research (and other risk-prone industries e.g., aviation and automotive).

My goal was to provoke thinking about these issues, to circumvent blank, uncritical acceptance of industry and industry-supporter memes.

I believe I succeeded.  Feedback I received was that the audience, including government officials, found many new things to consider as they embark on their national health IT projects.

I also heard that some HIT seller representatives were squirming a bit.  That was not unexpected.  I was taking "control of their message" away from them.


University of Sydney Professor Jon Patrick presenting on computational linguistics.   Jon is the author of a treatise on health IT defects (at this link), mentioned numerous times on this blog.  Dr. Patrick graciously hosted me at his Sydney home for several days after the conference and he and his wife gave me a wonderful tour of the city.  Click to enlarge.

Finally, I had a question from the audience, from fellow blogger Matthew Holt of the Health Care Blog.  (I've had some online debate with him before, such as in the comment thread at my April 2012 post here.)

Matthew asked me a somewhat hostile question (perhaps in retaliation for the thrashing he received at the end of my May 2009 post on the WaPo's HIT Lobby article here), that I was well prepared for, expecting a question along these lines from the seller community, actually.  The question was preceded by a bit of a soliloquy of the "You're trying to stop innovation through regulation" type, with a tad of Merck/VIOXX ad hominem thrown in (I ran Merck Research Labs' Biomedical libraries and IT group in 2000-2003).

His question was along the lines of - you were at Merck; VIOXX was bad; health IT allowed discovery of the VIOXX problem by Kaiser several years before anyone else; you're trying to halt IT innovation via demanding regulation of the technology thus harming such capabilities and other innovations.

The audience was visibly unsettled.  Someone even hollered out their disapproval of the question.

My response was along the lines that:

  • VIOXX was certainly not Merck at its best, but regulation didn't stop Merck from "revolutionizing" asthma and osteoporosis via Singulair and Fosamax;
  • That I'm certainly not against innovation; I'm highly pro-innovation;
  • That our definitions of "innovation" in medicine might differ, in that innovation without adherence to medical ethics is not really innovation.  It is exploitation.

(I forgot to mention that I gave an invited presentation to Merck's Drug Surveillance department in 2006, PPT here, long after I was their employee, on the potential use of EHR data to detect drug adverse events sooner than traditional phase IV studies or ad-hoc reporting allowed.)

When I spoke of medical innovation requiring ethics, nearly the full audience at my keynote address - hundreds of people - broke out in applause.

•
I knew at that point that my talk was a success.


This author with HISA CEO Louise Schaper , PhD. Click to enlarge.

More photos of my trip are here.

-- SS

Addendum:  Another added pleasure in my visit Down Under. As Australia and the U.S. respect each other's amateur radio licenses, I was able to operate my handheld radio as "KU3E portable Victor-Kilo." VK is the international radio prefix for Oz.  Contacting Australia from the U.S. is considered a "holy grail" of ham radio.  It was interesting to hear amateur radio "from the other end."


Yaesu VX-3 Multiband Transceiver

-- SS

Aug. 11, 2012 Addendum:

An excellent multimedia video of HIC 2012 produced as the conference proceeded has been posted on YouTube at http://www.youtube.com/watch?v=DZg_46wY0E0.  It was finished and shown immediately after the conference's conclusion.

-- SS