By Sara Calabro
On Thursday, the FDA recommended to reverse the approval of Avastin for breast cancer, a decision that The Washington Post says, “intensifies a politically charged debate over costly cancer drugs that appear to produce modest benefits—if any.” It also raises questions about the research processes by which therapies, including acupuncture, are deemed effective.
In a case of crystal-ball reporting, The New Yorker, three days before the Avastin news broke, covered the “decline effect” in research. This refers to the increasingly common phenomenon of follow-up studies failing to confirm original research findings. Avastin gained approval for breast cancer in 2008, based on one study that showed it slowed the growth of breast tumors. The FDA signed off with the understanding that the drug’s maker would conduct follow-up studies to confirm the results. Those studies proved unimpressive.
Debating the efficacy (or cost) of Avastin is beyond the scope of this post. However, the struggle to explain evolving, multifaceted clinical realities through defined research protocols relates strongly to acupuncture’s plight in the research world.
A common criticism of acupuncture is that it does not consistently demonstrate therapeutic benefit in clinical trials. There are numerous examples to the contrary, but compared with the overwhelmingly positive anecdotal feedback on acupuncture, its on-paper report card is weak. There are several reasons for this—lack of funding, cultural bias, poorly defined placebos, among many others. But perhaps most problematic is the rigidity with which research is conducted and interpreted.
Our tendency—as Westerners, and particularly in science and medicine—to want to put things in boxes, to understand and control them, causes us to negate that which cannot be clearly defined according to expected outcomes. An acupuncture study that does not improve pain scores by a certain percentage gets tossed in the acupuncture-doesn’t-work category. Yet in real life, acupuncture often improves conditions other than just the one that brought a patient in the door. Those changes can be what ultimately lead to improvement in the primary complaint.
A patient, for example, who comes in complaining of back pain may also be depressed and have a sedentary lifestyle. As acupuncture improves the depression, the patient becomes more motivated to exercise, which eventually alleviates the stiffness and pain in his back. “Does acupuncture work for back pain?” is not as easily answerable as sensationalized headlines encourage us to believe.
The conclusion of the New Yorker article on decline effect sums this up nicely: “The decline effect is troubling because it reminds us how difficult it is to prove anything. We like to pretend that our experiments define the truth for us. But that’s often not the case. Just because an idea is true doesn’t mean it can be proved. And just because an idea can be proved doesn’t mean it’s true. When the experiments are done, we still have to choose what to believe.”
Health is a personal state of being. Achieving it is about deciding what works for us. All the research in the world will not convince Pat Howard, interviewed by the Post about Avastin, that the drug does not work for breast cancer. “This is horrific,” she says of the reversed approval. “Without Avastin, I’m going to die.”
Acupuncture doesn’t fix everyone’s back pain. (Neither do cortisone shots.) But if it fixes yours—or your patient’s, or your husband’s—who cares what the data says?
This isn’t to suggest that scientific research is worthless, nor is it to say that there aren’t well-designed studies demonstrating acupuncture’s efficacy. But when it comes to making decisions about our health, it’s worth thinking about what factors may have influenced research findings and questioning whether those results should trump real-life experience.
By opening ourselves to the idea that medical research is neither foolproof nor always relevant, we’ll facilitate a dialogue about potential improvements.
“I’m convinced that we can use the tools of science to figure this out,” says a scientist featured in the New Yorker article. “First, though, we have to admit that we’ve got a problem.”
Photo by Sara Calabro