Showing posts with label science. Show all posts
Showing posts with label science. Show all posts

Friday, May 14, 2010

The Myth of the Placebo "Effect"

Thursday, May 12, NPR carried a story on their Talk of the Nation program about the placebo effect, and more specifically, using placebos as medical treatments. While they mentioned the ethical concerns in passing, I was really disappointed that they presented a largely unskeptical view of such practice. It also showed a completely lack of understanding about what the placebo effect really is, further perpetuating a lie that has been used to support some quite dangerous practices.

A little quick background, placebo treatments are treatments that have no active ingredients. Often in drug trials this is the classic sugar pill: a pill made to look exactly like the actual drug, but with the active ingredients replaced with sugar or other inactive ingredients. In a trial, participants are split into two (or more) groups, with one given the active drug, and the other the sugar pill. After a period of time, participants symptoms are measured and they are given a brief survey asking them to detail how they feel about the symptoms being studied and whether they thought they were on the placebo or the real thing. Then, in a perfect world, the results of the study group is compared to the results of the placebo group and, if the drug is statistically equal, or worse, than the placebo it doesn't go to market.

The name "placebo effect", and the reason for the placebo based control at all, stems from the fact that the mere act of treating someone can appear to cause an improvement in the treated condition, whether or not the drug itself is having the effect. The important thing to realize is that appearance is largely all it is; the drug or other studied treatment itself is not having the effect, the effect, if there is one, is happening due to some other cause. By introducing a placebo (and proper blinding) to the study, you are able to remove the act of treating as a possible cause for the effect. The "placebo effect" is just the name applied to these other, untracked causes.

This brings me to my problem with the Talk of the Nation story itself. They treated the placebo itself, this empty sugar pill, as a cause itself, as opposed to a control stand-in for the untracked (or untrackable) variables in these clinical trials. This is an easy mistake to make, and one that human brains are evolutionarily developed to encourage. Back in the day, it was safer to think a pattern of shadows was a tiger and be wrong than to see a tiger and think it was a pattern of shadows. These days, it's a fun thing to be able to see fish and dragons in clouds or to see the face of Jesus on a potato chip, but it can cause issues when we see patterns in data that aren't real.

Specifically, the doctors interviewed by Jennifer Ludden made two critical mistakes in describing what is happening in placebo controlled studies. The first is confusing correlation and causation, or making the assumption that because effect x happened after doing action y, y must have made x happen. A simplistic example of this (stolen from Fraggle Rock) is to imagine a person who saw a group open umbrellas, and then felt it start raining. That person could believe that opening those umbrellas caused the rain. The same thing happens with medicine: People see a doctor, receive a treatment, or take a pill (or goes to their local faith healer); their illness goes away; thus whatever they did fixed their illness, ignoring anything else that may have also happened.

Well controlled trials limit or eliminate many of these variables so that only one thing, the drug or treatment, is being studied. The placebo is just one of those controlling mechanisms, removing such variables as doctor attention, the comfort and stress relief of being treated and many other environmental factors. It also helps to control for the body's natural ability to heal, even (rarely) from the most serious illnesses. This is true because in theory, the same number of people receiving both the real treatment and the placebo will have these externally caused effects. Thus if you give a fake treatment to 100 people, and a real treatment to 100 people, and 25 people from the fake treatment group get better, but 50 from the real treatment group get better, you have good reason to believe that the extra 25 people got better because of the treatment itself, not from shared causes.

The other common, related mistake, which Dr. Arthur Barsky touched on very briefly in the interview, is what is known as selection bias. This effect is manifested by people expecting things to happen, so when it does happen, they notice it more. An example of this is the "full moon myth" in hospitals. The myth goes that on nights with full moons, there are more injuries admitted to hospitals. This gets reinforced to hospital workers because on some nights, the number of admittances either is, or feels, higher, and when they look outside they see the full moon. Other nights when the volume is high, but there is no full moon, they don't think about, but they remember the nights that confirm the myth because they're told to expect that. If you remove this expectation, and look at the statistics, no such pattern is shown.

The same thing happens with medical treatments. People expect a treatment to have an effect. Thus, when someone is on a drug and feel the illness subside, they attribute it to the medicine. If a their symptoms get worse, a they just say "oh, it's a bad day" or the like; conversely if the symptoms get better while off the medication, they just feel lucky or attribute it to lingering effects of the medication. The change in symptom severity could be completely random, but it's attributed to the treatment because it's expected that the treatment would help with the symptoms.

In the same way, you notice such variation more because you're asked to pay more attention to it. Using chronic pain as an example, day to day, the severity of such pain varies. While a victim of the pain may notice strong differences, mild changes in pain go largely unnoticed. When they go on a treatment however, they are often asked to rate their pain level on a daily, if not more frequent, basis. This forces them to pay attention to even small changes that they would not have noticed before. This aspect is highlighted by the fact noted by Dr. Barsky that 25% of study subjects on placebo report side effects. Taking a sugar pill doesn't make you feel more tired or nauseous, but when you feel tired or nauseous while taking a sugar pill, you notice it more because you're expecting a side effect. This is another variable that properly blinded placebos are supposed to control for because with or without active treatment, this effect will still happen.

Another pair of issues that cloud medical studies, especially of subjective ailments, and is controlled by placebos is both the natural desire to help others and the desire to get something for your actions. The first is a problem because people might over-report the benefits of a treatment because they believe the doctor worked hard to help them. You may rate your pain somewhere between a 5 and a 7, but if you think the doctor tried hard to help you, you'd rate it at a 5, but if you got no aid or your doctor acted distant or uninterested, you'd rate a 7. This isn't a conscious choice (in most cases), but it will affect overall scoring. Similarly, if you are very involved in something (for example a long term diet/exercise regimen) or you pay a lot for something you feel you deserve more out of it whereas if you did not have to invest much time, effort or money (for example, sitting and watching a video), you wouldn't feel as invested in the treatment.

None of the above is to say that the variables a placebo controls for have no actual effect. I do not know any scientist or physician who would not say spending more time with a patient is a good thing (insurance companies on the other hand...). However, it does say that just the act of prescribing a placebo is not a substitution for real treatment. The placebo itself, sugar pill, acupuncture, faith healing, etc. has no effect in and of itself. It is only a stand in for many variables that are not tested. It is one, or many, of those unnamed, untracked variables that is having the effect, not the placebo itself. Don't replace that active cause with the inactive placebo; you short-change your patient and yourself.

NPR, I strongly recommend you get an alternate view on this. A set of doctors I know would be willing to speak with you are the ones that run Science Based Medicine, specifically Dr. Stephen Novella. For further reading see Science Based Medicine's coverage of the placebo effect. Also a great listing of common logical fallacies to watch for.

Monday, April 14, 2008

Get Your Priorities Strait

The following is a letter I sent to Obama's campaign last week after hearing that he and McCain both rejected invitations to the Science Debate 2008. Clinton's campaign did not respond at all.

All of the candidates have disappointed me on this, particularly in light of the "Compassion Forum" Obama and Clinton took time for Sunday. The following is what I sent, but the sentiment holds for all the candidates:

I am a signee to the petition for the presidential candidates to participate in a 2008 debate focused on science. As a signee, I received an email today saying that none of the candidates accepted, but also that Sen. Obama actively declined.

Your campaign has consistently been at the forefront on science and technology issues; this is in fact one of the many things that drew me to your candidacy. This is why it greatly confuses me and also disappoints me to see you decline this opportunity to bring science back to the limelight.

Our nation has suffered under a president who doesn't believe in science for the past eight years. It has been eight years of inaction on global warming. We have fallen eight years behind on stem cells advancements. And most importantly we have consistently for the past eight years fallen in international science education levels.

We need a president who will turn this situation around. I believe that you are the candidate to do it - so much so that I am currently a state level delegate for you hoping to become a national delegate from Missouri. Please take the lead on this.

Thank you for your time,
John

Tuesday, January 15, 2008

Break Down of the Issues - Part 3

Domestic Policy

Domestic policy will be broken up into numerous sections as the candidates go in depth on plans for numerous topics. Check out part 1, part 2, part 4, part 5 part 6 and part 7. Again, all of these policy statements are taken from the candidates' campaign websites.

In this post I also want to make a request. Science has been the 800 lb gorilla in the room for the past several years. The candidates and the debates, unfortunately, give only passing mention of the real issues in science today. This is why I support the call for a full science debate this presidential election cycle. Please join me and thousands of others in supporting this debate.

Hillary Clinton John Edwards Barack Obama
Science and Technology
Link Link
Link
Link
Research and Funding
  • Increase NSF, DOE's Office of Science, and DOD funding 50% over 10 years
  • Increase NIH funding 50% in 5 years, 100% in 10 years
  • Require 8% of federal research funding go to "high risk" studies
  • Have agencies create innovation awards, along the lines of the X-Prize
  • Make the Research and Experimentation tax credit permanent
  • Include diversity criteria when awarding grants to give women and minorities greater opportunities
  • Make the Research and Experimentation tax credit permanent
  • Increase NIH/NSF funding
  • Make the Research and Experimentation tax credit permanent
  • Double research agency funding
Internet
  • Tax incentives to increase broadband deployment
  • No clear net neutrality stance since starting her campaign, did co-sponsor legislation before the campaign with Senator Obama meant to enforce it.
  • 100% broadband coverage by 2010
  • FCC must enforce net neutrality
  • Universal broadband coverage through the auspices of the Universal Service Fund
  • Increase the minimum speed that qualifies as broadband from the current 200 kbps
  • Supports net neutrality; co-sponsored a bill with Senator Clinton meant to enforce it
  • Protect personal privacy through new regulations on surveillance and data collection
  • Create "Public Media 2.0" to promote internet safety, etc. to children
  • Require distribution of tools to allow parents to regulate internet content
Please see also my previous post on education as the candidates also intend to increase science and math education

Tuesday, November 20, 2007

Hold some balloons back

I'm sure all of you have heard about the recent stem cell breakthrough. This is great news, if it pans out. My greatest fear, as echoed by Wired, is that we are going to throw away all of the research done so far in other methods for the glimmer of hope these as yet unproven methods promise. Already some organizations are lighting up the lines to kill all research into embryonic stem cell research.

If these techniques turn out to reliably produce quality, pluripotent stem cells, it will greatly, if not completely reduce the need for embryonic stem cell therapies. These techniques have not yet been thoroughly vetted, however, and the experiments haven't yet been reproduced. These are also very new stem cell lines and any mutations or other side effects of the methods have yet to be found.

As one of the scientists working on the project, Junying Yu, has said, "Nobody knows exactly what happens, but when we introduce the genes, it basically changes gene expression inside the cell, and that changes the fate of the skin cells." It is this uncertainty, from the experts themselves, that has me hold back my optimism. There is also the fact that even current pluripotent embryonic stem cells can't always be coaxed into forming certain cells. So far the University of Wisconsin study has been able to grow heart, muscle and brain tissue. Very key tissues, especially in Parkinson's, Alzheimer's, and heart disease studies, but still newly made.

Please, throw these studies more money, but don't stop sending money to other, more proven methods, even if those methods aren't accepted by all.