NAET-A cure for allergies (NOT!)

I have mentioned Dr. Deva Khalsa before, hawking magic water, making unsubstantiated claims about the health value of garlic, and so on. However, I recently ran across an article written by her in the pseudo-journal Integrative Veterinary Care (IVC) which surpasses anything I’ve seen from her before. I would be tempted to put this post in the “Humor” category if it weren’t for the real risk that such nonsense can pose to veterinary patients when their owners believe it.

Khalsa, D. NAET- A cure for the allergy epidemic. Integrative Veterinary Care. 2015;5(4);42-45.

She begins by blaming allergies, which are, of course, a real and serious health problem, on all the usual bogeymen of alternative vets, “over-vaccination, GMO foods, and environmental chemicals and toxins.” This is the sort of claim so deeply rooted in the faith of alternative medicine that it seems self-evident, so naturally no evidence is provided. As it happens, there isn’t any good evidence to support these claims, which are at best unproven hypotheses. If these notions actually turn out to have some validity at some point, of course, it still won’t have anything to do with the dramatic claim that forms the centerpiece of Dr. Khalsa’s article; that allergies can be cured by the simple methods she describes. It seems odd that such simple and effective therapies exist and yet allergies, unlike infectious diseases for which there are simple and effective vaccinations, don’t seem to be going away….

The method she discusses is called NAET- Nambudripad’s Allergy Elimination Technique, after the acupuncturist and chiropractor whom made it up, “while searching for solutions to her lifelong allergies, and surviving on the two foods she could safely eat-white rice and broccoli.” NAET is claimed to “reprogram” the immune system to not respond inappropriately to allergens, thus curing the allergy.

The origin myth for this practice is itself both hysterical and reason to doubt the miraculous claims made for it:

One day, after eating a carrot (a known antigen for [Dr. Nambudripad]), she developed an immediate and severe allergic reaction. She quickly needled some of her own acupuncture points, but passed out while still holding onto the carrot. Upon awakening, she reported a great feeling of peace, and discovered she was no longer allergic to carrots.

Somehow, this bizarre epiphany led to a revolutionary method of curing allergies. Once again, we are taught that despite the dramatic and unprecedented improvements in health and longevity that followed the advent of the scientific method, we apparently could achieve greater success if we eschewed scientific research and relied on individual intuition and random revelations of this sort.

The first step in employing the NAET cure is to identify the allergy triggers through applied kinesiology, a form of diagnostic quackery often favored by chiropractors. In humans, this usually involves some variation of asking a patient to resist downward pressure on an extended arm with and without the nearby presence of a suspected allergen. Supposedly, the patient becomes detectably weaker in the mere presence of the offending substance. This, of course, is voodoo which ignores the complex and well-established physiology of allergies, and it is ultimately a kind of “energy medicine” or faith healing practice.

In veterinary medicine, applied kinesiology becomes one step more ridiculous. Since the patient cannot be instructed to resist pressure and fooled into feeling weaker when a potential allergen is nearby, the method often involves bringing the potential allergen near the patient while asking the owner to touch the patient with one hand and resist the pressure on their other arm, acting as a proxy for their pet’s reaction. That anyone with a medical degree could believe that it is possible to diagnose allergies in a dog by waving a jar of wheat over the dog and pushing on their owner’s arm is at once mind boggling and sad.

Once the offending substances are identified, the cure can commence. This simply requires bringing the allergen close to the patient, always held in a glass container, and then applying acupressure to specific points on the back. Even more amazing, this method can be used to cure even life-threatening autoimmune diseases. “As an example, a dog with autoimmune hemolytic anemia can be treated with his own blood in a glass vial.”

It is probably unnecessary to point out that there is no scientific evidence to support the theory or methods of NAET. No controlled research has been conducted on the treatment (nor should it be, since it would be unethical abuse of patients and waste of resources to perform a clinical trial on such voodoo), and numerous groups of allergy treatment specialists warn against the use of applied kinesiology and other bogus allergy diagnostic and treatment methods.

According to Dr. Khalsa, this magical restoration of normal energy flow in the patient, “moves the treatment of allergies out of the world of biology and into the world of physics.” I would be inclined to say instead that this approach moves the treatment of allergies out of the world of medicine and into the world of fantasy.

 

 

 

 

Posted in Humor, Miscellaneous CAVM | 47 Comments

Homeopathy for Canine Parvo and Distemper: Dangerous and Unethical

I’ve written a lot about homeopathy over the years. I have investigated and summarized the scientific evidence, looked into the history and philosophy behind the practice, and even taken an online introductory course in this type of witchcraft so that I could fully understand the claims and the truth behind the practice. As a relatively minor therapy (less than 2% of adults in the U.S. use it in any given year and less than 4% have ever tried it) which usually involves giving only water or sugar pills to patients, one might wonder why this bit of nonsense is worth the trouble of debunking. Unfortunately, the fact is that the practice, and the irrational beliefs associated with it, can still harm and even kill patients.

I have pointed out before how some veterinary homeopaths make recommendations for homeopathy or against scientific medicine that can cause great harm to patients, (1, 2, 3, 4, 5). However, I still feel it is important that people see how consistently delusional and dangerous these vets can be, since they manage to appear reasonable, and even supportive of science, when they are marketing their practices to pet owner sand conventional veterinarians. Talking amongst themselves, however, they freely make claims that are so obviously untrue and ridiculous that it should be clear to most people that their advice is best rejected. I recently came across yet another example in the faux veterinary journal Integrative Veterinary Care (IVC).

Cooney, T. Homeopathic treatment for epidemic diseases: Focus on parvo and distemper. Integrative Veterinary Care. 2015;5(4);54-58.

Given the overwhelming evidence that homeopathic remedies cannot prevent or treat diseases, recommending their use for any condition is irrational. However, recommending the use of homeopathy for serious, life-threatening disease is dangerous and unethical. Even the World Health Organization (WHO), which for political reasons is often quite reluctant to criticize alternative therapies regardless of the evidence, has issued a warning that homeopathy should not be used in preference to science-based medicine for serious illnesses. And the National Center for Complementary and Alternative Medicine (NCCAM), another political agency very friendly to CAM, also warns that there is no evidence  homeopathy can prevent of treat any disease.

Dr. Conney begins by citing a very old lie from the homeopathy marketing kit, that homeopathic treatment has been proven effective in epidemics of infectious disease by its use against influenza in the pandemics of the early 20th century. The specifics of these sorts of studies and claims have been discussed by others (Cuba 2007, Cuba 2007, 1918 Flu Epidemic), but there are several obvious problems with them. For one thing, they are often based on uncontrolled reporting and case selection by proponents of homeopathy. Undoubtedly, homeopaths in 1918 claimed a very low mortality from the flu, without objective statistics (which are, shockingly, not available from 100years ago), there is no way to verify these claims.

Additionally, conventional medicine in the early 20th century was itself not science-based, and the early apparent successes of homeopathy were simply a reflection of the fact that an inactive treatment that did nothing was less likely to harm the patient than bloodletting, purgatives, and other pseudoscientific mainstream therapies of the time. Conventional medicine, however, has moved on and learned to use science to weed out ineffective therapies or those that do more harm than good, while homeopathy is still true to its unscientific 19th century superstitions.

Dr. Cooney continues making things up through the rest of the article. He claims, for example, to have collected “clinical data” showing that puppies who get parvovirus infections after having been vaccinated are less likely to survive than infected puppies who have never been vaccinated, and that puppies receiving homeopathic nosodes (a type of fake vaccine) had the highest survival rate. By “clinical data,” of course, Dr. Cooney means his own uncontrolled observations, which shockingly turn out to support exactly what he believed in the first place. One wonders why science is needed at all if we can prove ourselves right just by looking at our patients and seeing what we want and expect to see.

The clinical evidence of controlled research, of course, has proven the tremendous efficacy of parvovirus vaccines. Properly vaccinated puppies are so unlikely to get the infection that the companies making the vaccine ware willing to pay all medical costs for any pup who has been vaccinated on schedule and gets parvo. This, of course, virtually never happens, which is why they are willing to make this sort of guarantee. Nosodes, on the other hand, have been demonstrated not to be effective for parvovirus or other serious infectious diseases.*

Dr. Cooney provides no scientific evidence for his dramatic claims, he merely repeats some anecdotes from his own practice, which prove nothing other than his ability to see what he expects to see. For more on the unreliability of anecdotes and testimonials like these, see these articles:

Why We’re Often Wrong

The Role of Anecdotes in Science-Based Medicine

Why We Need Science: “I saw it with my own eyes” Is Not Enough

Don’t Believe your Eyes (or Your Brain)

Medical Miracles: Should We Believe?

Testimonials Lie

Alternative medicine and placebo effects in pets

Dr. Cooney makes the same sort of unsupportable claims about canine distemper, another deadly viral infection. He admits it is quite rare and that he hardly ever sees a case, though he neglects to mention that this is because of widespread vaccination. However, he brazenly claims that when the infection does occur, “yields the only hopeful outcome in most cases.” He supports assertion, of course, only with a testimonial from another veterinary homeopath and his own personal experiences.

Dr. Cooney derides conventional treatment as “’anti’ drugs like anti-emetics, anti-diarrheals, anti-nausea meds, antibiotics” and so on because in the twisted logic of homeopathy, treating the life-threating clinical effects of disease and the suffering they cause is a mistake. The body should be allowed to “vent the disease,” apparently even if it torments or kills the patient in doing so.

Undoubtedly, many of the patients Dr. Conney treats for parvo and distemper survive. This is likely due in part to misdiagnosis, since distemper is rare and difficult to diagnose, and he claims to see parvo regularly in vaccinated puppies despite the 99% effectiveness of the vaccine in preventing the disease. It is always easier to cure a life-threatening disease with fake medicine when the patient doesn’t actually have the disease in the first place.

It is also the case that Dr. Cooney apparently provides at least some of the standard supportive care, including intravenous fluids. With appropriate supportive care, about 50% of distemper cases survive, and about 80-95% of parvo cases survive. It would take an objective, controlled scientific study to prove what seems very likely to be the case, that Dr. Cooney’s use of fake medicines and avoidance of science-based treatments probably leads to a higher mortality rate among those true parvo and distemper cases he sees than those treated appropriately. However, even without such a study it seems obvious that for a licensed veterinarian to promote such pseudoscience and discourage accepted medical treatment for life-threating, and completely preventable, infectious diseases is dangerous unethical.

 

* Holmes MA, Cockcroft PD, Booth CE, Heath MF. Controlled clinical trial of the effect of a homoeopathic nosode on the somatic cell counts in the milk of clinically normal dairy cows. Vet Rec 2005; 156:565-567.

Larson L., Wynn S., and Schultz R.D. A Canine Parvovirus Nosode Study. Proceedings of the Second Annual Midwest Holistic Veterinary Conference 1996.

 

 

 

 

Posted in Homeopathy | 11 Comments

SkeptVet’s Acupuncture Adventure- Part 3: Acupuncture and the Evidence

Acupuncture and the Evidence
I have spent several hours, now, listening to lectures discussing scientific evidence and acupuncture. I have also made an effort to find and read many of the specific papers discussed so that I can evaluate their strengths and weaknesses for myself. The instructors for this course have taken a varied and somewhat scattered approach to discussing the scientific evidence, but their presentations seem to fall into three broad categories: discussions of animal model studies investigating the physiologic effects of needling and electrical stimulation of tissues with needles; discussions of the nature of placebo effects; and discussion of the epistemology of science and evidence-based medicine.

The framework for the discussion, of course, begins with the assumption that acupuncture, in some form for at least some conditions, is an effective therapy. This appears to be based predominantly on personal clinical experience. Science is then seen as a means for validating this fact and understanding the mechanisms and application of acupuncture in more detail. The appropriate null hypothesis, that acupuncture has no clinically meaningful beneficial effects, seems to be off the table, which undermines somewhat the instructors’ claims to be approaching this therapy in a truly scientific and evidence-based way. Nevertheless, bias does not itself prove a belief is wrong, only that it may not be based entirely on a rational assessment of the evidence. So I have tried to evaluate the evidence and arguments presented on their own merits.

Pre-clinical Acupuncture Research
This has always been the strongest element in the arguments for acupuncture. There is abundant research evidence that there are physiologic responses to the stimuli generally employed by acupuncturists: dry needling and electrical stimulation via acupuncture needles. And there are plausible mechanisms by which some of these responses could result in clinically meaningful benefits for a number of symptoms. While it remains unclear that any particular needling locations have more or better effects than any other (1, 2), there are undeniably effects to  needling and so-called electroacupuncture.

The instructors cite a number of research studies to illustrate specific effects of acupuncture and to at least imply that these represent mechanisms for clinical benefits. Up to this point in the course, these studies are mostly rat models for pain or gastrointestinal motility, and they often focus on the activity or expression of particular neurotransmitters or other neuroactive compounds, ion channels, or other signaling mechanisms within the nervous system. I think the evidence is convincing insofar as needling and electrical stimulation have measurable physiological effects.

However, this is a long way from demonstrating these techniques are effective clinical therapies. Those the effects identified might be mechanisms for clinical benefits, this has to be demonstrated at all levels, from the animal model to the clinical trial, and this has generally not been done. And it is clear that many other stimuli have similar effects. Pinching the skin or needling without penetration or even hitting your thumb with a hammer have measurable effects that could conceivably modify pain, blood pressure, or other variables affected by the nervous system. An effective therapy is not simply any intervention that does something, but an intervention than consistently and reliable does something specific and desirable in a particular patient population. This cannot be proven in lab animal studies, for acupuncture or any other potential therapy.

The studies cited, like all research, have plenty of limitations that have to be acknowledged. Often, there is a lack of blinding or control stimulation, and again the vast majority seem to involve electro-acupuncture, which begs the question of whether needling in predetermined locations traditionally sued by acupuncturists is itself the source of the observed effects, or if electrical stimulation is the treatment actually being studied.

So far, these lectures have added some depth to my understanding of the specific, and quite varied, effects of needling and electrical stimulation, but this is low-level evidence that only supports the claim that acupuncture might be a useful clinical therapy, not the claim that it actually is. That has to be demonstrated by clinical trials.

Clinical Trial Evidence
So what does the clinical trial evidence say about acupuncture. Well, it is a bit tricky. It is difficult to do a well-controlled acupuncture study because it is difficult to effectively employ some of the best methods to control for bias and placebo effects; a placebo control and blinding of patients and therapists to whether placebo of real acupuncture is being used. Patients, especially those with previous experience of acupuncture, can often tell if they are in the treatment or control group, and acupuncturists always know. This makes the results of most trials somewhat unreliable.

There are many, many studies of acupuncture, most of pretty poor quality or high risk for bias. When these are aggregated and assessed for quality in systematic reviews, generally there is no consistent difference between real and sham acupuncture, though both do better in terms of subjective outcomes like pain than no treatment at all or less dramatic ineffective therapies. This evidence is most consistent with acupuncture being mostly a placebo therapy, with perhaps some small effects on pain and other symptoms via non-specific mechanisms.

To their credit, the instructors in this course acknowledge that from an evidence-based perspective, the clinical trial literature does not support much efficacy for acupuncture.

[Acupuncture] activates the brain in areas that are activated when patients take a placebo, thinking it may be a real treatment.

Non-specific effects of needling ANYWHERE activate similar brain regions, but many studies use “non-verum” points as the placebo.

Unsurprisingly, in the vast majority of RCTs studying acupuncture, the treatment is superior to non-treatment, but not superior to placebo.

The most appropriate conclusion to draw from this, using a science-based perspective, would be that acupuncture is likely merely a placebo and does not have predictable, meaningful clinical effects beyond placebo. However, you can imagine the cognitive dissonance accepting such a conclusion would induce in folks not only practicing but teaching acupuncture, and of course the instructors do not come to this conclusion. They appear genuinely committed on some level to the science-based view. However, they also clearly believe acupuncture is effective based on their personal clinical experiences. When the science supports this, they are happy to rely on it. But when the science does not support their experiences, they begin looking for ways to explain the results that do not require giving up their beliefs.  Most of the rest of the lectures on evidence for acupuncture consist of this sort of salvage operation, attempting to explain why an effective therapy consistently fails to be validated in clinical trials. This involves redefining placebo effects, challenging the methods of clinical trials, and a lot of goalpost moving.

Placebos
These lectures spend a lot of time discussing the nature of placebo effects, and they make a number of troubling claims about placebos that suggest a fundamental misunderstanding of the nature of controlled scientific research. This understanding is most often and articulately represented by the work of Ted Kaptchuk, a proponent of Chinese medicine and a researcher into the nature of placebo effects. Dr. Kaptchuk’s research is interesting, but the conclusions and claims he makes are quite controversial, though they are presented in this course as established science.

One idea that the instructors try to suggest is that placebo effects may not be simply the false perception of improvement in one’s symptoms but real healing.

The meanings and expectations created by the interaction of doctors and patients matter physically, not just subjectively.

This is an idea Ted Kaptchuk has suggested as well, and it is really a rationalization to preserve belief in a therapy that does not outperform placebos in clinical trials. The reason placebos are used, and part of the reason clinical trials have proven so much more effective than individual experience in evaluating medical therapies is that placebos represent a collection of errors that create the impression of improvement without a real, objective change in health.

One of the best explanations for what goes into the placebo effects seen in clinical trials comes from Science-based Medicine in a translation of a French article.  This graphic illustrates the relationship between research placebos and actual healing.

placebo

Many different kinds of error feed into the apparent improvement experienced by patients getting placebos in clinical trials, but these do not represent actual , objective healing caused by the placebo therapy. A number of studies have looked at the question of whether or not placebos have meaningful clinical benefits, as opposed to simply creating the perception of improvement in subjective symptoms while leaving objective measures of health unchanged, and the conclusions do not support the “powerful placebo” idea.

Asbjørn Hróbjartsson, M.D., and Peter C. Gøtzsche, M.D., Is the Placebo Powerless? — An Analysis of Clinical Trials Comparing Placebo with No Treatment. Engl J Med 2001; 344:1594-1602.

Conclusions

We found little evidence in general that placebos had powerful clinical effects. Although placebos had no significant effects on objective or binary outcomes, they had possible small benefits in studies with continuous subjective outcomes and for the treatment of pain. Outside the setting of clinical trials, there is no justification for the use of placebos.

Hróbjartsson A, Gøtzsche PC. Placebo interventions for all clinical conditions. Cochrane Database Syst Rev.2010 Jan 20;(1):CD003974. doi: 10.1002/14651858.CD003974.pub3.

Authors’ conclusions:

We did not find that placebo interventions have important clinical effects in general. However, in certain settings placebo interventions can influence patient-reported outcomes, especially pain and nausea, though it is difficult to distinguish patient-reported effects of placebo from biased reporting. The effect on pain varied, even among trials with low risk of bias, from negligible to clinically important. Variations in the effect of placebo were partly explained by variations in how trials were conducted and how patients were informed.

Meta-regression analyses showed that larger effects of placebo interventions were associated with physical placebo interventions (e.g. sham acupuncture), patient-involved outcomes (patient-reported outcomes and observer-reported outcomes involving patient cooperation), small trials, and trials with the explicit purpose of studying placebo. Larger effects of placebo were also found in trials that did not inform patients about the possible placebo intervention.

The literature best supports the traditional idea that placebos fool patients (or, in the case of veterinary medicine, clients and vets) into thinking their condition is improved when it is not by objective measures. Some acupuncture studies illustrate this patter, including one I’ve written about before  involving sham acupuncture as a treatment for acute asthma attacks.

Wechsler, ME. Kelley, JM. Ph.D. Boyd, IOE. Dutile,S. Marigowda, G. Kirsch, I. Israel, E. Kaptchuk, TJ. Active albuterol or placebo, sham acupuncture, or no intervention in asthma. N Engl J Med 2011; 365:119-126

In addition to asking the patients how they felt after each treatment, the investigators also measured their lung function, using an instrument that records, among other data, how much air the patients could force out of their lungs in a given period of time. It turns out that this objective measure showed a 20% improvement with the bronchodilator inhaler, but a significantly lower 7% improvement with the inert therapies or no treatment at all. So while the patients couldn’t tell the difference between real and fake therapies, their lungs certainly could.

As David Gorski from Science-based Medicine put it,

[This finding] indicated how dangerous it could be to rely on placebo effects to treat asthma in that it could easily result in the death of your patients by lulling them into a false sense of security of not feeling short of breath when, from a physiologic standpoint, they are on the knife’s edge of respiratory failure.

The instructors refer to this study, but they draw a very different lesson from it than I do. To them, it illustrates the second idea concerning placebos which they suggest might justify acupuncture even if it has no more than a placebo effect, which is that the outcomes of interest ultimately should be the patient experience, not necessarily objective measures of health and disease. As one put it,

A patient centered approach requires that patient-preferred outcomes trump the judgment of the physician.

This strikes me as a dangerous approach to medicine. It is true, of course, that the ultimate goal of medical treatment is the total well-being of the patient. And for humans, at least, the values and goals of the patient are a major determinant of what constitutes well-being. However, there is a reason patients seek the advice and guidance of doctors. Our training and experience gives us a perspective that is different from the patient’s and useful to them. And part of this perspective is an understanding that subjective symptoms are influenced by many factors besides the true trajectory of a disease or overall health. Something can make you feel better without making you truly physically better, and if doctors have methods of assessing this that patients do not have, it is our duty to put this knowledge to the service of the patient’s overall well-being, even if it may sometimes conflict with their short-term perceptions of their symptoms.

In the case of entirely subjective symptoms, of course, the experience of relief is relief, and it cannot reasonably be declared “unreal” without wading into the philosophical morass of qualia, which I try to avoid. However, the experience of symptomatic relief, valuable as it may be in itself, should not be confused with true amelioration of disease or restoration of health. If asthmatics feel temporarily better with placebo therapy, that doesn’t mean we have restored their well-being. Placebo effects, remember, tend to be mild, short-term, and not associated with significant, sustained improvement in health condition.

What the instructors also fail to acknowledge is that placebo effects which lead to subjective experience of relief occur with truly, objectively effective therapies as well as with placebos. We can have both effective treatment and symptomatic relief, and there is no need to settle for only perceived improvement. In fact, I would argue that it is unethical to rely on a placebo therapy to make patients feel better when there are objectively effective therapies available. And when there are not, we are obliged to inform patients of this even if it diminishes our ability to use placebos to relieve their symptoms by fooling them into thinking we have improved their physical health.

Finally, the issue of placebo effects is complicated in veterinary medicine by the fact that some of the effects in the diagram above, those based on belief and expectation, don’t apply to veterinary patients. We can’t fool our pets into feeling better with placebos. However, we can fool their owners and ourselves into believing we have made them feel better when we haven’t. This makes the use of placebos doubly dangerous and unethical in veterinary medicine.

Imperfect Science
The instructors spend some time discussing flaws and sources of bias and error in clinical trials of acupuncture and in the methodology of systematic reviews and meta-analyses used to summarize clinical trial research. The majority of these criticisms are quite valid. There is no question that medical science is, like all human endeavors, deeply flawed and subject to bias and error. I have written about the problematic nature of much research evidence myself, and I actually just completed a master’s thesis specifically looking at some quality measures of veterinary clinical trials, which are far, far from ideal in many ways (hopefully something from this will be published reasonably soon). So questioning the reliability of the scientific literature is fair game, and it is not inconceivable that the benefits of acupuncture could be greater than they appear due to methodological problems with how it is studied.

That said, this begs the question of how else we evaluate therapies like acupuncture. Science is imperfect, but it is far, far superior to any other method we have ever used. The dramatic and unprecedented improvements in human health and longevity that have been brought about by the application of controlled scientific research to health, nutrition, and other related areas, are undeniable. If we must make judgments, and we must make them on the basis of the evidence we have rather than the ideal evidence we would like to have, then what can we rely on that is better than clinical research? While they might not admit it, I suspect deep down the instructors of this course believe their personal experiences are compelling proof that acupuncture is effective, and they find the inability of clinical science to confirm this to be more likely a failing of the research than of acupuncture. The potential bias in this view is obvious. My own view is that we are more likely to come to the right answer more often if we rely on scientific research, flawed as it is, than if we trust out personal experiences.

Bottom Line
The instructors present reasonably good evidence that acupuncture (dry needling and electrical stimulation) have wide-ranging physiologic effects that could plausibly have local and distant clinical benefits. They acknowledge, however, that clinical trials have not tended to support a meaningful, consistent benefit above placebo for acupuncture. Unfortunately, despite their ostensible commitment to evidence-based medicine, they appear to have a strong belief in the efficacy of acupuncture based on their personal experiences, and this has led the to respond to the absence of good clinical trial evidence for the practice by questioning the appropriateness of the methods and outcomes used to obtain this evidence rather than their belief in acupuncture.

The reinterpretation of placebo effects suggested in the course materials, as either true measures of real healing or as sufficient endpoints for therapy in themselves, seem misguided. While symptomatic relief is an important goal for patients, it is not sufficient in itself if it leaves the underlying disease unimproved. And such placebo effects can be obtained as easily by therapies with measurable objective benefits as by placebos. Offering placebos alone is ethically questionable, particularly if patients are misled into believing they are truly effective treatments, and it can harm patients if it creates a false impression of improvement.

The critiques offered of clinical trials and higher level scientific evidence are often valid. But they beg the question of what should be used instead to evaluate therapies such as acupuncture. The implication, that personal experience of success is sufficient reason to utilize a therapy despite an inability to validate its effects through clinical research, seems to suggest that such experiences are as or more reliable than controlled research. The history of science and medicine, and the state of human health, argue strongly against this view.

Posted in Acupuncture | 3 Comments

Another Systematic Review of Veterinary Homeopathy (Nope, it Still Doesn’t Work)

I have reviewed the overall evidence concerning homeopathy, from basic science through clinical trial research in great detail previously. Despite more than 150 years of effort by advocates for this practice, virtually no reliable evidence has been developed to show it can work or does work.

The same conclusion has been reached by many others, from the systematic reviews of homeopathic trials and systematic reviews of these systematic reviews, to the formal investigations of governmental agencies such as the British House of Commons Science and Technology Committee and the Australian National Health and Medical research Council. While homeopaths have had more than a century to try, they have not been able to produce a body of scientific evidence to convince anyone but themselves that homeopathy works.

However, homeopaths crave the legitimacy (and boost to their business) that comes from the appearance of scientific validation, so they continue to produce publications intended to create this appearance. A series of publications have been produced by a group of homeopaths employed by a homeopathic organization specifically to produce pro-homeopathic literature. This includes a number of systematic reviews. I have discussed one of these in detail previously. The study reviewed placebo-controlled randomized clinical trials of homeopathy. Despite grand claims of a robust evidence base, even these dedicated advocates could find almost no suggestion of an effect.

So the best that two committed supporters of homeopathy could find when attempting an objective evaluation of the veterinary homeopathy literature were two studies that were probably pretty reliably conducted, one of which found an effect and one of which didn’t. Once again, in the face of the inherent implausibility of the practice (despite the nonsense about “nanoparticles” which these authors themselves reference as if it solved the plausibility problem), and a century and a half of dedicated effort, such a glaring lack of positive evidence is far more consistent with homeopathy being a placebo than with it being the dramatically effective therapy its proponents claim.

However, for propaganda purposes, simply being able to cite studies and reviews creates the impression there is some reason to think homeopathy might work, so the authors have gone on to produce another review, this time of studies using something other than a placebo control.

Mathie, RT. Clausen, J. Veterinary homeopathy: Systematic review of medical conditions studied by randomised trials controlled by other than placebo. BMC Veterinary Research 2015, 11:236.

Like their other reviews, this one found no high-quality research evidence to support a beneficial effect for homeopathy. The studies reviewed were of generally poor quality and did not effectively control for bias and other sources of error. This is routine for homeopathy research and so not surprising. Given the implausibility of the premises behind homeopathy and the failure to find clear, meaningful effects in good quality research for over a century, once again the only rational conclusion is that homeopathy doesn’t work and that it is time to give up on it.

As I’ve argued before, science and evidence-based medicine are worthless if we can never reach a conclusion or reject any therapy no matter how many failed attempts we have made to find evidence it is effective. The absence of evidence absolutely can be evidence of absence and a reason to stop wasting resources on an idea once adequate efforts have been made. If this is not true, than science will never be able to reject any idea no matter how implausible, and we effectively surrender the most effective tool ever discovered for finding out the truth about nature.

However, belief counts for more than evidence with homeopaths, and science is merely a marketing tool, not a means to discover the truth about the practice. So these authors portray the absence of evidence in this study not as still more evidence of the absence of an effect but as a reason for yet more research:

Due to their extremely poor quality, OTP-controlled trials are incapable of providing useful additional insight into the effectiveness of homeopathic treatment or prophylaxis in animals. To clarify the matter, new and substantially improved OTP-controlled research in both individualised and non-individualised veterinary homeopathy is strongly indicated.

The opposite is actually true. Further research is strongly contraindicated. There is a tremendous shortage of good-quality research evidence in veterinary medicine, and more and better evidence is desperately needed to support effective clinical practice. Wasting precious and scarce resources on hare-brained ideas that have failed to prove their worth hundreds of times over for decades is not a rational, appropriate or ethical choice.

 

Posted in Homeopathy | 3 Comments

More Faith Healing Masquerading as “Holistic Veterinary Medicine”

I’ve often written about the problem of confusing religion with medicine. In religion, one is allowed to make any claims one likes, and the only evidence required is faith. In medicine, one is required to provide evidence to support claims about health and disease, and that evidence must come from science, not simply belief or opinion. This distinction is part of the reason for the unprecedented and dramatic success of medicine at improving health and lengthening life in the last couple of centuries, something thousands of years of faith-based healing was unable to accomplish.

The problem with faith-based claims is that one has complete freedom to claim absolutely anything, and there is no way any claim can be disproven. Everything must be allowed to be true if one believes it, in which case the distinction between truth and falsehood become meaningless. Clients and patients are totally at the mercy of individual practitioner’s personal beliefs and practices, since there is no objective basis on which to judge their claims or actions. This total reliance on the whims and beliefs of one individual, presented as universal truth, has been a tremendous impediment to real knowledge and progress in the history of medicine.

I have no objection to people practicing whatever religion they like, or none at all. However, when they present their religious beliefs as medicine, they are deceiving the public and endangering patients. Sometimes, this takes subtle forms, such as claiming that Chinese Medicine is a rational system of diagnostic and therapeutic practices, when it is really a hodgepodge of philosophical, religious, and traditional practices almost entirely incompatible with science. However, in some cases the conflation of religion and medicine, belief and evidence, takes such a blatant form that it seems transparently fraudulent to call one’s practices anything other than faith healing.

It requires tremendous arrogance, always hidden behind a mask of humility of course, to market oneself as having special insight denied to other doctors which lets you lead people and their pets to “real” health despite the deep and dangerous misunderstanding of the universe that cripples the rest of the medical profession and most of society. I recently found a stunning example of this phenomenon, which I think illustrates the danger hidden behind the benign tone and marketing of religion pretending to be medicine.

Dr. Dennis Thomas, like many self-identified “holistic vets” puts his mainstream medical credentials front and center when promoting himself and his services while simultaneously denigrating scientific medicine (mislabeled as “Western Medicine,” of course, as if no one outside of Europe or North America relied on science-based medicine as their primary form of healthcare, when in fact this is the predominant form of healthcare everywhere in the world to the whatever extent local resources allow).  He clearly wants to share the legitimacy that is attached to science while simultaneously rejecting its fundamental principles and its conclusions.

…the physical body exists simultaneously as both a material body and an energetic body. It also includes the awareness that the material body’s function, both in health and disease, follows specific science and logic, and that the energetic body’s function, in both health and disease, follows a different science and logic.***

This implies that the system he believes in for optimizing the patient’s spiritual energy is somehow equivalent to the system of developing knowledge about the physical world we call science, despite the fact that this system rejecting entirely the methods sciences uses.

Traditional medicine… specifically focuses on the material body and uses evidence based on the science and laws of the material world. This has proven to be very effective in handling health care from that perspective. However, traditional, allopathic medicine, completely ignores the existence of an energetic body and the energetic influences that have great affects on the manifestation of health in the material body. Using the science of quantum physics, we absolutely know that the energetic body not only influences the material body, but is also the major influence providing direction for the body’s functioning. Research indicates that the energetic influences are 100 times greater than the material or physical influences on cellular function. It seems logical that if we were to ignore the most important factors (energetic) that influence the body’s health, we would be severely limiting our ability to direct health and healing.”

Here Dr. Thomas claims that science-based medicine misses entirely the most important factor that influences health and disease, despite the abundant evidence to the contrary, and yet claims it is science itself which proves this to be true. Of course, the invocation of “quantum physics” to justify a fundamentally spiritual claim is a classic sign of quackery. Because quantum physics is a complex, fundamentally mathematical field, those of us not specializing in it understand it only shallowly through imprecise metaphors. It is easy to generalize these inappropriately to phenomena to which they don’t properly apply, and it is difficult to explain why this is inappropriate without utilizing mathematics most of us don’t understand. Ultimately, this is just another way of appealing to faith but calling it science.

Dr. Thomas, blithely dismisses the success of science-based medicine as “merely” addressing the physical body and then claims better results, without evidence, based on vague spiritual notions that he mislabels as science. This in itself is disingenuous and misleading. But it become much worse when he expands on his beliefs to make claims about the causes and effective treatments for disease that are completely made up and reflect only his beliefs and desires, not the nature of reality.

Bad, or distorted energy, might come from things in the environment, such as EMFs coming from nearby power lines.

Unhealthy energy can also come from computers or cell phones, microwaves, or many other sources.

The environment we and our pets live in is full of pollutants, toxins, and harmful microorganisms.  Our food supplies are laden with preservatives, GMOs, hormones, and additive fillers. No material body, including our pets’ bodies, can maintain health, and repair damage when it is compromised with over-vaccination, low quality nutrition, and less than optimal environmental conditions.

This is the usual sort of fear-mongering that alternative practitioners must engage in to build business. Telling people that even when they and their pets appear to be well, they are actually besieged by unseen dangerous eating away at their well-being is necessary if you want to sell unproven and unnecessary interventions. And claiming that scientific medicine ignores disease prevention, which is obviously untrue, seems more reasonable if you also claim a whole host of deadly threats science doesn’t recognize (because you made them up), or that science-based medicine actually promotes as beneficial. The absence of real evidence for these claims is not a problem, of course, because this style of “medicine” is really all about faith.

Dr. Thomas, however, goes beyond even most “holistic” vets who practice the same kinds of treatments he uses (Chinese medicine, alternative nutrition, “energy medicine,” and so on). He identifies the main cause of illness as not in the physical universe at all, but in the negative attitudes of the pet owner. That’s right, if you’re not serene and happy all the time, you are probably making your pets sick!

By far the most influential energy that your pet is exposed to is your overall energetic state. Yes, the major influence that directs your pets health and well being is your perceived state of being…. what my years of observation have taught me is that when our pet develops a chronic or fatal disease, the form of that disease often reflects our perspective on life…. the emotions we are experiencing, when we think about our pet’s health condition, are likely the emotions that participated in the development of the problem in the first place. It is as though the sick pet is a microcosm of the larger macrocosm of the caretaker’s perceived reality about life itself. If I am frustrated with life and this perception persists long enough, the energy that is created will influence my reality.

When I see a person who is chronically frustrated with their job, or relationships, it does not surprise me when their pet develops a chronic illness. And when someone views life as painful and fearful, the way their pet passes on may be influenced by that attitude.

Of course, these claims are not only unproven but highly unlikely to be true. Such “create your own reality” notions are a form of magical thinking which has been around for millennia without any measurable effect on health and well-being, compared the clearly beneficial effect of science in these areas. Or as Tim Minchin has put it, “ Throughout history, every mystery ever solved has turned out to be—NOT magic!”

But beyond being nonsense, these claims are a particularly cruel and self-serving form of the usual alternative medicine fear-mongering. Ultimately, anything bad that happens to your pets happened because you weren’t in the “right” state of mind. The state you should be in is simply Dr. Thomas vague personal syncretism, incorporating elements of various spiritual and philosophical traditions. In other words, the cure is as made-up as the cause.

While Dr. Thomas may very believe this stuff, the function of these claims is pretty convenient for his business. Create fear of dangers that science can’t detect or address, add a touch of guilt to the fear, and then offer the pet owner a way out that is, coincidentally, just the set of services you are selling. There is even a built-in excuse for any undeniable treatment failure:

The Healing Room is a one-room facility that is designed to promote and direct healing for you and your pet. Please be aware that any energy you bring into the room will affect the energetic balance of the entire room. Your pet’s natural state is one of calm attention. However, animals are sponge-like in their ability to absorb and take on the emotional states of their human companions. This can contribute to, or block the healing of an energetic imbalance.

That’s right. If your pet doesn’t get better, it’s probably because you messed up the “healing vibrations” with bad thoughts. It has nothing to do with the completely bogus nature of the causes of disease and treatments Dr. Thomas is selling.

Understand, I have nothing against taking spiritual comfort wherever you find it. I meditate and find some elements of Buddhist practice appealing and useful in my own life. But history makes an ironclad case for separating our spiritual beliefs from the causes and treatments for disease. Religion has never made effective medicine, and the emphasis in science on material, physical reality that folks like Dr. Thomas disdain has led to tremendous improvements in our health and well-being.

Belief and faith may fairly remain unchallenged when they address purely human constructs, such as art and morality and the meaning of life. But they are actively harmful and misleading when they encroach on domain of the natural world. Successful medicine throughout the world is based on science and scientific knowledge for the simple reason that is works better than any other approach, including the timeless musings of philosophers and spiritual leaders.

Dr. Thomas is entitled to evangelize for his spiritual beliefs as much as he wants. But it is misleading and wrong to confuse these with veterinary medicine, which is properly a science-based pursuit.

 

***All quotes come from these two sites: 1, 2

 

 

Posted in General | 4 Comments

SkeptVet’s Acupuncture Adventure- Part 2: Points and Channels

Having begun the online portion of my acupuncture course, I am beginning to get into the work of identifying, remembering, and locating the main acupuncture channels and points that are used for clinical treatment in several varieties of acupuncture. This section of the course touches on a key point I have discussed previously about acupuncture, namely do the points and channels acupuncturists use for needling exist in any verifiable sense?

Do Acupuncture Cannels and Points Exist?
TCM and other folkloric acupuncture styles utilize particular locations for needling based on maps or descriptions from historical sources, sometimes ancient but often more recent that you might think. Veterinary acupuncturists, in particular, utilize systems that are quite modern inventions since traditionally Chinese medicine did not involve fine needling as a therapy for animals. The rationales given for the locations of these points and channels are unscientific and unverifiable talk of energy forces, and historical research suggests they were dictated as much by astrological, philosophical, and religious principles as any observation of clinical effects in patients. As I have already pointed out, I don’t see any value in taking such unscientific approaches seriously.

Medical acupuncturists in more conventional, science-based practice, however, tend to try to rationalize the use of acupuncture maps adapted from traditional or folkloric sources by identifying measurable anatomic or functional features to the points chosen. They frequently claim that such points and channels can be consistently associated with nerves, locations where nerves divide or emerge from channels in bones (foramina), blood vessels and their associated innervation, tendons and ligaments, and the connective tissue planes that separate muscles and other structures (fascia). They may also claim that there are special features of the tissue in the region of acupuncture points identifiable with biopsy, with equipment testing electrical conductivity, or by other means. Some also claim that acupuncture points often correspond to “trigger points,” areas of pain or sensitivity which are themselves somewhat uncertain in definition. Stimulation of these sorts of structures could plausibly have physiological and even clinically beneficial effects since there are functionally important means of communication between different parts of the nervous system, and between nerves and other anatomic structures and organs.

The question then becomes what is the evidence for such claims? Are acupuncture channels and points just metaphoric ways of describing nerves and other anatomic structures that we understand in ways folk acupuncturists in history could not have? This is not an easy question to answer. A nice review of this subject by Dr. David Ramey points out that:

Research on the nature of acupuncture points and meridians is often difficult to evaluate because of the diverse nature of the claims made, incomplete data provided in published studies and the variety of parameters involved in the assessment of these claims. Many of the studies purporting to have identified acupuncture points or meridians come from China; the role of publication bias in Chinese literature needs to be considered in light of the fact that no trial published in China from 1966 through 1995 found a test treatment to be ineffective.

There is no question that if you take a particular channel or set of points from any acupuncture map and look at the anatomy underlying it, you can find all sorts of structures that could possibly respond to needling in potentially beneficial ways. But there are a number of problems with this strategy.

Acupuncture channels and points are quite vague and inconsistent between schools of acupuncture and individual acupuncturists. Some even in the acupuncture community have denied that the location of needling matters at all. And even among well-trained and experienced traditional acupuncturists, the identification of particular points can vary considerably. One study found the following:

This study took the approach of testing whether properly trained and experienced acupuncturists could consistently identify commonly used acupuncture points on a single patient. Twenty-three common points were selected and identified by the 71 test subjects. The area within which specific points were identified by 95% of the acupuncturists ranged from 2.7cm in diameter to 41.4cm in diameter.  Because of the variability with which experienced acupuncturists identified common acupuncture points, the authors concluded that to stimulate fake points as a placebo control for a clinical trial, it would be best to stimulate the skin at least 6cm away from the spot identified as the real point on the face or hands and at least 12cm away from a proposed real spot anywhere else on the body.

Given the vague nature of points and channels, and the fact that structures which might respond to needling are densely packed in nearly every part of the body, it is inevitable that any map at all is likely to overlie some structure that could be claimed to be the intended target of stimulation. It would be like dropping a large net on a sidewalk in Manhattan and then claiming that the location chosen was exactly the right one because some people were caught in the net. The same outcome would have happened wherever you dropped the net. Similarly, much clinical research shows that the apparent effects of acupuncture seem to be the same regardless of the location chosen for needling. Indeed, even some prominent acupuncturists have claimed that the location for needling is irrelevant.

The question of how folkloric practitioners could have come up with maps of anatomic structures that had not yet been discovered is also a bit problematic. Since it is clear that traditional systems for locating acupuncture points relied heavily of spiritual beliefs, astrology, and the like, it seems unlikely that they would be in any sense anatomically accurate. Some argue that by trial and error, acupuncturists might have found effective needling locations and then rationalized these with pre-scientific theories. This too seems unlikely, however, given how ineffective trial and error is in finding effective medical treatments, and also given the fact that early acupuncture was often a system for bloodletting, and the anatomic structures of interest would most likely have been blood vessels.

Nomenclature
The section of the course I am currently working on requires learning the names and locations of acupuncture channels and points. While the rationale given for the use of these points is based on the physiologic and anatomic arguments I have outlined, the nomenclature used is still that of traditional folkloric acupuncture. The WHO accepts an alphanumeric nomenclature and Chinese names for acupuncture points based on the traditional system, and these are used in this course. This system requires classification of channels as Yin or Yang based on designation of associated organs in order to help keep track of the point numbering system, even though the concepts of Yin and Yang are specifically rejected in the curriculum.

The reasoning here is that the use of this nomenclature is widespread and entrenched and facilitates communication between practitioners of different schools, so it must be tolerated. However, the use of these terms does not imply that the underlying metaphysics has anything to do with the function of the channels and points, which are intended to be defined and understood in terms of anatomic structures and physiological functions.

This may be innocuous, like referring to sunrise and sunset even though we now know that is an erroneous characterization of celestial mechanics, or referring to the days of the week and months of the year by the names of gods. Still, it seems unfortunate since it lends some sense of legitimacy to those who still actively use the system as if the metaphors were actual descriptions of reality. I would think that a serious commitment to a scientific approach to acupuncture might ultimately require renaming any maps of locations for needling used in terms of the actual anatomic structures or physiological functions they are supposedly associated with.

Bottom Line
While it makes sense that needles nerves, tendons, and other such structures could have beneficial effects, the evidence that traditional acupuncture maps have a meaningful or predictable relationship to these structures is weak. The associations claimed between acupuncture channels and points and identifiable anatomic structures seem more likely to be rationalizations after the fact for locations originally chosen without any actual understanding of or relationship to functional anatomy and retained as historical holdovers.

If the proposed effects of acupuncture really do relate to stimulation of nerves, myofascial planes, etc., it would make more sense to argue that the locations chosen for needling should be selected on the basis of the location of such structures and research showing functional responses to needle stimulation of them. There would then be no need for terms like Bladder 2 and Governor Vessel 12. We could simply say we are needling the radial nerve or the trigeminal nerve, and we would be more accurate and less associated with folkloric acupuncture practices.

 

Posted in Acupuncture | 10 Comments

SkeptVet’s Acupuncture Adventure- Part 1: Introduction

I have written extensively about acupuncture since it is one of the most widely used and accepted of the alternative therapies. It is also complex, with many different definitions, associated theories, and a huge body of relevant research evidence. Sorting through all of this to make a rational, evidence-based assessment of whether any of the various practices called acupuncture have legitimate, demonstrable medical value is challenging. Over the years, my assessment has evolved, so I want to start by summarizing how I currently view this practice.

What is Acupuncture?
A general definition of acupuncture that captures most of the claims and practices of modern practitioners would probably be something like, “the insertion of fine needles into specific locations on the body with the intent of producing beneficial health effects.” This is necessarily vague because there are so many different and mutually inconsistent rationales and theories for how acupuncture is supposed to work and so many different clinical practices. Some say acupuncture manipulates mystical spiritual “energy” while others claim it works by stimulating nerves or inducing release of a variety of neurotransmitters or other endogenous compounds. Some acupuncturists place needles at points all over the body, and others limit their needling to the hand, or the ear, or other specific parts of the body. There is nothing like a consistent, agreed-upon definition or map of acupuncture points and channels. Even the use of needles is not universal, and sometimes needling is accompanied by electrical stimulation, the burning of herbs on needles, and many other practices.

Some of the theoretical constructs used to explain or justify acupuncture are clearly more religious than scientific, and there is no point in talking about Qi or spiritual energies if one is trying to seriously evaluate the use of acupuncture as a medical therapy. However, there are more plausible potential explanations involving the physiological effects of needling in locations associated with nerves and other anatomic structures. My current view is that while needling undoubtedly has physiological effects, it has not been convincingly demonstrated that these are predictable, repeatable, and controllable to achieve beneficial clinical outcomes. I also am not convinced that acupuncture points or channels exist as a consistent network of identifiable anatomical structures that can be predictably identified and manipulated to achieve a desired clinical goal. It is not impossible that this is true, but the literature is not compelling.

Does Acupuncture Work?
There is an enormous amount of basic and clinical research on acupuncture, and a lot of it appears to show meaningful clinical effects. However, acupuncture is challenging to study because it can be hard to define “real” and “fake” acupuncture, it can be difficult to effectively blind patients to whether they are receiving real treatment or the sham, and it is impossible to blind acupuncturists. The demeanor and style of communication of acupuncturists has been shown to affect the perception of patients as to whether or not they benefit from treatment, so this inability to blind therapists is a real problem.

Ultimately, much of the acupuncture literature cannot be viewed as very reliable due to these and other sources of bias. The best controlled studies seem to suggest that acupuncture affects subjective symptoms and perceptions more than objectively measurable indicators of disease. This is most consistent with a placebo effect, and perhaps some very non-specific physiologic effects. However, there is some room for rational uncertainty about the extent to which acupuncture might have small benefits in terms of pain, nausea, and a couple of other clinical symptoms.

Is It Safe?
There are definitely risks associated with acupuncture. Human patients have experienced dizziness and other unpleasant subjective symptoms, though again whether this is directly due to acupuncture or a nocebo effect is difficulty to determine. Infections and injuries from needles, sometimes serious, have been reported. Overall, serious adverse effects seem to be quite rare when experienced, formally trained acupuncturists are doing the needling.

Bottom Line
Most of the theories behind how acupuncture might work are either complete nonsense or at best not fully validated by convincing evidence. There is clinical research that shows some benefits from acupuncture treatment, but this is mostly in terms of subjective symptoms and seems likely to be predominantly a placebo effect. Acupuncture is pretty safe, though there are some risks, especially when proper technique is not used.

My Acupuncture Adventure
Given this assessment, it will likely come as a surprise that I have signed up to take a training course in acupuncture. There are several reasons for this, and since I intend to share my experiences through this blog, I thought I would start by describing my goals and intentions at the beginning.

While I am perhaps 75-80% convinced acupuncture operates primarily as a placebo, as I said there are some plausible potential mechanisms by which it could have true clinical benefits, and there is some reasonable quality clinical literature to support these. In the interest of a truly skeptical evaluation of acupuncture, and following the principles of proportioning judgment to the evidence, I am interested in exploring some of the claims, theories, and evidence for acupuncture in more detail. The best way to do this is not only to seek information from sources that agree with my existing views of the practice but to engage with supporters and advocates who have different views. Challenging one’s own beliefs is a core value of skepticism, and I am hoping to put that into action.

Additionally, acupuncture is quite popular in veterinary medicine, at least where I practice. I have a moderately large number of clients who seek it out, as well as a number of colleagues who practice conventional, science-based medicine exclusively yet recommend or refer for acupuncture treatment. Currently, I share with clients who ask about acupuncture the views I have outlined above and emphasize that the existing evidence in veterinary medicine is limited, weak, and gives little reason to expect much harm or much benefit from the practice.

Despite this uncertainty, pet owners will often choose to try acupuncture anyway, even without much evidence it will benefit their pets. Currently in my area, the only way for them to receive this therapy is through a few local holistic veterinarians who not only practice acupuncture but who are fully committed to TCVM and other pseudoscientific practices and who actively counsel their clients to avoid science-based care. Despite some misgivings, I have come to feel that these patients would be better served receiving this therapy from someone who will be honest with clients about the lack of good evidence for real benefits and who will continue to provide them appropriate, evidence-based care as well. If acupuncture is, at worst, a relatively low-risk placebo therapy, then these patients will be better served by this approach than by being handed over to practitioners with a broader alternative, anti-science agenda.

I have long been interested in investigating acupuncture more directly, but I simply could not stomach the thought of slogging through textbooks and lectures than talked about Qi, Ying and Yang, the Five Elements, pulse diagnosis, and all the other TCVM folklore as if it were a legitimate way to approach health and disease in the modern world. Fortunately, I have the opportunity to take an acupuncture training course that largely eschews this sort of mysticism, Medical Acupuncture for Veterinarians (MAV), taught by Dr. Narda Robinson.

Dr. Robinson is a professor at the Colorado State University School of Veterinary Medicine, where she teaches and practices comparative and integrative pain management. She is one of the rare proponents of alternative medical practices who I believe has a genuine commitment to evaluating these through rigorous science, and she is a well-known opponent of pseudoscience in veterinary medicine. Dr. Robinson and I have spoken together at the AVMA annual conference, and we have interacted through our efforts on behalf of the AVMA resolution condemning homeopathy and through this blog. We often disagree about the conclusions that should be drawn from the evidence concerning acupuncture, glucosamine, and other specific topics. But it is not necessary to always agree in order to respect someone else’s efforts and goals.

Dr. Robinson describes medical acupuncture this way:

Scientific medical acupuncture utilizes modern medical knowledge of anatomy and physiology to design treatment protocols based on rational mechanisms of action and objectively identifiable endpoints without resorting to folkloric diagnostic approaches or metaphorical ideations. Veterinary medicine should be scientific and evidence-based.

I think that is a perfectly sound and reasonable way to approach the practice, and while Dr. Robinson has not yet convinced me that the evidence actually supports medical acupuncture as more than a placebo therapy, I accept that we share a commitment to a scientific approach to the question, so I am willing to evaluate her claims and the evidence she uses to support them carefully and seriously.

MAV consists of a series on online modules, followed by an onsite practical training course. Over the next eight months, I will be working through the online modules and preparing for the practical training. I plan to evaluate the content of the modules as thoroughly as I can, drawing on critical appraisal of published evidence, and then share my thoughts through a series of posts. If I ultimately begin providing acupuncture services to clients, I hope to write about those experiences as well.

This adventure, of course, raises the question of whether I am succumbing to the exhortations often made by advocates for alternative therapies to “try it and see for yourself.” If I start treating patients with acupuncture, even while clearly disclosing that it is most likely an elaborate placebo, and these patients appear to improve, will I become a convert to this therapy and start sliding down the rabbit hole into a Wonderland where every therapy works so long as someone has tried it and thinks it does? That seems unlikely.

I am well aware of the many cognitive biases and other sources of error that make uncontrolled personal experience a poor guide to cause and effect relationships. I make use of many treatments for which there is little real scientific evidence, as everyone who practices veterinary medicine unfortunately must given the paucity of high-quality research in our field. And some of these therapies sure look like they work! But I am always aware that this perception is based on shaky ground, and I have so far had no difficulty accepting new practices and abandoning familiar ones when good quality research evidence emerged that contradicted my intuition and experiences.

My goal in learning about and potentially employing acupuncture is not to validate or invalidate the practice through my own clinical experience, since this is not how science-based medicine works, but to engage with the theories, claims, and evidence in more depth and to hopefully minimize the exposure of my patients and clients to the egregious pseudoscience and anti-science ideologies of most of the veterinary acupuncturists they currently have access to.

Posted in Acupuncture | 13 Comments

Veterinary Medicine is a Business, and that Includes Alternative Medicine

Medicine is a business. That is an often uncomfortable but always unavoidable fact. There is plenty of room for debate about whether or not it should be, but as things currently work, veterinary medicine is a business. It is not only a business, of course. For most of us, medicine is a passion and a vocation. For all the years spent in school, and the money borrowed to pay for those years, most veterinarians could make a lot more money doing something else. So money is not the reason we practice, but nevertheless veterinary medicine is how we make our living, pay our bills, support our families.

The question of whether or not making money from our work as doctors influences the recommendations we give clients is an important and complex one. There’s not much in the way of controlled research on the subject, and studies of this would be difficult to do, so we have little more than speculation and opinion to work with. Having known an awful lot of vets, I am confident that deliberate deception, promoting goods and services that are unnecessary or ineffective simply to make more money, is incredibly rare. As I’ve already pointed out, people with that sort of ethic and drive to make money would be doing something else for a living.

That said, I also know how vulnerable people are to unconscious bias, despite the best of intentions. I have little doubt that in a more subtle way, money does influence veterinary decision making in a variety of ways.  Funding source probably influences research to some extent, and the potential profitability of particular therapies probably influences how likely vets are to offer them. The claim that vets are “just in it for the money” is clearly nonsense, but we shouldn’t be naïve enough to imagine that the fact that we make our living from our work as doctors has no influence on our thinking or behavior.

The question of financial bias often comes up in debates about alternative veterinary medicine, usually in the form of an unsophisticated and self-serving claim that conventional vets are “in it for the money,” whereas “holistic” vets are simply doing what is best for their patients. Here are just a few examples I’ve received personally over the years:

Obviously this website is biased against complementary integrative veterinary medicine….keeping comments and ideas one sided and supported pharmaceutical and commercial pet food monopolies which have been raking in the money for many decades…Threatened financially and ideologically, they must resort to political tactics of attack, shock and awe using headlines inspired by the National Inquirer or some other ladies gossip rag…If you were a legitimate blog looking for the Truth and not a shill for the pharmaceutical companies, you would have researched both sides of any issue.

The old 70 year old urologist told me I was crazy for believing that acupuncture helped my stone. I think he is crazy for thinking I would have let him make another 15 grand off of a surgery that caused me more pain and suffering than I had ever experienced. I wish someone would have told me that I could have just bought a 12 dollar bag of herbs. They don’t taste so great, but hey, it beats the heck out of feeling like the mob got a hold of your kidney with a bat. Or should I say the rich Mob Doctor MD.

I believe that traditional veterinarians are today motivated by GREED and the medicine they practice does as much harm as much as it helps…And how about the local vet’s push for more and more, now found to be harmful, vaccines they are always telling us pet owner are needed- just so they can make more money, not to mention the those oh so toxic flea meds,

it looks like the only faith you have is in your holier than though self. You remind me of our consulting vet. you can show him and show him, but when it comes down to the bottom line what the drug companies will do for him, he will jump on their bandwagon even when it doesn’t work

After reading your “rant” (so accurately described by another reader), I am left feeling like you must have a financial interest in big pharma, for that is the only logical reason I can see that you would put such effort in condemning a product that has successfully treated and prolonged the lives of so many animals… Maybe you should conduct a clinical research study with neo and see the results for yourself? Oh wait, you wouldn’t make the money using neo as you do with chemo and radiation, my bad. It sure does seem like your motives are financial,

You are a skeptic because it could put you out of business.

The FDA is a sub contractor for Monsanto. Come to think, so is this website!

You’re sole reason to exist is to try to hold back the tide that threatens your alternative medicine buddies in big pharma.

It’s all about the bottom line, folks. Now that the pet industry is a multi-billion dollar a year industry, unfortunately it appears the vets and “pet-care” companies are using our pets in the same way the human medical establishment has done…cause confusion and watch the big bucks roll in!

Huh, sounds a lot like what you say you aren’t – a pet food company lackey. The strong reason in favor of healthy, appropriate, homemade diets is the health of our pets…the strong reason against is two-fold – money and sickness – both of which I am sure you have no problems with. Sick animals are good for business.

What a HORRID article! If everyone in this world was healthy and living without chronic disease, then how would the pharmaceutical companies make money?

Who is paying you to write all this crap? The AMA? Jeez.

Another example of Government out of control serving Big Pharma both in an alliance and both disserving the unknowing blinded public while they RAKE IN $BILLIONS IN PROFITS. It’s the Government and its Agencies like the FDA THAT CANNOT BE TRUSTED! Do we need any more evidence for this? No, it is clear. SkeptVet clearly takes THEIR side.

You are a typical vet who just wants to stand behind the prescriptions that pay for your lifestyle.

I know one thing for sure……Vets scoff because it is about the $$$$…..they focus on keeping us coming back for the prescription food, meds and their $$$’s…….I do not trust doctors for humans let alone for my precious little ones. They are ALL about the money

To all you ignorant people bought off by Big Pharma . It is getting old by now you all not getting it. America is a fat, diseased very sick nation. The irony of thinking we are this Great nation when we are the international laughing stock. Europe has a seperate factory for making send out food to America because the Ingredients we allow are not allowed in their country due to most are toxic. Even the little cashier at World Market know’s this… If people were well and did not need prescription medicine their would be no money to be made in this billion dollar Big Pharma Industry. They want us sick!

Another sellout medical doctor…Medical doctors and mainstream people are so arrogant. They think they know everything, when behind closed doors, the people who fund these foods and treatments are actively trying to harm them.

I think you’d find it more eduational than blindly working for the pharmaceutical industry who are constantly being sued for lying about test results on their products.  Why would they lie if their products have been properly tested and proved to be safe?  I don’t suppose it’s occurred to you that they’re not in the business of healing.  They’re in the business of making as much money as they can… Most vets who switch to a holistic practice earn far less money than you do, so what possible reason could they have for changing?  Has it occurred to you that they have actually bothered to pay attention and have realised that they are hurting our animals with unnecessary medications? That their consciences have stepped in and prevented them from continuing to cause chronic disease in our pets?  Obviously not. Our animals need healers working with us owners, not drug sales people.

Who’s paying you!!?? Talk about biased. I’d like to know the serious side effect of taking cats claw… I always read opposing info when researching but this is so slanted its crazy. So I figure you are either a vet or you are paid/paid off by them. Let’s all feed science diet, shall we!… Seriously, who pays you!!??

If you don’t get a payment from the drug company, it’s not worth recommending.

After reading this blog and these testimonials, I think the skeptics here are for the most part, on someones payroll. Science has been Hijacked long ago, and the truth is being continually sacrificed on the alter of Corporate profits. I dont know what they are paying you to slander this company, too much if you ask me,

The drug industry ARE the quacks. Its a protection racket. This skepvet is a living testament to that. Ignore them and do what works not what their rigged trials tell you should work.

Someone is paying you to discredit vitamins, glandulars and minerals as beneficial remedies. You probably are a stupid medic. Breast feeding at age 80 off the pharmaceutical TIT. Die quickly so u can be reborn and do something to help someone.go pop a pill. You are an idiot.

Another sellout medical doctor…. These people probably promote heavy metal-laden vaccines; liver destroying drugs and toxic foods that contain genetically modified organisms. Go ahead, be ignorant and take the medical industries junk. They will be happy to benefit off of your illnesses. Big pharma and agribusiness work hand-in-hand

These sorts of comments are pretty obviously ridiculous in a lot of ways, but specifically the idea that somehow science-based medicine is more influenced by financial bias that alternative medicine is demonstrable nonsense. I have yet to meet an alternative vet who gives away all of their products and services just to bring healing and expects no payment in return. All of the potential sources of bias that are in play in conventional medicine pertain to alternative therapies as well.

  1. Research on alternative products is often paid for by companies selling those products. That is the case for the majority of products I have reviewed here, and it is a general rule in the business of alternative medicine. The claim that “natural” products can’t be patented and so make nobody any money is nonsense. Herbal remedies and dietary supplements are multi-billion dollar industries (also 1 and 2) involving large corporations, in many cases some of the same companies that make money from the conventional medicines and commercial pet foods “holistic” practitioners complain so much about. And not only do these companies make enormous profits from these supposedly unpatentable “natural” products, because they are minimally regulated they return a far lower proportion of this profit to research than the pharmaceutical industry does.
  2. Similarly, vets make a lot of money selling supposedly “natural” products, include herbal remedies and supplements and raw and other alternative diets. Publications aimed at “holistic” vets actively promote these kinds of products as profit centers. This is as true of alternative practitioners as it is of conventional vets.
  3. Continuing education for alternative vets is itself a profitable business, and also often financially supported by companies selling products and services for these vets. One well-known proponent of so-called Traditional Chinese Veterinary Medicine (TCMV), Dr. Xie, teaches TCVM, including herbal medicine and even a business management course for integrative veterinary medicine, and he also sells the same herbal medicines he teaches vets to use. How is this any different from Pfizer or Roche teaching doctors to use the conventional medicines they then sell to those doctors?
  4. Continuing education conferences for alternative vets are also sponsored by companies selling them supplements and other products, just as is the case for conventional veterinary conferences. There is a real issue of potential bias in this, but it applies just as much to alternative medicine and conventional medicine and so is not an argument in favor of one over the other.

Bottom Line
The bottom line is that financial bias is a real issue in veterinary medicine at all levels, and it has to be investigated and managed. However, this is not the same as saying there is widespread fraud or a sinister conspiracy involving vets and companies that do business with them. There is no reason to believe that the majority of vets are doing anything other than the best they can to help their patients and clients. And there is absolutely no reason to believe vets offering alternative therapies are any less subject to financial bias or any purer in their motivation or behavior than vets practices science-based medicine.

Posted in General | 1 Comment

Australian GPs Take a Stand Against homeopathy

In the wake of the latest in a series of evidence-based reviews that all agree homeopathy has no clinical value beyond placebo and causes more harm than it is worth (e.g. 1, 2), and in the context of the overwhelming evidence behind this conclusion, the Royal Australian College of General Practitioners (RACGP) has taken a strong, principled stand against the use of homeopathy by physicians and pharmacists and against the waste of healthcare insurance resources on this useless treatment:

The RACGP supports the use of evidence-based medicine, in which current research information is used as the basis for clinical decision-making.

In light of strong evidence to confirm that homeopathy has no effect beyond that of placebo as a treatment for various clinical conditions, the position of the RACGP is:

1. Medical practitioners should not practice homeopathy, refer patients to homeopathic practitioners, or recommend homeopathic products to their patients.

2. Pharmacists should not sell, recommend, or support the use of homeopathic products.

3. Homeopathic alternatives should not be used in place of conventional immunisation.

4. Private health insurers should not supply rebates for or otherwise support homeopathic services or products.

 

In doing so, the RACGP has joined many other groups of healthcare workers, scientists, and public health officials in condemning this deceptive and worthless practice. A number of veterinary groups have taken similar positions, including:

The British Veterinary Association:

The BVA cannot endorse the use of homeopathic medicines, or indeed any medicine making therapeutic claims, which have no proven efficacy.

The Australian Veterinary Association:

That the Board agreed that the veterinary therapies of homeopathy and homotoxicology are considered ineffective therapies in accordance with the AVA
promotion of ineffective therapies Board resolution.

The Evidence-based Veterinary Medicine Association

The American College of Veterinary Clinical Pharmacology

The American Academy of Veterinary Pharmacology and Therapeutics

However, many other organizations of veterinarians have refused to take a position on this issue, even when the opportunity arose with the introduction of a resolution in the AVMA House of Delegates to acknowledge homeopathy is ineffective. This refusal to accept the overwhelming evidence concerning perhaps the most egregiously unscientific of alternative therapies and to take a public position that defends our patients and clients from pseudoscience is regrettable and diminishes the integrity of our profession. While it would be ideal for the AVMA to be in the vanguard of protecting our patients and their owners, I hope that eventually ethics and science will triumph over politics and self-interest and they will join the growing chorus of reason.

 

Posted in Homeopathy | 4 Comments

Evidence-based Veterinary Medicine: What Is It & Why Does It Matter?

The following is a summary and the slides for a presentation I gave recently on evidence-based veterinary medicine:

WHAT IS EVIDENCE-BASED MEDICINE?
Evidence-based medicine (EBM) has been defined as the “conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual patients.”1 More generally, EBM is the formal application of the philosophy and methods of science to generating knowledge and making decisions in veterinary medicine. What distinguishes evidence-based veterinary medicine from other approaches is the explicit and formal integration of scientific research evidence into the clinical decision-making process. Evidence-based veterinary medicine (EBVM) is the adaption of EBM principles and techniques to the environment and circumstances of veterinary medicine.

As clinicians we need information to evaluate our patient’s health problems and to provide effective preventative and therapeutic interventions. EBVM provides tools and guidance to those who generate this information (through clinical research), those who disseminate it (through publication, continuing education, clinical practice guidelines, etc.), and those who utilize it (in clinical practice as well as public health and policy making). With better information, and more efficient information management, we are able to make better decisions, provide the best patient care possible, and more reliably achieve our intended outcomes.

WHY DO WE NEED EBM?
In the absence of EBM practices, clinicians typically base their decisions on a number of sources of evidence other than formal research data. Studies of veterinary decision making have found that veterinarians rely largely on the opinions of colleagues and perceived experts.2-3 To the extent that clinicians refer to research findings to guide their practice, they appear to utilize an informal, haphazard consultation of textbooks, journal articles, consensus statements and clinical guidelines. Above all, veterinarians, come to rely on their own clinical experience, judgment, and intuition in making diagnostic and therapeutic decisions. This collection of strategies is often referred to as opinion-based medicine.

There are a number of limitations to these approaches. Personal experience and opinion, even that of intelligent, educated, and experienced individuals, is subject to a wide range of cognitive biases and other sources of error that make it less reliable that is generally believed. Limitations in human perception, cognition, and memory and the influence of our beliefs and expectations lead us to erroneous conclusions which undermine the safety and efficacy of our interventions.4

There are many examples of how such error-prone assessment has supported ineffective or dangerous medical practices. Historically, interventions such as bloodletting, have been able to become ubiquitous and to persist for centuries with the best and brightest minds in medicine convinced they were effective, only to disappear rapidly when controlled scientific research revealed no benefits and significant risks.

In modern times, informal assessment not based on objective research has led to the similar widespread adoption of ineffective practices in many areas of healthcare. Based largely on the opinion of one individual, the practice of putting infants to sleep on their bellies to prevent Sudden Infant Death Syndrome (SIDS) was once nearly universal. This behavior persisted for two decades past the discovery of adequate scientific evidence to show it actually increased the risk of SIDS. Only once this external research evidence was integrated into public health recommendations and parent education did the practice, and the rate of SIDS, rapidly decrease.5

Surgical procedures such as internal mammary artery ligation and arthroscopic knee surgery have been widely employed until shown by controlled trials to be no more effective than sham surgery.6-7 In the veterinary field, practices such as prescribing antibiotics for young cats with hematuria and the nearly universal use of oral glucosamine as a therapy for osteoarthritis illustrate the potential for common and persistent use of ineffective or inappropriate therapies in the absence of a rigorous evidence-based approach to evaluating our interventions.8-9

It has been said the three most dangerous words in medicine are “In my experience.” And one definition for clinical experience is “Making the same mistakes with increasing confidence over an impressive number of years.” The reality is that our judgments are far less reliable than we feel them to be, and we are easily fooled by circumstances, by the complexity of the living organisms we deal with and their diseases, and by our own perceptual and cognitive biases. EBVM offers strategies and tools to help compensate for the limitations of uncontrolled observation and judgment.

THE STEPS OF EBVM
While EBM is concerned with the production and reporting of scientific research as well as its use in guiding clinical decision making, from the point of the clinician the most important elements are the steps involved in integrating research evidence with clinical experience and the circumstances of a particular case in order to inform patient care. The basic steps of an EBVM clinical process are these:

  1. Ask useful questions
  2. Find relevant evidence
  3. Assess the value and reliability of the evidence
  4. Draw a conclusion
  5. Assign a level of confidence to your conclusion

This is an iterative process that will be repeated regularly to build a body of knowledge with a known degree of uncertainty that can guide our clinical practice.

Asking Useful Questions
Vague or overly broad questions impede effective use of research evidence in informing clinical practices. “Does drug X work?” or “What should I do about disease Y?” are not questions that are likely to lead to the recovery of useful information from published research. There are a number of schemes for constructing questions the scientific literature can help answer. One of the easiest is the PICO scheme.

P- Patient, Problem Define clearly the patient in terms of signalment, health status, and other factors relevant to the treatment, diagnostic test, or other intervention you are considering. Also clearly and narrowly define the problem and any relevant comorbidities. This is a routine part of good clinical practice and so does not represent “extra work” when employed as part of the EBVM process.

I- Intervention Be specific about what you are considering doing, what test, drug, procedure, or other intervention you need information about.

C- Comparator What might you do instead of the intervention you are considering? Nothing is done in isolation, and the value of most of our interventions can only be measured relative to the alternatives. Always remember that educating the client, rather than selling a product or procedure, should often be considered as an alternative to any intervention you are contemplating.

O- Outcome What is the goal of doing something? What, in particular, does the client wish to accomplish. Being clear and explicit, with yourself and the client, about what you are trying to achieve (cure, extended life, improved performance, decreased discomfort, etc.) is essentially in evidence-based practice.

FIND RELEVANT EVIDENCE
Experienced clinicians typically have opinions on the value of most interventions they routinely consider. Unfortunately, we rarely know where those opinions originally came from or how consistent they are with the current best scientific evidence. And given the constraints of time and resources, practitioners will rarely have the ability to find and critically evaluate all the primary research studies relevant to a particular question. Fortunately, there are sources of evidence that can provide reliable guidance in an efficient, practical manner.

The best EBVM resource for busy clinicians is the evidence-based clinical practice guideline. These are comprehensive evaluations of the research in a general subject area that explicitly and transparently identify the relevant evidence and the quality of that evidence and make recommendations with clear disclosure of the level of confidence one should place in those recommendations based on the evidence.

Sadly, many guidelines produced in veterinary medicine are not evidence based but opinion-based (so-called GOBSAT or “Good Old Boys Sat At a Table” guidelines). These are no more reliable than any other form of expert opinion. Excellent examples of truly evidence-based guidelines are those of the RECOVER Initiative for small animal CPR and the guidelines produced by the International Task Force for Canine Atopic Dermatitis.

After evidence-based guidelines, the next most useful resources are systematic reviews and critically-appraised topics (CATs). These are more focused but still explicit and transparent reviews of the available evidence on specific topics. Systematic reviews can be identified by searching the VetSRev database, a free online resource produced by the Centre for Evidence-based Veterinary Medicine (CEVM) at the University of Nottingham. Unfortunately, getting full-text copies of these reviews can be challenging for vets not at universities, but there are a number of options depending on where one practices.

Critically appraised topics are also produced by CEVM and freely available on the web as BestBetsforVets. There are a number of other free CAT resources, including the Banfield Applied Research and Knowledge web site.

Finally, primary research studies are a useful source of guidance for clinicians, though they take more effort and expertise to find and critically evaluate.

ASSESS THE VALUE OF THE EVIDENCE
All research has limitations, and these must be formally assessed through the process of critical appraisal (discussed below). Only when the limitations of a study are clearly understood can we decide how much confidence to have in the results and conclusions of the study and whether it should lead to changes in our clinical practices. And even the best studies may not be applicable to our patients if the population studied differs in important ways from our patient population, or if the tools and techniques described are unavailable, impractical, or unacceptable to our clients. It is not enough merely to read published research reports. We must critically evaluate them in terms of reliability and applicability to our needs.

DRAW A CONCLUSION
Ultimately, the job of a veterinarian is to guide the client in making decisions about care for their animals. When the clinician is aware of the existing evidence and its limitations and clearly appreciates the degree of uncertainty, then he or she can best help the client to understand their options. Making evidence-informed decisions and clearly communicating with clients about the needs and choices for their animal is the core of clinical veterinary medicine, and this is what the tools and methods of EBVM exist to support.

ASSIGN A LEVEL OF CONFIDENCE TO YOUR CONCLUSIONS
Often, the relevant research evidence is incomplete or flawed, and sometimes there is little or no such evidence applicable to a given patient’s needs. EBVM is still useful in this situation, because it allows us to clearly, systematically identify and communicate the uncertainty inherent in our work.

EBVM is, above all, an approach for helping clinicians reach conclusions that can guide their decisions about the diagnosis and treatment of individual patients. It is often believed that a determination in Step 3 that the evidence is weak or flawed precludes making clinical decisions and taking action, and that this limits the usefulness of EBM in the veterinary field, where research evidence is often severely limited in quantity and quality. However, this is incorrect. The purpose of assessing the reliability of the research evidence is to assign a degree of confidence to conclusions or decisions based upon it. If the evidence is weak, it is often still be necessary to make a decision and act on it, especially if there is an urgent clinical problem. EBVM does not prohibit or undermine such action, it simply facilitates a clear and accurate understanding of the degree of uncertainty involved. This helps the clinician and also allows fully informed consent for the client.

It is also important that we openly discuss with clients our use of evidence to inform our recommendations. Research has suggested that clients want to be told about the uncertainties involved in the treatment of their animals, and that discussing this does not reduce their confidence in their veterinarians.10 Clients also identify truthfulness as their highest priority in communication with their vet.11 By explicitly discussing our process in identifying and evaluating relevant evidence, we enhance our clients’ understanding of the role we play, and we help them to appreciate the value of our expertise, not only the products and procedures we sell.

CRITICAL APPRAISAL
Critical appraisal is the term used to describe the formal assessment of the quality and limitations of published research evidence. Different study designs have strengths and weaknesses that bear on how the reliability and applicability of their results. And many individual aspects of how a research study is designed, conducted, and reported influence how much weight the study results should be given in developing an answer to a specific clinical question.

The well-known hierarchy of evidence, often used as a symbol for EBVM, is simply one of many tools employed in the critical appraisal process. There are also a number of key methodological factors that need to be evaluated when deciding how much confidence to place in the conclusions of a given research study:

  1. Control Group- If a treatment is applied to a group of subjects and there is no control group receiving a placebo or alternative treatment, there is no way to be sure any changes observed in the treatment group are actually due to the treatment or are greater than would be seen if we did something else or nothing at all. Uncontrolled trials are very weak evidence.
  2. Allocation- How the subjects are assigned to the different groups in a study is important. If there is not truly randomized allocation, in which every subject has an equal chance of being assigned to any group, then there is a risk that subjects will be assigned in a biased manner and that any differences seen between the groups will be due to inherent differences between subject rather than any treatment being tested.
  3. Blinding- One of the greatest strengths of formal scientific research is that it can compensate for the cognitive biases that lead us to the wrong conclusions when making informal observations. If, however, investigators and animal caregivers are able to determine which group in a study particular subjects are in, all of these biases can operate freely, and any assessments of the subjects, especially those that are at all subjective, can be skewed by unconscious bias. Unblinded or ineffectively blinded studies almost always find what the investigators expect to find, and this is no accident. Research has shown that in veterinary clinical trials, owner perceive a response in patients on placebo treatment nearly 57% of the time, and veterinarians perceived a response in these subjects 40-45% of the time.11
  4. Statistics- While the details of evaluating the statistical analysis in a given paper are complex and beyond the expertise of most veterinarians, it is important to bear in mind that research has demonstrated statistical errors are extremely common in published veterinary research and that even properly applied analyses are often inappropriately used to draw conclusions.
  5. Effect Size- Statistical significance is largely irrelevant to the question of whether an effect observed in a study is real or important. The effect size, or the absolute value of the effects seen and the differences between groups, is far more important. One can often show a statistically significant difference that would be clinically undetectable and irrelevant.
  6. Replication- No single study is ever sufficient to confidently demonstrate any hypothesis to be true or false. Replication is essential to uncovering the truth in science, and any conclusions based on research that has not been replicated should be viewed as tentative at best.

The studies which have evaluated the reliability of published veterinary research is not encouraging. Significant flaws are present in the majority of published studies, and this limits the confidence that can be placed in the results or conclusions of these studies.13-23

RESOURCES
Print Resources

Buczinski, S. Vandeweerd, J. (Eds.). Evidence-Based Veterinary Medicine for the Bovine Veterinarian.  Veterinary Clinics of North America: Small Animal Practice. 2012 March: 28(1).

Cockroft, P. Holmes, M. (2003). Handbook of Evidence-Based Veterinary Medicine. Oxford: Blackwell.

Ramey DW. (Ed.). Evidence-based veterinary medicine. Veterinary Clinics of North America: Equine Practice. 2007 Aug;23(2).

Schmidt, PL. (Ed.). Evidence-Based Veterinary Medicine.  Veterinary Clinics of North America: Small Animal Practice. 2007 May: 37(3).

Smith RD. Veterinary clinical epidemiology. 3rd ed. Boca Raton, FL: CRC/Taylor & Francis, 2006. 280 pgs. ISBN: 0849315662.

 

Electronic Resources
Evidence-Based Veterinary Medicine Association
http://ebvma.org (includes an extensive EBVM bibliography curated by Susan Whittaker)

Centre for Evidence-Based Veterinary Medicine
http://nottingham.ac.uk/cevm

VeSRev- A database of veterinary systematic reviews http://webapps.nottingham.ac.uk/refbase/

BestBetsfor Vets- Critically appraised topics
http://bestbetsforvets.org/

BARK_Banfield’s EBVM resources
http://www.banfield.com/veterinary-professionals/resources/research

BOTTOM LINE
EBVM is the formal, explicit integration of controlled scientific research into clinical decision making. It can reduce error and lead to better patient outcomes. However, published clinical research is not always reliable, and clinicians must carefully assess the limitations of specific studies and the applicability of their results to individual patients.

REFERENCES

  1. Sackett DL, Rosenberg WMC, Muir Gray JA, et al. Evidence based medicine: what it is and what it isn’t. British Med J 1996;312:71.
  2. Vandeweerd JMEF, Vadeweerd S, Gustin C, et al. Understanding veterinary practitioners’ decision-making process: Implications for veterinary medical education. J Vet Med Edu 2012;39(2):142-51.
  3. Everitt S. (2011) Clinical decision making in veterinary practice. (Unpublished doctoral dissertation). University of Nottingham, U.K. Available at: http://etheses.nottingham.ac.uk/2051/
  4. McKenzie, BA. Veterinary clinical decision-making: cognitive biases, external constraints, and strategies for improvement. J Amer Vet Med Assoc. 2014;244(3):271-276.
  5. Gilbert R, Salanti G, Harden M, See S. Infant sleeping position and the sudden infant death syndrome: systematic review of observational studies and historical review of recommendations from 1940 to 2002. International Journal of Epidemiology. 2005;34:874–887.
  6. Cobb LA, Thomas GI, Dillard DH, Merendino KA, Bruce RA. An evaluation of internal-mammary-artery ligation by a double-blind technic. New England Journal of Medicine 1959;260(22):1115–8.
  7. Moseley JB, O’Malley K, Petersen NJ, Menke TJ, Brody BA, Kuykendall DH, Hollingsworth JC, Ashton CM, Wray NP . A controlled trial of arthroscopic surgery for osteoarthritis of the knee. New England Journal of Medicine. 2002;347(2):81–8.
  8. Dru Forrester S, Roudebush P. Evidence-based management of feline lower urinary tract disease. Vet Clin North Am Small Anim Pract. 2007; 37(3):533-58.
  9. McKenzie BA. What’s the evidence? There is only very weak clinical trial evidence to support the use of glucosamine and chondroitin supplements for osteoarthritis in dogs. J Am Vet Med Assoc. 2010 Dec 15;237(12):1382-3.
  10. Mellanby, RJ. Crisp, J. DePalma, G. et al. Perceptions of veterinarians and clients to expressions of clinical uncertainty. J Small Anim Pract. 2007 Jan;48(1):26-31.
  11. Stoewen, DL. Coe, JB. McMartin, C. et al. Qualitative study of the information expectations of clients accessing oncology care at a tertiary referral center for dogs with life-limiting cancer. J Am Vet Med Assoc. 2014 Oct 1;245(7):773-83.
  12. Conzemius MG. Evans RB. Caregiver placebo effect for dogs with lameness from osteoarthritis. Journal of the American Veterinary Medical Association. 2012;241(10):1314-1319.
  13. Sargeant JM, Elgie R, Valcour J, Saint-Onge J, Thompson a, Marcynuk P, et al. Methodological quality and completeness of reporting in clinical trials conducted in livestock species. Prev Vet Med. 2009 Oct 1;91(2-4):107–15.
  14. Sargeant JM, Thompson A, Valcour J, Elgie R, Saint-Onge J, Marcynuk P, et al. Quality of reporting of clinical trials of dogs and cats and associations with treatment effects. J Vet Intern Med. 2010;24(1):44–50.
  15. Elbers A, Schukken Y. Critical features of veterinary field trials. Vet Rec. BMJ Publishing Group Limited; 1995 Feb 25;136(8):187–92.
  16. Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA. 1995 Feb 1;273(5):408–12.
  17. Lund EM, James KM, Neaton JD. Veterinary randomized clinical trial reporting: a review of the small animal literature. J Vet Intern Med. 1998;12(2):57–60.
  18. Brown DC. Control of selection bias in parallel-group controlled clinical trials in dogs and cats: 97 trials (2000-2005). J Am Vet Med Assoc. 2006 Sep 15;229(6):990–3.
  19. Brown DC. Sources and handling of losses to follow-up in parallel-group randomized clinical trials in dogs and cats: 63 trials (2000-2005). Am J Vet Res. 2007 Jul;68(7):694–8.
  20. Arlt S, Dicty V, Heuwieser W. Evidence-based medicine in canine reproduction: quality of current available literature. Reprod Domest Anim. 2010 Dec;45(6):1052–8.
  21. Simoneit C, Heuwieser W, Arlt S. Evidence-based medicine in bovine, equine and canine reproduction: Quality of current literature. Theriogenology. Elsevier Inc.; 2011;76(6):1042–50.
  22. Giuffrida MA, Agnello KA, Brown DC. Blinding terminology used in reports of randomized controlled trials involving dogs and cats. J Am Vet Med Assoc. 2012 Nov 1;241(9):1221–6.
  23. Giuffrida MA. Type II error and statistical power in reports of small animal clinical trials. J Am Vet Med Assoc. 2014 May 1;244(9):1075–80

SFT Slides to Post

 

Posted in Presentations, Lectures, Publications & Interviews, Science-Based Veterinary Medicine | Leave a comment