Eric Weisman Gets Fine and Probation for Violating Court Order

I recently received a comment from Mr. Eric Weisman, promoter of Evolution Diet, regarding a post I wrote about his products in 2009. The comment was full of conspiracy theories, baseless accusations, and a general disregard for truth. At that time of my original article, I knew only that Mr. Weisman was making claims about his diet, as well as other commercial diets and veterinary medicine as a profession, that were untrue and without any basis in fact. It later became clear that Mr. Weisman isn’t interested in facts at all when a reader pointed out that Mr. Weisman had been sanctioned numerous times for violating the terms of his license as a chiropractor and for practicing veterinary medicine without a license. In an update to my original post, I made available the public documents showing this pattern of dishonest behavior, for which Mr. Weisman ultimately lost his license to practice chiropractic.

Unfortunately, this did not disabuse him of the mistaken belief that he was qualified to practice medicine on both humans and animals, since he was subsequently charged with violating the terms of this court injunction along with new counts of practicing medicine without a license and mistreatment of animals, as I reported in an update last year. The allegations included some horrific descriptions of unethical behavior, including this from a veterinarian at the University of Minnesota,

Weisman brought in a cat he suspected had kidney failure and cancerous lesions, the complaint said. According to the U’s veterinarian, the cat had neither – it died of pneumonia, was unable to absorb nutrients from the food it ate and had broken bones in each of its front legs. The suspected cancerous lesions, the veterinarian said, were actually scabs caused by the cat walking on its joints instead of its broken feet, the complaint said.

Earlier this year, Mr. Weisman and the authorities reached a plea deal in which he pled guilty to violating the terms of his earlier court agreement. In return for this plea, he received a fine a 90-day suspended sentence, and probation, and the other charges were dropped. Interestingly, Mr. Weisman did not deny that he diagnosed a dog with cancer and prescribed treatment for it or that he recommended treatment to a man with lymphoma, he merely claimed that in doing so he explicitly told them he wasn’t a doctor and so was not legally allowed to practice medicine. Apparently, this disclaimer, followed by behavior indistinguishable from the practice of medicine, is sufficient to absolve Mr. Weisman of legal responsibility for his actions.

Naturally, Mr. Weisman sees his conviction as a vindication, and it’s hard not to see why when such egregious disregard for the law of the truth meet with such mild sanction. And it seems clear that no lesson has been learned here. While sprinkling his web site with disclaimers about not being allowed to practice veterinary or human medicine, statements like this are still to be found there:

Q. I have concerns about how healthy a Vegetarian Diet is for my Pet. My pet is having some problems and I have been feeding my pet another pet food or Evolution for a while and I’m not sure if it’s the food causing the problem.

Please phone me immediately with any Health Concerns at 651-221-9056 and leave a message for me, Eric Weisman, Scientist, Dr. of Health Sciences. I have helped many Dogs, Cats, Ferrets and Humans with Health and Behavior Issues in 1000’s of cases. I am an internal disease expert with many years of both Nutrient Compound Procedure and Drug-Surgery Health Experience and feeding a Meat Based or Vegetarian Diet to many types of animals, including wild outdoor animals and exotic pets. Although it is far better to phone for the fastest response, you may also e-mail us about health, behavior, and product issues at weisman@qwestoffice.net. For Urgent issues,call 651-492-2190.

We can tell you exactly how we treat a Dog, Cat or Ferret with the same or similar condition you or a veterinarian describes. I will give you the most accurate information possible about our Nutrient Compound Procedures. I can also use your Veterinary Diagnosis and we can review your Veterinary Lab Work & Diagnosis. I would also be glad to work with your veterinarian, although that will involve extra veterinary expense. Again, I will tell you about all the supplements and what we do in the same or similar case. Because of current law, we can not refer to our Nutrient Compound Procedures as a diagnosis, prevention, treatment or cure. I am a former physician with 23 years of experience with humans. I have worked and helped people in thousands of cases with their dogs, cats and ferrets for 20 years explaining exactly how I use nutrient, botanical and pharmaceutical procedures in cancers, immune system disfunction and failure, infectious disorders, kidney and liver failure, etc..

Despite have no recognized medical credentials, Mr. Weisman is willing to make recommendations and sell products to people with ill pets by representing himself as “an internal disease expert” and a “former physician” (not a former chiropractor stripped of his license, which would be accurate). This seems quite clearly to violate the terms of Mr. Weisman’s plea, but ultimately that is up to the Minnesota Attorney General, or perhaps the Little Canada City Attorney.

Posted in Law, Regulation, and Politics, Nutrition | 4 Comments

Can you own an idea? Hemopet sues Nestle-Purina and Hill’s over Nutrigenomics.

Intellectual property law is a complex, often bewildering tangle that I make no claim to be deeply conversant with. However, it has always struck me as odd to consider the notion that ideas can be owned. While I understand the purpose of allowing innovators to profit from their work, I also see knowledge, particularly knowledge about the physical world to which we all have access, as something impossible, or at least inappropriate, to try and restrict in the pursuit of market advantage. In any case, whatever one thinks about the underlying philosophical and moral issues, the processes of claiming and enforcing ownership of an idea often make interesting narratives.

A recent example is a lawsuit filed by veterinary Hemopet, a blood blank and diagnostic testing company founded by Dr. Jean Dodds, and the pet diet manufacturer Nestle-Purina. Dr. Dodds is herself a complex character. She has done great and important work in promoting transfusion medicine and is well-regarded as an advocate and researcher, though without a traditional academic background or affiliation. She is undoubtedly a pioneer in veterinary medicine.

However, like many pioneers she holds a number of views which are not compatible with a conventional medical or scientific understanding, and her accomplishments do not automatically make these views legitimate. She goes beyond the available evidence in claiming that vaccines are an established and important cause of disease (so-called vaccinosis). Her theories about thyroid disease are not generally accepted by endocrinologists, though they are widely promoted by practitioners of alternative veterinary medicine. In fact, Dr. Dodds’ ideas are quite popular with this community, and in addition to being on the board of the American Holistic Veterinary Medical Foundation, she has been awarded the honor of Holistic Veterinarian of the Year.

This current lawsuit stems from a couple of other projects of Dr. Dodds which are not part of mainstream science-based medicine. She has developed a method which she claims can identify dietary sensitivities in animals through testing saliva (a claim most immunologists and dermatologists do not accept), and she has patented an idea for implementing a nutrigenomics program for identifying and modifying disease risk in animals.

Nutrigenomics is an interesting idea. The theory is that the expression and function of genes interacts with specific nutrients in a way that can be identified and manipulated through gene sequencing, dietary modification, and other diagnostic, preventative, and therapeutic practices. If that sounds vague, it is. The idea is far from being established even in general principle, much less in actual clinical practice, and there is little evidence to suggest any specific diagnostic or therapeutic approach that can be owned and marketed exists. The term nutrigenomics, and the small amount of laboratory research suggesting that it might one day be a real approach to health, have been used to market specific products well before this is justified by appropriate scientific evidence. And not only has Dr. Dodds joined in this practice, she is apparently willing to sue to assert her ownership of the general idea in animals.

The initial details of the lawsuit, and the patents Hemopet alleges have been infringed, are contained in this complaint:

Hemopet v.Nestle-Purina Petcare Company Patent Infringement Complaint

There is a great deal of repetitive verbiage describing the patents held, but the general sense is that Hemopet has patented the idea of using a comprehensive computer database containing information about individual animals and groups of animals, as well as the results of both legitimate and questionable or misapplied laboratory tests, to identify health risks and appropriate nutrition for companion animals. The description seems to envision a database and consulting system made available, for a fee, via the Internet. Here are a few selections from the patents:

…it is necessary in animal health diagnosis and care that appropriate predictive testing for diseases and disorders of animals be achieved in order to reduce morbidity and mortality, and improve the quality of life and lifespan. Currently this is not done in relation to the health assessment data of an animal together with the genetic data related to that same animal. Current tests do not provide as much data as possible to attain correct diagnosis and disorder predictions with the net result of an improvement in the quality of life and increased longevity.

The disclosure is directed to a method, apparatus and system of obtaining, analyzing and reporting laboratory test data in relation to the health assessment data of an animal together with the genetic data related to that same animal.

The disclosure also provides a bioinformatics system for inputting, controlling, analyzing and outputting of a broad range of criteria related to the health, genetic background and longevity of animals. This includes a system concerning phenotype data and genetic data relating to animals. Further, there is provided a system for screening of genetic data and genomic mapping, and integrating the phenotype health assessment data and genetic identifier and assessment data in a computerized data processing resource (“CDPR”).

The present disclosure offers a unique solution to above-described problems by providing an apparatus, method and system, in relation to animals, for performing data analyses of biological specimens from specific subject animals or animal groups in relation to specific subject animal or animal groups of genetic data. The apparatus, method and system comprises a controller for obtaining, inputting, and analyzing biological, physiological, and pathological test data together with genomic mapping and genetic screening data into the CDPR.

The biological, physiological, and pathological data of the subject animal or animal group and the genetic data of the subject animal or animal group are communicated to a remote user as raw data or as related, analyzed biological, physiological, and pathological data and genetic data. The remote user can also appropriately access the CDPR to input data to, or obtain data from, the CDPR.

The disclosure also includes the step of reporting the determination of the health care, well-being, nutrition or other therapeutic requirements and suggestions or health on a communications network including the Internet. Preferably, there is a payment procedure for the report which is achieved through the Internet.

A further aspect of the disclosure is the accessibility of the health assessment database and/or genetic database or other databases of the CDPR by the remote user selected on the basis of password, security control, and financial payment such that the data can be transmitted into and from the CDPR by a computer network. Use of selected passwords, encryption systems, and payment systems are employed to facilitate and restrict the flow of data in and/or out of the databases.

A diagnosis of the health of an animal is obtained through a combination of computerized data analysis, and human interpretation. Data relates to the physical characteristics of the animal, and includes data obtained from a physical inspection of the animal. A blood or other fluid sample is used to obtain a computer generated laboratory analysis. This is reported through an internet network to specialist for analysis by a specialist clinical pathologist. The clinical pathologist has the data relating to the physical characteristics, and thereby makes a diagnosis of the animal’s overall health status.

So what appears to have been patented here is the idea of collecting a wide range of pieces of information about an animal in a computer, passing it around to people, and using it to “reduce morbidity and mortality, and improve the quality of life and lifespan” in companion animals. It’s hard to see how this could be a patentable idea, or even truly original apart from the unsubstantiated general claims about the links between gene sequences and health, but again I’m not expert in patent law. And despite a list of scientific papers included with the patent application (but not used as specific citations to support particular claims), it’s not clear that there is an actual preventative or therapeutic healthcare intervention here.

So how has Nestle-Purina allegedly violated the ownership of this very general idea? That’s not entirely clear from the complaint either. The allegation is that,

Purina has infringed and continues to infringe the ’343 patent by its manufacture, use, sale, importation, and/or offer for sale of its products and services developed using molecular nutrition or ‘-omics platforms,’ including Purina’s Veterinary Diet JM and OM products.

Again, it appears that the basis of the complaint is that Hemopet owns the idea of nutrigenomics and that Nestle-Purina has stolen this idea by utilizing this method which, from a scientific point of view, doesn’t really exist yet. Nestle-Purina does claim on its website to use nutrigenomics in developing its diets:

Nestlé Purina scientists use molecular and functional genetics to help them understand the “why” behind dog health. Our goal is to impact the processes through nutrition.

Nestlé Purina scientists use molecular nutrition to identify gene-expression changes related to specific health conditions and examine how nutrition can help manage canine health. Whether scientists are studying the nutritional management of obesity, joint conditions, or food allergies, molecular nutrition helps them to fully understand the biological context of certain changes and how they can be used in order to benefit dogs.

How exactly the company does this given the embryonic, even blastocystic, state of current knowledge about genes and nutrients, isn’t explained.

So we have a theoretical approach to health and nutrition which has not yet been validated scientifically. Hemopet claims to own it. And Nestle-Purina claims to use it in developing its pet foods. You might think Dr. Dodds would approve of this, given her apparent lack of confidence in the healthfulness and safety of current commercial foods and her belief that nutrigenomics is the right way to approach nutrition, but apparently not. In any case, it’s a bit baffling how these two organization can compete for ownership of an idea which doesn’t really exist in a tangible form yet.

I’ve written before about the fact that the legal system has very different priorities than the systems of science. Malpractice lawsuits involving alternative medicine, for example, rarely hinge on whether the practice being challenged is scientifically legitimate or can be shown to be safe or effective. The lawyers and judges involved seem more interested in the balance of state power and individual liberty than whether the therapy at issue is legitimate or pseudoscientific nonsense. And individuals often and easily get away with egregiously ridiculous medical practices entirely incompatible with science despite laws that sound like they should protect the public from such people. And securing a patent has more to do with proving an idea is original that proving it is true or actually works, as evinced by the weird and clearly implausible things that can be patented.

So I suppose it shouldn’t be a surprise that Hemopet can claim to essentially own the concept of nutrigenomics and choose to sue Nestle-Purina for claiming to use it. It does seem, however, like putting the cart before the horse, since who gets to profit from a new approach to health and nutrition should at least have something to do with whether the approach actually works and who has done the work to demonstrate this. But maybe that’s why I’m a scientist and not a lawyer.

 Addendum-

A reader was kind enough to point out that Hemopet is also suing Hill’s Pet Food for apparently the same violation of its ownership of the idea of nutrigenomics. Here’s the complaint:

Hemopet vs.Hills Pet Nutrition

Hill’s does also claim to use nutrigenomics, though again it isn’t clear what exactly that means.

 

 

 

 

Posted in Law, Regulation, and Politics | 11 Comments

Another Study Shows CAM Use Harms Cancer Patients

A recent study of cancer patients provides yet another addition to my list of examples of how complementary and alternative medicine (CAM) can do harm.

Yun YH, Lee MK, Park SM, Kim YA, Lee WJ, Lee KS, Choi JS, Jung KH, Do YR, Kim SY, Heo DS, Kim HT, Park SR. Effect of complementary and alternative medicine on the survival and health-related quality of life among terminally ill cancer patients: a prospective cohort study.Ann Oncol. 2012 Oct 30. [Epub ahead of print]

This study was a prospective cohort study which followed 481 terminally ill cancer patients in Korea. The authors compared the use of any alternative therapy with the use of no such therapies, so obviously the study does not evaluate the effectiveness of individual treatments. Its purpose was to see if overall the use of CAM had a measurable effect of survival or quality of life for cancer patients. The essential findings were these:

  1. There was no overall difference in survival between patients who used CAM and patients who didn’t.
  2. Overall, CAM users exhibited poorer cognitive function and more fatigue than non-users.
  3. A series of subgroup analyses (always to be viewed skeptically) identified a number of poorer quality of life scores among CAM users and a poorer survival among those who used prayer as a healing intervention.

This is certainly not the definitive word on CAM in general, nor a clear disproof of the value of any particular CAM practice. What it is, is a sound rebuttal to the unsubstantiated claims that CAM use improves the survival or well-being of cancer patients. It also provides yet another stone in the avalanche of evidence that the blithe assumption that even if CAM doesn’t help it can’t hurt. Previous studies of both general CAM use and specific CAM practices, have found not only no benefit but a significant decrease in the survival and the quality of life of cancer patients using CAM.

All therapies need to be rigorously evaluated scientifically, beginning with the establishment of a plausible theoretical principle, progressing to proof of concept in animal model and in vitro studies and, if this information warrants it, ultimately being subjected to clinical trial evaluation to prove real safety and efficacy. The assumption of either efficacy or safety based on tradition, intuition, theoretical reasoning, or low-level preclinical evidence not only wastes resources on useless therapies but harms patients.

Additional Examples
Kurian Joseph, Sebastian Vrouwe, Anmmd Kamruzzaman, Ali Balbaid, David Fenton, Richard Berendt, Edward Yu and Patricia Tai. Outcome analysis of breast cancer patients who declined evidence-based treatment.World Journal of Surgical Oncology 2012, 10:118.

Lim A, Cranswick N, South M. Adverse events associated with the use of complementary and alternative medicine in children. Arch Dis Child. 2010 Dec 22. [Epub ahead of print]

Chang EY, Glissmeyer M, Tonnes S, Hudson T, Johnson N. Outcomes of breast cancer in patients who use alternative therapies as primary treatment.Am J Surg. 2006 Oct;192(4):471-3.

Bostrom, H. Rostrom, S. Quality of alternative medicine–complications and avoidable deaths.

Han E, Johnson N, Delamelena T, Glissmeyer M, Steinbock K. Alternative therapy used as primary treatment for breast cancer negatively impacts outcomes. Ann Surg Oncol 2011;Jan 12 [Epub ahead of print

The Danger of Choosing Alternative Therapies Over Conventional Care

Posted in General | 4 Comments

Caregiver Placebo Effects: New Study Shows that Owners and Vets Often Believe an Ineffective Therapy is Working When it Isn’t

The placebo effect is a critically important, and much misunderstood phenomenon which can mislead us greatly when we are trying to decide if a medical therapy is or is not effective. While most people understand the placebo effect to mean a patient feels better because they think they are getting a real therapy, when actually they are getting a fake therapy, this is only one kind of error included under this label.

Belief and expectation can certainly cause people to imagine an improvement in their condition even when they aren’t getting a real treatment, and even when objectively their disease is unchanged or getting worse. One relatively recent example is a study of placebo treatments, including acupuncture, for asthma.  In this study, fake therapies frequently made people feel their asthma symptoms were reduced, but objective measures of lung function didn’t change. This sort of result indicates pretty clearly that even if people report feeling better, it is not a good idea to rely on placebo effects alone because they don’t actually improve the condition being treated. There may be some value to improvements in subjective symptoms like pain even if they aren’t real, but we cannot ignore the fact that these improvements can occur even when the people feeling better are actually getting sicker.

There are many other sources of error in scientific studies of medical treatments that can lead to a false impression of improvement even if a therapy doesn’t work. Regression to the mean, the Hawthorne Effect, the natural course of disease, and many other similar phenomena can fool us into thinking a therapy is working when it isn’t, or lead us to believe the effect of a treatment is stronger than it really is. These are often called placebo effects because they can be controlled for in experimental studies by having a placebo treatment group, but they don’t involve belief or expectation on the part of the patient. Many of these effects occur in animals just as they occur in humans, even though animal patients likely do not have beliefs or expectations about their health. Even with a problem as apparently objective and straightforward as epileptic seizures, significant placebo effects have been seen in dogs.

One source of error seen in studies of medical therapies in humans, and which likely also operates in veterinary medicine, is the placebo effect by proxy (e.g. 1, 2). This is where the beliefs and expectations of someone caring for a patient (often a parent) influence the apparent effect of a medical treatment because the parent either reports on the effect of therapy or behaves differently in other ways related to the treatment being tested. Often, this effect makes it look like patients are improving by the subjective measure of caregiver evaluation even if objective measures show the patient actually is not getting better.

I have long argued that this form of placebo effect is a serious problem in veterinary medicine, where subjective measures of response based on owner or veterinarian opinion are often used to evaluate the effect of therapies for veterinary patients. Inconsistent and usually positive subjective evaluations of response to treatment show up in almost every veterinary clinical trial, and without adequate controls for placebo effects, these can lead to false impressions of a benefit. This is especially a concern with therapies shown in humans to operate mostly or entirely by placebo effects.

One area in which this problem appears to be significant is the treatment of arthritis in veterinary patients. Many therapies are used which have not yet been demonstrated to be effective through high-quality clinical trials (such as stem cell therapies) or which have been shown in humans to operate mostly as placebos (such as glucosamine, acupuncture, and others), are tested in dogs and cats using only subjective assessment by owners or vets to determine if they are effective. A new study specifically evaluating the impact of caregiver placebo effects on evaluation of arthritis treatments illustrates why studies that don’t use objective measures or control for placebo effects are very likely to be misleading.

Conzemius MG. Evans RB. Caregiver placebo effect for dogs with lameness from osteoarthritis. Journal of the American Veterinary Medical Association. 2012;241(10):1314-1319. 

This study looked at the assessment of lameness in 58 dogs who were in the placebo arm of a clinical trial evaluating a non-steroidal anti-inflammatory medication for arthritis treatment. The authors compared owner and veterinarian assessments of patient lameness with the results of an objective measurement tool that evaluated the amount of weight the dogs actually put on their arthritic legs. There were several important results that illustrate the importance of proxy placebo effects:

  1. Objective measures were consistent throughout the study, while subjective evaluations were inconsistent and tended to show progressive improvement as the study progressed, even in dogs who were not actually improving.
  2. A placebo effect in the owner evaluations occurred 56.9% of the time.
  3. A placebo effect in veterinarian evaluations occurred between 40% and 45% of the time, depending on which specific method of evaluation was being used.
  4. These placebo effects were highly significant at every point at which the dogs were evaluated (P<0.001).
  5. Changes in lameness of </= 5% measured objectively were not unusual, but changes >/= 10% were rare, suggesting that small changes may occur naturally and can interfere with accurate evaluation of a therapy. Higher effect sizes should be seen if we are to have confidence that a therapy is truly working. 

These placebo effects, seen in dogs not actually receiving any therapy for their arthritis, were highly significant and easily large enough to make an ineffective therapy appear effective without an objective measure of response. This illustrates quite clearly how important it is that we not accept only subjective assessments of arthritis treatments as proof that they work. We have to remember that the caregiver placebo effect means that the owner or veterinarian judge the patient to be improved, but actually the patient is likely in as much or more pain as they were without the treatment. Trusting in our uncontrolled observations to judge the value of treatments for arthritis pain very likely guarantees uncontrolled suffering for our pets and our patients.

Posted in General, Science-Based Veterinary Medicine | 12 Comments

HopeScience Vet’s EFAC for Periodontal Disease and Arthritis

My attention was recently drawn to another dietary supplement product with pretty dramatic claims, this time for treating both oral disease (gingivitis and periodontal disease) and joint disease (osteoarthritis). As usual, the company web site and promotional materials are unequivocal about the benefits you can expect.

Comprehensive oral health care is now a reality!

Safe, No Side Effects…Only Side Benefits

A truly major advancement…

Far more effective and much faster acting than current natural joint products

Of course, there is the usual disclaimer, which one presumes is present because the company has not met the FDA requirements for making health claims:

This information is presented for informational purposes only and is not intended as an endorsement of any product. The information is not intended to be a substitute for visits to your local veterinarian. Rather, these testimonials / research pages and/or case studies offer the reader information written by pet owners and/or veterinarians concerning animal health and products that have shown results.

It is hard to imagine anyone actually claiming this information is “not intended as an endorsement of any product” given that the context is entirely product advertising, but that’s a relatively minor example of the weird things that happen when one tries to advertise a health care product not approved by the FDA as a health care product.

Several of the warning signs of bogus claims are present, including:

Claims of a major scientific breakthrough, initiated by a hunch or guess and an uncontrolled personal experience

Support for these claims primarily through testimonial and anecdote

Reference to scientific proof with few details

Claims of great benefits with absolutely no side effects

A money back guarantee

And while science is often used as a marketing point, this company goes farther, making several references to evidence-based medicine and making a number of statements about  the need for meaningful scientific evidence with which I agree completely:

[this product is] not just another one of the multitude of unproven joint products, as it is also evidence-based. This is an often used term and at the same time an often abused term. As an example, we often see “contains clinically proven ingredients” In reality this usually implies that the actual product was in fact never tested clinically.

Esterified oils are the only evidence-based product for gum or periodontal health.

There is scientific support for natural approaches, but at the same time there are a lot of half truths and at times totally misleading statements made in order to sell products. We will let the science speak for itself.

The company also aggressively challenges the usefulness of what they appear to see as their major competition for the arthritis supplement market, glucosamine products. And here again, they make a case I am in complete agreement with about the lack of clinically meaningful, proven benefits for glucosamine supplements*:

It is quite amazing that so many people, including physicians just assume that glucosamine is effective. This is understandable when we consider how much joint health advertising that takes place. The sad reality is that in well controlled clinical trials that the placebo pills produced just as good effects as glucosamine.

Advertisers have frequently referred to GAIT and the 72 patient’s that seem to benefit, but they fail to mention the other 95% of trial participants or the fact that this 72 patient group went on to experience more cartilage loss than placebo.

So let’s take a look at this “evidence-based” product, what it is and what the evidence says about it.

What Is It?

The exact active ingredient in the product is listed as a “proprietary blend” of an “esterified fatty acid complex” from “beef tallow”. Esterified fatty acids are similar to other fatty acids, such as fish oils, with some chemical modifications. The other ingredients are a variety of vehicles and some compounds with Vitamin E activity, which are commonly included with fatty acid supplements since these tend to reduce Vitamin E activity in people or animals taking them.

Does It Work?

Given the heavy promotion of this as an “evidence-based” product, is there strong evidence to support the strong claims made for it? Well, not really.

The company claims, “EFAC has been studied with seventeen (17) animal and clinical studies, with six (6) studies presented at scientific meetings and six (6) published in pre-eminent scientific journals.” Of these, they provide links to 5 papers and once conference presentation, however all but one of the links are currently broken. It’s not clear what other studies they are referring to.

In terms of the use of esterified fatty acids in general (not this product specifically) for osteoarthritis, there are a few clinical trials that suggest some improvement in human patients with osteoarthritis. (1-3) These are the sort of small, early trials which can suggest a potential effect is worth investigating further, but the results often are not supported in larger, better controlled, and independently funded research. In fact, the clinical trial evidence supporting glucosamine as an arthritis treatment is far greater, and yet the largest and highest quality trials have turned out to show, as this company points out on their site, that there is not a real benefit. It seems a bit self-serving to correctly identify the weakness in the evidence for glucosamine and yet to aggressively promote their own product as “evidence-based” on the strength of far weaker clinical trial evidence.

As for the use of this product to prevent or treat gingivitis and periodontal disease, I have only found one related published paper, a report of a study involving the topical application of esterified fatty acids to the gums of 18 rabbits in which periodontal disease was artificially induced.(4) This is the sort of animal model study that is useful for providing proof of concept, but it is not appropriate to justify widespread clinical use in dogs and cats based on one laboratory study in rabbits. The company also claims a trial has been done in cats, and provides a testimonial from a veterinary dentist supporting the product, but apparently that study has not yet been published

The company also promotes the fact that they have been granted a patent for their product. This does not, however, have anything to do with whether or not it is effective. Evidence of clinical safety and efficacy is not required for a patent application, and patents have been granted for a wide range of bizarre and useless inventions.

Is It Safe?

A few safety studies in laboratory animals have been done and did not identify any hazards. I am also not aware of any reported side effects in humans or other species taking these supplements, though there does not appear to be any formal surveillance or reporting mechanism in place.

Bottom Line

It is certainly possible that esterified fatty acids could have clinically meaningful benefits. There is no clearly established physiologic mechanism by which this would occur, but there are a few small clinical studies in humans suggesting a benefit for osteoarthritis and at least one animal model study suggesting some benefit for periodontal disease. There is no evidence of any risk at this time.

At this level of evidence, the proper assessment is that benefits are possible but unproven. Use of the product would certainly be appropriate in controlled research studies and situations in which established therapies are not available or tolerated. Substituting these products for established therapies is not appropriate. And, unfortunately, despite all the talk of being scientifically validated and “evidence-based,” the claims made for these products go well beyond anything justified by published scientific evidence. Such language indicates only a recognition of the marketing value of science and the term “evidence-based medicine,” not any qualitative difference between the level of evidence behind claims for these products and that supporting similar claims by other nutritional supplements marketed to treat or prevent disease.

*Articles I have written about glucosamine for arthritis

 Veterinary Glucosamine and Chondroitin

Growing skepticism about glucosamine for arthritis in dogs and cats

Is recommending glucosamine for arthritis evidence based medicine or wishful thinking?

Nope, glucosamine and chondroitin still don’t work in humans

Cognitive dissonance in action: Glucosamine no matter what!

 

References

  1. Kraemer WJ, Ratamess NA, Anderson JM, et al. Effect of a cetylated fatty acid topical cream on functional mobility and quality of life of patients with osteoarthritis. J Rheumatol. 2004;31:767–74.
  2. Kraemer WJ, Ratamess NA, Maresh CM, et al. Effects of treatment with a cetylated fatty acid topical cream on static postural stability and plantar pressure distribution in patients with knee osteoarthritis. J Strength Cond Res . 2005;19:115–121.
  3. Hesslink R Jr, Armstrong D, Nagendran MV, et al. Cetylated fatty acids improve knee function in patients with osteoarthritis. J Rheumatol . 2002;29:1708–12.
  4. Hasturk H, Goguet-Surmenian E, Blackwood A, Andry C, Kantarci A. 1-Tetradecanol complex: therapeutic actions in experimental periodontitis.J Periodontol. 2009 Jul;80(7):1103-13.

 

 

Posted in Herbs and Supplements | 24 Comments

Cranberry Products for Prevention of Urinary Tract Infections: An Update of the Evidence

I have written previously about the rationale and evidence concerning the use of cranberry products to prevent or treat urinary tract infections. In my summary, I concluded:

There is weak theoretical justification for using cranberry products for urinary tract infections (UTI), though none of the supporting preclinical evidence involves dogs or cats. There is conflicting clinical trial evidence in humans, and no clinical studies in dogs and cats.  

A recent Cochrane review concerning the use of cranberry products to prevent UTIs in humans further undermines the already weak argument for the value of these products. This update of the previous review in 2008 includes an additional 14 clinical trials in a meta-analysis. The conclusion was that there is no evidence cranberry products are effective for preventing UTIs:

Data included in the meta-analyses showed that, compared with placebo, water or not [sic] treatment, cranberry products did not significantly reduce the occurrence of symptomatic UTI overall (RR 0.86, 95% CI 0.71 to 1.04) or for any the subgroups: women with recurrent UTIs (RR 0.74, 95% CI 0.42 to 1.31); older people (RR 0.75, 95% CI 0.39 to 1.44); pregnant women (RR 1.04, 95% CI 0.97 to 1.17); children with recurrent UTI (RR 0.48, 95% CI 0.19 to 1.22); cancer patients (RR 1.15 95% CI 0.75 to 1.77); or people with neuropathic bladder or spinal injury (RR 0.95, 95% CI: 0.75 to 1.20).

Prior to the current update it appeared there was some evidence that cranberry juice may decrease the number of symptomatic UTIs over a 12 month period, particularly for women with recurrent UTIs. The addition of 14 further studies suggests that cranberry juice is less effective than previously indicated….Given the large number of dropouts/withdrawals from studies (mainly attributed to the acceptability of consuming cranberry products particularly juice, over long periods), and the evidence that the benefit for preventing UTI is small, cranberry juice cannot currently be recommended for the prevention of UTIs. Other preparations (such as powders) need to be quantified using standardised [sic] methods to ensure the potency, and contain enough of the ‘active’ ingredient, before being evaluated in clinical studies or recommended for use.

Cranberry juice does not appear to have a significant benefit in preventing UTIs and may be unacceptable to consume in the long term. Cranberry products (such as tablets or capsules) were also ineffective (although had the same effect as taking antibiotics), possibly due to lack of potency of the ‘active ingredient’.

This review indicates pretty clearly that overall, cranberry juice is not effective in preventing UTIs despite theoretical reasons why it might be. This illustrates, yet again, why we cannot rely on extrapolation from pre-clinical or in vitro studies to tell us what will work in actual patients.

As always, one cannot completely rule out a subset of patients for whom these products might have benefits, but quite a variety of patient populations and different forms of cranberry have been investigated so far without any convincing evidence of value. And, of course, there is no clinical research at all in veterinary species to support using cranberry products to treat or prevent UTIs.

Posted in Herbs and Supplements | Leave a comment

Storyteller’s Creed–How do you feel about this?

There’s a pretty good argument to be made that a lot of the differences between people’s opinions on controversial issues have more to do with differences in temperament and its influence on world view than with the facts or arguments related to specific conflicts. Journalist Chris Mooney has made a compelling case, based on extensive research in psychology, that our political opinions, for example, are shaped more by our temperament than our experiences. And that temperament is determined largely (perhaps 70%) by our genes.

Such a theory certainly seems to explain some of the ideological divisions in the U.S. today, and the intense and reason-proof arguments often seen around so-called “culture war” issues. It would also explain why facts and rational arguments are of so little value in challenging faith-based beliefs, both those pertaining to alternative medicine and those in other domains. Ultimately, a clash of philosophies, built largely on a clash of personalities, may underlie arguments that seem like differences of opinion about factual matters but which seem insoluble and intransigent no matter how much data is available.

Of course, this is a simple theory about a complex subject, human belief and behavior, and it may very well not be correct. Certainly, it can’t be said to be established beyond any reasonable doubt. Still, I find it intriguing and perhaps enlightening.

I ran across the credo below at an art fair last week. My own reaction to it was that it represented the kind of thinking that is behind many of the worst choices and arguments people make. Willful denial of reality in favor of what we wish were true can’t be a sound basis for decisions, in medicine, politics, or any other area involve the world outside our own minds.

I would never deny the importance and power of imagination, hope, love, or other core human feelings. Anyone who knows me will attest I am nothing if not intense in my feelings. Still, I find this set of statements naïve at best and perhaps even a little offensive. Obviously, others see it in a much more positive light. I suspect, though I can’t see any way to prove, that how one reacts to this credo might very well be predictive, to some extent, of how one views religion, alternative medicine, and other areas of conflict between reason and emotion, skepticism and faith. 

I’d be interested in any thoughts or reactions to the series of principles that inspired it.

 

 

The Storyteller’s Creed

 

Posted in General | 9 Comments

Zoopharmacognosy–Do Animals Self-Medicate?

Before becoming a veterinarian, I did a master’s degree in animal behavior, working primarily with chimpanzees. These are fascinating creatures, with many of the cognitive abilities of a young human child (and with a similar emotional temperament as well, which can be a problem in an animal far stronger than any human and equipped with large canine teeth!). One of the most interesting observations about chimpanzees in the wild is that they are sometimes seen eating plants, dirt, or other substances not part of their normal diet, substances which are thought to have possible therapeutic values in preventing or treating parasitic infestations, infections, and other medical problems. Other mammals, birds, and even insects have been seen engaging in similar behaviors, and the suggestion has been made that these creatures are, in some sense, deliberately medicating themselves, a phenomenon labeled zoopharmacognosy.

This is, not surprisingly, a popular idea among proponents of herbal medicine and other medical approaches that claim natural remedies and intuitive knowledge are central to health. However, as a skeptic I am well aware of how easily anecdotes, and elaborate theories built on them, can turn out to be descriptions of what we hope or wish to be true rather than of the world as it actually is. Humans are masters of seeing what we want to see and ignoring things that contradict our beliefs. So do animals self-medicate? 

How Can We Find Out?
The first question to ask in order to explore this subject is how would we demonstrate self-medication and distinguish it from other behaviors? A variety of criteria have been suggested for identifying self-medication in wild animals. And as always in science a consistent pattern that holds up even when attempts are made to explain it with alternative hypotheses is necessary for a reliable conclusion.

Ideally, animals should be seen to seek out and ingest plants or other substances that are not part of their normal diet. They should do so only when they have some objectively identifiable marker of a specific illness. There should be some plausible explanation for why the substance ingested could potentially affect the illness the animal has (e.g. laboratory evidence that a chemical consistently found in a plant can reduce the levels of a GI parasite; NOT simply an unproven folk belief in the medicinal value of the plant). The marker of illness should consistently resolve after the animal has ingested the substance thought to be therapeutic.

Of course, all of these steps could be present and still not definitively prove self-medication, especially given that most behavior of wild animals isn’t observed, and there are many ways in which observers can skew results be selectively attending to or noting some behaviors more than others. Controlled experimentation would also be needed to rule out other explanations. This is, of course, rarely possible with great apes or other wild mammals, though some work has been done with laboratory animals and insects.

Another question to consider is what mechanism might explain self-medicating behavior if it were observed. Do animals have theories of disease, as humans do, that lead them to select specific therapies based on predictions from these theories? Do they remember or communicate to others the particular remedies for particular illnesses? Such deliberative thinking seems pretty unlikely, and there is no reliable evidence of it, despite extensive research, even in the most cognitively advanced species such as the great apes.

More likely, self-medicating behavior would be, like all other behaviors, a product of natural selection operating on underlying variation between individuals. The tendency to seek out certain tastes or smells, for example, when experiencing certain symptoms could easily be fixed by selection if doing so improved the reproductive success of individuals with genes prompting this behavior over that of individuals without such genes. Of course, such adaptive explanations can easily be manufactured for every behavior, and they need to be demonstrated experimentally when possible to be truly believable.

What’s the Evidence?

Wild Animals
In any case, what is the evidence for self medication? In wild animals, it consists largely of uncontrolled observations with a significant risk of bias or misinterpretation. Anecdotes abound, but rigorous, repeatable patterns with solid links between symptoms, behavior, and outcome have not been demonstrated. It is common to note the consumption of an unusual substance and begin looking for evidence of a medical problem to explain it, but instances of that same problem or consumption of that same substance that are not related are overlooked. This is a form of recall or confirmation bias that makes all anecdotes unreliable as evidence for a particular theory.

The medicinal value of plant ingested in such cases is often assumed based on local folk medicine practices or the presence of certain chemicals in the plant which have in vitro effects that might be relevant. The same sources of evidence are often used to validate all kinds of claims about the medicinal value of herbal remedies, and the reality often turns out to be that there is no such value. These kinds of evidence can only suggest possible relationships, not prove them.

And we have to remember that animals also frequently ingest substances that are actively harmful to them. I pull a surprising variety of potentially deadly objects out of the gastrointestinal tract of dogs and cats on a regular basis. And both domestic and wild animals have been seen to succumb to ingestion of poisons as well as indigestible foreign objects. So any theory about intentional self-medication has to also explain this self-injurious behavior. Are these animals committing suicide? Or, as seems more likely, are they mistaking harmful and inedible substances for food or exploring the world through taste and ingestion without a consistent regard for the likely benefit or harm?

There is, of course, little question that animals seek out specific tastes, smells, and colors in their food that are associated with relevant nutrients. It is reasonable, then, to suppose they might similarly seek out such cues in medicinal substances. And the distinction between food and medicine can be unclear when both are made up of substances found in nature and not processed in any significant way. So, all the anecdotes about self-medication behavior may represent an evolved behavior that reduces the burden of disease and parasitism in some individuals, conferring a selective advantage. As of now, however, this is still simply a hypothesis that has not been rigorously demonstrated.

Laboratory Experiments
More convincing evidence of self-medication is available from experimental studies in insects and laboratory animals. One such study, looking at Monarch butterflies, elegantly shows a facultative change in food source associated with parasitism.

These butterflies normally lay their eggs on milkweed. The larvae ingest the plant and incorporate toxins called pyrrolizidine alkaloids into their tissues. These act as a defense mechanism. Predators eating the distinctively colored butterflies will be nauseated by the toxins and will avoid similarly colored butterflies in the future. This doesn’t, of course, help the individual the predators eat, but it can help related individuals who carry similar genes. This is itself a fascinating and amazing example of natural selection in action.

The research study showed that butterflies affected by a certain parasite preferentially lay their eggs on a variety of milkweed which they do not ordinarily use as a food source. This variety contains a higher level of pyrrolizidine alkaloids than the one they usually lay eggs on. Larvae which hatch out on the more toxic variety and ingest its toxins have lower rates of parasitic infestation and a greater reproductive success than parasitized larvae feeding on regular milkweed.

Interestingly, there is a cost to this behavior. Unparasitized larvae that hatch on the more toxin milkweed actually have a reduced survival, so the behavior is only advantageous in the face of parasitism, otherwise it’s a bad choice for the female butterfly. This is also a nice illustration of the fact that all medical therapies, whether “natural” or not, involve balancing risks and benefits in specific circumstances.

This model shows how behavior that can be called self-medicating can evolve in the same way that food preferences evolve. It also shows that the development of such behavior doesn’t require advanced mental abilities or any mystical intuition about the healing value of plants. The trial-and-error processes of natural selection operating over long periods of time are capable of leading to behaviors that appear purposeful even though they are not.

Bottom Line
So do animals self-medicate? Iwould say the answer is a qualified “yes.”

There is good evidence that some animals have evolved adaptive behaviors which include selecting certain food sources preferentially when the individual has a medical problem that that food source can ameliorate. There is considerably less evidence that animals consistently make accurate choice about ingesting specific substances to treat or prevent specific medical conditions. The numerous anecdotes of behaviors which appear to suggest this could easily be matched by anecdotes of behaviors which are clearly self-injurious or neutral with respect to health, so any theory about self-medication has to account for both kinds of behavior.

The theory that most effectively does so is the same general theory of how natural selection shapes food preferences and other complex behaviors over time, through differential reproductive success among individuals with genes predisposing to different behavior patterns selecting for the most adaptive pattern for the current environment. Many such variations are expressed. Some are harmful or maladaptive and eventually die out, but they can be seen at any given “moment” in evolutionary time and mistaken for something that is adaptive. Some variations may hit upon a truly beneficial behavior and, over time, the genes underlying these behaviors will become more frequent in the population, as wil the behavior.

It is important to point out also that this has nothing to do with the complex theories and mythologies used to justify herbal folk medical practices. People may or may not have gotten the idea of using certain plants for treating disease from watching wild animals. Whether or not this is true doesn’t mean those plants are actually effective as medical therapies, in humans or in animals. That has to be proven in the usual rigorous, controlled, scientific way.

And there is no need to imagine a mystical intuition about the healing power of plants to explain self-medication. Butterflies can be manipulated to show such behavior under controlled conditions, and this can be easily explained by established mechanisms of natural selection, without any need for recourse to mystical explanations. Likewise, the medicinal use of natural substances by animals doesn’t suggest this is a highly effective or desirable form of medicine for modern humans. Evolved self-medication and folk medical practices were part of human behavior for millions of years with little improvement in our overall health and longevity. We are fortunate to have stumbled across methods of identifying cases, treatments, and preventive measures for disease that are far more effective even if not “natural” in any atavistic sense.

There is also ample evidence that animals, including humans, make maladaptive choices about food and medicinal substances. Animals ingest poisons and inedible foreign objects readily. And while humans have a clearly adaptive drive to seek certain nutrients which were scarce in the environment in which we evolved (like sugar, salt, and the ample calories in fat), our inability to curb our desire for these substances now that most of us have an abundance of them is the source of the most serious disease afflicting the developed world. The mechanisms of food selection and self-medication which may be beneficial in one environment, can just as easily be harmful in another. They are not drives towards health and well-being; they are specific behaviors generated by natural selection to better adapt our ancestors to a particular environment.

 

 

 

Posted in General, Herbs and Supplements | 11 Comments

The American Holistic Veterinary Medical Foundation: Science or Salesmanship?

One of the biggest problems with alternative veterinary medicine is the promotion of specific therapies or practices without reasonable scientific evidence that these are safe or effective. Sometimes, the evidence is actually clear that a specific approach is not effective, and yet advocates refuse to acknowledge this and abandon the practice. They often defend such practice on the basis of anecdotal experiences suggesting an effect while ignoring all the reasons uncontrolled observations are often wrong and why miracle stories and other testimonials can’t be trusted. However, sometimes scientific research is used to defend a practice even when the research doesn’t truly validate it.

There are several ways to use science to support a therapy that doesn’t actually work.

1. Extrapolation from tangentially related theories:
Proponents of an untested or demonstrably ineffective method will refer to scientific ideas in unrelated areas to suggest their theories must be true. Quantum physics is commonly relied on in this way since it is complex and not really comprehensible to most of us without facility with advanced mathematics. Homeopaths, have made much of the phenomenon of hormesis to suggest that it validates the ultradilution of homeopathic remedies, though it clearly does not.

The problem with this time of defense is it creates the appearance of scientific legitimacy without actually saying anything substantive about the method being defended.

 2. Extrapolation from pre-clinical research:
In vitro or animal model studies can be very useful in demonstrating a basic concept or in screening for possible safety concerns or other biological effects from a therapy. But what happens in a test tube or a lab mouse is not a reliable guide to what happens when an actual patient, often of a different species, with naturally occurring disease. Such research can generate hypotheses and provide support for them, but it cannot be the primary validation for medical therapies.

Again, the problem is that such research is real, legitimate science used illegitimately to imply that we know more about the effects of a medical therapy than we really do.

3. Low-quality, poorly controlled clinical research:
For some CAM therapies, such as homeopathy and acupuncture, there is an enormous body of clinical research in humans. You would think this would make a decision about whether these therapies work easier, but that isn’t always the case. It has been persuasively argued that most published research is wrong, in conventional as well as alternative medicine. It is very easy to set up an experiment to confirm what you already believe. Even with reasonably good controls, single studies often generate unreliable, usually positive results.

The Decline Effect is a well-known phenomenon in which small, early tests of a hypothesis generate positive results, but as independent investigators get involved and potential sources of error are better understood, the effect of the intervention get smaller and sometimes evaporate altogether. This is how science is supposed to work, but it leads to trouble when early, small, low-quality studies without confirmation by replication are cited as evidence to support a therapy.

The National Center for Complementary and Alternative Medicine (NCCAM) was set up specifically to investigate therapies which had committed believers but had little in the way of plausible theories or preliminary research evidence to suggest they were worth subjecting to clinical trial analysis. Its parent was politics, not science, and after more than 10 years and $1.4 billion, the results have been largely negative and have had little impact on the popularity of CAM therapies, even those shown to be useless. The political figure most responsible for this organization, Senator Tom Harkin, reacted to the negative scientific findings with disappointment and a clear lack of understanding of the purpose and methods of science:

One of the purposes of this center was to investigate and validate alternative approaches. Quite frankly, I must say publicly that it has fallen short. It think quite frankly that in this center and in the office previously before it, most of its focus has been on disproving things rather than seeking out and approving.

Of course, real science doesn’t set out to prove what one already believes but to find out what is true.

Which makes me ambivalent about an initiative by the American Holistic Veterinary Medical Association (AHVMA) to generate funding for alternative veterinary medicine research through the American Holistic Veterinary Medical Foundation (AHVMF).

There are certainly some CAVM therapies which deserve rigorous scientific investigation, particularly in the area of herbal medicine. There are also some that we would be better off without, and if clear scientific evidence that these are useless would lead to their decline in popularity, this too would be a good thing. However, based on both human nature and the example of NCCAM, I am suspicious that the AHVMA efforts are more likely to lead to the promotion of alternative therapies without strong, robust scientific evidence that they are worthwhile.

What is the AHVMF, and what is its purpose? Here’s what the AHVMF web site says:

The Foundation was established to receive and administer funds for research and education in all aspects of integrative medicine, especially as it pertains to that part which is called variously, holistic, alternative, or complementary veterinary medicine, or CAVM. The Foundation concentrates on 3 aspects: scholarships for veterinary students who are interested in this branch of veterinary medicine, research in this aspect of veterinary medicine, and support for the use of and education in this branch in veterinary schools.

So from the beginning, the purpose seems largely about promotion of alternative therapies. Research to investigate objectively the potential value of some specific therapies is certainly appropriate. Supporting students who wish to study these therapies seems a bit premature given the lack of evidence that the therapies themselves have value and deserve to be taught. Likewise, supporting the teaching of CAVM in veterinary schools presumes the value of the methods to be taught. So it is difficult to imagine the AHVMA supporting truly rigorous and impartial research given it seems to be focused primarily on promoting therapies that have yet to demonstrate their worth through such research.

Obviously the AHVMF is an offshoot of the AHVMA, sharing office space and many individuals in leadership positions. The AHVMA is a professional association and lobby for CAVM practitioners, so again this suggests that the AHVMF has been formed as a promotional organization rather than to sponsor truly independent research.

This is further supported by the AHVMF statement specifically about the research aspect of their activities:

Holistic medicine often has answers to chronic disease that use methods with few to no side effects. It may have an answer that is non-existent in conventional medicine. But this type of research is always under-funded and overlooked. The AHVMA Foundation is the best way to bring these modalities into the consciousness of mainstream medical thinking and practice.

Clearly, the starting point for AHVMF-funded research is the proposition that CAVM methods work and research is a useful tool for convincing others of this. This does not suggest a truly critical, open-minded approach to the subject. And if there were any doubt about this, it should be eliminated by the fact that the AHVMF has a page specifically devoted to testimonials for the miraculous benefits of CAVM therapies.

Inspiring stories about patients who have been helped by Integrative Medicine. If you have a story, please send it to us, along with a picture and the name of your veterinarian.

Inspiring stories about the success of specific therapies are not typically found on the web sites of organizations supporting research aimed at finding new or better therapies, such as the American Heart Association, American Lung Association, the National Multiple sclerosis Society, and such. Testimonials are he tool of organizations selling something even if, as in his case, it is not a product but a point of view being marketed.

Organizations like the Bravewell Collaboration and others have been very successful at promoting the integration of unproven or disproven therapies into mainstream medical schools and hospitals by providing financial incentives to hop on the bandwagon. Little good-quality science has resulted, and as mentioned earlier what research has been done hasn’t served to effectively validate much CAM or to discourage the use of methods shown not to be effective.

Obviously, it is impossible and inappropriate to judge in advance the quality of the research the AHVMF claims to be raising money to sponsor. The foundation has already raised over $400,000, a not inconsiderable sum in veterinary medicine, and is aiming for $20 million. I hope these resources lead to good-quality, rigorous studies that will let evidence-based medicine advocates like me accept and begin using new, effective therapies and that will convince CAVM advocates to abandon practices which are shown to be effective despite their a priori beliefs. Perhaps the involvement of veterinary schools will ensure the marketing and promotion activities of the AHVMF don’t damage the integrity of the research it funds. I am skeptical that this will be the case, but I will certainly be watching closely and hoping for the best.

Posted in General | 9 Comments

The Problem with Systematic Reviews of Acupuncture in China

One of the highest levels of evidence in the system of evidence-based medicine is the systematic review. Unlike narrative reviews, in which an author selects those studies they consider relevant and then summarizes what they think the studies mean, which is a process subject to a high risk of bias, a systematic review identifies randomized controlled clinical trials according to an explicit and objective set of criteria established ahead of time. Criteria are also used to grade the studies evaluated by quality so any relationship between how well studies are conducted and the results can be identified. Done well, a systematic review gives a good sense of the balance of the evidence for a specific medical question.

Unfortunately, done badly systematic reviews can create an inaccurate impression that there is high-level, high-quality evidence in favor of a hypothesis when there really isn’t. Reviews of acupuncture research illustrate this quite well.

Acupuncture is one of the most studied CAM practices, and this means there is a large volume of research to evaluate. While one might expect this to be a good thing, making it easier to tell whether acupuncture is effective for any specific medical problem, the amount of research studies actually makes for muddy waters in which the truth about the clinical efficacy of acupuncture is difficult to discern. The more studies there are, the greater the chance of getting positive results even for an ineffective therapy. If the quality or methodology of the studies is poor, the results will be unreliable. And if numerous studies of questionable quality exist, it becomes easier to generate systematic reviews which appear to provide high-level supporting evidence that doesn’t actually mean what it looks like it means.

For example, a recent systematic review of the use of acupuncture for pain following stroke appeared in the Journal of Alternative and Complementary Medicine.

Jung Ah Lee, Si-Woon Park, Pil Woo Hwang, Sung Min Lim, Sejeong Kook, Kyung In Choi, and Kyoung Sook Kang. Acupuncture for Shoulder Pain After Stroke: A Systematic. Review The Journal of Alternative and Complementary Medicine. September 2012, 18(9): 818-823.

The conclusion seems quite promising; “It is concluded from this systematic review that acupuncture combined with exercise is effective for shoulder pain after stroke.” Given that a systematic review is high-level evidence, this ought to provide us with a fair degree of confidence that acupuncture is useful for this problem.

But a more detailed look casts a bit of doubt on this conclusion. For one thing, 453 studies were identified and only 7 met the quality criteria for inclusion. This suggests that, even in the eyes of acupuncture researchers, most acupuncture research is lousy. And the 7 studies that were evaluated were all conducted and published in China and all showed positive results. This may have as much to do with how research is conducted and published in China as with the efficacy of acupuncture for this problem.

While there is no question that great scientific research is done in China, there is evidence for a systematic problem with the conduct and publication of alternative medicine studies there. Studies reported as randomized are most often not actually properly randomized. And one review in 1998 found that no negative study of acupuncture had ever been published in China. This strongly suggests that the acupuncture literature coming from China is unreliable due to poor methodological quality and a high risk of publication bias.

A review of systematic reviews published in the same journal as the review of acupuncture for shoulder pain also supports a skeptical interpretation of the first paper.

Bin Ma, Guo-qing Qi, Xiao-ting Lin, Ting Wang, Zhi-min Chen, and Ke-hu Yang. Epidemiology, Quality, and Reporting Characteristics of Systematic Reviews of Acupuncture Interventions Published in Chinese Journals.  The Journal of Alternative and Complementary Medicine. September 2012, 18(9): 813-817.

These authors identified and evaluated systematic reviews of acupuncture research published in China and these were their findings:

Results: A total of 88 SRs were identified; none of the reviews had been updated. Less than one third (27.3%) were written by clinicians and one third (35.2%) were reported in specialty journals. The impact factor of 53.4% of the journals published was 0. Information retrieval was not comprehensive in more than half (59.1%) of the reviews. Less than half (36.4%) reported assessing for publication bias. Though 97.7% of the reviews used the term “systematic review” or “meta-analysis” in the title, no reviews reported a protocol and none were updated even after they had been published after 2 or more years.

Conclusions: Although many SRs of acupuncture interventions have been published in Chinese journals, the reporting quality is troubling. Thus, the most urgent strategy is to focus on increasing the standard of SRs of acupuncture interventions, rather than continuing to publish them in great quantity.

This suggest that most systematic reviews of acupuncture published in China don’t search the literature thoroughly and don’t evaluate it properly. Given existing evidence that much of the research being reviewed is itself questionable, there is ample reason to be suspicious of the conclusions of such systematic reviews.

What this means is that when supporters of acupuncture who claim to follow the principles of evidence-based medicine cite systematic reviews, there is a strong possibility that these reviews don’t actually fairly present the balance of the evidence. If they are poor quality reviews based on a biased sample of questionable studies, then they can only serve to create an inaccurate impression of the efficacy of acupuncture.

And there are systematic reviews of the systematic reviews for acupuncture which have found that the balance of the evidence does not suggest a benefit from acupuncture: “In conclusion, numerous systematic reviews have generated little truly convincing evidence that acupuncture is effective in reducing pain.” A large number of studies makes it possible to generate high-level evidence both for and against a hypothesis, in this case concluding both that acupuncture does and does not relieve pain. That only further clouds the issue since naturally everyone cites those reviews which support their a priori position on acupuncture.

Another way of evaluating the state of the evidence on a given intervention is to compare the quality of studies with the likelihood of positive results. Dr. R. Barker Bausell has reviewed the acupuncture this way in his book Snake Oil Science. As it turns out, the highest-quality studies of acupuncture consistently find acupuncture works no better than placebo and that using fake needles and even jabbing the skin in random places with toothpicks work just as well as “real” acupuncture. Lower quality studies are more likely to be positive. This too sheds doubt on the reliability of positive clinical trials

As supporters of acupuncture will undoubtedly point out, this doesn’t prove acupuncture doesn’t work in those conditions for which systematic reviews have stated it does work. It does show, however, that a lot of time, energy, and money has been spent on acupuncture research without generating a consistent body of evidence to support it, which does not justify great confidence.

Which raises the issue of prior plausibility. In theory, I do not object to clinical trial testing of interventions without well-established theoretical foundations. As Sir Austin Bradford Hill, one of the early luminaries of clinical epidemiology, put it, “What is biologically plausible depends upon the biological knowledge of the day.” And as CAM proponents delight in pointing out, sometimes wacky ideas prove true.

What they often fail to acknowledge, though, is that science does a pretty good job of accommodating such things if they can prove themselves through rigorous testing. The theory that Helicobacter could cause duodenal ulcers was considered implausible when proposed in 1982, and it won a Nobel prize for the proponents of the idea in 2005. That’s a pretty quick acceptance of an initially controversial idea, not consistent with the caricature of mainstream science as closed-minded and dogmatic.

In the real world, however, crazy ideas are far more likely to turn out to be wrong than revolutionary. Dr. Sanden’s Electric Belt was at least as wacky as the idea that bacteria cause ulcers, but it has faded into history without any recognition from the Nobel committee. When time, money, and talent are limited (and they always are), spending them on ideas unlikely to bear fruit is hard to justify.

And while a perfect world might allow for thorough, methodical testing of every possible practice, in the real world we owe it to our patients to focus our energies on those ideas most likely to result in real help for them, those ideas which build on established knowledge rather than asking us to ignore or overturn it.

Finally, some sort of reasonable limit on the time and resources committed to investigating an idea is needed. When adequate effort has been made and a strong, consistent body of evidence has failed to emerge, it is time to move on.

In the case of acupuncture, the original theoretical mechanisms invoked to explain why it should help (Ch’i, meridians, and so on) are vitalistic and inconsistent with established science. Attempts to find alternative mechanisms have yielded some interesting information about physiology and the mediation of pain sensation, but they have not turned up a coherent, unified theory of action supported by good evidence. And enormous numbers of clinical trials have been done over decades, again without yielding a consistent body of evidence supporting a specific therapeutic effect for acupuncture beyond the placebo effects of the therapeutic ritual.  

So determining the truth about acupuncture requires more than simply looking for published systematic reviews. The quality of these reviews, and the studies they evaluate, must be critically appraised. And the evidence at all levels, not simply clinical trials, must be considered. Finally, the proposed mechanisms by which acupuncture might work must also be critically evaluated to see if they are supported by good evidence and consistent with established scientific knowledge. It is a misuse of evidence-based medicine to simply conduct poor quality systematic reviews on poor quality trials with a high risk of bias and then take the conclusion of these reviews at face value. A more comprehensive look at the question and the evidence at all levels is required.

 

 

Posted in Acupuncture | 3 Comments