April 23, 2021

What is Evidenced-Based Medicine?

With the growth of the Internet, we are flooded with information about attention deficit hyperactivity disorder from many sources, most of which aim to provide useful and compelling "facts" about the disorder.  But, for the cautious reader, separating fact from opinion can be difficult when writers have not spelled out how they have come to decide that the information they present is factual. 

My blog has several guidelines to reassure readers that the information they read about ADHD is up-to-date and dependable. They are as follows:

Nearly all the information presented is based on peer-reviewed publications in the scientific literature about ADHD. "Peer-reviewed" means that other scientists read the article and made suggestions for changes and approved that it was of sufficient quality for publication. I say "nearly all" because in some cases I've used books or other information published by colleagues who have a reputation for high-quality science.

When expressing certainty about putative facts, I am guided by the principles of evidence-based medicine, which recognizes that the degree to which we can be certain about the truth of scientific statements depends on several features of the scientific papers used to justify the statements, such as the number of studies available and the quality of the individual studies. For example, compare these two types of studies.  One study gives drug X to 10 ADHD patients and reported that 7 improved.  Another gave drug Y to 100 patients and a placebo to 100 other patients and used statistics to show that the rate of improvement was significantly greater in the drug-treated group. The second study is much better and much larger, so we should be more confident in its conclusions. The rules of evidence are fairly complex and can be viewed at the Oxford Center for Evidenced Based Medicine (OCEBM;http://www.cebm.net/).


The evidenced-based approach incorporates two types of information: a) the quality of the evidence and b) the magnitude of the treatment effect. The OCEBM levels of evidence quality are defined as follows (higher numbers are better:

  1. Mechanism-based reasoning.  For example, some data suggest that oxidative stress leads to ADHD, and we know that omega-3 fatty acids reduce oxidative stress. So there is a reasonable mechanism whereby omega-3 therapy might help ADHD people.
  2. Studies of one or a few people without a control group, or studies that compare treated patients to those that were not treated in the past.

Non-randomized, controlled studies.    In these studies, the treatment group is compared to a group that receives a placebo treatment, which is a fake treatment not expected to work.  

  1. Non-randomized means that the comparison might be confounded by having placed different types of patients in the treatment and control groups.
  2. A single randomized trial.  This type of study is not confounded.
  3. Systematic review and meta-analysis of randomized trials. This means that many randomized trials have been completed and someone has combined them to reach a more accurate conclusion.

It is possible to have high-quality evidence proving that a treatment works but the treatment might not work very well. So it is important to consider the magnitude of the treatment effect, also called the "effect size" by statisticians. For ADHD, it is easiest to think about ranking treatments on a ten-point scale. The stimulant medications have a quality rating of 5 and also have the strongest magnitude of effect, about 9 or 10.Omega-3 fatty acid supplementation 'works' with a quality rating of 5, but the score for the magnitude of the effect is only 2, so it doesn't work very well. We have to take into account patient or parent preferences, comorbid conditions, prior response to treatment, and other issues when choosing a treatment for a specific patient, but we can only use an evidence-based approach when deciding which treatments are well-supported as helpful for a disorder.

Related posts

No items found.

Swedish Population Study Confirms Association Between ADHD and Height

Nationwide population study in Sweden confirms association between ADHD and shorter height in children and adolescents, suggests stimulant medications are not a factor

A commonly reported risk associated with ADHD medication is reduced growth in height. But studies to date have generally not adequately described or measured possible confounders, such as genetic factors, prenatal factors, or socioeconomic factors. What if ADHD were associated with reduced height even in the absence of medications? 

An international study team explored this question by performing a nationwide population study comparing data from before (1968-1991) and after (1992-2020) the adoption of stimulant therapy for ADHD in Sweden. 

The country’s single-payer health insurance system that connects patient records with all other national registers through unique personal identification numbers makes such analysis possible. Sweden also has military service conscription, which records the heights of 18-year-old males.

The participants were all 14,268 Swedish males with a diagnosis of ADHD who were drafted into military service at any time from 1968 through 2020. 

Up to five non-ADHD controls were identified for each ADHD case, matched by sex (they had to be male), birth year, and county. The total number of controls was 71,339.

Among 34,586 participants in the period before adoption of stimulant medications (1968-1991), those diagnosed with ADHD had roughly 30% greater odds of being shorter than normal (166-172 vs. 173-185 cm) than typically developing controls. That dropped to 20% greater odds among the 34,714 participants in the cohort following adoption of stimulant medications.

The odds of those diagnosed with ADHD being much shorter than normal (150-165 vs. 173-185 cm) remained identical (about 55% greater) among the almost 30,000 participants in both cohorts.

In other words, there was no increase in the odds of ADHD individuals being shorter than normal after adoption of stimulant therapy in Sweden compared with before such adoption.

Furthermore, after adjusting for known confounders, including birth weight, inflammatory bowel disease, celiac disease, hypothyroidism, anxiety disorders, depression, substance use disorder, and highest parental education, the odds of those diagnosed with ADHD being shorter than normal or much shorter than normal in the 1992-2020 cohort dropped to roughly 10% and 30% greater, respectively.

Could it be the disorder itself rather than stimulant treatment that is associated with reduced height in individuals diagnosed with ADHD?

To address effects of environmental and familial/genetic confounding, the team then compared the entire cohort of males diagnosed with ADHD from 1968 through 2020 with typically developing male relatives, ranging from first cousins to full siblings.

Among full siblings, the odds of those with ADHD diagnoses being shorter (over 90,000 participants) or much shorter (over 77,000 participants) were a statistically significant 14% and 18%, respectively.

The authors concluded, “Our findings suggest that ADHD is associated with shorter height. On a population level, this association was present both before and after ADHD-medications were available in Sweden. The association between ADHD and height was partly explained by prenatal factors, psychiatric comorbidity, low SES [socioeconomic status] and a shared familial liability for ADHD.”

January 9, 2024

Swedish nationwide population study finds mothers with ADHD have elevated risk of depression and anxiety disorders after childbirth

Swedish nationwide population study finds mothers with ADHD have elevated risk of depression and anxiety disorders after childbirth

In the general population, most mothers experience mood disturbances right after childbirth, commonly known as postpartum blues, baby blues, or maternity blues. Yet only about one in six develop symptoms with a duration and magnitude that require treatment for depressive disorder, and one in ten for anxiety disorder.

To what extent does ADHD contribute to the risk of such disorders following childbirth? A Swedish study team used the country’s single-payer health insurance database and other national registers to conduct the first nationwide population study to explore this question.

They used the medical birth register to identify all 420,513 women above 15 years of age who gave birth to their first child, and all 352,534 who gave birth to their second child, between 2005 and 2013. They excluded miscarriages. They then looked for diagnoses of depression and/or anxiety disorders up to a year following childbirth.

In the study population, 3,515 mothers had been diagnosed with ADHD, and the other 769,532 had no such diagnosis. 

Following childbirth, depression disorders were five times more prevalent among mothers with ADHD than among their non-ADHD peers. Excluding individuals with a prior history of depression made little difference, lowering the prevalence ratio to just under 5. Among women under 25, the prevalence ratio was still above 3, while for those 25 and older it was above 6.

Similarly, anxiety disorders were over five times more prevalent among mothers with ADHD than among their non-ADHD peers. Once again, excluding individuals with a prior history of depression made little difference, lowering the prevalence ratio to just under 5. Among women under 25, the prevalence ratio was still above 3, while for those 25 and older it was above 6.

The team cautioned, “There is a potential risk of surveillance bias as women diagnosed with ADHD are more likely to have repeated visits to psychiatric care and might have an enhanced likelihood of also being diagnosed with depression and anxiety disorders postpartum, compared to women without ADHD.”

Nevertheless, they concluded, “ADHD is an important risk factor for both depression and anxiety disorders in the postpartum period and should be considered in the post- pregnancy maternal care, regardless of sociodemographic factors and the presence of other psychiatric disorders. Parental education prior to conception, psychological surveillance during, and social support after childbirth should be provided to women diagnosed with ADHD.”

December 22, 2023

Meta-analysis suggests acupuncture might offer effective treatment for ADHD, but suffers from methodological flaws

Meta-analysis suggests acupuncture might offer effective treatment for ADHD, but suffers from methodological flaws

Noting that previous “systematic reviews concluded that currently available data on the clinical effectiveness of acupuncture for treating ADHD are yet to be sufficient to support its routine use,” a South Korean study team conducted an updated systematic search of the medical literature for randomized controlled trials (RCTs) comparing acupuncture with drug treatment for children and adolescents with ADHD. There were no restrictions on language or publication type.

Only two of the meta-analyses involved more than two RCTs. 

One of them, of six RCTs with a combined 541 participants, reported total treatment efficacy of acupuncture to be at least equal to that of conventional treatment with ADHD medicines. 

Another, of five RCTs with a total of 351 participants, reported total treatment efficacy of combined acupuncture and ADHD drugs to be at least equal to that of conventional treatment with ADHD medicines.

Two RCTs with a Noting that previous “systematic reviews concluded that currently available data on the clinical effectiveness of acupuncture for treating ADHD are yet to be sufficient to support its routine use,” a South Korean study team conducted an updated systematic search of the medical literature for randomized controlled trials (RCTs) comparing acupuncture with drug treatment for children and adolescents with ADHD. There were no restrictions on language or publication type.

Only two of the meta-analyses involved more than two RCTs. 

One of them, of six RCTs with a combined 541 participants, reported total treatment efficacy of acupuncture to be at least equal to that of conventional treatment with ADHD medicines. 

Another, of five RCTs with a total of 351 participants, reported total treatment efficacy of combined acupuncture and ADHD drugs to be at least equal to that of conventional treatment with ADHD medicines.

Two RCTs with a combined 152 participants reported a large effect size improvement in hyperactivity/impulsivity symptoms from acupuncture treatment versus conventional drug treatment.

From this one could superficially conclude that acupuncture is at least as effective for treating ADHD as the medicines currently considered to be the standard of care, and that there is no need to combine acupuncture with drug treatment.

However, there were numerous methodological shortcomings:

  • No effort was made to look for publication bias.
  • There were few RCTs, and the combined number of participants was relatively small.
  • Only one of the six RCTs in the first meta-analysis and none of the five RCTs in the second meta-analysis was rated “low risk of bias.”
  • Though nowhere stated in the journal article, there may have been cultural bias as well. All studies included in the meta-analyses were conducted in China. As China has emerged as a global superpower, it has been eager to portray its traditional medicine as at least equal if not superior to forms of medicine originating elsewhere.
  • The authors noted, “the quality of the studies included in this systematic review was poor. Assessing the blinding of studies is a major aspect in determining the risk of bias of a study, but most of the studies did not provide any relevant information.” 

The authors concluded, “The current evidence on AT [acupuncture treatment] is still too limited to support its routine use in treating ADHD.”

152 participants reported a large effect size improvement in hyperactivity/impulsivity symptoms from acupuncture treatment versus conventional drug treatment.

From this one could superficially conclude that acupuncture is at least as effective for treating ADHD as the medicines currently considered to be the standard of care, and furthermore that there is no need to combine acupuncture with drug treatment.

However, there were numerous methodological shortcomings:

  • No effort was made to look for publication bias.
  • There were few RCTs, and the combined number of participants was relatively small.
  • Only one of the six RCTs in the first meta-analysis and none of the five RCTs in the second meta-analysis was rated “low risk of bias.”
  • Though nowhere stated in the journal article, there may have been cultural bias as well. All studies included in the meta-analyses were conducted in China. As China has emerged as a global superpower, it has been eager to portray its traditional medicine as at least equal if not superior to forms of medicine originating elsewhere.
  • The authors noted, “the quality of the studies included in this systematic review was poor. Assessing the blinding of studies is a major aspect in determining the risk of bias of a study, but most of the studies did not provide any relevant information.” 

The authors concluded, “The current evidence on AT [acupuncture treatment] is still too limited to support its routine use in treating ADHD.”

January 4, 2024