Tuesday, November 10, 2015

The Business of Psychological Questionnaires

Questionnaires are certainly in vogue in mental health research.  Often they are referred to in technical-sounding jargon, for example it is common to call a questionnaire an "instrument"  or a "measurement tool."

There are good reasons to have well-standardized questionnaires.  In research, it is useful if people across the world are all using a similar type of questionnaire, so that comparisons can be made more easily and clearly.

In psychotherapy or other mental health practice, there is evidence that obtaining regular feedback from patients or clients can be valuable to improve the quality of the therapy, and to prevent mistakes.  One of the leaders in showing the importance of this is Michael Lambert, an esteemed psychologist and psychotherapy researcher from Brigham Young University.  In a nutshell, his research shows us that problems can occur in psychotherapy without the therapist realizing it:  the patient or client could be developing new symptoms, detaching or losing interest in the therapy, feeling upset or disappointed with the therapist, or even developing a life-threatening emergency, but the therapist may not know this, because it is not talked about or asked about in the session.  This could be because the patient is inhibited to share this information, but it could also be simply because the problem was never inquired about.  In therapy sessions, just like with any other interaction, one can follow a certain narrative pathway habitually, therefore missing things that could be quietly going wrong in the background.

So Lambert has developed a questionnaire called the OQ-45, which consists of 45 simple questions covering everything from mood, anxiety, relationship satisfaction, loneliness, drinking, family life, work life, cognition, and physical health.  The idea is for patients or clients to fill in this questionnaire frequently, maybe even before every therapy appointment, so that no potential evolving problem area would be "missed."   The questionnaire would only take a few minutes to fill out, and could be done in the waiting room before an appointment.    Samples of the OQ-45 can be found in an internet search.  

I believe that this type of questionnaire is useful.  Certainly we have to respect Lambert's many years of research, to acknowledge that feedback of this type can improve therapy.

But the therapeutic benefit of this is not due to some special property of the questionnaire itself!  And the therapeutic benefit does not require the sophisticated statistical analysis that is offered to purchasers of the questionnaire!  The benefit of this is simply to do a review of symptoms regularly with patients or clients.  

Questionnaires in psychology have become a business.  For hundreds of dollars, one can sign up to receive copies of a questionnaire, scoring manuals, or perhaps an on-line entry and scoring package, which may produce attractive graphs of results.

I believe that it is absurd--in most cases--to have to pay for something like this.  The therapeutic principle here is of simply keeping track of a wide range of symptoms or problems systematically.   The technology here is not a sophisticated x-ray machine or microscope -- rather, they are sets of simple questions such as "I'm a good person" or "My body hurts" (to be rated from 0-4).

I have jokingly thought of creating a questionnaire, to be marketed, with a full statistical analysis package and online access, called the "How Are You Doing" instrument (the HAY-D-1).  It would consist of a single question, "How are you doing?"  with the opportunity to choose from one of 5 responses.    Perhaps there could be a published article demonstrating its reliability, validity, and correlations with other established research instruments. 

Understandably, many researchers have worked long and hard to show useful results from their work.  And it could be very desirable for them to have a way to earn a financial reward from the fruits of their labor.  I suppose, in a free society, it is quite reasonable for people to attempt to sell such things, if people are willing to buy them.

But when there is this type of marketing and financial dealing going on, it can increase biases on the part of both the seller and the buyer.  The buyer, having paid good money for questionnaires or "instruments," is more likely to think highly of their acquisition, due to cognitive bias (think again of Daniel Kahneman's work showing such effects).  Perhaps therapists are more likely to rely on such purchased questionnaires rather than simply creating their own.

I think it could be useful, if questionnaires are to be used at all, to create custom symptom review questions.  There is also some evidence that questions about the therapeutic alliance could be pertinent to therapeutic progress; these are absent from many symptom review surveys, including the OQ-45.

A nice idea in CBT is to have the clients or patients be actively involved in assessing and planning their own progress, instead of having the therapist be the "assessor."  So, it could be a useful therapeutic exercise for clients or patients to design their own questionnaires, using their own language, and their own scale!  The therapist could encourage and suggest a wide range of categories of questions to be followed, covering areas of physical, social, occupational, cultural, and psychological health, as well as a category about the therapeutic alliance, but the questions themselves could be designed by the client or patient!    If statistical analysis was felt to be interesting or useful, we could easily design a simple app to create graphs, or use a spreadsheet -- we would not have to pay an extra fee for this!

So I support the idea of regularly conducting broad symptom reviews in psychotherapy, but I do not believe it is necessary to buy questionnaire packages.  It could be even better to design one's own package, or collaborate with a patient or client to design a custom, personalized survey.  

Monday, November 9, 2015

Stimulant Medications for treating ADHD: A comparison

ADHD medication is a big business in the world today.  Annual sales of ADHD medication are projected to be 15-20 billion dollars by 2020, increasing at a rate of about 8% per year.   To put this in perspective, this is similar to the value of the worldwide market for fresh vegetables
 ( http://siteresources.worldbank.org/INTPROSPECTS/Resources/GATChapter13.pdf ).

 It is an amount of money that would pay for the salaries of  400 000 teachers, each of whom paid $50 000 per year. 

 A relevant article to look at about this is by Alan Schwartz, published in the New York Times in 2013:

I am not meaning this post to be a discussion of the controversies of ADHD diagnosis.  Instead, this post will focus mainly about ADHD medication.   I think the rising rate of ADHD diagnosis, and the rising rate of stimulant prescription,  is a very concerning trend, particularly if these diagnoses and treatments are offered without attending adequately to other biopsychosocial factors, and particularly if these treatments are being offered under the influence of un-recognized biases due to the financial power and influence of the manufacturers.

On the other hand, the rising awareness and acceptance of ADHD can allow those children, adults, and families who are dealing with ADHD-related issues to feel less stigmatized, judged, and unfairly treated.  In families, knowledge and acceptance of ADHD can help child-rearing practices to be adapted, so as to avoid a harshly punitive stance towards those children with attention problems.  

The newer ADHD medications are, not surprisingly, very popular, frequently prescribed, are often touted as being better than the older medications, and are listed first on medication advice guideline sheets (such as the CADDRA recommendations).

Here is a comparison of costs per day between the different ADHD drugs, looking at a typical full therapeutic dose for an adult.  These cost estimates come from a site called "Pharmacy Compass" which searches for the best local prices for medications at pharmacies.   

1. Newer drugs (CADDRA considers these to be the only "first line" medications):

Adderall XR 30 mg:$3.91 per day
Biphentin 80 mg:$4.36 per day
Concerta 72 mg:$5.92 per day
Vyvanse 60 mg:  $5.14 per day
Strattera 100 mg: $5.51 per day

2. Older drugs (CADDRA considers these "second line"):

Dexedrine spansules 40 mg: $3.59 per day

Ritalin (methylphenidate) 60 mg: $0.81 per day
 Ritalin SR 60 mg $0.66 per day

So we see that the least expensive option is methylphenidate or methylphenidate SR.  Dexedrine is over 5 times as expensive.  Concerta and Vyvanse are about 8 times as expensive, per day.

I mention these expense differences not necessarily in an effort to favour the cheaper medication, but rather to heighten your anticipation that there could be bias in any research results regarding these medications--especially if the research is sponsored by the manufacturers-- due to the huge profit motives involved.

It would be fair to look for studies which carefully and prospectively treat ADHD patients with Ritalin vs. one of the newer medications, in randomized comparisons.

1) Vyvanse vs. Ritalin.  Almost no studies in the literature!  In one study, all they looked at was whether patients stuck to a dosing regimen, in which case the Vyvanse group did "better." (http://www.ncbi.nlm.nih.gov/pubmed/23937642 ) But this measure had nothing to do with the patients actually feeling better or improving more!

A better study compared Vyvanse with Oros-MPH, a long-acting version of Ritalin (though not plain old Ritalin itself!)
[ http://www.ncbi.nlm.nih.gov/pubmed/23801529]

In this study, at first glance it certainly appears that Vyvanse is better!  But looking carefully, one finds statements such as this: "At endpoint, the difference between lisdexamfetamine and OROS-MPH in the percentage of patients with an ADHD-RS-IV total score less than or equal to the mean for their age was not statistically significant." (p.747)   This statement was tucked into the results section but left out of the conclusion.  Looking at side-effects, we find a lower total rate of adverse effects in the Ritalin group.  Reduced appetite, insomnia, and nausea were more common in the Vyvanse group.  Notably, there is a long list of conflicts of interest at the end of this paper, including some of the authors being employees of the Vyvanse manufacturer, and owning stocks in the company!

In conclusion here, there is no doubt that Vyvanse is an effective medication for ADHD.  The dosing regime is very convenient, which may be particularly effective and helpful for many.  But it is not necessarily superior to much cheaper alternatives.  For some people (including many patients I have seen), regular methylphenidate (Ritalin) allows better fine control of symptoms during the course of the day, without being "stuck" with a continuous sustained-release effect.  For others, they certainly do prefer the Vyvanse.  I just think that Vyvanse should not be assumed to be better, as the evidence is very weak that it is, while it is 8 times more expensive than Ritalin!

2) Concerta vs. Ritalin
This is a good early study, directly comparing the two medications, published in Pediatrics in 2001.  Here is the authors' concise summary: "On virtually all measures in all settings, both drug conditions were significantly different from placebo, and the 2 drugs were not different from each other."   The reason to choose Concerta over Ritalin would be convenience.  The authors do point out that "compliance" is more likely on a long-acting formulation.  But remember that "compliance" is a very, very indirect, and possibly irrelevant, measure of health and well-being!!  Why is it important that there be better "compliance?"   Should the only criteria not be well-being?   Certainly this is not a reason to classify Concerta as "better" or "first line".  Concerta is 9 times more expensive than Ritalin!

3) Adderall vs Ritalin
In this study, published in Pediatrics in 1999, Adderall comes out as looking better than Ritalin.  But, once again, the study was sponsored by the manufacturer.  On a close look, a couple of problems:  first, the doses of the medications were fixed.  The ritalin doses appear too low, so as not to match the equivalent doses of Adderall given.  At this point, one would usually give Ritalin doses at least twice that of Adderall (i.e. 100% higher) but in this study the Ritalin dose was only 40% higher than the Adderall dose.  In accordance with this under-dosing, the Adderall group not surprisingly had more side effects such as insomnia.

In conclusion, there is no doubt that Adderall XR is a good medication for ADHD.  Many of my patients have preferred it over other alternatives.  But it is not fair, once again, to assume that it is better.  It does not deserve to be considered "first line" while a similarly-effective alternative that is one-sixth the cost is considered "second line."

4) Meta-analytic comparison:
Faraone and Glatt (2010) have published a good meta-analytic review paper, which is worth reading in detail, with particular attention to the data tables and graphs:   http://www.ncbi.nlm.nih.gov/pubmed/20051220
In the conclusion of this paper, the authors state that they "found no significant differences between short- and long-acting stimulant medications."

Quetiapine for non-psychotic depression and anxiety

I read a recent review last week which warned against the use of quetiapine for treating non-psychotic mood disorders.

Yet, I believe there are a number of reasons to consider quetiapine and similar medications for non-psychotic states:

1) there is a much lower risk of the medication causing mania or psychosis.  With antidepressants, there is always the risk of mania induction.  Quetiapine not only would not cause mania, it could protect against it.

2) the use of quetiapine could reduce the likelihood of other sedatives, such as benzodiazepines, being used as often.  Benzodiazepine dependence is very common.  Quetiapine is less "addictive."

3) the doses of quetiapine in non-psychotic states can often be very low (under 100 mg) causing a much lower risk of metabolic side-effects than full doses of 400-600 mg per day or more.

What about research evidence?

Mezhebovsky et al (2013) published results of a multi-centre study involving about 450 elderly patients, showing that quetiapine 50-300 mg (mean = 168 mg) daily for 11 weeks, led to significant improvements in generalized anxiety symptoms, compared to placebo.
( http://www.ncbi.nlm.nih.gov/pubmed/23070803  )
 As with most effective treatments, the medication group had about twice as much improvement as the placebo group.  It is true that sleep improvement could account for a significant proportion of the overall symptom score improvement, but there was also improvement in the other symptom domains.   There were no major metabolic side effect problems in the quetiapine group.  The most common side effect was somnolence (sleepiness).

A 2012 review by Sanford and Keating ( http://www.ncbi.nlm.nih.gov/pubmed/22519923 ) showed an abundance of evidence that quetiapine is beneficial for treating bipolar depression (typically at doses of 300 mg/day) and for preventing recurrences of any mood episode.  For those who benefit acutely from quetiapine, there is evidence that it is a more effective mood stabilizer--on its own--than lithium. 

In unipolar depression, quetiapine would be most commonly used when a standard treatment such as an antidepressant was not working well.  In a study by El-Khalili et al (2010), quetiapine up to 300 mg per day was added as an adjunct to previous therapy for non-remitting depression:
( http://www.ncbi.nlm.nih.gov/pubmed/20175941).  They showed a modest benefit of adding the quetiapine, particularly at a higher dose of 300 mg/d.    A nice component of this article is the inclusion of symptom subtypes.   Many critics would argue that quetiapine might simply be sedating, and improve sleep, leading to most of its benefit over placebo.  These results confirm that quetiapine improves sleep symptoms.  But there were also symptom improvements in other categories, such as pessimism, inner tension,  and concentration impairment.

In conclusion, I think that quetiapine deserves to be considered as a medication option for non-psychotic conditions.   In many cases, there are comorbidities or diagnostic uncertainties, in cases of depression.  Many studies exclude patients who have comorbidities, or who do not neatly fit into diagnostic categories.   Quetiapine is unlikely to worsen comorbid conditions, and may be beneficial for many.  This makes it a safe option to think about if there is uncertainty or complexity in the diagnosis.  Standard antidepressants in this situation may carry a higher risk of causing new problems, including agitation or a manic state.

 The risks of metabolic side effects, etc. need to be watched for carefully, with consideration of stopping or changing the plan if problems of this type arise. 

Duloxetine (Cymbalta)

Duloxetine (Cymbalta) is another newer antidepressant, approved in the US in 2004, and in Canada in 2007.  It is a reuptake inhibitor of both serotonin and norepinephrine, and is most similar in this regard to venlafaxine (Effexor).  

In a study of medication treatment options for severe depression, a switch to duloxetine was compared with a dose increase of escitalopram.  The escitalopram group had better results, including a remission rate of 54% for escitalopram vs. 42% for duloxetine.  ( http://www.ncbi.nlm.nih.gov/pubmed/22559255 )

Another similar comparative study also favoured escitalopram 10-20 mg daily over duloxetine 60 mg, both in terms of effectiveness and side effect profile.  In this study 2% of the escitalopram group dropped out due to side effects, compared to 13% of the duloxetine group.
( http://www.ncbi.nlm.nih.gov/pubmed/17563128 )

In this well-done 2011 review by Schueler et al. comparing venlafaxine and duloxetine with SSRIs.  They concluded the following:
1) Venlafaxine had superior efficacy in response rates but inferior tolerability to SSRIs
2)  Duloxetine did not show any advantages over other antidepressants and was less well tolerated than SSRIs and venlafaxine.
( http://www.ncbi.nlm.nih.gov/pubmed/20831742 )

Another study, done in 2006, also showing evidence that venlafaxine is superior to duloxetine:  http://www.ncbi.nlm.nih.gov/pubmed/16867188

In one of the few well-designed comparative studies of venlafaxine vs. duloxetine, done by Perahia et al (2008), the two medications are found to have similar effectiveness, but with a higher dropout rate due to side effects in the duloxetine group. ( http://www.ncbi.nlm.nih.gov/pubmed/17445831 )   A look at graphs of symptom change show that the two medications appear identically effective.  But duloxetine caused more side effects, especially nausea.  It is true that discontinuing venlafaxine causes more side effects than discontinuing duloxetine, but this could be framed as a technical matter that just needs to be managed by very slow tapering.

This 2012 study (sponsored by the manufacturer!) by Martinez et al ( http://www.ncbi.nlm.nih.gov/pubmed/22027844 ) compares duloxetine with SSRI treatments for major depression, in a 12 week prospective trial.  Duloxetine performed well, but on the primary outcome measure there was no significant difference in response or remission rates.  On secondary measures there appeared to be some advantages for duloxetine, particularly for pain symptoms.  But the study was not intended to be for treating pain syndromes!  SSRIs are known to be ineffective for pain!
 Duloxetine is often touted as a good treatment for neuropathic pain.  And numerous studies do show that it can help.  But how does it actually compare to other options?  Specifically, how does it compare with a much cheaper and similar antidepressant, venlafaxine?   Rudroju et al (2013) looked at comparative effectiveness of various medications for treating neuropathic pain.  Many medications helped, including duloxetine.  But in this study, gabapentin and venlafaxine had the best odds ratio of helping, followed by pregabalin. Duloxetine was farther down the list.  With a benefit-risk analysis, which takes into account side effects and tolerability, gabapentin, pregabalin, and venlafaxine were once again at the top of the list of best agents, with duloxetine farther down.
 ( http://www.ncbi.nlm.nih.gov/pubmed/24284851)

Duloxetine (Cymbalta) costs about $4.23 for a 60 mg dose, compared to $0.38 for an equivalent 150 mg dose of Effexor XR.  So it is about 10 times more expensive than an alternative which is shown to work as well if not better. 

In conclusion, Cymbalta is yet another newer antidepressant which is not necessarily better than alternatives; in fact the alternatives such as Effexor XR are probably equally effective or more effective.   It is marketed intensely as a treatment for neuropathic and other pain syndromes, but alternatives such as Effexor XR work better, with fewer side effects, at a lower cost.   Therefore, just as with the other antidepressants mentioned in the previous posts, Cymbalta could be considered a third-line option, which might suit some people well if they have tried other things unsuccessfully.


Vortioxetine is one of the newest antidepressants on the market, released in the U.S. in 2013.  It has serotonin and norepinephrine reuptake inhibition effects, plus a variety of direct effects on serotonin receptors. 

This is a negative study of vortioxetine, showing that it did not lead to any difference in rating scores compared to placebo, when used at doses of 10 mg or 15 mg daily, to treat depression for 8 weeks:

In another study, by Jacobson et al (2015), looking at doses of 10 mg or 20 mg daily, they found slight improvements in the vortioxetine groups compared to placebo, with "significant" differences in the MADRS score only for the 20 mg dose ( http://www.ncbi.nlm.nih.gov/pubmed/26035185 ).  If you look at the symptom changes vs. placebo on a graph, the clinical relevance of the vortioxetine effect appears questionable.  Yet, typically with papers of this type, despite the results being very unimpressive, the authors try to frame it in a very positive way, as though they had discovered a fantastically effective new treatment.  Vortioxetine is supposed to be helpful for managing sexual side effects as well, but the measures of this done in the study once again do not show a spectacular benefit.  For those who did not have sexual side effects previously, about half in the vortioxetine group developed sexual side effects, at a rate 10-20% greater than placebo.   Here are the authors' final assertions at the end of their paper:   "In conclusion, vortioxetine 20 mg significantly reduced MADRS total score at 8 weeks in adults with MDD. Overall, vortioxetine was well tolerated in this study."   Perhaps a more fair conclusion could be "vortioxetine produced small differences compared to placebo in the MADRS score, but only at a dose of 20 mg daily.  The degree of improvement does not compare favourably with similar studies using other antidepressants.  Rates of side effects, including sexual side effects, were higher in the vortioxetine groups compared to the placebo groups."   

A 2015 meta-analytic review paper by Rosenblat et al (http://www.ncbi.nlm.nih.gov/pubmed/26209859 ) showed in general that antidepressants appear to help with cognitive function when used to treat depression.  But they conclude that "no statistically significant difference in cognitive effects was found when pooling results from head-to-head trials of SSRIs, SNRIs, TCAs, and NDRIs."

In this article by Llorca et al (2014), which is a "meta-regression analysis", it appears to favour vortioxetine as being better than other antidepressants.  (https://www.ncbi.nlm.nih.gov/pubmed/25249164)This article is then quoted elsewhere, such as on Wikipedia, as supporting the claim that vortioxetine is a superior antidepressant.  But the article shows indirect information only, there is no actual comparative study referred to at all.  And the findings, even from this study, really only show that vortioxetine is in the "same ballpark" in terms of effects, compared to other agents-- it certainly doesn't show superiority.

It was hoped that vortioxetine might help with generalized anxiety, but after several negative studies (https://www.ncbi.nlm.nih.gov/pubmed/24424707,
https://www.ncbi.nlm.nih.gov/pubmed/24341301 ), the latter of which showing that it was significantly inferior to another antidepressant (duloxetine), it is no longer claimed by anyone that it is an appropriate treatment for GAD.

Vortioxetine costs about $3.25 for a 20 mg dose.  This is about 10 times more than a 20 mg dose of citalopram.  

In conclusion, vortioxetine is another new option for treating depression.  It could be something to think about for treating anxious depression.  But there is no evidence that it is superior to other options, and is probably inferior in many cases.  There is no evidence of any specific benefit for treating anxiety disorders such as GAD.    I would consider it to be a third-line alternative at this point.