Predicting placebo response in adolescents with major depressive disorder: The Adolescent Placebo Impact Composite Score (APICS)

Paul A. Nakonezny, Taryn L. Mayes, Matthew J. Byerly, Graham J. Emslie

Research output: Contribution to journalArticle

8 Citations (Scopus)

Abstract

Objective: The aim of this study was to construct a composite scoring system to predict the probability of placebo response in adolescents with Major Depressive Disorder (MDD). Method: Participants of the current study were 151 adolescents (aged 12-17 years) who were randomized to the placebo arm (placebo transdermal patches) of a randomized controlled trial (RCT) comparing the selegiline transdermal patch with placebo (DelBello etal., 2014). The primary outcome of response was defined as a CGI-I score of 1 or 2 (very much or much improved) at week 12 (study-end) or exit. As a first step, a multiple logistic mixed model was used to estimate the odds of placebo response from each predictor in the model, including age, CDRS-R total at baseline (depressive symptom severity), history of recurrent depression (yes vs. no), sex (female vs. male), and race (non-Caucasian vs. Caucasian). On the basis of the initial logistic mixed model analysis, we then constructed an Adolescent Placebo Impact Composite Score (APICS) that became the sole predictor in a re-specified Bayesian logistic regression model to estimate the probability of placebo response. Finally, the AUC for the APICS was tested against a nominal area of 0.50 to evaluate how well the APICS discriminated placebo response status. Results: Among the 151 adolescents, with a mean age of 14.6 years (SD=1.6) and a mean baseline CDRS-R total of 60.6 (SD=12.1), 68.2% were females, 50.3% was Caucasian, and 39.7% had a history of recurrent depression. Placebo response rate was 58.3%. Based on the logistic mixed model, the re-specified equation with the highest discriminatory ability to estimate the probability of placebo response was APICS=age+(0.32×CDRS-R Total at baseline)+(-2.85×if female)+(-5.50×if history of recurrent depression)+(-5.85×if non-Caucasian). The AUC for this model was 0.59 (p=.049). Within a Bayesian decision-theoretic framework, in 95.5% of the time, the 10,000 posterior Monte Carlo samples suggested that as APICS decreased the probability of placebo response increased. The observed APICS and related probability of responding to placebo in this adolescent sample ranged from 14.1=74.1% (in placebo responders) to 39.1=41.8% (in placebo non-responders). Conclusion: The APICS model estimates the probability of placebo response in adolescents with MDD with a modest degree of accuracy (AUC=0.59) and with a reasonable degree of positive predictive value (74.5%), and is based on five previously identified patient characteristics of placebo response from prior meta-analytic studies (Bridge etal., 2009; Cohen etal., 2010) of randomized placebo-controlled trials of antidepressants in youth with MDD. Calculation of the APICS should be restricted to the range of the adolescent ages (12-17 years) and CDRS-R total scores (17-113); thus, the APICS can assume possible calculated values and related probability of responding to placebo ranging from about 3 (84%) to 53 (25%). The APICS Bayesian logistic model, based on a given aggregate patient profile, has a range of predicted probabilities of placebo response that is fairly wide, albeit truncated, but potentially meaningful for predicting the probability of placebo response among adolescent youth with MDD. The ability of the APICS to objectify the probability of placebo response in adolescents with MDD could be accounted for in the clinical research design of the trial itself and perhaps aid clinicians in treatment strategy for youth who are more likely to experience placebo response.

Original languageEnglish (US)
JournalJournal of Psychiatric Research
DOIs
StateAccepted/In press - Jan 27 2015

Fingerprint

Major Depressive Disorder
Placebos
Placebo
Logistic Models
Depression
Transdermal Patch
Area Under Curve
Aptitude

Keywords

  • Clinical trials
  • Pediatric MDD
  • Placebo response

ASJC Scopus subject areas

  • Psychiatry and Mental health
  • Biological Psychiatry
  • Arts and Humanities (miscellaneous)

Cite this

@article{ceee317f93a646798230adf058635ff7,
title = "Predicting placebo response in adolescents with major depressive disorder: The Adolescent Placebo Impact Composite Score (APICS)",
abstract = "Objective: The aim of this study was to construct a composite scoring system to predict the probability of placebo response in adolescents with Major Depressive Disorder (MDD). Method: Participants of the current study were 151 adolescents (aged 12-17 years) who were randomized to the placebo arm (placebo transdermal patches) of a randomized controlled trial (RCT) comparing the selegiline transdermal patch with placebo (DelBello etal., 2014). The primary outcome of response was defined as a CGI-I score of 1 or 2 (very much or much improved) at week 12 (study-end) or exit. As a first step, a multiple logistic mixed model was used to estimate the odds of placebo response from each predictor in the model, including age, CDRS-R total at baseline (depressive symptom severity), history of recurrent depression (yes vs. no), sex (female vs. male), and race (non-Caucasian vs. Caucasian). On the basis of the initial logistic mixed model analysis, we then constructed an Adolescent Placebo Impact Composite Score (APICS) that became the sole predictor in a re-specified Bayesian logistic regression model to estimate the probability of placebo response. Finally, the AUC for the APICS was tested against a nominal area of 0.50 to evaluate how well the APICS discriminated placebo response status. Results: Among the 151 adolescents, with a mean age of 14.6 years (SD=1.6) and a mean baseline CDRS-R total of 60.6 (SD=12.1), 68.2{\%} were females, 50.3{\%} was Caucasian, and 39.7{\%} had a history of recurrent depression. Placebo response rate was 58.3{\%}. Based on the logistic mixed model, the re-specified equation with the highest discriminatory ability to estimate the probability of placebo response was APICS=age+(0.32×CDRS-R Total at baseline)+(-2.85×if female)+(-5.50×if history of recurrent depression)+(-5.85×if non-Caucasian). The AUC for this model was 0.59 (p=.049). Within a Bayesian decision-theoretic framework, in 95.5{\%} of the time, the 10,000 posterior Monte Carlo samples suggested that as APICS decreased the probability of placebo response increased. The observed APICS and related probability of responding to placebo in this adolescent sample ranged from 14.1=74.1{\%} (in placebo responders) to 39.1=41.8{\%} (in placebo non-responders). Conclusion: The APICS model estimates the probability of placebo response in adolescents with MDD with a modest degree of accuracy (AUC=0.59) and with a reasonable degree of positive predictive value (74.5{\%}), and is based on five previously identified patient characteristics of placebo response from prior meta-analytic studies (Bridge etal., 2009; Cohen etal., 2010) of randomized placebo-controlled trials of antidepressants in youth with MDD. Calculation of the APICS should be restricted to the range of the adolescent ages (12-17 years) and CDRS-R total scores (17-113); thus, the APICS can assume possible calculated values and related probability of responding to placebo ranging from about 3 (84{\%}) to 53 (25{\%}). The APICS Bayesian logistic model, based on a given aggregate patient profile, has a range of predicted probabilities of placebo response that is fairly wide, albeit truncated, but potentially meaningful for predicting the probability of placebo response among adolescent youth with MDD. The ability of the APICS to objectify the probability of placebo response in adolescents with MDD could be accounted for in the clinical research design of the trial itself and perhaps aid clinicians in treatment strategy for youth who are more likely to experience placebo response.",
keywords = "Clinical trials, Pediatric MDD, Placebo response",
author = "Nakonezny, {Paul A.} and Mayes, {Taryn L.} and Byerly, {Matthew J.} and Emslie, {Graham J.}",
year = "2015",
month = "1",
day = "27",
doi = "10.1016/j.jpsychires.2015.05.003",
language = "English (US)",
journal = "Journal of Psychiatric Research",
issn = "0022-3956",
publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Predicting placebo response in adolescents with major depressive disorder

T2 - The Adolescent Placebo Impact Composite Score (APICS)

AU - Nakonezny, Paul A.

AU - Mayes, Taryn L.

AU - Byerly, Matthew J.

AU - Emslie, Graham J.

PY - 2015/1/27

Y1 - 2015/1/27

N2 - Objective: The aim of this study was to construct a composite scoring system to predict the probability of placebo response in adolescents with Major Depressive Disorder (MDD). Method: Participants of the current study were 151 adolescents (aged 12-17 years) who were randomized to the placebo arm (placebo transdermal patches) of a randomized controlled trial (RCT) comparing the selegiline transdermal patch with placebo (DelBello etal., 2014). The primary outcome of response was defined as a CGI-I score of 1 or 2 (very much or much improved) at week 12 (study-end) or exit. As a first step, a multiple logistic mixed model was used to estimate the odds of placebo response from each predictor in the model, including age, CDRS-R total at baseline (depressive symptom severity), history of recurrent depression (yes vs. no), sex (female vs. male), and race (non-Caucasian vs. Caucasian). On the basis of the initial logistic mixed model analysis, we then constructed an Adolescent Placebo Impact Composite Score (APICS) that became the sole predictor in a re-specified Bayesian logistic regression model to estimate the probability of placebo response. Finally, the AUC for the APICS was tested against a nominal area of 0.50 to evaluate how well the APICS discriminated placebo response status. Results: Among the 151 adolescents, with a mean age of 14.6 years (SD=1.6) and a mean baseline CDRS-R total of 60.6 (SD=12.1), 68.2% were females, 50.3% was Caucasian, and 39.7% had a history of recurrent depression. Placebo response rate was 58.3%. Based on the logistic mixed model, the re-specified equation with the highest discriminatory ability to estimate the probability of placebo response was APICS=age+(0.32×CDRS-R Total at baseline)+(-2.85×if female)+(-5.50×if history of recurrent depression)+(-5.85×if non-Caucasian). The AUC for this model was 0.59 (p=.049). Within a Bayesian decision-theoretic framework, in 95.5% of the time, the 10,000 posterior Monte Carlo samples suggested that as APICS decreased the probability of placebo response increased. The observed APICS and related probability of responding to placebo in this adolescent sample ranged from 14.1=74.1% (in placebo responders) to 39.1=41.8% (in placebo non-responders). Conclusion: The APICS model estimates the probability of placebo response in adolescents with MDD with a modest degree of accuracy (AUC=0.59) and with a reasonable degree of positive predictive value (74.5%), and is based on five previously identified patient characteristics of placebo response from prior meta-analytic studies (Bridge etal., 2009; Cohen etal., 2010) of randomized placebo-controlled trials of antidepressants in youth with MDD. Calculation of the APICS should be restricted to the range of the adolescent ages (12-17 years) and CDRS-R total scores (17-113); thus, the APICS can assume possible calculated values and related probability of responding to placebo ranging from about 3 (84%) to 53 (25%). The APICS Bayesian logistic model, based on a given aggregate patient profile, has a range of predicted probabilities of placebo response that is fairly wide, albeit truncated, but potentially meaningful for predicting the probability of placebo response among adolescent youth with MDD. The ability of the APICS to objectify the probability of placebo response in adolescents with MDD could be accounted for in the clinical research design of the trial itself and perhaps aid clinicians in treatment strategy for youth who are more likely to experience placebo response.

AB - Objective: The aim of this study was to construct a composite scoring system to predict the probability of placebo response in adolescents with Major Depressive Disorder (MDD). Method: Participants of the current study were 151 adolescents (aged 12-17 years) who were randomized to the placebo arm (placebo transdermal patches) of a randomized controlled trial (RCT) comparing the selegiline transdermal patch with placebo (DelBello etal., 2014). The primary outcome of response was defined as a CGI-I score of 1 or 2 (very much or much improved) at week 12 (study-end) or exit. As a first step, a multiple logistic mixed model was used to estimate the odds of placebo response from each predictor in the model, including age, CDRS-R total at baseline (depressive symptom severity), history of recurrent depression (yes vs. no), sex (female vs. male), and race (non-Caucasian vs. Caucasian). On the basis of the initial logistic mixed model analysis, we then constructed an Adolescent Placebo Impact Composite Score (APICS) that became the sole predictor in a re-specified Bayesian logistic regression model to estimate the probability of placebo response. Finally, the AUC for the APICS was tested against a nominal area of 0.50 to evaluate how well the APICS discriminated placebo response status. Results: Among the 151 adolescents, with a mean age of 14.6 years (SD=1.6) and a mean baseline CDRS-R total of 60.6 (SD=12.1), 68.2% were females, 50.3% was Caucasian, and 39.7% had a history of recurrent depression. Placebo response rate was 58.3%. Based on the logistic mixed model, the re-specified equation with the highest discriminatory ability to estimate the probability of placebo response was APICS=age+(0.32×CDRS-R Total at baseline)+(-2.85×if female)+(-5.50×if history of recurrent depression)+(-5.85×if non-Caucasian). The AUC for this model was 0.59 (p=.049). Within a Bayesian decision-theoretic framework, in 95.5% of the time, the 10,000 posterior Monte Carlo samples suggested that as APICS decreased the probability of placebo response increased. The observed APICS and related probability of responding to placebo in this adolescent sample ranged from 14.1=74.1% (in placebo responders) to 39.1=41.8% (in placebo non-responders). Conclusion: The APICS model estimates the probability of placebo response in adolescents with MDD with a modest degree of accuracy (AUC=0.59) and with a reasonable degree of positive predictive value (74.5%), and is based on five previously identified patient characteristics of placebo response from prior meta-analytic studies (Bridge etal., 2009; Cohen etal., 2010) of randomized placebo-controlled trials of antidepressants in youth with MDD. Calculation of the APICS should be restricted to the range of the adolescent ages (12-17 years) and CDRS-R total scores (17-113); thus, the APICS can assume possible calculated values and related probability of responding to placebo ranging from about 3 (84%) to 53 (25%). The APICS Bayesian logistic model, based on a given aggregate patient profile, has a range of predicted probabilities of placebo response that is fairly wide, albeit truncated, but potentially meaningful for predicting the probability of placebo response among adolescent youth with MDD. The ability of the APICS to objectify the probability of placebo response in adolescents with MDD could be accounted for in the clinical research design of the trial itself and perhaps aid clinicians in treatment strategy for youth who are more likely to experience placebo response.

KW - Clinical trials

KW - Pediatric MDD

KW - Placebo response

UR - http://www.scopus.com/inward/record.url?scp=84930028817&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84930028817&partnerID=8YFLogxK

U2 - 10.1016/j.jpsychires.2015.05.003

DO - 10.1016/j.jpsychires.2015.05.003

M3 - Article

C2 - 26028546

AN - SCOPUS:84937974268

JO - Journal of Psychiatric Research

JF - Journal of Psychiatric Research

SN - 0022-3956

ER -