Journal Pre-proof
Bullying and psychotic symptoms in youth with bipolar disorder Jandira Rahmeier Acosta , Diego Librenza-Garcia , Devon Watts , ´ Ana Paula Franciscoa , Franco Zortea , Bruno Raffa , Andre´ Kohmann , Fabiana Eloisa Mugnol , Gledis Lisiane Motta , Silza´ Tramontina , Ives Cavalcante Passos PII: DOI: Reference:
S0165-0327(19)30719-0 https://doi.org/10.1016/j.jad.2019.11.101 JAD 11348
To appear in:
Journal of Affective Disorders
Received date: Revised date: Accepted date:
20 March 2019 27 September 2019 21 November 2019
Please cite this article as: Jandira Rahmeier Acosta , Diego Librenza-Garcia , Devon Watts , ´ Ana Paula Franciscoa , Franco Zortea , Bruno Raffa , Andre´ Kohmann , Fabiana Eloisa Mugnol , Gledis Lisiane Motta , Silza´ Tramontina , Ives Cavalcante Passos , Bullying and psychotic symptoms in youth with bipolar disorder, Journal of Affective Disorders (2019), doi: https://doi.org/10.1016/j.jad.2019.11.101
This is a PDF file of an article that has undergone enhancements after acceptance, such as the addition of a cover page and metadata, and formatting for readability, but it is not yet the definitive version of record. This version will undergo additional copyediting, typesetting and review before it is published in its final form, but we are providing this version to give early visibility of the article. Please note that, during the production process, errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain. © 2019 Published by Elsevier B.V.
HIGHLIGHTS
Study participants (N = 64) included those who had a lifetime history of psychotic symptoms (n = 21; 32.8%), and those who reported being bullied (n = 24; 37.5%).
A lifetime history of psychotic symptoms was associated with bullying, suicidal behavior, low socioeconomic status, and higher Clinical Global Impression-Severity (CGI-S) scale scores.
Only bullying and suicidal behavior remained significant after adjusting for potential confounders.
In a supplementary analysis, using a supervised machine learning model, the most relevant predictive variables in differentiating participants with vs without psychotic symptoms were bullying, CGI-S scale scores, and suicidal behavior.
Study limitations include the small sample size, use of a cross-sectional design, and the generalizability of findings beyond the outpatient clinical sample.
Bullying and psychotic symptoms in youth with bipolar disorder
Jandira Rahmeier Acosta, MD a,b; Diego Librenza-Garcia, MD b,c Devon Wattsc , Ana Paula Franciscoa,b,c, Franco Zórteaa; MD; Bruno Raffa MD a,b, André Kohmann MDa; Fabiana Eloisa Mugnol, MDa; Gledis Lisiane Motta, MDa; Silzá Tramontina, MD, PhDa; Ives Cavalcante Passos, MD, PhDd
a. Program for Children and Adolescents with Bipolar Disorder (ProCAB), Division of Child and Adolescent Psychiatry, Hospital de Clínicas de Porto Alegre (HCPA), Universidade Federal do Rio Grande do Sul (UFRGS), Porto Alegre, RS, Brazil. b. Programa de Pós-Graduação em Psiquiatria e Ciências do Comportamento – Faculdade de Medicina, Universidade Federal do Rio Grande do Sul (UFRGS), Porto Alegre (RS), Brazil; c. Department of Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, Canada. d. Laboratory of Molecular Psychiatry and Bipolar Disorder Program, HCPA, UFRGS, Porto Alegre, RS, Brazil.
ABSTRACT Background: Childhood trauma is associated with psychosis in adults with bipolar disorder (BD). Although bullying represents a widespread form of childhood trauma, no studies thus far have investigated the association of bullying and psychosis in pediatric bipolar disorder (PBD). We aim to examine the association between psychosis in PBD with bullying victimization. Methods: We included 64 children and adolescents (age± mean= 12±3.43) outpatients with BD spectrum disorders. Psychiatric diagnoses were assessed with the semi- structured interview Schedule for Affective Disorders and Schizophrenia for School Age Children-Present
and Lifetime (KSADS-PL) version with additional depression and manic symptom items derived from the Washington University in St. Louis Kiddie Schedule for Affective Disorders (WASH-UKSADS). Bullying, demographic, and clinical variables were assessed during the clinical interview. Results: A lifetime history of psychotic symptoms was associated with bullying (p=0.002), suicidal behavior (p=0.006), low socioeconomic status (p=0.04), and severity of PBD (p=0.02). Only bullying (OR=7.3; 95%CI= 2-32) and suicidal behavior (OR=7.6; 95%CI=1.5–47.8) remained significant after adjustment for confounders. In a supplementary analysis, we developed a model using supervised machine learning to identify the most relevant variables that differentiated participants with psychotic symptoms, which included bullying, Clinical Global Impression-Severity scale (CGI-S), and suicidal behavior (accuracy=75%, [p=0.03]; sensitivity=77.91%; specificity=69.05%; area under the curve [AUC]= 0.86). Limitations: Small sample, cross-sectional design, and generalizability of findings beyond the outpatient clinical sample. Conclusions: Findings underscore the importance of assessing bullying in PBD participants. Future longitudinal studies with larger samples are needed to replicate our findings and determine causality.
INTRODUCTION According to epidemiological data from several countries, pediatric bipolar disorder (PBD) has an overall prevalence of 3.9% across the spectrum of the disorder (van Meter et al., 2019) and previous reports suggest that pediatric onset of bipolar disorder (BD) presents with a more severe course of illness than BD that manifests in adulthood (Duffy et al., 2017); Kapczinski et al., 2017; Leverich et al., 2007). Furthermore, psychotic symptoms such as hallucinations and delusions are associated with pernicious outcomes (Birmaher et al., 2006; Geller et al., 2004), and are commonly observed in pediatric cases of BD. Indeed, psychotic symptoms have been reported in approximately 42% of PBD participants (Kowatch et al., 2005). Similarly, in a cross-sectional study comprising 226 participants with PBD, the presence of psychotic symptoms was associated with an increased number of mood episodes, psychiatric hospitalizations, psychiatric comorbidities, functional impairment, and a family history of psychosis (Hua et al., 2011). In recent years, an increasing number of studies have investigated the association between psychotic symptoms and childhood trauma (Etain et al., 2017; Romero et al., 2009; van Bergen et al., 2018). For instance, in a meta-analysis of 30 studies, childhood trauma was associated with unfavorable clinical outcomes in BD, such as a higher prevalence of psychosis, greater mood recurrence and severity, early onset, suicide attempts, and psychiatric comorbidities (Agnew-Blais and Danese, 2016). A cross-sectional study in PBD reported a twofold risk of psychotic symptoms among individuals with a history of physical and/or sexual abuse (Romero et al., 2009). Most studies of trauma in BD have focused on sexual, physical, or emotional abuse, and/or neglect. Although increasing research has focused on bullying as a traumatic event (van Dam et al., 2012), no studies thus far have evaluated the association between bullying and psychotic symptoms in BD. Bullying can be defined as an aggressive act, where there is an imbalance of power; that is, the victim cannot defend him/herself, with some element of repetition (Sourander et al., 2007). Birth cohort studies have indicated that bullying victimization at school is a risk factor for psychotic symptoms in both early adolescence (Kelleher et al., 2013; Schreier et al., 2009) and adulthood (Catone et al., 2015; Lereya et al., 2015) among the general population. However, the majority of epidemiological studies focus on subthreshold psychotic experiences that are not necessarily associated with a formal psychotic episode diagnosis. In clinical
samples, despite the higher prevalence of being bullied among participants, relative to controls, the association between bullying and psychotic symptoms remains unclear. In a nationwide birth cohort study of 5034 Finnish children, bullying victimization at 8 years old was associated with psychosis in adulthood. When controlling for childhood psychiatric symptoms, the association with psychosis was no longer significant (Sourander et al., 2016). In another study comprising 508 psychiatric inpatient adolescents, victims of bullying showed two to three times the prevalence of psychotic disorders relative to bullies or bully-victims (i.e. a person who is both a bully and a victim of bullying), but the association was not statistically significant (Luukkonen et al., 2010). Conversely, a longitudinal study found that youth with Attention Deficit Hyperactivity Disorder (ADHD) who were bullied at the age of 10 had a twofold risk of psychotic experiences at the age of 12 (Hennig et al., 2016). In the present study, we aim to assess the association between psychosis and bullying victimization in a sample of outpatients with PBD. We hypothesize that PBD participants with a lifetime history of psychosis will show higher rates of bullying, compared to participants without a history of psychosis. We also examined the association between clinical and demographic variables and psychosis. Clinical variables were selected based on previous studies with positive findings on psychosis in BD, such as anxiety disorders, rapid cycling, and suicidal behavior (Caetano et al., 2006; Hua et al., 2011). Considering the association previously found between psychotic symptoms and bullying in ADHD participants, we also examined this potential relationship (Hennig et al., 2016). Additionally, in a supplementary analysis, we developed a machine learning model to identify the most relevant variables to predict a risk of lifetime psychosis among participants with PBD.
METHODS
Participants The present cross-sectional study included 64 children and adolescents with BD from the outpatient Program for Children and Adolescents with Bipolar Disorder (ProCAB) of the Hospital de Clínicas of Porto Alegre, Brazil, between January 2012 and November 2017.
Participants were included if they were between 5 - 17 years old with a diagnosis of BD I, II, or not otherwise specified (NOS), based on the text revision of the fourth edition Diagnostic and Statistical Manual of Mental Disorders (DSM-IV-TR) criteria. Participants were excluded if they had a clinical diagnosis of schizophrenia, pervasive developmental disorder, active substance abuse at intake, or if they were unable to answer the questionnaires.
Procedures The institutional ethics committee approved the study protocol. Parental written informed consent and verbal assent were obtained from the children. Diagnostic assessment relied on a screening interview based on DSM-IV criteria administered by trained investigators. All diagnoses, including rapid cycling, were confirmed with the semi-structured interview Schedule for Affective Disorders and Schizophrenia for School Age Children-Present and Lifetime version (KSADS- PL) (Kaufman et al., 1997). Additional depression and manic symptom items were derived from the Washington University in St. Louis Kiddie Schedule for Affective Disorders (Wash-U-KSADS). This version offers the advantage of focused diagnosis in pre- pubertal and early adolescent manifestations of mania with and without rapid cycling (Geller et al., 2001). Data was collected from the caregivers and participants, and it was reviewed and confirmed by a trained child psychiatrist.
2.2. Measures
Psychosis K-SADS-PL-W was used to assess psychiatric diagnosis and the presence of lifetime psychosis at intake. K-SADS-PL rates hallucinations and delusions on a scale from 1 to 3 (1 = absent, 2 = suspected or likely, 3 = definite). Participants who were classified as “definite” in current or previous hallucinations or delusions were determined to have lifetime psychosis. Bullying
Bullying victimization was assessed through a clinical interview by trained psychiatrists, which involved asking participants if they had experienced psychological or physical bullying more than once in their life. This question was asked to the participants and caregivers in the screening interview. A positive response from either the caregiver or child was taken as evidence of a history of bullying victimization. When the participant and caregiver had conflicting answers of being bullied or when they did not fully understand the concept of bullying, more explanations and examples of bullying victimization were provided by the evaluator. Moreover, participants and caregivers were asked to provide examples of the conflicting situations considered as bullying. Based on this information, the evaluator had the final decision.
Suicidal behavior Lifetime suicidal behavior was evaluated at intake using the Columbia-Suicide Severity Rating Scale (C-SSRS) screen version, which assesses the presence of suicidal behavior using five questions. We considered suicidal behavior to be present if “yes” was answered to any of following 5 items: 1) Preparatory acts or suicidal behavior, 2) Actual attempt, 3) Interrupted attempt, 4) Aborted attempt, or 5) Suicide.
Socio-demographics and clinical characteristics Demographic and clinical characteristics of the disorder such as sex, ethnicity, age, and socioeconomic status (SES) were collected in the screening interview. Family history of psychiatric disorders in first degree relatives was collected with a clinical interview. We included in the analysis family history of BD; we did not include psychotic disorders due the small number of cases. The Clinical Global Impression-Severity (CGI-S) scale was used to determine BD symptom severity at the time of assessment. SES was assessed using a validated Brazilian questionnaire, the Brazilian Association of Research Companies questionnaire (http://www.abep.org/criterio-brasil). This scale assesses acquisition of material assets, level of education of the head of household, and access to public services; classifying families into five distinct socioeconomic groups (A, B, C, D or E). In
the present study, groups A/B and C/D had similar socioeconomic characteristics, and therefore, classes were grouped in two categories, Middle-High (A, B) and Middle-Low (C, D). There was no family included in the study within the lowest level (E). Statistical analysis Statistical analyses were conducted using the program R software 1.0.136 (https://www.R-project.org/). Descriptive analyses were reported as means (standard deviations) or absolute and relative frequencies. We divided participants into two groups: those with a lifetime history of psychosis, and those without a history of psychosis. We used the chi-square or Student t tests to analyze demographic, clinical, and school related variables between these two groups. Any comparisons in the bivariate model that were significant at p < 0.1 were entered in multiple logistic regression analyses with a history of psychosis as the dependent variable. All statistics were two-tailed, and significance was set at p-value ≤0.05. Odds ratios (OR) and confidence intervals (CI) were computed.
Machine learning analysis Linear associations between risk factors and clinical outcomes are important in understanding chronic diseases, however, traditional statistical approaches explore the linear relationship between variables at a group-level (Bzdok et al., 2018). Machine learning approaches can be used in problems that are difficult to address using traditional statistics and have increasingly been used in psychiatry. This is because machine learning models can assume a complex relationship between variables, including non-linear patterns, and allow us to make individualized predictions (Dwyer et al., 2018). As such, machine learning may facilitate predictive models that can be used in clinical practice (Passos et al., 2016; Passos and Mwangi, 2018; Sartori et al., 2018; Wu et al., 2017). In the present study, we built a supervised machine learning model to predict psychosis among participants with PBD. The predictors included in the machine learning model were the same sociodemographic and clinical characteristics used in the classical bivariate analyses. The machine learning analysis was conducted using R software (Version R 3.3.1) and R Studio (Version 0.99.902), using the package CARET. The CARET package (short
for Classification And REgression Training) is a set of functions that attempt to streamline the process for creating predictive models. The package contains tools for: 1) data splitting; 2) preprocessing; 3) feature selection model tuning using resampling; 4) variable importance estimation; 5) as well as other functionality. It is worth mentioning that the caret package contains numerous tools for developing predictive models using the rich set of models available in R. There are many different modeling functions in R. Some have different syntax for model training and/or prediction. The package started off as a way to provide a uniform interface for the functions themselves, as well as a way to standardize common tasks (such parameter tuning and variable importance). Missing data was inputted after multiple imputations (m=5, maxit=50, seed=500) with the R package mice (Buuren and Groothuis- Oudshoorn, 2011). We used a naive bayes classifier with a high-density kernel to train the model. Naive bayes classifiers are a family of probabilistic algorithms based on the Bayes' theorem, using the maximum a posteriori (MAP) decision rule. We used leave-one-out cross validation (LOOCV), ROC (receiver operating characteristic) and AUC (area under the curve) to estimate model performance, as well as accuracy and kappa. LOOCV consists of training the algorithm with all participants but one, testing the model on the omitted participant, then repeating the process until all participants were used during algorithm testing at least once. This approach ensures that our model is being tested in an “unseen” dataset in order to avoid overfitting (Librenza-Garcia et al., 2017). LOOCV has become the standard for estimating model performance for studies with small sample sizes (Vehtari et al., 2017).
RESULTS A total of 64 participants were included in the present study, of which 32.8% (n=21) had a history of psychosis. Of those, 71.4% (n=15) reported hallucinations and 52.4% (n=11) delusions. Table 1 shows the sociodemographic characteristics and prevalence of bullying in the nonpsychotic and psychotic PBD participants. Clinical characteristics are presented in Table 2. In the bivariate analyses, psychosis was associated with Middle-Low SES (p=0.04); higher scores in CGI- S, which indicate greater symptom severity of BD (p=0.02); suicidal behavior (p=0.006); and being bullied (p=0.002). No differences were found between
nonpsychotic and psychotic participants for the other variables assessed, however there was a statistical trend toward an association between psychosis and caucasian ethnicity (p=0.06). In the psychotic PBD group, 35,7% (n=5) of the participants with a lifetime history of bullying victimization also had a lifetime history of suicidal behavior. In the non-psychotic PBD group, none of the participants with a lifetime history of bullying victimization reported suicidal behavior. We also compared the frequencies of suicidal behavior in bullying (n=25) and non-bullying (n=39) participants. The prevalence of suicidal behavior among those with history of bullying victimization was 20% (n=5). Of those, 100% had history of psychosis. The prevalence of suicidal behavior in the non-bullying group was 17.9% (n=7), with 42.8% (n=3) reporting also psychosis. However, due to the small number of participants in the sample, it was not possible to analyze the difference between groups. Considering the positive relationship between bullying and psychosis, and inability to infer causation due to the cross-sectional design, we also performed an analysis comparing those with and without a history of bullying victimization. Our objective was to analyze whether SES, severity of PBD, and suicidal behavior were also associated with bullying. SES (X² = 0.30, p=0.58), CGI-S scale (t=-1.36, p=0.12), and suicidal behavior (X²= 0.04, p= 0.84) were not statistically significant between bullying and non-bullying participants.
Multivariate analysis We computed logistic regression analyses, with psychotic symptoms as the dependent variable, and clinical variables significant at p < 0.1 from the bivariate analyses entered as the independent variables, as listed in Table 3. We included bullying, suicidal behavior, SES, ethnicity, and severity of the disorder as independent variables. Only bullying and suicidal behavior remained associated with lifetime psychotic symptoms in PBD.
Predictive model of lifetime psychosis The Naive Bayes algorithm differentiated participants with psychosis in PBD from those without psychosis in PBD with 75% accuracy (CI95%=6.66-8.23, p=0.03, 77.91%
sensitivity, 69.05% specificity). The other performance measures are listed in Table 4. Figure 1 demonstrates the variable importance for predicted probability of lifetime psychosis. The most relevant predictive variables in differentiating participants with psychosis were bullying, CGI-S scale, and suicidal behavior. The AUC for the model was 0.86 and the ROC curve for the model is represented in Figure 2.
DISCUSSION To our knowledge, this is the first study to investigate the relationship between psychosis and bullying victimization in children and adolescents with BD. Psychosis was associated with bullying, suicidal behavior, low SES, and symptom severity of BD. In the multivariate analysis, only bullying and suicidal behavior remained significant. In the machine learning model, the most relevant predictive variables in differentiating the participants with psychosis were bullying, BD symptom severity, and suicidal behavior. It is important to mention that machine learning and most traditional statistics are rooted in different mathematical contexts, and largely judge evidence of an effect in different ways. Therefore, an effect that is observed to be statistically significant using a p-value will not necessarily yield a high predictive accuracy in new independent data, and vice versa (Bzdok et al., 2018). Classical statistical analysis allows us to compute a quantitative measure of confidence that a discovered relationship describes a 'true' effect that is unlikely the result of statistical noise. By contrast, machine learning uses general- purpose learning algorithms to find patterns and provide predictions in a dataset. Given that we observed similar results using both traditional statistical and machine learning methods, this lends support to the notion that we observed a true effect in our study. The positive association between psychosis and bullying victimization in PBD participants is in accordance with prior cross-sectional and longitudinal studies in youth among community samples (Arseneault et al., 2011; Kelleher et al., 2013; Schreier et al., 2009; Singham et al., 2017). However, among clinical studies, the results are inconclusive (van Dam et al., 2012), and a majority of the participants included had psychotic disorders (Bebbington et al., 2004; Trotta et al., 2013). In a cross-sectional study in adults, prior repeated peer victimization was reported more frequently by participants with a psychotic disorder, as
compared to those without a psychotic disorder, but the effect disappeared after adjusting for other negative life events (Bebbington et al., 2004). In another cross-sectional study with adults, participants with psychotic disorders reported more bullying victimization, when compared to controls. This association remained significant after adjustments only in those with schizophrenia-spectrum disorders but did not remain significant in those with affective disorders. However, the negative finding may be related to the small sample size in the affective group (Trotta et al., 2013). Psychological and affective mechanisms may be involved in the association between psychosis with bullying victimization and suicidal behavior. Affective dysregulation and impulsivity/hostility are associated with childhood trauma in BD (Aas et al., 2017; Etain et al., 2017), and appears to mediate the association between childhood trauma and risk of a more severe clinical trajectory, including suicide attempts (Etain et al., 2017) and psychosis (Fisher et al., 2013; Myin-Germeys and van Os, 2007; Winsper et al., 2017). In a community sample study, children with higher levels of dysregulated behaviour were prone to the development of Borderline Personality Disorder symptoms, depressive symptoms, and psychosis in early adolescence, when exposed to bullying victimization (Winsper et al., 2017). Traumatic experiences resulting in maladaptive cognitive schemas characterized by negative beliefs about self, world, and others, as well as an increased suspiciousness of others, may lead to the development of paranoid delusions (Read et al., 2005). Children who are victims of bullying may also be vulnerable to a ‘victim schema’ that demonstrate an implicit cognitive association of themselves as victims and develop an attributional bias whereby victims may inaccurately attribute hostile intent in social situations perceived as threatening (Rosen et al., 2007). In addition, Fisher et al. (2013) evidenced that the association between bullying victimization and psychosis was mediated by believing that the outcome of events in one’s life are external forces beyond their control. Alternatively, being at risk for psychosis might affect the perception of being bullied. For instance, individuals with paranoia may experience real and overestimated threat as bullying (Jack and Egan, 2018). There is also evidence that some individuals with BD have a poor genetic susceptibility to environmental stress (Aas et al., 2016), such as bullying victimization during critical years of development in childhood or adolescence. This poor stress response coupled with prior victimization may not only make the individual more vulnerable to further bullying, but also
precipitate a more pernicious manifestation of the disorder, including psychosis. Moreover, internalizing and externalizing behaviors that emerge during the prodromal phases of psychosis may contribute to youth vulnerable to bullying victimization (Arseneault et al., 2011; Singham et al., 2017). Genetic factors appear to influence these behaviors (Marceau et al., 2013; Schoeler et al., 2019), and genetic influences can be accounted for over two thirds of individual differences in bullying victimization (Ball et al., 2008). For instance, Schoeler et al. (2019) evidenced that genetic predisposition for certain externalizing and internalizing behaviors were associated with bullying, and Shakoor et al. (2015) found that individuals vulnerable to bullying are also phenotypically susceptible to paranoia via a shared genetic propensity(Shakoor et al., 2015). Factors beyond the individual may also influence the relationship between psychosis and bullying victimization, including other types of childhood trauma (Bowes et al., 2009), family environment (Jansen et al., 2011), and SES (Bowes et al., 2009a; Jansen et al., 2011). In our study, low SES was also associated with psychosis, but this association did not remain after logistic regression. BD participants with a history of childhood trauma may be less likely to have protective factors, such as family and social support, increasing the vulnerability to the negative long-term effects of the trauma (Aas et al., 2016). The statistical association identified between psychosis and suicidal behavior in PBD is in accordance with previous cross-sectional studies of children and adolescents with BD (Caetano et al., 2006; Goldstein et al., 2005) Conversely, Goldstein et al. (2012) performed a longitudinal study and observed no relationship between history of psychosis at intake with suicide attempts at 5-year follow-up. On the other hand, community based-studies reported an association between psychosis and an elevated risk of suicidal ideation and behavior (Bromet et al., 2017; Kelleher et al., 2012). In the study from Bromet et al. (2017), psychosis was associated with an increased 2-fold risk (after adjusting for psychiatric disorders) of subsequent suicidal ideation and behavior across all life stages, with the strongest association observed in individuals 12 years and younger. Kelleher et al. (2012) reported an increased risk for suicidal behavior in the general adolescent population and in adolescents with (nonpsychotic) psychiatric disorder. In our study, around one third of the participants with both psychosis and bullying victimization reported suicidal behavior. No participant without psychosis with history bullying victimization reported suicidal behavior. After separating the
sample into participants with and without a history of bullying victimization, we found no statistical association between suicidal behavior and bullying victimization, contrary to many studies (Bang and Park, 2017; Copeland et al., 2013; Geoffroy et al., 2018). For example, adolescents with a history of bullying victimization were more likely to be diagnosed with depression, psychosis, and suicide attempts in a cross-sectional study. The association between bullying and suicide attempts remained statistically significant even after adjusting for depression and psychosis (Bang and Park, 2017). Our study presents with some limitations. First, data was collected retrospectively, and recall bias is possible. Moreover, children might have under-reported bullying or suicidal behavior due to feelings of shame and self-blame. The young age of our participants may also account for some occasional misreporting that may have also occurred. We evaluated bullying victimization in a clinical interview with the participants and parents. No previously validated instrument was used to assess this. When participants did not fully understand the concept of bullying, the evaluator provided further examples and a more detailed explanation. However, the definition of bullying is partly subjective, and it may be increased without a validated instrument, which could lead to over-reporting or under-reporting (Gromann et al., 2013). Second, the small sample size restricted the statistical power of the study. Given the limited power, a lack of statistical significance with other variables does not mean that the covariates cannot have any confounding or mediating effect. Besides that, the small sample size in the different categories of interest increases the risk for making Type I errors. Therefore, our findings need to be interpreted carefully. Third, since this is a cross-sectional study, the possibility of reverse causality cannot be discounted. We are unaware if bullying victimization or suicidal behavior are associated with later onset of psychosis in PBD or whether psychosis in PBD tends to occur before bullying victimization or before suicidal behavior. It is also possible that psychosis and bullying may both emerge during a prodromal phase of the PBD. However, studies demonstrated that there is a bidirectional relationship between childhood trauma and psychotic experiences, with each independently predicting the other (Kelleher et al., 2013; Mcgrath et al., 2017), and psychosis may predict suicidal behavior even before meeting criteria for psychiatric disorders (Bromet et al., 2017).
Fourth, we also did not investigate the possible subtypes, intensity, or frequency of bullying. A dose–response relationship between frequency and intensity of bullying victimization with levels of psychotic symptoms have been reported. (Arseneault et al., 2011; Kelleher et al., 2013). We did not investigate other types of childhood traumas that are also associated with psychosis in BD, such as sexual, physical, or emotional abuse (Agnew-Blais and Danese, 2016; Etain et al., 2017; Romero et al., 2009; van Bergen et al., 2018). The occurrence of additional negative childhood traumas in this period appears to intensify the risk of later developing psychosis (Mcgrath et al., 2017). Besides that, our study was carried out in an outpatient clinic of a tertiary hospital, so it may be different depending on the context in which the evaluation takes place. Despite these limitations, our study has several strengths. This is the first study to investigate the association of psychosis and bullying in PBD participants. The prevalence of psychosis, suicidal behavior, and bullying in our sample were similar to those reported in the literature. We used two different analytic approaches in the study, classical statistics and machine learning techniques. Additionally, we assessed for some potential confounding effects (i.e. SES, family history of BD, and comorbidities). We used validated instruments to assess psychiatric diagnosis and suicidal behavior in children and adolescents. Nonetheless, the inclusion of participants at all levels of symptom severity, treatment, and phase of illness allows for a broader generalization in outpatient settings. Bullying victimization may be viewed not only as a cause of psychosis but may also in part represent a “symptom” of pre-existing vulnerabilities (Singham et al., 2017). The integration of the school in the treatment of PBD may impact positively in the outcomes of the disorder, even if psychosis precedes bullying victimization. A community sample study reported a decrease in psychosis in 3 months after the school bullying had ceased (Kelleher et al., 2013). School bullying programs focusing on potential groups of vulnerable children and adolescents, as those with PBD, instead of only those who bully, may reduce the burden of bullying victimization. Programs at school focusing on negative cognitions and in increasing resilience among victims of bullying is one example (Arseneault, 2018). The role of family support is also important to minimize the negative effects of bullying victimization (Bowes et al., 2009). Parent support for child autonomy may also contribute to reduce bullying during early school years (Rajendran et al., 2016).
In summary, in our study psychosis was associated with bullying victimization and suicidal behavior in children and adolescents with BD. Future longitudinal studies including a larger sample, other potential confounding, or mediating factors could help to better understand the association between psychosis and bullying in PBD.
Table 1. Sociodemographic and bullying characteristics comparing nonpsychotic and psychotic PBD participants
All sample
Nonpsychotic PBD
(n=64)
(n=43)
Variable
N (%)
N (%)
Age (mean±SD)
12 (±3.43)
11.63 (± 3.38)
Sex (female)
28 (43.7)
Ethnicity (Caucasian)
Psychotic PBD (n=21) Effect size
p-value
12.76 (± 3.49)
t = -1.23
0.225
16 (37.2)
12 (57.1)
x² = 2.27
0.131
49 (76.5)
30 (69.7)
19 (90.4)
x² = 3.37
0.066
Middle-low SES
28 (43.7)
15 (34.8)
13 (61.9)
x²= 4.19
0.04*
Bullying
25 (39)
11 (25.6)
14 (66,6%)
x²= 10.00
0.001**
N (%)
PBD = pediatric bipolar disorder; SD= standard deviations; SES = Socioeconomic status. * p <.0.05; ** p < 0.01
Table 2. Clinical characteristics comparing nonpsychotic and psychotic PBD participants
All sample Variables (n=64)
Nonpsychotic PBD (n=43) N (%)
Psychotic PBD Effect size (n=21)
p-value
N (%) Family History of BD
N (%)
27 (42.2)
21 (48.8)
6 (28.6)
X²= 2.38
0.12
39 (60.9)
24 (55.8)
15 (71.4)
4 (6.2)
4 (9.3)
0
X² = 2.69
0.26
21 (32.8)
15 (34.9)
6 (28.6)
Rapid cycling
26 (40.6)
15 (34.9)
11 (52.4)
Anxiety disorders
32 (50)
21 (48.8)
11 (52.4)
X²= 0.07
0.79
ADHD
41 (64.1)
30 (69.8)
11 (52.4)
X²= 1.85
0.17
Suicidal Behavior
12 (18.7)
4 (9.3)
8 (38.1)
X²= 7.68
0.005**
CGI-S (mean±SD)
3.64 (±1.43)
3.35 (±1.34)
4.24 (± 1.45)
t = -2.36
0.023*
BD type Type I Type II NOS X² = 1.79 0.18
PBD = pediatric bipolar disorder; NOS= not otherwise specified; ADHD= Attention Deficit Hyperactivity Disorder; CGI-S = Clinical Global Impression-Severity scale; SD= standard deviation. * p <.0.05; ** p < 0.01.
Table 3. Logistic Regression model with psychosis as the dependent variable in PBD participants
Variable
z-value
P value
OR (adjusted)
95%CI
Bullying
2.807
0.005**
7.4
1.9 – 34.6
Suicidal behavior
2.158
0.03*
6.6
1.3 – 41.7
Middle-low SES
1.633
0.1
3
0.8 – 12.4
Ethnicity (Caucasian)
1.412
0.15
3.7
0.7 – 2.1
CGI-S
0.989
0.32
1.27
0.8 - 2
SES = Socioeconomic status; CGI-S = Clinical Global Impression-Severity scale CI = confidence interval; OR = odds ratio; p <.0.05; ** p < 0.01 p value for the logistic regression model = 0.00012
Table 4. Performance measures of Naïve Bayes algorithm on differentiating nonpsychotic and psychotic Pediatric Bipolar Disorder participants
Naive bayes
Sensitivity
Specificity
PPV
NPV
77.91%
69.05%
83.75%
60.42%
PPV = positive predictive value; NPV = negative predictive value
Balanced accuracy 73.48%
ADHD= Attention Deficit Hyperactivity Disorder; CGI-S = Clinical Global Impression-Severity scale
Figure 1. Variable importance for predicted probability of lifetime psychosis among participants with Pediatric Bipolar Disorder based on the Naive bayes algorithm.
Figure 2. Receiver operating characteristic (ROC) curve for predicted probability of lifetime psychosis among participants with Pediatric Bipolar Disorder based on the Naive bayes algorithm. We used leaveone-out cross-validation.
Author Statement We confirm that the manuscript has been read and approved by all named authors and that there are no other persons who satisfied the criteria for authorship but are not listed. We further confirm that the order of authors listed in the manuscript has been approved by all of us. We confirm that we have given due consideration to the protection of intellectual property associated with this work and that there are no impediments to publication, including the timing of publication, with respect to intellectual property. In so doing we confirm that we have followed the regulations of our institutions concerning intellectual property. We further confirm that any aspect of the work covered in this manuscript that has involved either experimental animals or human patients has been conducted with the ethical approval of all relevant bodies and that such approvals are acknowledged within the manuscript. We understand that the Corresponding Author is the sole contact for the Editorial process (including Editorial Manager and direct communications with the office). He/she is responsible for communicating with the other authors about progress, submissions of revisions and final approval of proofs. We confirm that we have provided a current, correct email address which is accessible by the Corresponding Author and which has been configured to accept email from
[email protected]
Contributors All authors contributed to the final version of the manuscript and have approved the final article. Their individual contribution to the article were:
Jandira Rahmeier Acosta: conception and design, acquisition of data, drafting of manuscript, critical revision, statics analyses.
Franco Zortea: conception of the idea, construct the data bank and statics analyses.
Diego Librenza-Garcia: machine learning analyses, drafting of manuscript, critical revision.
Devon Watts: drafting of manuscript, critical revision
Ana Paula Francisco: acquisition of data, drafting of manuscript, critical revision.
Bruno Raffa: acquisition of data, critical revision
Gledis Lisiane Motta: conception of the idea, acquisition of data, critical revision
André Kohmann: acquisition of data, critical revision
Fabiana Eloisa Mugnol: acquisition of data, critical revision.
Silza Tramontina: Supervision of the collection of the data from the patients, critical revision and drafting of manuscript.
Ives Cavalcante Passos: conception and design of the idea, supervision of the article organization and the data collection, critical revision and drafting of manuscript.
Declarations of interest: Ives Cavalcante Passos has received consulting fees from Torrent/Omnifarma. He has received research grants from CNPq/CAPES. Ana Paula Francisco has been receiving a scholarship that is partially financed by Shire. The remaining authors does not have competing interests to declare.
Funding: ProCAB was partially supported by FIPE/HCPA (Fund of Incentive to Research at Hospital de Clínicas de Porto Alegre).
Acknowledgements: None
REFERENCES
Aas, M., Henry, C., Andreassen, O.A., Bellivier, F., Melle, I., Etain, B., 2016. The role of childhood trauma in bipolar disorders. Int. J. Bipolar Disord. 4, 2. https://doi.org/10.1186/s40345-015-0042-0 Agnew-Blais, J., Danese, A., 2016. Childhood maltreatment and unfavourable clinical outcomes in bipolar disorder: a systematic review and meta-analysis. The Lancet Psychiatry 3, 342–349. https://doi.org/10.1016/S2215-0366(15)00544-1 Arseneault, L., 2018. Annual Research Review: The persistent and pervasive impact of being bullied in childhood and adolescence: implications for policy and practice. J. Child Psychol. Psychiatry Allied Discip. 59, 405–421. https://doi.org/10.1111/jcpp.12841
Arseneault, L., Cannon, M., Fisher, H.L., Polanczyk, G., Moffitt, T.E., Caspi, A., 2011. Childhood trauma and children’s emerging psychotic symptoms: A genetically sensitive longitudinal cohort study. Am. J. Psychiatry 168, 65–72. https://doi.org/10.1176/appi.ajp.2010.10040567 Ball, H.A., Arseneault, L., Taylor, A., Maughan, B., Caspi, A., Moffitt, T.E., 2008. Genetic and environmental influences on victims, bullies and bully-victims in childhood. J. Child Psychol. Psychiatry 49, 104–112. https://doi.org/10.1111/j.1469-7610.2007.01821.x Bang, Y.R., Park, J.H., 2017. Psychiatric disorders and suicide attempts among adolescents victimized by school bullying. Australas. Psychiatry 25, 376–380. https://doi.org/10.1177/1039856217715987 Bebbington, P., Bhugra, D., Brugha, T., Singleton, N., Farrell, M., Jenkins, R., Lewis, G., Meltzer, H., 2004. Psychosis, victimization and childhood disadvantage: evidence from the second British National Survey
of
Psychiatric
Morbidity.
Br.
J.
Psychiatry
185,
220–226.
https://doi.org/10.1192/bjp.185.3.220 Birmaher, B., Axelson, D., Strober, M., Gill, M.K., Valeri, S., Chiappetta, L., Ryan, N., Leonard, H., Hunt, J., Iyengar, S., Keller, M., 2006. Clinical course of children and adolescents with bipolar spectrum disorders. Arch. Gen. Psychiatry 63, 175. https://doi.org/10.1001/archpsyc.63.2.175 Bowes, L., Arseneault, L., Maughan, B., Taylor, A., Caspi, A., Moffitt, T.E., 2009a. School, neighborhood, and family Factors are associated with children’s bullying involvement: A nationally representative longitudinal
study.
J.
Am.
Acad.
Child
Adolesc.
Psychiatry
48,
545–553.
https://doi.org/10.1097/CHI.0b013e31819cb017 Bowes, L., Arseneault, L., Maughan, B., Taylor, A., Caspi, A., Moffitt, T.E., 2009b. School, Neighborhood, and Family Factors Are Associated With Children’s Bullying Involvement: A Nationally Representative Longitudinal Study. J. Am. Acad. Child Adolesc. Psychiatry 48, 545–553. https://doi.org/10.1097/CHI.0b013e31819cb017 Bromet, E.J., Nock, M.K., Saha, S., Lim, C.C.W., Aguilar-Gaxiola, S., Al-Hamzawi, A., Alonso, J., Borges, G., Bruffaerts, R., Degenhardt, L., de Girolamo, G., de Jonge, P., Florescu, S., Gureje, O., Haro, J.M., He, Y., Hu, C., Karam, E.G., Kovess-Masfety, V., Lee, S., Lepine, J.-P., Mneimneh, Z., Navarro-Mateu, F., Ojagbemi, A., Posada-Villa, J., Sampson, N.A., Scott, K.M., Stagnaro, J.C., Viana, M.C., Xavier, M., Kessler, R.C., McGrath, J.J., 2017. Association between psychotic experiences and subsequent suicidal
thoughts
and
behaviors.
https://doi.org/10.1001/jamapsychiatry.2017.2647
JAMA
Psychiatry
74,
1136.
Buuren, S. van, Groothuis-Oudshoorn, K., 2011. mice : Multivariate Imputation by Chained Equations in R. J. Stat. Softw. 45. https://doi.org/10.18637/jss.v045.i03 Bzdok, D., Altman, N., Krzywinski, M., 2018. Statistics versus machine learning. Nat. Methods 15, 233– 234. https://doi.org/10.1038/nmeth.4642 Caetano, S.C., Olvera, R.L., Hunter, K., Hatch, J.P., Najt, P., Bowden, C., Pliszka, S., Soares, J.C., 2006. Association of psychosis with suicidality in pediatric bipolar I, II and bipolar NOS patients. J. Affect. Disord. 91, 33–7. https://doi.org/10.1016/j.jad.2005.12.008 Catone, G., Marwaha, S., Kuipers, E., Lennox, B., Freeman, D., Bebbington, P., Broome, M., 2015. Bullying victimisation and risk of psychotic phenomena: analyses of British national survey data. The Lancet Psychiatry 2, 618–624. https://doi.org/10.1016/S2215-0366(15)00055-3 Copeland, W.E., Wolke, D., Angold, A., Costello, E.J., 2013. Adult psychiatric outcomes of bullying and being
bullied by
peers in childhood and adolescence.
JAMA
Psychiatry
70, 419.
https://doi.org/10.1001/jamapsychiatry.2013.504 Duffy, A., Goodday, S., Passos, I.C., Kapczinski, F., 2017. Changing the bipolar illness trajectory. The Lancet Psychiatry 4, 11–13. https://doi.org/10.1016/S2215-0366(16)30352-2 Dwyer, D.B., Falkai, P., Koutsouleris, N., 2018. Machine learning approaches for clinical psychology and psychiatry. Annu. Rev. Clin. Psychol. 14, 91–118. https://doi.org/10.1146/annurev-clinpsy-032816045037 Etain, B., Lajnef, M., Bellivier, F., Henry, C., M’bailara, K., Kahn, J., Leboyer, M., Fisher, H., 2017. Revisiting the association between childhood trauma and psychosis in bipolar disorder: A quasidimensional
path-analysis.
J.
Psychiatr.
Res.
84,
73–79.
https://doi.org/10.1016/j.jpsychires.2016.09.022 Fisher, H.L., Schreier, A., Zammit, S., Maughan, B., Munafo, M.R., Lewis, G., Wolke, D., 2013. Pathways between childhood victimization and psychosis-like symptoms in the ALSPAC birth cohort. Schizophr. Bull. 39, 1045–1055. https://doi.org/10.1093/schbul/sbs088 Geller, B., Tillman, R., Craney, J.L., Bolhofner, K., 2004. Four-year prospective outcome and natural history of mania in children with a prepubertal and early adolescent bipolar disorder phenotype. Arch. Gen. Psychiatry 61, 459–467. https://doi.org/10.1001/archpsyc.61.5.459 Geller, B., Zimerman, B., Williams, M., Bolhofner, K., Craney, J.L., DelBello, M.P., Sout, C., 2001. Reliability of the Washington University in St. Louis Kiddie Schedule for Affective Disorders and
Schizophrenia (WASH-U-KSADS) Mania and Rapid Cycling Sections. J. Am. Acad. Child Adolesc. Psychiatry 40, 450–455. https://doi.org/10.1097/00004583-200104000-00014 Geoffroy, M.-C., Boivin, M., Arseneault, L., Renaud, J., Perret, L.C., Turecki, G., Michel, G., Salla, J., Vitaro, F., Brendgen, M., Tremblay, R.E., Côté, S.M., 2018. Childhood trajectories of peer victimization and prediction of mental health outcomes in midadolescence: a longitudinal population-based study. Can. Med. Assoc. J. 190, E37–E43. https://doi.org/10.1503/cmaj.170219 Goldstein, T.R., Birmaher, B., Axelson, D., Ryan, N.D., Strober, M.A., Gill, M.K., Valeri, S., Chiapetta, L., Leonard, H., Hunt, J., Bridge, J.A., Brent, D.A., Keller, M., 2005. History of suicide attempts in pediatric bipolar disorder: factors associated with increased risk. Bipolar Disord. 7, 525–535. https://doi.org/10.1111/j.1399-5618.2005.00263. Goldstein, T.R., Ha, W., Axelson, D.A., Goldstein, B.I., Liao, F., Gill, M.K., Ryan, N.D., Yen, S., Hunt, J., Hower, H., Keller, M., Strober, M., Birmaher, B., 2012. Predictors of prospectively examined suicide attempts among youth with bipolar disorder. Arch. Gen. Psychiatry 69, 1113–1122. https://doi.org/10.1001/archgenpsychiatry.2012.650 Gromann, P.M., Goossens, F.A., Olthof, T., Pronk, J., Krabbendam, L., 2013. Self-perception but not peer reputation of bullying victimization is associated with non-clinical psychotic experiences in adolescents. Psychol. Med. 43, 781–787. https://doi.org/10.1017/S003329171200178X Hennig, T., Jaya, E.S., Lincoln, T.M., 2016. Bullying mediates between attention-deficit/hyperactivity disorder in childhood and psychotic experiences in early adolescence. Schizophr. Bull. 43, sbw139. https://doi.org/10.1093/schbul/sbw139 Hua, L.L., Wilens, T.E., Martelon, M., Wong, P., Wozniak, J., Biederman, J., 2011. Psychosocial functioning, familiality, and psychiatric comorbidity in bipolar youth with and without psychotic features. J. Clin. Psychiatry 72, 397–405. https://doi.org/10.4088/JCP.10m06025yel Jack, A.H., Egan, V., 2018. Childhood bullying, paranoid thinking and the misappraisal of social threat: trouble at school. School Ment. Health 10, 26–34. https://doi.org/10.1007/s12310-017-9238-z Jansen, D.E.M.C., Veenstra, R., Ormel, J., Verhulst, F.C., Reijneveld, S.A., 2011. Early risk factors for being a bully, victim, or bully/victim in late elementary and early secondary education. The longitudinal TRAILS study. BMC Public Health 11, 440. https://doi.org/10.1186/1471-2458-11-440 Kapczinski, N.S., Mwangi, B., Cassidy, R.M., Librenza-Garcia, D., Bermudez, M.B., Kauer-Sant’anna, M., Kapczinski, F., Passos, I.C., 2017. Neuroprogression and illness trajectories in bipolar disorder. Expert Rev. Neurother. 17, 277–285. https://doi.org/10.1080/14737175.2017.1240615
Kaufman, J., Birmaher, B., Brent, D., Rao, U., Flynn, C., Moreci, P., Williamson, D., Ryan, N., 1997. Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): initial reliability and validity data. J. Am. Acad. Child Adolesc. Psychiatry 36, 980–8. https://doi.org/10.1097/00004583-199707000-00021 Kelleher, I., Keeley, H., Corcoran, P., Ramsay, H., Wasserman, C., Carli, V., Sarchiapone, M., Hoven, C., Wasserman, D., Cannon, M., 2013. Childhood trauma and psychosis in a prospective cohort study: cause,
effect,
and
directionality.
Am.
J.
Psychiatry
170,
734–741.
https://doi.org/10.1176/appi.ajp.2012.12091169 Kelleher, I., Lynch, F., Harley, M., Molloy, C., Roddy, S., Fitzpatrick, C., Cannon, M., 2012. Psychotic symptoms in adolescence index risk for suicidal behavior: Findings from 2 population-based casecontrol
clinical
interview
studies.
Arch.
Gen.
Psychiatry
69,
1277–1283.
https://doi.org/10.1001/archgenpsychiatry.2012.164 Kowatch, R.A., Youngstrom, E.A., Danielyan, A., Findling, R.L., 2005. Review and meta-analysis of the phenomenology and clinical characteristics of mania in children and adolescents. Bipolar Disord. 7, 483–496. https://doi.org/10.1111/j.1399-5618.2005.00261.x Lereya, S.T., Copeland, W.E., Costello, E.J., Wolke, D., 2015. Adult mental health consequences of peer bullying and maltreatment in childhood: two cohorts in two countries. The Lancet Psychiatry 2, 524–531. https://doi.org/10.1016/S2215-0366(15)00165-0 Leverich, G.S., Post, R.M., Keck, P.E., Altshuler, L.L., Frye, M.A., Kupka, R.W., Nolen, W.A., Suppes, T., McElroy, S.L., Grunze, H., Denicoff, K., Moravec, M.K., Luckenbaugh, D., 2007. The Poor Prognosis of
Childhood-Onset
Bipolar
Disorder.
J.
Pediatr.
150,
485–490.
https://doi.org/10.1016/j.jpeds.2006.10.070 Librenza-Garcia, D., Kotzian, B.J., Yang, J., Mwangi, B., Cao, B., Pereira Lima, L.N., Bermudez, M.B., Boeira, M.V., Kapczinski, F., Passos, I.C., 2017. The impact of machine learning techniques in the study of bipolar disorder: A systematic review. Neurosci. Biobehav. Rev. 80, 538–554. https://doi.org/10.1016/j.neubiorev.2017.07.004 Luukkonen, A.-H., Riala, K., Hakko, H., Räsänen, P., 2010. Bullying behaviour and substance abuse among underage
psychiatric
inpatient
adolescents.
https://doi.org/10.1016/j.eurpsy.2009.12.002
Eur.
Psychiatry
25,
382–389.
Marceau, K., Horwitz, B.N., Narusyte, J., Ganiban, J.M., Spotts, E.L., Reiss, D., Neiderhiser, J.M., 2013. Gene-environment correlation underlying the association between parental negativity and adolescent externalizing problems. Child Dev. 84, 2031–2046. https://doi.org/10.1111/cdev.12094 Mcgrath, J.J., Mclaughlin, K.A., Saha, S., Bruffaerts, R., Girolamo, G. De, Jonge, P. De, Esan, O., Florescu, S., Haro, J.M., Hu, C., Karam, E.G., Lee, S., Lepine, J., Lim, C.C.W., Mneimneh, Z., Pennell, B., Piazza, M., Sampson, N., Viana, M.C., Xavier, M., Bromet, E.J., Kendler, K.S., Services, H., Gasthuisberg, C., Regulation, E., Development, P., Kangning, S., Po, T., Kong, H., Descartes, P., 2017. The association between childhood adversities and subsequent first onset of psychotic experiences: a crossnational analysis of 23,998 respondents from 17 countries. Psychol. Med. 47, 1230–1245. https://doi.org/10.1017/S0033291716003263.The Myin-Germeys, I., van Os, J., 2007. Stress-reactivity in psychosis: Evidence for an affective pathway to psychosis. Clin. Psychol. Rev. 27, 409–424. https://doi.org/10.1016/j.cpr.2006.09.005 Passos, I.C., Mwangi, B., 2018. Machine learning-guided intervention trials to predict treatment response at an individual patient level: an important second step following randomized clinical trials. Mol. Psychiatry. https://doi.org/10.1038/s41380-018-0250-y Passos, I.C., Mwangi, B., Kapczinski, F., 2016. Big data analytics and machine learning: 2015 and beyond. The Lancet Psychiatry 3, 13–15. https://doi.org/10.1016/S2215-0366(15)00549-0 Rajendran, K., Kruszewski, E., Halperin, J.M., 2016. Parenting style influences bullying: a longitudinal study comparing children with and without behavioral problems. J. Child Psychol. Psychiatry 57, 188–195. https://doi.org/10.1111/jcpp.12433 Read, J., Van Os, J., Morrison, A.P., Ross, C.A., 2005. Childhood trauma, psychosis and schizophrenia: A literature review with theoretical and clinical implications. Acta Psychiatr. Scand. 112, 330–350. https://doi.org/10.1111/j.1600-0447.2005.00634.x Rosen, P.J., Milich, R., Harris, M.J., 2007. Victims of their own cognitions: Implicit social cognitions, emotional
distress,
and
peer
victimization.
J.
Appl.
Dev.
Psychol.
28,
211–226.
https://doi.org/10.1016/j.appdev.2007.02.001 Romero, S., Birmaher, B., Axelson, D., Goldstein, T., Goldstein, B.I., Gill, M.K., Iosif, A.-M., Strober, M.A., Hunt, J., Esposito-Smythers, C., Ryan, N.D., Leonard, H., Keller, M., 2009. Prevalence and correlates of physical and sexual abuse in children and adolescents with bipolar disorder. J. Affect. Disord. 112, 144–150. https://doi.org/10.1016/j.jad.2008.04.005
Sartori, J.M., Reckziegel, R., Passos, I.C., Czepielewski, L.S., Fijtman, A., Sodré, L.A., Massuda, R., Goi, P.D., Vianna-Sulzbach, M., Cardoso, T. de A., Kapczinski, F., Mwangi, B., Gama, C.S., 2018. Volumetric brain magnetic resonance imaging predicts functioning in bipolar disorder: A machine learning
approach.
J.
Psychiatr.
Res.
103,
237–243.
https://doi.org/10.1016/j.jpsychires.2018.05.023 Schoeler, T., Choi, S.W., Dudbridge, F., Baldwin, J., Duncan, L., Cecil, C.M., Walton, E., Viding, E., McCrory, E., Pingault, J.-B., 2019. Multi–Polygenic Score Approach to Identifying Individual Vulnerabilities Associated With the Risk of Exposure to Bullying. JAMA Psychiatry 76, 730–738. https://doi.org/10.1001/jamapsychiatry.2019.0310 Shakoor, S., McGuire, P., Cardno, A.G., Freeman, D., Plomin, R., Ronald, A., 2015. A shared genetic propensity underlies experiences of bullying victimization in late childhood and self-rated paranoid thinking in adolescence. Schizophr. Bull. 41, https://doi.org/754–763. 10.1093/schbul/sbu142 Schreier, A., Wolke, D., Thomas, K., Horwood, J., Hollis, C., Gunnell, D., Lewis, G., Thompson, A., Zammit, S., Duffy, L., Salvi, G., Harrison, G., 2009. Prospective study of peer victimization in childhood and psychotic symptoms in a nonclinical population at age 12 years. Arch. Gen. Psychiatry 66, 527. https://doi.org/10.1001/archgenpsychiatry.2009.23 Singham, T., Viding, E., Schoeler, T., Arseneault, L., Ronald, A., Cecil, C.M., McCrory, E., Rijsdijk, F., Pingault, J.-B., 2017. Concurrent and longitudinal contribution of exposure to bullying in childhood to mental health. JAMA Psychiatry 74, 1112. https://doi.org/10.1001/jamapsychiatry.2017.2678 Sourander, A., Gyllenberg, D., Klomek, A.B., Sillanmäki, L., Ilola, A.M., Kumpulainen, K., 2016. Association of bullying behavior at 8 years of age and use of specialized services for psychiatric disorders by 29 years of age. JAMA Psychiatry 73, 159–165. https://doi.org/10.1001/jamapsychiatry.2015.2419 Sourander, A., Jensen, P., Ronning, J.A., Niemela, S., Helenius, H., Sillanmaki, L., Kumpulainen, K., Piha, J., Tamminen, T., Moilanen, I., Almqvist, F., 2007. What is the early adulthood outcome of boys who bully or are bullied in childhood? The finnish “From a Boy to a Man” study. Pediatrics 120, 397– 404. https://doi.org/10.1542/peds.2006-2704 Trotta, A., Di Forti, M., Mondelli, V., Dazzan, P., Pariante, C., David, A., Mulè, A., Ferraro, L., Formica, I., Murray, R.M., Fisher, H.L., 2013. Prevalence of bullying victimisation amongst first-episode psychosis
patients
and
unaffected
https://doi.org/10.1016/j.schres.2013.07.001
controls.
Schizophr.
Res.
150,
169–175.
van Bergen, A.H., Verkooijen, S., Vreeker, A., Abramovic, L., Hillegers, M.H., Spijker, A.T., Hoencamp, E., Regeer, E.J., Knapen, S.E., Riemersma-van der Lek, R.F., Schoevers, R., Stevens, A.W., Schulte, P.F.., Vonk, R., Hoekstra, R., van Beveren, N.J., Kupka, R.W., Sommer, I.E.C., Ophoff, R.A., Kahn, R.S., Boks, M.P.M., 2018. The characteristics of psychotic features in bipolar disorder. Psychol. Med. 1– 13. https://doi.org/10.1017/S0033291718002854 van Dam, D.S., van der Ven, E., Velthorst, E., Selten, J.P., Morgan, C., de Haan, L., 2012. Childhood bullying and the association with psychosis in non-clinical and clinical samples: a review and metaanalysis. Psychol. Med. 42, 2463–2474. https://doi.org/10.1017/S0033291712000360 van Meter, A., Moreira, A.L.R., Youngstrom, E., 2019. Updated meta-analysis of epidemiologic studies of pediatric Bipolar Disorder. J. Clin. Psychiatry 80, 1-11. https://doi.org/10.4088/JCP.18r12180 Vehtari, A., Gelman, A., Gabry, J., 2017. Practical bayesian model evaluation using leave-one-out crossvalidation and WAIC. Stat. Comput. 27, 1413–1432. https://doi.org/10.1007/s11222-016-9696-4 Winsper, C., Hall, J., Strauss, V.Y., Wolke, D., 2017. Aetiological pathways to Borderline Personality Disorder symptoms in early adolescence: childhood dysregulated behaviour, maladaptive parenting and bully victimisation. Borderline Personal. Disord. Emot. Dysregulation 4, 1–10. https://doi.org/10.1186/s40479-017-0060-x Wu, M.-J., Mwangi, B., Passos, I.C., Bauer, I.E., Cao, B., Frazier, T.W., Zunta-Soares, G.B., Soares, J.C., 2017. Prediction of vulnerability to bipolar disorder using multivariate neurocognitive patterns: a pilot study. Int. J. Bipolar Disord. 5, 32. https://doi.org/10.1186/s40345-017-0101-9