Dimensional structure of the Frankfurt Complaint Questionnaire

Dimensional structure of the Frankfurt Complaint Questionnaire

Dimensional Structure of the Frankfurt Complaint Questionnaire Gwenole´ Loas, Vale´rie Yon, and Denis Brien The Frankfurt Complaint Questionnaire (FCQ...

87KB Sizes 14 Downloads 68 Views

Dimensional Structure of the Frankfurt Complaint Questionnaire Gwenole´ Loas, Vale´rie Yon, and Denis Brien The Frankfurt Complaint Questionnaire (FCQ) was designed to evaluate the subjective symptoms of schizophrenics. Several validation studies of the FCQ using principal components analyses (PCA) have shown one-, two-, or four-factor solutions. The present study was conducted using FCQ data on 310 schizophrenics who met the ICD-10 criteria for F20 (schizophrenia)

disorder. Using several guidelines to select the number of factors, the PCA yielded one factor. This result suggests a unidimensionality underlying FCQ items. A new scale comprising 24 items was derived from those items with higher weights in the first factor. Copyright 2002, Elsevier Science (USA). All rights reserved.

S

mensional structure and proposed a reduced version of the scale (the Frankfurt-Pamplona Subjective Experiences Scale [FPSES] comprising 18 items with loads higher than 0.58 in the first factor. Recently, Mass et al.10 conducted a principal components analysis (PCA) on 505 schizophrenics and 187 alcoholics. The PCA yielded two factors, termed “dysphoric concomitants of severe illness particularly impairing concentration” and “subjective experiences of perceptual uncertainties.” The aim of the present study was to explore the factor structure of the FCQ and to test the hypothesis of unidimensionality.

ELF-EXPERIENCED COGNITIVE deficits of schizophrenia have received little attention, despite their high prevalence in this disease. Recently, there has been renewed interest in the study of subjective symptoms and a number of scales evaluating these symptoms have been published.1 From a historical point of view, several groups began research on subjective symptoms. Huber2 named the subjective symptoms “basic symptoms” to indicate their proximity to the hypothetized basic neural dysfunction of schizophrenia. Chapman3 studied subjective symptoms in different areas of cognition in schizophrenics and suggested an organic etiology. Several names have been proposed to identify subjective symptoms: basic symptoms or disorders, subjective experiences, subjective symptoms, subjective experience of deficit, or negative symptoms. Among the different rating scales, the Frankfurt Complaint Questionnaire (FCQ) is the instrument most widely used in Europe for assessing subjective symptoms. Moreover, this instrument has been adapted to several languages, including an English version.4 The FCQ was developed by Su¨llwold5 from the complaints of schizophrenic patients. The scale contains 98 items concerning a wide range of cognitive dysfunctions. The FCQ items are grouped into 10 categories according to phenomenological descriptive subscales: loss of control, simple perception, complex perception, language, thought, memory, motility, lack of automatism, anhedonia, and sensorial overstimulation. Factorial analyses on 463 and 229 schizophrenics, respectively, have suggested a four-factor solution interpreted as: disturbance of automated responses, perceptual disturbances, depression, and overinclusion.6,7 Moreover, in 80 schizophrenics, Rey8 found a unidimensional structure underlying a 76-item version of the scale. Using a Spanish version of the scale, Cuesta et al.9 found a unidi-

METHOD

Subjects A total of 310 psychiatric patients with ICD-1011 diagnoses of schizophrenia (F20) were recruited from the psychiatric departments of two psychiatric hospitals (Pinel’s Hospital and the Hospital of Clermont de l’Oise) and three psychiatric departments of two general hospitals (the Hospitals of Pe´ronne and Abbeville). There were 129 inpatients and 181 outpatients. The study was conducted from November 1998 to February 2000. Each patient was interviewed by a senior psychiatrist (V.Y). The diagnostic criteria according to ICD-10 were verified using international diagnosis checklists.12 Patients with organic mental disorder or severe somatic disorder were no included. In addition, patients who were not accessible for an interview (e.g., refusal, mute) were excluded. The distribution of the clinical forms was as follows: 149 paranoid (48.1%), 63 hebephrenic (20.3%), one postpsychotic depression (0.3%), 31 undifferentiated (10%), and 66 residual (21.3%). As the study was naturalistic, almost all of the subjects (n ⫽ 277) were undergo-

From the University Department of Psychiatry, Pinel’s Hospital, Amiens, France. Address reprint requests to Gwenole´ Loas, M.D, D.Sc., University Department of Psychiatry, Pinel’s Hospital, 80044 Amiens Cedex 01, France. Copyright 2002, Elsevier Science (USA). All rights reserved. 0010-440X/02/4305-0015$35.00/0 doi:10.1053/comp.2002.33487

Comprehensive Psychiatry, Vol. 43, No. 5 (September/October), 2002: pp 397-403

397

398

LOAS, YON, AND BRIEN Table 1. Sample Characteristics (N ⴝ 310)

Gender Male Female Age (yr) Status Inpatients Oupatients Marital status Single Married ICD-10 diagnoses (F20) Paranoid Hebephrenic Postpsychotic depression Undifferentiated Residual Duration of illness (yr) No. of hospitalizations Neuroleptics (equivalent chlorpromazine) FCQ score

229 81 39.23 (10.45) 129 181 278 32 149 63 1 31 66 16.25 (10.37) 7.56 (10.54) 407.55 (346.33) 35.46 (24.29)

ing treatment, essentially antipsychotic medication. The mean dose of chlorpromazine equivalent was 407.55 mg (SD 346.33). Table 1 presents background sample characteristics.

Rating Scale The author’s French translation of the third version of the FCQ was used.13 The FCQ is composed of 98 yes-no questions, and was completed by the inpatients a few days before discharge while they were considered to be at their clinical baseline. In accordance with the guidelines of the FCQ manual, the questionnaire was administered by a nurse (D.B) recruited specifically for the study. The nurse explained to the patients the purpose of the questionnaire and notably the fact that their

responses would have no consequences on their status (medication, decision of relapse, etc.). In case of vision difficulties or difficulties in comprehension, the items were read or explained. The Brief Psychiatric Rating Scale (BPRS)14 was completed by a senior psychiatrist (V.Y). The BPRS total score was taken into account, as well as three subscores rating positive (BPRS-P), negative (BPRS-N), and general (BPRS-G) symptomatologies.15 All subjects participated voluntarily in the study and gave informed consent, which was obtained after the procedure had been fully explained. Subject anonymity was protected.

Statistical Analysis We conducted an exploratory PCA on the correlation matrix of the 98 items of the FCQ. Several guidelines were used to select the number of factors: the Kaiser criteria (eigenvalue ⬎ 1), the Cattell scree test, the Horn parallel analysis, and the interpretability of the factors. Orthogonal varimax rotation was then performed. Construct validity and reliability were evaluated by calculating Cronbach’s alpha coefficient and the average of the correlations (point biserial correlation coefficient) between each item and the total score.

RESULTS

PCA showed 25 factors with an eigenvalue greater than 1, which collectively represent 65.30% of the variance. The scree test showed a break between the first two factors and the other factors (Fig 1); parallel analysis retained the first two factors. The eigenvalues of the two factors were 28.24 and 3.98, respectively, and the corresponding variances were 28.80% and 4.10%. Each of the 23 remaining factors explained less than 2.5% of the variance.

Fig 1. ues.

Plot of the eigenval-

DIMENSIONAL STRUCTURE OF THE FCQ

Interpretation of the first two unrotated factors was based on the variable’s loadings (Table 2). Considering only the variables with a loading higher than 0.30, the first factor contains 95 items and the second, 14 items. Moreover, all 14 items of the second factor had a higher loading on the first factor. Thus, we decided to retain only the first factor. As our results were compatible with the unidimensional hypothesis, we attempted to reduce the length of the inventory. First, we retained the 24 items (no. 26, 27, 35, 36, 38, 39, 42, 44, 45, 46, 55, 60, 66, 69, 73, 75, 80, 85, 86, 89, 93, 95, 96, 98) with a loading greater than 0.60. A PCA was then performed, which showed one factor with an eigenvalue higher than 1. The scree test showed a break between the first factor and the other factors, and parallel analysis gave the same results. Concerning the reliability and the construct validity of the scale, Cronbach’s alpha coefficient was 0.97 with an average interitem correlation of 0.28. The correlations between each item and the total score were all significant (P ⬍ .001), with a range from 0.27 to 0.67; the average value was 0.53 Cronbach’s alpha of the 24-item subscale of the FCQ was 0.94, with an average interitem correlation of 0.41. The average total FCQ score was 35.46 (SD 24.29). The prevalence of the items was higher than 11%. Ten items (no. 14, 20, 23, 24, 45, 50, 51, 63, 79, 92) had a prevalence lower than 20%. The prevalence of the remaining items was 54 in the 21% to 40% range, 33 in the 41% to 60% range, and one in the 61% to 100% range. The FCQ score correlated significantly and weakly with the BPRS score (r ⫽ 0.14, P ⬍ .05). The correlations between the FCQ score and the BPRS-P and BPRS-N scores were not significant (r ⫽ 0.08 and 0.05, respectively). However, the BPRS-G score correlated significantly and weakly with the FCQ score (r ⫽ 0.15, P ⬍ .01). DISCUSSION

Our study does not support a four- or two-factor solution for the FCQ. Among 229 schizophrenics meeting the ICD-8 criteria, Su¨llwold found a four-factor solution explaining 72% of the variance. Using a loading higher than 0.3, the factors were interpreted as (1) disturbances of automated responses, (2) percep-

399

tual disturbances, (3) depression, and (4) overinclusion. Schu¨nemann-Wurmthaler6 found a similar four-factor solution in 463 schizophrenics. In these studies, the authors used the Kaiser criteria and the interpretability of the variance to select the factors. Unfortunately, they did not display eigenvalue plots. Mass et al.10 found a two-factor solution among 505 schizophrenic and 187 alcoholic inpatients meeting the ICD-10 criteria. The Kaiser criteria yielded 23 factors explaining 59.60% of the variance and the scree test yielded two nontrivial FCQ factors explaining 25.2% and 4.5% of the variance, respectively. A varimax rotation was then done and the variables with a loading higher than 0.50 were retained. The two factors were respectively termed “dysphoric concomitants of severe illness which particularly impair concentration” (FCQ-F1) and “subjective experiences of perceptual uncertainties” (FCQ-F2). These factors comprised 36 and 14 items, respectively. These authors did not examine the composition of the first two unrotated factors, and thus the rates of items having a loading higher than 0.30 in each factor are not known. The factor analysis of Kim and Mueller16 relied on two fundamental postulates. The first, which they called the “postulate of factorial causation,” imposes a particular causal order on the data that observed variables are linear combinations of some underlying causal variables. The second is the “postulate of parsimony,” which allows the choice of the more parsimonious model between several factor models that are consistent with the observed data. The methods of rotation constitute the next step in factor analysis, which involves finding simpler and more easily interpreted factors through rotation, while keeping the number of factors fixed.17 We believe the principle of parsimony and the criteria of interpretability of the variance must be applied to the unrotated factor solution. The primary aim of the rotation method is to increase the variable saturations on the different factors and not to reveal a factor composition that is not yet obvious in the unrotated solution. Thus, the relevance of the unrotated two-factor solution in the study by Mass et al.10 remains unknown. The unidimensionality of the FCQ is supported by two studies. First, in 80 schizophrenics Rey8 found a unidimensional structure underlying a 76-

400

LOAS, YON, AND BRIEN

Table 2. Factor Loadings of the Two-Factor (Unrotated Solution)

V1 V2 V3 V4 V5 V6 V7 V8 V9 V10 V11 V12 V13 V14 V15 V16 V17 V18 V19 V20 V21 V22 V23 V24 V25 V26 V27 V28 V29 V30 V31 V32 V33 V34 V35 V36 V37 V38 V39 V40 V41 V42 V43 V44 V45 V46 V47 V48 V49 V50 V51 V52 V53 V54 Variance

F1

F2

.4826562 .4843129 .4695152 .4672975 .4415212 .5126932 .5398800 .4186357 .4363188 .4694760 .2610032 .3847896 .5431466 .4651494 .2808113 .3837888 .5341097 .5131341 .4434294 .5090553 .5619017 .5413608 .4546740 .4531203 .4538299 .6288251 .6277768 .2929797 .4866834 .4047893 .4098658 .4586194 .5710194 .5570924 .6770623 .6545119 .5191549 .6042960 .6522998 .4959759 .3467040 .6026101 .5348653 .6548284 .6004866 .6161281 .4775495 .5663689 .4640549 .4842506 .4707302 .5566506 .5310537 .5730434 .2880

⫺.063679 ⫺.028830 .070329 .054530 ⫺.159578 .020361 .082748 ⫺.230978 .244293 .063459 .196268 ⫺.041497 ⫺.084140 .282504 ⫺.027765 ⫺.007120 ⫺.005024 ⫺.014878 .285452 .272570 .097155 ⫺.103382 .405982 .299528 .256012 .037311 .007906 ⫺.015950 .331116 .170259 ⫺.341236 .349693 ⫺.140794 .187518 ⫺.110320 ⫺.201149 ⫺.399761 .040973 ⫺.166214 ⫺.286648 ⫺.080401 ⫺.170357 ⫺.006185 .082710 .372136 .116739 .237679 ⫺.178131 .055404 .346486 .435700 ⫺.104438 .143667 ⫺.060666 .0410

V55 V56 V57 V58 V59 V60 V61 V62 V63 V64 V65 V66 V67 V68 V69 V70 V71 V72 V73 V74 V75 V76 V77 V78 V79 V80 V81 V82 V83 V84 V85 V86 V87 V88 V89 V90 V91 V92 V93 V94 V95 V96 V97 V98

F1

F2

.6136351 .5437167 .3525150 .4078381 .5385681 .6049987 .5772102 .5525952 .5390207 .5097763 .5393680 .6468858 .5300158 .5828567 .6315641 .5903571 .5957214 .5000820 .6634384 .5768476 .6325819 .5952109 .5651370 .5413597 .4773528 .6124118 .5797381 .4937707 .4970554 .4450619 .6409110 .6650780 .5018403 .5641485 .6594394 .5308239 .5482731 .5003692 .6672952 .5498517 .6740992 .6138667 .5402857 .6603466

⫺.127270 ⫺.190863 ⫺.105096 .254765 .203544 ⫺.097492 ⫺.245036 .063480 .301793 .206314 ⫺.226974 ⫺.274136 .070998 .122536 ⫺.287599 ⫺.078711 ⫺.312862 .268781 ⫺.152283 .023976 ⫺.057880 .112551 ⫺.030642 ⫺.338018 .333125 ⫺.102752 .277508 ⫺.295130 .101750 ⫺.117129 .002871 .091661 .239020 ⫺.104671 ⫺.107327 ⫺.428872 .123551 .107963 ⫺.203193 ⫺.348464 ⫺.075953 .110318 ⫺.231266 ⫺.148439

DIMENSIONAL STRUCTURE OF THE FCQ

item version of the scale. Unfortunately, the author did not mention the eigenvalues of the factor solution. Second, Cuesta et al.9 found a one-factor solution in 286 psychotic inpatients meeting the DSM-III-R for psychosis (schizophrenia, schizophreniform disorder, schizoaffective disorder, etc.). The Kaiser criteria yielded 25 factors explaining 64.60% of the variance and the scree test (as reanalyzed by Mass et al.10) yielded two nontrivial FCQ factors explaining 26.3% and 3.8% of the variance, respectively. The interpretation of the variance and the principle of parsimony led the authors to retain only one factor. Moreover, 87 of the 98 FCQ items were loaded in the first factor with a value between 0.30 and 0.69. Only 11 items had their highest weight in factors other than the first. Several authors have proposed statistical methods for determining unidimensionality of a factor structure. For Reckase,18 the rate of the variance explained by the first factor should be higher than 20%, whereas Lumsden19 believes the ratio between the first and the second eigenvalue is a good indicator of unidimensionality. For Lord,20 a rough procedure for determining unidimensionality involves the ratio of first to second eigenvalue and an inspection as to whether the second eigenvalue is not much larger than any other value. Cuesta et al.9 operationalized the Lord criteria using Lord’s homogeneity index ⫽ (1° ⫺ 2°)/(2° ⫺ 3°). The value was 24.17 in their study. In our study, the Lord homogeneity index was (28.24 ⫺ 3.98)/(3.98 ⫺ 2.31) ⫽ 14.53. It is important to note that this index is uncommon and its cutoff score to detect unidimensionality has not been determined. Other authors21 have proposed four criteria of the unrotated factor matrix that could support the hypothesis of unidimensionality: (1) the first extracted component should explain a large proportion (⬎40%) of the variance in the items; (2) subsequent components should explain fairly equal proportions of the remaining variance except for a gradual decrease; (3) all or most of the items should have substantial loadings (⬎0.3) on the first component; and (4) all or most of the items should have higher loadings on the first component than on subsequent components. Our results meet three of the four criteria. Furthermore, Cronbach’s alpha is not only a reliability coefficient, but also an index of internal

401

consistency. Cronbach’s alpha is an index of common-factor concentration22 and measures the homogeneity and the internal consistency of the scale. Its value is related to the average interitem correlation, and thus its represents a measure of unidimensionality. It is important to note that all the studies exploring the construct validity of the FCQ have shown the same value of (0.97) for this coefficient.7,9 Cronbach’s alpha values for the different subjective symptoms scales higher than 0.80 have been found,1 but construct validity using factorial analyses has been seldom studied. Recently, the construct validity of the Bonn Scale for the Assessment of Basic Symptoms (BSABS) was examined using cluster analysis to identify the empirical item grouping. The results indicate five easily interpretable BSABS subsyndromes.23 The issue of the number of dimensions of the FCQ has important implications. When one factor (FCQ score) or two factors (FCQ-F1, FCQ-F2) were taken into account, there were no significant differences between schizophrenia and other psychoses10,24 or alcoholism.10 When the 10 original subscales of the FCQ were considered, the results were contradictory. In one study, four subscales (motility, impaired simple perception, impaired complex perception, thought disorder) differentiated schizophrenics from schizoaffective and bipolar disorders,25 while another study found there were no significant differences among subjects with schizophrenia, alcoholism, and obsessivecompulsive disorders.26 Mass et al27 built two subscales extracted from the FCQ, the first being specific for schizophrenia and the second for alcoholism.10,26 In other words, as pointed out by Mass et al.10 the dimensional approach is not a suitable strategy concerning the problem of the specificity of the FCQ. Unidimensionality underlying subjective symptoms could be related to a common pathogenetic mechanism as proposed by Huber.2 In addition, Peralta and Cuesta24 have proposed that subjective symptoms in psychotic disorders are the result of both a general psychotic factor and a diagnosisrelated factor. To take into account the fact that subjective symptoms were observed not only in psychotic disorders but also in nonpsychotic disorders, like alcoholism, we suggest that subjective symptoms are related to a general psychopatholog-

402

LOAS, YON, AND BRIEN

ical dimension. This dimension would be constitutive, associated with other dimensions, of the different psychiatric syndromes. Exploring the structure of 10 common mental disorders using confirmatory factorial analyses in the entire National Comorbidity Survey sample (N ⫽ 8,098), Krueger28 found that a three-factor model (externalizing, anxious-misery, fear) provided the best fit for the data. This study excluded psychotic disorders. The dimensional approach in schizophrenia using factorial analyses of the items of the Positive and Negative Syndrome Scale (PANSS) has shown that at least four or five dimensions (negative, positive, disorganization, anxious-depressive, excitation-activation) appear to best account for the phenotypic manifestations of schizophrenia.29 Moreover, in psychotic disorders, five dimensions (negative signs, social dysfunctions, delusions, hallucinations, thought disorders) explain the factor structure of the Andreasen scale for positive and negative symptoms.30 Using the Operational Criteria Cheklist for Psychotic Illness (OCCPI), Van Os et al.31 explored underlying dimensions of psychopathology in a cohort of 166 patients with functional psychosis of recent onset. Using factorial analysis of the OCCPI items, they found seven psychopathological dimensions. Five of these seven dimensions bore differential associations with subsequent treatment and illness course. These authors felt that dimensional representations of psychopathological features were more useful than categorical representations as predictors of illness course and treatment decisions. In a prospective study with an average 8-year follow-up, Klosterko¨tter et al.32 explored the pre-

dictive value of early self-experienced neuropsychological deficits for subsequent development of schizophrenia. Using the BSABS, they found that the development of schizophrenia was correctly predicted by the earlier presence of self-experienced disturbances. It would be interesting to explore the relationships between the subjective symptom dimensions and the objective symptom dimensions using factorial analysis on the FCQ and PANSS items to test the hypothesis that the subjective dimension was independent of the objective dimensions. If the subjective dimension would constitute an independent dimension, its prognostic value could be explored. Finally, our subscale avoids the use of the full FCQ, which takes a long time to administer. It contains 24 items, 11 and 16 of which are respectively shared by the 18-item FPSES and the 36item FCQ-F1 subscales. Concerning the correlations between the FCQ score and the BPRS subscale scores, our results confirm previous studies. Mass et al.26 did not find, in 50 schizophrenic inpatients, significant correlations between the FCQ score and the positive or the negative subscale scores of the PANSS. Moreover, they reported significant correlations between the FCQ score and the cognitive and the depression subscale scores of the PANSS. Interpretation of the results of the present study is subject to limitations. First, only one psychiatrist interviewed patients to make a diagnosis. Second, all patients were currently in treatment. This naturalistic setting led to bias, although the correlation between the FCQ score and the neuroleptic dosage (chlorpromazine equivalent) was low (r ⫽ 0.15, P ⬍ .01).

REFERENCES 1. Peralta V, Cuesta MJ. Subjective experiences in schizophrenia: a critical review. Compr Psychiatry 1994;35:198-204. 2. Huber G. Die coene¨sthetische schizophrenie. Fortschr Neurol Psychiatr 1957;25:491-520. 3. Chapman J. The early symptoms of schizophrenia. Br J Psychiatry 1966;112:225-251. 4. Williams RM, Alagaratnam W, Hemsley DR. Relationship between subjective self-report of cognitive dysfunction and objective information-processing performance in a group of hospitalized schizophrenic patients. Eur Arch Psychiatry Neurol Sci 1984;234:48-53. 5. Su¨llwold L. Frankfurter Beschwerde-Frageboden (FBF). In: Su¨llwold L, Huber G (eds). Schizophrene Basissto¨rungen. Berlin, Germany: Springer, 1986;1-36.

6. Schu¨nemann-Wurmthaler S. Subjektive Basissto¨rungen der Schizophrenie: Die Standardisierung ihrei Erhebung und ihre Einordnung in den Rahmen schizophrener Symptomatik. Frankfurt/Main, Germany: Lang, 1984:197. 7. Su¨llwold L. Frankfurter Beschwerde-Frageboden (FBF). Heidelberg, Germany: Springer, 1986. 8. Rey ER. Identifizierung und Verlauf kognitiver Sto¨rungen Schizophrener. Arbeitsbericht des Sonderforschungsbereichs 116 (Psychiatrische Epidemiologie). Mannheim, Germany: Zentralinstitut fu¨r Seelische Gesundheit, 1982:139-290. 9. Cuesta MJ, Peralta V, Irigoyen I. Factor analysis of the Frankfurt Complaint Questionnaire in a Spanish sample. Psychopathology 1996;29:46-53. 10. Mass R, Haasen C, Krausz M. Dimensional structure and

DIMENSIONAL STRUCTURE OF THE FCQ

diagnostic specificity of the Frankfurt Complaint Questionnaire. Eur Psychiatry 1997;12:117-123. 11. World Health Organization. The ICD-10 Classification of Mental and Behavioural Disorders: Clinical Descriptions and Diagnostic Guidelines. Gene`ve, Switzerland: WHO, 1992. 12. Organisation Mondiale de la Sante´. Crite`res diagnostiques pour la recherche. CIM-10, ICD-10. Troubles mentaux et troubles du comportement. Geneva, Switzerland: WHO, Masson, 1994. 13. Loas G, Berner P, Rein W, Yon V, Boyer P, Lecrubier Y. Traduction franc¸aise du questionnaire de plaintes de Francfort (QPF) (Frankfurter Beschwerde-Frageboden, FBF, Su¨llwold, 1986). Ence´phale 1997;23:364-374. 14. Overall JE, Gorham DR. Brief Psychiatric Rating Scale. Psychol Rep 1962;10:799-812. 15. Bell M, Milstein R, Beam-Goulet J, Lysaker P, Ciccheti D. The Positive and Negative Syndrome Scale and the Brief Psychiatric Rating Scale. J Nerv Ment Dis 1992;180:723-728. 16. Kim JO, Mueller CW. Introduction to Factor Analysis. What It Is and How To Do It. Beverly Hills, CA: Sage Publications, 1978. 17. Kim JO, Mueller CW. Factor Analysis, Statistical Methods and Pratical Issues. Beverly Hills, CA: Sage Publications, 1978. 18. Reckase MD. Unifactor latent trait models applied to multifactor tests: results and implications. J Educ Stat 1979;4: 207-230. 19. Lumsden J. A factorial approach to unidimensionality. Aust J Psychol 1957;9:105-111. 20. Lord FM. Applications of item response theory to practical testing problems. Hillsdale, NJ: Erlbaum, 1980. 21. Carmines EG, Zeller RA. Reliability and validity assessment. Beverly Hills, CA: Sage Publications, 1979. 22. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika 1951;16:297-334. 23. Klosterko¨tter J, Ebel H, Schultze-Lutter F, Steinmeyer

403

EM. Diagnostic validity of basic symptoms. Eur Arch Psychiatry Clin Neurosci 1996;246:147-154. 24. Peralta V, Cuesta MJ. Subjective experiences in psychotic disorders: diagnostic value and clinical correlates. Compr Psychiatry 1998;39:11-15. 25. Ricca V, Galassi F, La Malfa G, Mannucci E, Barciulli E, Cabras PL. Assessment of basic symptoms in schizophrenia, schizoaffective and bipolar disorders. Psychopathology 1997; 30:53-58. 26. Mass R, Weigel S, Schneider S, Klepsch R. Schizophreniaspecific basic symptoms. Psychopathology 1998;31:113-119. 27. Mass R, Krausz M, Gross J. Basissymptome bei schizophrenie und alkoholismus. Eine methodenkritische Vergleichsstudie. Nervenarzt 1995;66:331-337. 28. Krueger RF. The structure of common mental disorders. Arch Gen Psychiatry 1999;56:921-926. 29. Loas G, Noisette C, Legrand A, Delahousse J. Mode`le quadridimensionnel des schizophre´nies chroniques issu de la structure factorielle de l’e´chelle des syndromes positif et ne´gatif (PANSS). E´tude chez un groupe de 153 schizophre`nes chroniques et comparaison avec la structure factorielle de la BPRS. Ence´phale 1997;23:10-18. 30. Minas IH, Klimidis S, Stuart GW, Copolov DL, Singh BS. Positive and negative symptoms in the psychoses: principal components analysis of items from the Scale for the Assessment of Positive Symptoms and the Scale for the Assessment of Negative Symptoms. Comp Psychiatry 1994;35:135-144. 31. Van Os J, Fahy TA, Harvey I, Sham P, Lewis S, Bebbington P, Toone B, et al. Psychopathological syndromes in the functional psychoses: associations with course and outcome. Psychol Med 1996;26:161-176. 32. Klosterko¨tter J, Schultze-Lutter F, Gross G, Huber G, Steinmeyer EM. Early self-experienced neuropsychological deficits and subsequent schizophrenic diseases: an 8 year average follow-up prospective study. Act Psychiatr Scand 1997;95: 396-404.