© American Diabetes Association ®, Inc., 2004
Development and Validation of the Diabetes Quality of Life Brief Clinical InventoryAddress correspondence to: Dr. Thomas E. Burroughs, St. Louis University Center for Outcomes Research, Salus Center, Room 2378, 3545 Lafayette Ave., St. Louis, MO 63104
Objective. To design and test the reliability and validity of a brief, treatment-focused version of the Diabetes Quality of Life (DQOL) questionnaire for use with both type 1 and type 2 diabetes.
Research design and methods. Questionnaire packets including the DQOL, measures of current diabetes self-care behaviors, and demographic and health characteristics were mailed to 1,080 adults with type 1 or type 2 diabetes. A total of 498 patients returned completed packets. A three-stage statistical process was used to understand the underlying structure of the DQOL and to identify items most predictive of self-care behaviors and satisfaction with diabetes control.
Results. Principal components analysis, conducted on 26 items predictive of the main criteria, identified five key underlying factors. For each component, best subset regression analysis was conducted to identify nonredundant questions that best explained self-care behaviors and satisfaction with diabetes control. A combined set of 15 questions was reliable (alpha = 0.85) and valid, though several questions were more relevant to type 1 or type 2 diabetes. For patients with type 1 diabetes, the 15-item brief inventory was equally or more effective at predicting self-care behaviors (shortened scale R2 = 0.360; full scale R2 = 0.254) and satisfaction with diabetes control (shortened scale R2 = 0.562; full scale R2 = 0.580) than the original 60-item DQOL. For type 2 diabetic patients, only satisfaction with diabetes control was well-predicted, but the 15-item inventory accounted for as much variance as the original 60-item DQOL (shortened scale R2 = 0.513; full scale R2 = 0.492).
Conclusions. The 15-item DQOL Brief Clinical Inventory provides a total healthrelated quality of life score that predicts self-reported diabetes care behaviors and satisfaction with diabetes control as effectively as the full version of the instrument. In addition, it provides a vehicle for quickly screening patients for readiness and specific treatment-related concerns. It takes about 10 minutes to administer and can be used to identify quality of life issues that might not arise during the typical patient-provider encounter.
The past few decades have witnessed considerable research about health-related quality of life (HRQOL), leading to the development and refinement of a number of generic and disease-specific HRQOL measures.18 A patients quality of lifetotal physical, mental, and social well-beinghas come to be viewed as a critical outcome of disease treatment and control. Consequently, generic and disease-specific HRQOL measures have been used extensively in clinical trials and research initiatives to assess the impact of medical interventions.2,3,9 A finding underscoring the importance of HRQOL is that clinical variables alone do not comprehensively capture patients perceptions of their health. In fact, studies show relatively low correlations between clinical measures of disease activity (e.g., peak flow rates for asthma and hemoglobin A1c [A1C] results for diabetes) and patients perceptions of health and well-being.5,10 Such low correlations have been reported in several chronic diseases including diabetes, asthma, and chronic obstructive pulmonary disease.9,1113 The issue of HRQOL is particularly important for diseases such as diabetes, for which the health care regimen requires ongoing self-care behaviors that can interfere with patients desired lifestyles. Providing optimal diabetes care involves recognizing the inherent cost-benefit trade-off between the disease and treatment burden. The Diabetes Control and Complications Trial (DCCT) hinted at this delicate balance by finding that intensive insulin therapy yielded a significant reduction in diabetic complications compared to traditional insulin therapy,14 but did not lead to improved quality of life.15 Other research has yielded inconsistent relationships between therapy intensity and quality of life,1626 in part because of the fact that HRQOL is influenced by a myriad of other factors, such as the existence of other health problems, social relationships, marital status,7,22,27 patient knowledge,28 treatment satisfaction,18 and perceived ability to control ones disease.7 For health care professionals, a key goal in treating diabetes is to help patients improve their quality of life by identifying and addressing diabetes-related issues. Past research has found, however, that as much as 54% of patient problems and 45% of patient concerns are neither elicited by providers nor disclosed by patients during a typical office visit.29 Along these same lines, patients often express dissatisfaction with the information provided to them by their providers,29,30 and this patient-provider communication is linked to patient compliance with therapy31 and satisfaction with care.32,33 Findings also suggest that improving patient-provider communication benefits patient health and promotes provider loyalty as a consequence of improved satisfaction with care.34 The objective of this study was to develop a valid and reliable, but brief, diabetes-specific HRQOL instrument for use in routine office visits, with specific actionable items to improve provider-patient communication, treatment compliance, and health care satisfaction. Recent short-form quality of life (QOL) measures, such as the Medical Outcomes Study SF-36,35 short hypertension-specific QOL form,36 short coronary artery diseasespecific QOL form,37 and short mental-health SF-36,38 have been successfully developed, in which the goal was to preserve the full item content range, scale structure, reliability, validity, and responsiveness of the original instruments.39 Outcome-predictive QOL inventories have been successfully implemented with other specific health problems, such as hypertension,40 arthritis,41 and mental health.38 Our goal, and consequently our analytical approach, differed somewhat from this. We focused on selecting items that differentiate patients in terms of treatment satisfaction and compliance. Items most predictive of these two criteria were retained to build a clinical inventory that highlights clinically significant patient problems.
Overview First, we reviewed the literature for diabetes-specific QOL measures, and these instruments were reviewed for comprehensiveness and psychometric properties. Based on this review, we selected the Diabetes Quality of Life (DQOL) questionnaire to be our foundation instrument. Second, a panel of experts in diabetes care reviewed the DQOL for comprehensiveness. Third, we administered this instrument, along with a measure of current health care behaviors and demographic characteristics, to 1,080 adults with type 1 or type 2 diabetes. Fourth, we analyzed this data to identify those survey items that best predict regimen adherence and satisfaction with the diabetes regimen. These items became the core of the shortened DQOL instrument. Finally, we conducted analysis to evaluate the statistical performance of this shortened instrument.
Selection of the DQOL The DQOL questionnaire, developed for both type 1 and type 2 diabetes as part of the DCCT,18,27,52 was identified through our review as having qualities most amenable to aiding provider-patient communication about treatment. Despite desirable content focus, reliability, and validity,52 the DQOL in its full form is too lengthy to be completed as part of a providers routine office visit. Its 46 core items measure four domains highly relevant to treatment perceptions: satisfaction with treatment, impact of treatment, worry about the future effects of diabetes, and worry about social/vocational issues.
Procedure
Instruments Items are scored on a 5-point Likert scale and are of two general formats. One format asks about the frequency of negative impact of diabetes itself or of the diabetes treatment (i.e., "How often do you worry about whether you will pass out?") and provides response options from 1 (never) to 5 (all the time). The second format asks about satisfaction with treatment and quality of life (i.e., "How satisfied are you with the time you spend exercising?") and is scored from 1 (very satisfied) to 5 (very dissatisfied). Higher scores on DQOL items and subscales are, therefore, negatively valenced, indicating problem frequency or dissatisfaction. The instrument has been shown to have excellent internal consistency (r = 0.780.92), test retest reliability (r = 0.780.92), and convergent validity for all four subscales for people with type 1 and type 2 diabetes.18,27,52
Concurrent criteria
Overall treatment satisfaction. Respondents were asked to rate their overall "satisfaction with diabetes control" based on their current treatment. Responses were made on a Likert scale ranging from 1 (very satisfied) to 5 (very unsatisfied).
Patient background questionnaire
Statistical Analyses In the third stage, we identified optimal subsets of items for type 1 and type 2 diabetes. First, we performed principal components analysis on the 26 predictive items for the entire participant sample. Several orthogonal rotations were examined, with varimax rotation yielding the clearest separation of factor loadings. We then used multiple linear regression to model 1) diabetes control satisfaction and 2) reported self-care as a function of the groups of items from the five DQOL components. Models were built separately in a two-step process for type 1 and type 2 diabetes. In the first step, we used stepwise selection to identify items from each orthogonal principal component that explained significant variance in either diabetes control satisfaction or reported self-care. In the second step, we used best 110 variable subset methods with the joint set of items identified in the first step to identify items that jointly and most parsimoniously (based on Schwarzs BIC and Mallows C) explained the maximum amount of variance in diabetes control satisfaction and reported self-care. The two-step approach allowed us to reduce redundancy among items that were highly correlated with each other before trying to explain maximal combined variance from all unique sources of variation in the instrument.
Sample Characteristics Of the 498 respondents, 32% had type 1 diabetes, and 68% had type 2 diabetes. Length of time since diagnosis ranged from 1 to more than 20 years, with a median length of time of 8 years. Slightly more than half the respondents were female (53%), and ages for respondents ranged from 21 to more than 80 years, with a median of 51 years. Educational levels ranged from a completed doctoral to less than a high school degree, with 41% having completed just a high school degree. Annual household income ranged from less than $15,000 to more than $100,000, with a median of $37,500. In examining respondents health status, subjects reported a number of health problems including hypertension (51%), high cholesterol (45.3%), arthritis (42.4%), sleeping problems (44.6%), and depression (33.3%).
Comparison of Data With DQOL Validation Sample DQOL reliability coefficients in our sample were comparable to the validation study,52 ranging from 0.61 for the Diabetes Worry subscale to 0.94 for the total DQOL scale score. Detailed examination of missing values indicated few problems with only two items (Impact Q25 [9%] and Impact Q21 [10%]) having missing value rates as high as 10%. Further, there were no items for which more than 90% of respondents selected the lowest response option, which would have suggested that the item did not pose a quality of life issue for our sample.
Item Selection
Type 1 diabetes Six items were identified by the two-stage regression analysis as predictors of satisfaction with diabetes control (P < 0.0001). These items included satisfaction with the time spent managing diabetes, satisfaction with current treatment, satisfaction with sex life, frequency of bad sleep, frequency of career limitation, and frequency of worry over missing work. Table 2 provides regression parameters.
Similarly, nine items were identified as predictors of self-care adherence (P < 0.0001). These items included satisfaction with glucose maintenance, satisfaction with current treatment, satisfaction with burden on family, satisfaction with exercise, frequency of pain with treatment, frequency of feeling ill, frequency of breaking diet to avoid telling others about diabetes, frequency of career limitation, and frequency of worry over passing out. Regression analyses were next conducted to evaluate how well the six- and nine-item models predicted satisfaction and self-care, compared to models containing all 60 DQOL items. In predicting satisfaction with treatment, the six-item model had an adjusted R2 of 0.562, compared to 0.580 for the 60-item model. In predicting self-care behaviors, the six-item model had an adjusted R2 of 0.360, compared to 0.254 for the 60-item model. These results suggest that six- and nine-item solutions are effectively able to predict overall satisfaction with diabetes control and overall self-care behaviors as well as the full 60-item survey among patients with type 1 diabetes.
Type 2 diabetes Regression analyses evaluated how well these six-item models predicted satisfaction and self-care, as compared to models that contained all 60 DQOL items. In predicting satisfaction with treatment, the six-item model had an adjusted R2 of 0.513, compared to 0.492 for the 60-item model. In predicting self-care behaviors, the six-item model had an adjusted R2 of 0.117, compared to 0.196 for the 60-item model. These results suggest that, for type 2 diabetes, overall satisfaction with diabetes control was predicted as well by the six-item survey as by the 60-item survey, though overall self-care behaviors were predicted slightly better by the overall 60-item model than by the six-item reduced model.
Constructing the DQOL Short-Form Clinical Inventory The new total score was correlated with the full DQOL scale and with the individual DQOL subscales. The uncorrected correlation between the two total scales was 0.81, and correlation corrected for attenuation due to the instruments reliability was 0.91, suggesting that the shortened version was able to explain the vast majority of variation in total DQOL scores. Equivalent analysis suggested that the shortened scale correlated strongly with each of the individual subscales from the full instrument. The strongest relationship was with the satisfaction subscale (uncorrected r = 0.84 and corrected r = 0.97), and the weakest relationship was with the social worry scale (uncorrected r = 0.43 and corrected r = 0.52). The final set of 15-items selected into the two regression models is shown in Table 3.
Research has suggested that individuals with diabetes have reduced HRQOL compared to the general population, but better HRQOL than individuals with many other chronic illnesses.7 While intensive insulin therapy has been successful in achieving control of the physical symptoms and complications of diabetes, patients report varied and mixed impact on their HRQOL.17,1921,23,24,27 As a result, helping patients balance disease control and treatment burden is a critical goal for health care providers. Past communication research has demonstrated that many patient issues go unexplored in office visits, due to factors including limited time for interaction, provider communication style, and patient discomfort raising issues with the provider.25,29,31,33,34 The goal of this study was to establish a reliable and valid brief DQOL inventoryfocused on treatment satisfaction and compliance issuesthat could be effectively integrated into clinicians office settings to improve patient-provider communication. Previous HRQOL instruments, largely because of their length, have not transitioned from the research setting to provider office settings. To establish this shortened and treatment-focused inventory, we employed a statistically driven three-step process to identify the core set of items that is strongly linked to participants satisfaction with the diabetes control and their own self-care behaviors. The result was a 15-item shortened scale instrument that is highly correlated with the total DQOL and subscales. The shortened instrument was also able to explain as much variance in self-care behaviors and satisfaction with diabetes control as did the full DQOL. This suggests that we lost very little core information from the original DQOL subscales as a result of significantly shortening the survey. A primary purpose for this shortened survey is to facilitate better communication between patients and their health care providers. The 15 items on this survey cover a broad range of issues related to diabetes. They range from satisfaction with various aspects of the diabetes regimen to fears and concerns to frequency of diabetes problems. One can easily imagine how these issues might not be uncovered during a typical clinical office visit. It is also easy to imagine how many of these issues could be addressed either through tailoring of the regimen, providing information, or simply listening and providing reassurance to patients concerns. Because this was just the initial step in the development of a modified DQOL inventory, additional research will need to examine how to best integrate this measure into clinical practice and evaluate longitudinal reliability, predictive validity for clinical and QOL outcomes (particularly A1C levels), and responsiveness/sensitivity to different treatments. While the shortened scale has strong links to satisfaction with diabetes control and with self-care behaviors, there are several limitations that should be noted. First, with only 15 items, the instrument should be viewed as an initial screening device to identify specific patient issues, but does not obviate the need for informed probing of other issues that patients may be facing. Second, because the selection of items was driven by the statistical item relationships provided by the participants in this study, the extent to which these participants and their responses are not representative of the general population of people with diabetes may limit the generalizability of the instrument. Despite these limitations, this study established a 15-item shortened version of the DQOL that demonstrated excellent ability to predict satisfaction and self-care behaviors, particularly among patients with type 1 diabetes. The items on the instrument cover a wide range of issues for people with diabetes that are addressable during routine clinical care. By identifying issues that might not otherwise come up during clinical care, the instrument provides an opportunity to strengthen the provider-patient interaction and provide patients with assistance for issues that may be impeding their HRQOL.
Thomas E. Burroughs, PhD, is an associate professor at St. Louis University School of Medicine and director of the St. Louis University Center for Outcomes Research in St. Louis, Mo. Radhika Desikan, PhD, is a research scientist, and Janet McGill, PhD, is an associate professor of medicine at the Washington University School of Medicine, in St. Louis, Mo. Brian M. Waterman, MPH, is president, and Debra Gilin, PhD, is an analytical consultant at Waterman Research Solutions, LLC, in St. Louis, Mo.
2 Greenfield S, Nelson EC: Recent developments and future issues in the use of health status assessment measures in clinical settings. Med Care 30:2341, 1992 3 Guyatt G, Veldhuyzen V, Sander J, Feeny D, Patrick D: Measuring quality of life in clinical trials: a taxonomy and review. CMAJ 140:14411448, 1989[Abstract] 4 Guyatt G, Kirshner B, Jaeschke R: Measuring health status: what are the necessary measurement properties. J Clin Epidemiol 45:13411345, 1992[Medline]
5 Guyatt G, Feeny D, Patrick D: Measuring health-related quality of life. Ann Intern Med 118:622629, 1993 6 Patrick DL, Erickson P: What constitutes quality of life? Concepts and dimensions. Qual Life Cardiovasc Care 4:103126, 1988 7 Rubin RR, Peyrot M: Quality of life and diabetes. Diabetes Metab Res Rev 15:205218, 1999[Medline] 8 Shipper H, Clinch J, Powell V: Definitions and conceptual issues. In Quality of Life Assessments in Clinical Trials. Spilker B, Ed. New York, Raven Publishers, 1990, p. 1124 9 Stewart AL, Greenfield S, Hays RD: Functional status and well-being of patients with chronic conditions: results from the Medical Outcomes Study. JAMA 262:907913, 1989[Abstract] 10 Mackeigan LD, Pathak DS: Overview of health-related quality-of-life measures. Am J Hosp Pharm 49:22362245, 1992[Abstract] 11 Juniper EF: Rhinitis management: the patients perspective. Clin Exper Allergy 28:3438, 1998 12 Juniper EF: Effect of asthma on quality of life. Can Resp J 5:77A84A, 1998 13 Weinberger M, Kirkman S, Samsa GP, Cowper PA, Shortliffe EA, Simel DL, Feussner JR: The relationship between glycemic control and health-related quality of life in patients with non-insulin dependent diabetes mellitus. Med Care 32:11731181, 1994[Medline]
14 The DCCT Research Group: The effect of intensive treatment of diabetes on the development and progression of long-term complications in insulin-dependent diabetes mellitus. N Engl J Med 329:977986, 1993 15 Group DR: Influence of intensive diabetes treatment on quality-of-life outcomes in the Diabetes Control and Complications Trial. Diabetes Care 19:195203, 1996[Abstract] 16 Hanestad B, Albreksten G: Quality of life, perceived difficulties in adherence to a diabetes regimen, and blood glucose control. Diabet Med 8:759764, 1991[Medline] 17 Watkins KW, Connell CM, Fitzgerald JT, Klem L, Hickey T, Ingersoll-Dayton B: Effects of adults self-regulation of diabetes on quality of life outcomes. Diabetes Care 23:15111515, 2000[Abstract] 18 Jacobson AM, the DCCT Research Group: The Diabetes Quality of Life Measure. In Handbook of Psychology and Diabetes: A Guide to Psychological Measurement in Diabetes Research and Practice. Bradley C, Ed. Chur, Switzerland, Harwood Academic Publishers, 1994, p. 6588
19 Prospective Diabetes Study Group: Quality of life in type 2 diabetic patients is affected by complications but not by intensive policies to improve blood glucose or blood pressure control. Diabetes Care 22:11251136, 1999 20 Schiel R, Muller UA: Intensive or conventional insulin therapy in type 2 diabetic patients? A population-based study on metabolic control and quality of life. Exp Clin Endocrinol 107:506511, 1999 21 The DCCT Research Group: Influence of intensive diabetes treatment on quality-of-life outcomes in the diabetes control and complications trial. Diabetes Care 19:195203, 1996 22 Parkerson GRJ, Connis RT, Broadhead WE, Patrick DL, Taylor TR, Tse CK: Disease-specific versus generic measurement of health-related quality of life in insulin-dependent diabetes patients. Med Care 31:629639, 1993[Medline] 23 Eiser C, Flynn M, Green E, Havermans T, Kirby R, Sandeman D, Tooke JE: Quality of life in young adults with type 1 diabetes in relation to demographic and disease variables. Diabet Med 9:375378, 1992[Medline] 24 Wikby A, Hornquist JO, Andersson PO: Background, quality of life and metabolic control in patients with insulin-dependent diabetes mellitus. Diabetes Res Clin Pract 13:5361, 1991[Medline] 25 Tallroth G, Karlson B, Nilsson A, Agardh CD: The influence of different insulin regimens on quality of life and metabolic control in insulin dependent diabetics. Diabetes Res Clin Pract 6:3743, 1989[Medline] 26 Karlson B, Agardh C: Influence of intensified insulin regimen on quality of life and metabolic control in insulin-dependent diabetes mellitus. Diabetes Res Clin Pract 25:111115, 1994[Medline] 27 Jacobson AM, Samson JA, De Groot M: The evaluation of two measures of quality of life in patients with type 1 and type 2 diabetes. Diabetes Care 17:267274, 1994[Abstract] 28 Williams GC, Zeldman A: Patient-centered diabetes self-management education. Curr Diabetes Reps 2:145152, 2002 29 Stewart MA: Effective doctor-patient communication and health outcomes: a review. C MAJ 152:14231433, 1995 30 Stewart M, Brown JB, Boon H, Galajda J, Meredith L, Sangster M: Evidence on patient-doctor communication. Cancer Prev Control 3:2530, 1999[Medline] 31 Woolley FR, Kane RL, Hughes CC, Wright DD: The effects of doctor-patient communication on satisfaction and outcome of care. Soc Sci Med 12:123128, 1978 32 Lochman JE: Factors related to patients satisfaction with their medical care. J Comm Health 9:91109, 1983[Medline] 33 Stewart MA, McWhinney IR, Buck CW: The doctor/patient relationship and its effect on outcome. J Royal Coll Gen Pract 29:7782, 1979 34 Kaplan SH, Greenfield S, Ware JE, Jr.: Assessing the effects of physician-patient interactions on the outcome of chronic disease. Med Care 27:110127, 1989 35 Ware JJ, Kosinski M, Keller SD: A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity. Med Care 34:220233, 1996[Medline] 36 Testa MA, Sudilovsky A, Rippey RM, Williams GH: A short form for clinical assessment of quality of life among hypertensive patients. Am J Prevent Med 5:8289, 1989[Medline] 37 Buchner DA, Graboys TB, Johnson K, Mordin MM, Goodman L, Partsch DS, Goss TF: Development and validation of the ITG Health-Related Quality of Life Short-Form measure for use in patients with coronary artery disease. Clin Cardiol 24:556563, 2001[Medline] 38 Ware JE, Gandek B: The SF-36 Health Survey: development and use in mental health research and the IQOLA Project. Int J Mental Health 23:4973, 1994 39 Smith GT, McCarthy DM, Anderson KG: On the sins of short-form development. Psychol Assess 12:102111, 2000[Medline] 40 Testa M: Parallel perspectives on quality of life during antihypertensive therapy: impact of responder, survey environment, and questionnaire structure. J Cardiovasc Pharm 21:S18S25, 1993 41 Ware JE, Keller SD, Hatoum HT, Kong SX: The SF-36 Arthritis-Specific Health Index (ASHI): I. Development and cross-validation of scoring algorithms. Med Care 37:MS40MS50, 1999[Medline] 42 Chang J, Guo J, Chen Y, McNulty P, Martens L: Health-related quality of life (HRQOL) measures in type 2 diabetes. Presentation at the International Society for Pharmacoeconomic and Outcomes Research 5th Annual International Meeting. Arlington, Va., May 24, 2000
43 Fitzgerald JT, Davis WK, Connell CM, Hess GE, Funnell MM, Hiss RG: Development and validation of the Diabetes Care Profile. Eval Health Prof 19:208230, 1996 44 Anderson RM, Fitzgerald JT, Wisdom K, Davis WK, Hiss RG: A comparison of global versus disease-specific quality of life measures in patients with NIDDM. Diabetes Care 20:299305, 1997[Abstract] 45 Bradley C: The Diabetes Treatment Satisfaction Questionnaire (DTSQ). In Handbook of Psychology and Diabetes: A Guide to Psychological Measurement in Diabetes Research and Practice. Bradley C, Ed. Chur, Switzerland, Harwood Academic, 111132, 1994 46 Bott U, Muhlhauser I, Overmann H, Berger M: Validation of a diabetes-specific quality of life scale for patients with type 1 diabetes. Diabetes Care 21:757769, 1998[Abstract] 47 Shen W, Kotsanos JG, Huster WJ, Mathias SD, Andrejasich CM, Patrick DL: Development and validation of the Diabetes Quality of Life Clinical Trial Questionnaire. Med Care 37:AS45AS66, 1999 48 Boyer JG, Earp JA: The development of an instrument for assessing the quality of life of people with diabetes. Diabetes-39. Med Care 35:440453, 1997[Medline] 49 Bradley C, Todd C, Gorton T, Symonds E, Martin A, Plowright R: The development of an individualized questionnaire measure of perceived impact of diabetes on quality of life: the ADDQOL. QOL Res 8:7991, 1999 50 Bradley C, Speight J: Patient perceptions of diabetes and diabetes therapy: assessing quality of life. Diabetes Metab Res Revs 18:6469, 2002 51 Hahl J, Hamalainen H, Sintonen H, Simell T, Arinen S, Simell O: Health-related quality of life in type 1 diabetes without or with symptoms of long-term complications. QOL Res 11:427436, 2002 52 The DCCT Research Group: Reliability and validity of a diabetes quality of life measure for the Diabetes Control and Complications Trial (DCCT). Diabetes Care 11:725732, 1998 53 Burroughs TE, Pontious SL, Santiago JV: The intercorrelates of psychosocial domains and metabolic control in adolescents with IDDM. Diabetes Educ 19:396402, 1993 54 Hanson CL, Henggeler SW, Burghen GA: Model of associations between psychosocial variables and health-outcome measures of adolescents with IDDM. Diabetes Care 10:752758, 1987[Abstract] 55 Tabachnick BG, Fidell LS: Using Multivariate Statistics. New York, Harper Collins College Publishers, 1996
|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||