• KAFM
  • Contact us
  • E-Submission
ABOUT
ARTICLE CATEGORY
BROWSE ARTICLES
AUTHOR INFORMATION

Page Path

28
results for

"validity"

Filter

Article category

Keywords

Publication year

Authors

Funded articles

"validity"

Original Articles
Testing the reliability and validity of the Korean version of the Pittsburgh Sleep Quality Index using Fitbit devices: a cross-sectional analysis
Si-Yeon Lee, Ja-Eun Choi, Ji-Won Lee, Yaeji Lee, Jae-Min Park, Kyung-Won Hong
Korean J Fam Med 2025;46(1):42-47.   Published online April 22, 2024
DOI: https://doi.org/10.4082/kjfm.23.0166
Background
Sleep disorders and insomnia are prevalent worldwide, with negative health outcomes. The Pittsburgh Sleep Quality Index (PSQI) is a widely used self-report assessment tool for evaluating sleep quality, comprising seven subdomains. The Korean version of the PSQI (PSQI-K) has been tested for reliability and validity in small sample sizes but lacks large-scale validation using objective measures.
Methods
This study was conducted with 268 Korean adults attending health check programs. Participants completed the PSQI-K questionnaire and wore Fitbit devices (Fitbit Inc., USA) to ascertain sleep parameters. Reliability was analyzed using the Cronbach’s α coefficient, and construct validity was determined through factor analysis. Criteria validity was assessed by correlating their index scores with Fitbit sleep parameters. We identified the optimal cutoff for detecting sleep disorders.
Results
The Cronbach’s α coefficient was 0.61, indicating adequate internal consistency. Factor analysis revealed three factors, explaining 48.2% of sleep quality variance. The index scores were negatively correlated with Fitbit sleep efficiency, total sleep time, and number of awakenings (P<0.05). The optimal cutoff point for identifying sleep disorder groups was ≥6.
Conclusion
The PSQI-K demonstrated good reliability and validity when correlated with Fitbit sleep parameters, offering a practical screening tool for identifying sleep disorders among Korean adults. Cutoff scores can help identify patients for sleep interventions. However, further large-scale studies are required to validate these findings.

Citations

Citations to this article as recorded by  
  • Association of work ability with job burnout and sleep quality among biosafety laboratory personnel in Xinjiang, China: a cross-sectional study
    Keke Ju, Ruikai Wu, Jing Yu, Lei Ding, Mengjie Xia, Jiwen Liu, Yaoqin Lu
    Frontiers in Public Health.2025;[Epub]     CrossRef
  • Validation of the Korean version of the Sleep Hygiene Practice Scale in a Non-Clinical Population
    Dongyeop Kim, Ji Young Yun, Hye Ah Lee, Pamela Song, Heeyoung Ahn, Chien-Ming Yang, Jee Hyun Kim
    Behavioral Sleep Medicine.2024; 22(6): 791.     CrossRef
  • The relationship between sleep quality and happiness among preclinical students in a medical school
    Rusdiah Ruzanna Jusoh, Kavimitha G Krishnasamy, Saila Dharishinee Alagu, Pretha Mohan, Jeslyn Tan Guan Qian, Elayevenee Elanthevan, Muhammad Zulfiqah Sadikan, Haryati Ahmad Hairi
    Journal of Education Technology in Health Sciences.2024; 11(3): 92.     CrossRef
  • 2,465 View
  • 96 Download
  • 2 Web of Science
  • 3 Crossref
Development and Psychometric Properties of an Extended Theory of Planned Behavior Questionnaire for Childbearing Intentions and Behaviors in Iran
Babak Moeini, Amir Erfani, Majid Barati, Amin Doosti-Irani, Hatam Hosseini, Mokhtar Soheylizad
Korean J Fam Med 2023;44(2):109-116.   Published online March 20, 2023
DOI: https://doi.org/10.4082/kjfm.22.0066
Background
Childbearing is the most important determinant of population fluctuations, and its study is more important than other population phenomena. Owing to the lack of a valid questionnaire based on the extended theory of planned behavior, this mixed-method study was conducted to determine the validity and reliability of a questionnaire designed to examine related belief-based factors on the intention to bear children in Iranian society.
Methods
This study was conducted in two phases in Hamadan city, western Iran, in 2021. Phase 1 consisted of an extensive literature review and a qualitative study using a directed content analysis approach to generate an item pool. Psychometrics were measured in phase 2, including content, face, and construct validity. Reliability was assessed based on internal consistency and stability. The collected data were analyzed using IBM SPSS and AMOS ver. 24.0.
Results
Mean content validity ratio and content validity index were 0.7 and 0.85, respectively. Exploratory factor analysis of the 32 items identified an eight-factor solution. These factors jointly accounted for 79.1% of the observed variance in the outcome variables. Confirmatory factor analysis indicated a good fit for the data. The internal consistency based on Cronbach’s α was 0.85 (0.71–0.93). In addition, stability was confirmed using the test-retest method and intraclass correlation coefficient (0.74–0.94).
Conclusion
The designed questionnaire is a valid and reliable instrument for evaluating related belief-based factors on the intention and behavior of childbearing among married men and women in Iran.

Citations

Citations to this article as recorded by  
  • An integrated theory based-educational intervention to change intention to have a child: study protocol of a cluster randomized controlled trial
    Maryam Moridi, Maryam Damghanian, Sedigheh Keshaverz
    Reproductive Health.2024;[Epub]     CrossRef
  • Does fiscal expenditure contribute to increasing fertility intentions of rural households?
    Zhongyi Gong, Mei Ge
    Finance Research Letters.2024; 63: 105286.     CrossRef
  • 2,802 View
  • 81 Download
  • 2 Web of Science
  • 2 Crossref
Cultural Adaption and Psychometric Analysis of Family APGAR Scale in Iranian Older People
Zeinab Karimi, Zahra Taheri-Kharameh, Fatemeh Sharififard
Korean J Fam Med 2022;43(2):141-146.   Published online March 17, 2022
DOI: https://doi.org/10.4082/kjfm.21.0028
Background
Family function is a necessary factor that influences older people’s health. The Family APGAR has been widely used to study family functions. However, there has been no Persian version of this instrument to assess family function in older people. The aim of this study was to determine the psychometric properties of the Persian version of the Family APGAR Scale to evaluate the perception of family functions.
Methods
The “forward-backward” procedure was applied to translate the scale from English into Persian. The translated version was checked in terms of validity and reliability, with a sample of 281 older people selected from retirement centers. The factor structure of the scale was also tested using a confirmatory factor analysis. To test reliability, internal consistency and test–retest analyses were performed.
Results
The results of the confirmatory factor analysis indicated a good structural model. Criterion-related validity was strongly supported by the pattern of association between the APGAR Scale and the social support survey. Cronbach’s α of the scale was 0.88 and test–retest reliability ranged from 0.96 to 0.98, indicating a good range of reliability.
Conclusion
The findings of this study suggest that the Iranian version of the Family APGAR is a valid and reliable scale to evaluate family functions in health intervention programs.

Citations

Citations to this article as recorded by  
  • Advance care planning readiness among older adults in aged service centers: A cross-sectional study
    Kalok Wong, Haobin Yuan, Stephen Tee, Sinkei Cheong
    International Journal of Nursing Sciences.2025; 12(1): 59.     CrossRef
  • Psychosocial distress in people with overweight and obesity: the role of weight stigma and social support
    Vladimira Timkova, Pavol Mikula, Iveta Nagyova
    Frontiers in Psychology.2025;[Epub]     CrossRef
  • ‘Let the System Do Its Job and Families Handle the Rest’? Protective and Risk Factors Contributing to Pandemic Crisis Parental Burnout
    Roman Ryszard Szałachowski, Wioletta Tuszyńska-Bogucka, Jacek Bogucki
    Journal of Clinical Medicine.2025; 14(2): 617.     CrossRef
  • Homogeneity, dimensionality, convergent and nomological validity of the family APGAR among primary care users in Bucaramanga, Colombia
    Julián Andrés Jaimes-Grimaldos, Carlos Arturo Cassiani-Miranda, Andrés Felipe Tirado-Otálvaro, German Díaz Buitrago, Adalberto Campo-Arias, Sandra Milena Velásquez-Vergara, Andrea Carolina Duran-Bedoya
    Journal of Family Social Work.2025; 28(2): 72.     CrossRef
  • Risk factors and a nomogram for predicting cognitive frailty in Chinese patients with lung cancer receiving drug therapy: A single‐center cross‐sectional study
    Jinping Li, Yan Wang, Minfeng Zhai, Mengyuan Qin, Dandi Zhao, Qian Xiang, Zaoyuan Shao, Panrong Wang, Yan Lin, Yiting Dong, Yan Liu
    Thoracic Cancer.2024; 15(11): 884.     CrossRef
  • Psychometric adequacy of the persian adapted version of the tilburg frailty indicator (P-TFI)
    Maryam Safarnavadeh, Leili Salehi
    BMC Geriatrics.2024;[Epub]     CrossRef
  • Risk Factors Associated with Suicidal Ideation in Students of the Faculty of Medicine and Surgery, URSE
    Iván Antonio García-Montalvo, Diana Matías-Pérez, Silvia Lois López-Castellanos, Enrique López-Ramírez, Moisés Martínez-López
    Psychiatry International.2024; 5(3): 544.     CrossRef
  • Relación de la capacidad funcional y la funcionalidad familiar con la fragilidad en adultos mayores con riesgo cardiovascular en el suroccidente colombiano
    Clara Inés Paz , Betsy Mercedes Ledezma , Diana María Rivera, Mabel Lorena Salazar , María Verónica Torres , Franklin René Patiño, Andry Yasmid Mera-Mamián
    Biomédica.2024; 44(4): 537.     CrossRef
  • Analysis of the Functioning of Families of Children with Autism Spectrum Disorder: A Psychometric Study of the Family APGAR Scale
    Laura Serrano, Esther Vela, Laura Martín
    International Journal of Environmental Research and Public Health.2023; 20(23): 7106.     CrossRef
  • The family dynamics of children on the streets of Ibadan, Southwest Nigeria
    Abimbola M. Obimakinde, Moosa Shabir
    South African Family Practice.2023;[Epub]     CrossRef
  • Nomogram reliability for predicting potential risk in postgraduate medical students with anxiety symptoms
    Zewen Huang, Lejun Zhang, Junyu Wang, Tingting Wang, Lu Xu, Xialing Yang, Heli Lu
    Heliyon.2022; 8(10): e10803.     CrossRef
  • Riesgo familiar total y funcionalidad familiar en hogares de una agrupación familiar de San Juan de Lurigancho, 2021.
    Rocio Miriam Bravo Rojas, Cecilia Olga Martinez Ramos
    Revista Cuidado y Salud Pública.2022; 2(1): 22.     CrossRef
  • 4,622 View
  • 109 Download
  • 10 Web of Science
  • 12 Crossref
Development of the Perceived Stress Inventory: A New Questionnaire for Korean Population Surveys
Eon Sook Lee, Ho Cheol Shin, Jun Hyung Lee, Yun Jun Yang, Jung Jin Cho, Gwiyeoroo Ahn, Yeong Sook Yoon, Eunju Sung
Korean J Fam Med 2015;36(6):286-293.   Published online November 20, 2015
DOI: https://doi.org/10.4082/kjfm.2015.36.6.286
Background

Given emerging evidence of the association between stress and disease, practitioners need a tool for measuring stress. Several instruments exist to measure perceived stress; however, none of them are applicable for population surveys because stress conceptualization can differ by population. The aim of this study was to develop and validate the Perceived Stress Inventory (PSI) and its short version for use in population surveys and clinical practice in Korea.

Methods

From a pool of perceived stress items collected from three widely used instruments, 20 items were selected for the new measurement tool. Nine of these items were selected for the short version. We evaluated the validity of the items using exploratory factor analysis of the preliminary data. To evaluate the convergent validity of the PSI, 387 healthy people were recruited and stratified on the basis of age and sex. Confirmatory analyses and examination of structural stability were also carried out. To evaluate discriminatory validity, the PSI score of a group with depressive symptoms was compared with that of a healthy group. A similar comparison was also done for persons with anxious mood.

Results

Exploratory factor analysis supported a three-factor construct (tension, depression, and anger) for the PSI. Reliability values were satisfactory, ranging from 0.67 to 0.87. Convergent validity was confirmed through correlation with the Perceived Stress Scale, Center for Epidemiologic Studies Depression Scale, and State-Trait Anxiety Inventory. People with depressive or anxious mood had higher scores than the healthy group on the total PSI, all three dimensions, and the short version.

Conclusion

The long and short versions of the PSI are valid and reliable tools for measuring perceived stress. These instruments offer benefits for stress research using population-based surveys.

Citations

Citations to this article as recorded by  
  • Childhood adversity and late-life depression: moderated mediation model of stress and social support
    Jin-kyung Lee, Jinhee Lee, Moo-Kwon Chung, Ji Young Park, Taeksoo Shin, Kyoung-Joung Lee, Hyo-Sang Lim, Sangwon Hwang, Erdenebayar Urtnasan, Yongmie Jo, Min-Hyuk Kim
    Frontiers in Psychiatry.2023;[Epub]     CrossRef
  • Non-Cognitive Adaptive Resourcefulness: Scrutiny of Its Multidimensionality and Nomological Validity
    Andrew Denovan, Neil Dagnall, Kenneth Drinkwater
    Psychological Reports.2023;[Epub]     CrossRef
  • Psychological Stress Management in Primary Care
    Eon Sook Lee
    Korean Journal of Family Practice.2021; 11(2): 90.     CrossRef
  • Perceived stress and non-alcoholic fatty liver disease in apparently healthy men and women
    Danbee Kang, Di Zhao, Seungho Ryu, Eliseo Guallar, Juhee Cho, Mariana Lazo, Hocheol Shin, Yoosoo Chang, Eunju Sung
    Scientific Reports.2020;[Epub]     CrossRef
  • Influence of the Perception of Aging Symptoms as a Mediator and Moderator on the Relationship between Family Function and Stress in Middle-Aged Adults
    Hyun-E Yeom, Kyoung Ok Ju
    Korean Journal of Adult Nursing.2020; 32(2): 175.     CrossRef
  • Subclinical Hypothyroidism and Incident Depression in Young and Middle-Age Adults
    Ji Sun Kim, Yiyi Zhang, Yoosoo Chang, Seungho Ryu, Eliseo Guallar, Young-Chul Shin, Hocheol Shin, Se-Won Lim, Juhee Cho
    The Journal of Clinical Endocrinology & Metabolism.2018; 103(5): 1827.     CrossRef
  • 8,766 View
  • 106 Download
  • 6 Web of Science
  • 6 Crossref
Validity and Reliability of the Korean Version of Neighborhood Physical Activity Questionnaire
Woo Kyung Bae, Belong Cho, Ki Young Son
Korean J Fam Med 2015;36(3):135-140.   Published online May 22, 2015
DOI: https://doi.org/10.4082/kjfm.2015.36.3.135
Background

Given that a substantial number of daily activities take place in neighborhoods, a convenient and effective method for measuring the physical activity of individuals is needed. Therefore, we tested the validity and reliability of the Korean version of the Neighborhood Physical Activity Questionnaire (K-NPAQ), which was developed through translation and back-translation of the NPAQ.

Methods

The K-NPAQ was administered twice, with a 1-week interval, to participants in the study who were recruited at a health promotion center. We assessed energy expenditure and compliance using an accelerometer and an activity diary. The Kappa statistic and Spearman correlation coefficient were used to evaluate the test-retest reliability of the K-NPAQ, and the Spearman rank correlation was used to assess the validity.

Results

Of the 122 participants, 43 were excluded owing to a lack of compliance. The Kappa values for all items that were used to assess walking or cycling within or outside the neighborhood were >0.424; 0.251-0.902 for 5 items related to the purpose of the physical activity; 0.232-0.912 for most items related to the number of times and the duration for each types of physical activity. The total energy expenditure and the energy expenditure in the neighborhood were significantly correlated with the K-NPAQ and the accelerometer, with correlation coefficients of 0.192-0.264.

Conclusion

The K-NPAQ is a valid and reliable tool for measuring physical activity in the neighborhood, and it can be used for individual education and counseling in order to augment physical activity in specific neighborhood environments.

Citations

Citations to this article as recorded by  
  • Validity and responsiveness to change of the Active Australia Survey according to gender, age, BMI, education, and physical activity level and awareness
    Corneel Vandelanotte, Mitch J. Duncan, Rob Stanton, Richard R. Rosenkranz, Cristina M. Caperchione, Amanda L. Rebar, Trevor N. Savage, W. Kerry Mummery, Gregory S. Kolt
    BMC Public Health.2019;[Epub]     CrossRef
  • Self-reported physical activity within and outside the neighborhood: Criterion-related validity of the Neighborhood Physical Activity Questionnaire in German older adults
    Malte Bödeker, Jens Bucksch, Birgit Wallmann-Sperlich
    Measurement in Physical Education and Exercise Science.2018; 22(1): 61.     CrossRef
  • Using Accelerometer/GPS Data to Validate a Neighborhood-Adapted Version of the International Physical Activity Questionnaire (IPAQ)
    Levi Frehlich, Christine Friedenreich, Alberto Nettel-Aguirre, Jasper Schipperijn, Gavin R. McCormack
    Journal for the Measurement of Physical Behaviour.2018; 1(4): 181.     CrossRef
  • Methodological considerations and impact of school‐based interventions on objectively measured physical activity in adolescents: a systematic review and meta‐analysis
    R. Borde, J. J. Smith, R. Sutherland, N. Nathan, D. R. Lubans
    Obesity Reviews.2017; 18(4): 476.     CrossRef
  • 4,588 View
  • 25 Download
  • 4 Web of Science
  • 4 Crossref
Reliability and Validity of Korean Version of Questionnaire for Weight Bias Measurement.
Eun Mi Kim, Kayoung Lee, Kyu Man Hwang, Jun Su Kim, Tae Jin Park
Korean J Fam Med 2010;31(6):461-471.   Published online June 20, 2010
DOI: https://doi.org/10.4082/kjfm.2010.31.6.461
Background
Korean versions of Fat Phobia Scale (short form) (F-scale), Beliefs About Obese Persons Scale (BAOP), and Attitudes Toward Obese Persons Scale (ATOP) which are scales of rating weight bias were assessed to find out the reliability and validity.Methods: Korean versions of F-scale, BAOP, and ATOP were completed twice by 165 adults (85 males, 80 females; 73 hospital staffs, and 92 teachers). Validity was tested using Spearman correlation and factor analysis. Reliability was analyzed using test-retest analyses (Spearman Rho value).Results: Using factor analyses, F-scale comprised of three factors explaining 55.20% of the total variance, BAOP two factors explaining 53.3% of the total variance, and ATOP six factors explaining 61.61% of the total variance. Spearman correlation between F-scale and ATOP was -0.28 to -0.36 (P < 0.05), suggesting that people who worried about being obese tended to have negative attitudes against obesity. The correlation between F-scale and BAOP was -0.25 to -0.27 (P < 0.05), meaning that people who worried about being obese had a tendency to blame obesity on environmental factors. Cronbach's alpha coefficients were 0.79 to 0.90 for F-scale, 0.34 to 0.38 for BAOP and 0.82 to 0.87 for ATOP. Spearman Rho values were 0.47 for F-scale, 0.50 for BAOP, and 0.47 for ATOP (P < 0.05). The scores of each scale were not related to subjects' sex, BMI, body perception, and weight control efforts, while for ATOP scores older subjects were more likely to have a negative view for obesity (P < 0.05).Conclusion: The Korean version of F-scale, ATOP and BAOP could be considered as a tool to evaluate weight-bias however, further study is needed for appropriate application.

Citations

Citations to this article as recorded by  
  • From flab to fab: A cross-sectional study for cultural adaptation and validation of the Fat Phobia Scale-Short Form in India
    Kumari Rina, Rosali Bhoi, Anubhav Vindal, Pawanindra Lal
    Journal of Minimal Access Surgery.2025;[Epub]     CrossRef
  • Validity and Reliability of the Korean Version of the Weight Self-Stigma Questionnaire (WSSQ-K)
    Seyoen Park, Kawoun Seo
    Nursing Reports.2023; 13(2): 835.     CrossRef
  • The Effects of Obesity Stress, Weight Bias, and Heath Care on BMI in Soldiers of Non-combat Area
    Kyeng Jin Kim, Yeon Kyung Na
    Korean Journal of Occupational Health Nursing.2016; 25(3): 199.     CrossRef
  • Teachers' Influence on Weight Perceptions in Preschool Children
    Jin Suk Ra, Hyun Jung Yun, Yoon Hee Cho
    Applied Nursing Research.2016; 31: 111.     CrossRef
  • 2,290 View
  • 53 Download
  • 4 Crossref
Performance of the AUDIT Alcohol Consumption Questions (AUDIT-C) and AUDIT-K Question 3 Alone in Screening for Problem Drinking.
Jeong Hwan Seong, Chang Hun Lee, Hyun Jin Do, Seung Won Oh, Youl Lee Lym, Jae Kyung Choi, Hee Kyung Joh, Kyuk Jung Kweon, Dong Yung Cho
Korean J Fam Med 2009;30(9):695-702.   Published online September 20, 2009
DOI: https://doi.org/10.4082/kjfm.2009.30.9.695
Background
In the busy primary care setting, there are several limitations in applying Alcohol Use Disorders Identifi cation Test in Korea (AUDIT-K) to screen problem drinking. Thus, for primary healthcare practice, we evaluated AUDIT-C, which covers questions from 1 to 3 in AUDIT-K, and AUDIT-K Question 3 Alone to present cut points for these two screening questionnaire according to AUDIT-K test scores. Methods: In a university hospital, we surveyed 302 males with a drinking history via self-administered questionnaire including AUDIT-K, from November 2007 to April 2008. On the basis of total score in AUDIT-K, we divided them into four groups: normal, problem drinking, alcohol use disorder, and alcohol dependence. For each alcohol drinking behavior pattern, we drew the receiver operating characteristics (ROC) curves to present cut points for appropriate sensitivity and specifi city. In addition, we compared the performance of AUDIT-C and AUDIT-K Question 3 Alone through area under the curve (AUC). Results: For AUDIT-C, we designated the score 8 or more as problem drinking, 9 or more as alcohol use disorder, and 11 or more as dependence. The results of sensitivity/specifi city for each group were 82%/76%, 76%/79%, 80%/86%, respectively, which were suitable for screening. For AUDIT-K Question 3 Alone, we defined the score 3 or more as problem drinking or alcohol use disorder and the score 4 as dependence. The results of sensitivity/specifi city for each group were 79%/80%, 84%/67%, 85%/77%, which were appropriate for screening. For every drinking behavior group, AUDIT-C was superior to AUDIT-K Question 3 Alone in screening performance (problem drinking: 0.88 vs. respectively 0.85, alcohol use disorder: 0.86 vs. 0.82, alcohol dependence: 0.88 vs. 0.81) Conclusion: We confi rmed that both AUDIT-C and AUDIT-K Question 3 Alone, which are more convenient and have fewer time con-straints than AUDIT-K, are reasonable screening methods for problem drinking. Thus, we recommend further drinking assessment and proper intervention for male drinkers who have scores 8 or more in AUDIT-C or 3 or more in AUDIT-K Question 3 Alone.

Citations

Citations to this article as recorded by  
  • Multimorbidity and its Associated Factors in Korean Shift Workers: Population-Based Cross-Sectional Study
    Hye Chong Hong, Young Man Kim
    JMIR Public Health and Surveillance.2024; 10: e55014.     CrossRef
  • A Study on the Factors Influencing the Psychological Problems of Suicide Survivors
    Jin-Hwa Choi, Keunhye Sung, Tae-Yeon Hwang
    Journal of Korean Neuropsychiatric Association.2024; 63(2): 140.     CrossRef
  • Associations between changes in deprivation and alcohol use disorder: a nationwide longitudinal study
    Dan Bi Kim, Jae Hyeok Lim, Ji Su Ko, Min Jeong Joo, Eun-Cheol Park, Suk-yong Jang
    Alcohol and Alcoholism.2024;[Epub]     CrossRef
  • Clinical validation of screening test for at-risk drinking for young and middle-aged adults in an emergency department
    Hosub Chung, Jae Hee Lee
    Hong Kong Journal of Emergency Medicine.2023; 30(4): 203.     CrossRef
  • Age at onset of alcohol consumption and its association with alcohol misuse in adulthood
    Soo Y. Kim, Sung H. Jeong, Eun‐Cheol Park
    Neuropsychopharmacology Reports.2023; 43(1): 40.     CrossRef
  • Factors Influencing Sleep Disturbance of Novice Nurses: Focusing on Sleep Hygiene and Physical Activity - Longitudinal Study of Secondary Data
    Minjeong Yu, Smi Choi-Kwon, Jison Ki, Kyeongsug Kim
    Journal of Korean Academy of Nursing Administration.2023; 29(3): 278.     CrossRef
  • Association between chronic fatigue syndrome and suicidality among survivors of Middle East respiratory syndrome over a 2-year follow-up period
    So-Hyun Ahn, Jeong Lan Kim, Jang Rae Kim, So Hee Lee, Hyeon Woo Yim, Hyunsuk Jeong, Jeong-Ho Chae, Hye Yoon Park, Jung Jae Lee, Haewoo Lee
    Journal of Psychiatric Research.2021; 137: 1.     CrossRef
  • Controlled Drinking Behaviors Among Korean American and Korean Male Workers
    Younkyoung Kim, John Lowe, OiSaeng Hong
    Nursing Research.2021; 70(2): 114.     CrossRef
  • The Mediating Role of Spirituality on Depression, Alcohol Use Disorder, and Problem Gambling Among Korean College Students
    Young-Me Lee, Mi Yeul Hyun, Suyoung Choi, Elizabeth Aquino
    Journal of Addictions Nursing.2021; 32(2): 79.     CrossRef
  • A Deep Learning Algorithm to Predict Hazardous Drinkers and the Severity of Alcohol-Related Problems Using K-NHANES
    Suk-Young Kim, Taesung Park, Kwonyoung Kim, Jihoon Oh, Yoonjae Park, Dai-Jin Kim
    Frontiers in Psychiatry.2021;[Epub]     CrossRef
  • Drinking Trajectories and Factors in Koreans
    Yun-Young Kim, Hyung-Joo Park, Mee-Sook Kim
    International Journal of Environmental Research and Public Health.2021; 18(16): 8890.     CrossRef
  • The effects of duration after entering poverty on the alcohol consumption mediated by depression in middle-aged adults: The longitudinal study based on Korea Welfare Panel Study data
    Hye Chung Cho, Eun Sook Lee
    Korean Journal of Health Education and Promotion.2020; 37(3): 15.     CrossRef
  • The relationship between alcohol abuse and suicide risk according to smoking status: A cross-sectional study
    Myoungjee Jung
    Journal of Affective Disorders.2019; 244: 164.     CrossRef
  • Factors influencing blood pressure classification for adults: Gender differences
    Jin Yi Choi, Eun Kyoung Yun, Eun Ja Yeun, Eun Sook Jeong
    International Journal of Nursing Practice.2019;[Epub]     CrossRef
  • Prolonged Risk of Suicide Reattempts in Patients with Alcohol Use Disorder and Acute Alcohol Use: A Register-Based Follow-Up Study (2010–2015)
    Jinhee Lee, Sei Jin Chang, Hyun Kim, Min-Hyuk Kim, Joung-Sook Ahn, Ki-Chang Park, Jin Sil Moon, Seongho Min
    Psychiatry Investigation.2019; 16(2): 145.     CrossRef
  • Post-Traumatic Stress, Quality of Life and Alcohol Use Problems among Out-of-School Youth
    Yeon Jung Lee, Moon-Soo Lee, Sung-Doo Won, So Hee Lee
    Psychiatry Investigation.2019; 16(3): 193.     CrossRef
  • Emotional labor and job types of male firefighters in Daegu Metropolitan City
    Sung Kyu Park, Han Cheol Heo, Joon Sakong, Man Joong Jeon
    Annals of Occupational and Environmental Medicine.2019;[Epub]     CrossRef
  • Identifying alcohol problems among suicide attempters visiting the emergency department
    Jinhee Lee, Seongho Min, Joung-Sook Ahn, Hyun Kim, Yong-Sung Cha, Eugene Oh, Jin Sil Moon, Min-Hyuk Kim
    BMC Psychiatry.2019;[Epub]     CrossRef
  • Cut-off points for screening at-risk drinking by AUDIT-C Korean version at emergency department
    Kyung Wan Lee, Yoon Hee Choi, Jae Hee Lee
    Turkish Journal of Emergency Medicine.2018; 18(2): 57.     CrossRef
  • Screening Test for At-Risk Drinking: Development of New Abbreviated Version of Alcohol Use Disorder Identification Test for Young and Middle-Aged Adults
    Jae Hee Lee, Koo Young Jung, Yoon Hee Choi
    Emergency Medicine International.2018; 2018: 1.     CrossRef
  • Validation and proposal for cut-off values of an abbreviated version of the Alcohol Use Disorder Identification Test using the Korean National Health and Nutrition Examination Survey
    Jae Hee Lee, Kyoung Ae Kong, Duk Hee Lee, Yoon Hee Choi, Koo Young Jung
    Clinical and Experimental Emergency Medicine.2018; 5(2): 113.     CrossRef
  • Unresolved Bereavement and Other Mental Health Problems in Parents of the Sewol Ferry Accident after 18 Months
    Hyu Jung Huh, Seung Huh, So Hee Lee, Jeong-Ho Chae
    Psychiatry Investigation.2017; 14(3): 231.     CrossRef
  • Factors Affecting Problem Drinking in Male Nursing Students
    Eun Joo JI, Eun Kyung Lee
    Journal of Korean Academy of Fundamentals of Nursing.2016; 23(4): 440.     CrossRef
  • Relationship between Secondhand Smoking with Depressive Symptom and Suicidal Ideation in Korean Non-Smoker Adults: The Korean National Health and Nutrition Examination Survey 2010–2012
    Wook Gim, Jun-Hyun Yoo, Jin-Young Shin, Ae-Jin Goo
    Korean Journal of Family Medicine.2016; 37(2): 97.     CrossRef
  • Characteristics and Factors Associated with Problem Drinking in Male Workers
    Eun Kyung Lee, Ok Soo Kim, Ji Yeon Hong
    Asian Nursing Research.2015; 9(2): 132.     CrossRef
  • Structural Equation Modeling on Health Status in Hospital Nurses: Based on the Theory of Salutogenesis With Bio Behavioral Approach
    Kyeong Sug Kim, Smi Choi-Kwon, Kihye Han
    Journal of Korean Biological Nursing Science.2015; 17(1): 50.     CrossRef
  • Utility of the Alcohol Consumption Questions in the Alcohol Use Disorders Identification Test for Screening At-Risk Drinking and Alcohol Use Disorders among Korean College Students
    Ui Suk Kwon, Jong Sung Kim, Sung Soo Kim, Jin Gyu Jung, Seok-Joon Yoon, Seong Gu Kim
    Korean Journal of Family Medicine.2013; 34(4): 272.     CrossRef
  • A Validation Study of the Brief Alcohol Use Disorder Identification Test (AUDIT): A Brief Screening Tool Derived from the AUDIT
    Kyungseop So, Eunju Sung
    Korean Journal of Family Medicine.2013; 34(1): 11.     CrossRef
  • The Determinants and Comparison of Health Behavior and Health Service by Private Medical Insurance on National Health-Nutrition Survey
    Yong-Chul Lee, Bock-Hee Im, Young-Hee Park
    The Journal of the Korea Contents Association.2010; 10(12): 190.     CrossRef
  • Smart Phone based Personalized Menu Management System for Diabetes Patient
    Young-Ho Lee, Jong-Hun Kim, Jae-Kwon Kim, Kyong-Pil Min, Eun-Young Jung, Dong-Kyun Park
    The Journal of the Korea Contents Association.2010; 10(12): 1.     CrossRef
  • 4,142 View
  • 140 Download
  • 30 Crossref
The Validity and Reliability of Korean Version of Lubben Social Network Scale.
Kyung Woo Lee, Soo Young Kim, Woobin Chung, Gyo Soon Hwang, Ye Won Hwang, In Hong Hwang
Korean J Fam Med 2009;30(5):352-358.   Published online May 10, 2009
DOI: https://doi.org/10.4082/kjfm.2009.30.5.352
Background
Over the past decade, considerable evidence has been accumulated showing that social networks infl uence health. However few valid and reliable instruments exist for assessing social networks among elderly population. Therefore, we translated the Lubben social network scales (LSNS) and tested the validity and reliability of Korean version.Methods: Ten items, self-administered questionnaires were translated by multidisciplinary committee members. Also they were reverse translated by bilingual and modifi ed from pretest procedure. Reliability was tested by 4 weeks test-retest reliability and internal consistency (Cronbach's alpha). Validity was tested by factor analysis and construct validity comparison with the Korean version of Duke-UNC and Korean Health Related Quality of Life Scale (KQOLS) were tested for validity testing. Results: Cronbach's alpha was 0.75. Four weeks test-retest Pearson coeffi cient was 0.78 (P < 0.0001). Correlation coeffi cient with the Korean version of Duke-UNC was 0.58 (P < 0.0001). Correlation coeffi cient with social function domain of KQOLS was 0.40 (P < 0.0001). Principal components analysis identified 3 factors. Three contents areas are family and friends networks, interdependent social support and living arrangements. Conclusion: Korean version of LSNS is both valid and reliable instrument, but fi ne refi nements will be needed to adapt for use in practical settings.

Citations

Citations to this article as recorded by  
  • Review of the Health of the Elderly on the Impact of Social Isolation and Loneliness: Focusing on the Coronavirus Disease (COVID-19) Pandemic
    Kayoung Kim
    Korean Journal of Geriatrics & Gerontology.2024; 25(1): 13.     CrossRef
  • Frailty: Assessment and Intervention
    Hana Moon, Geon Ho Lee, DaeHyun Kim
    Keimyung Medical Journal.2024; 43(2): 100.     CrossRef
  • A Study on Social Support of the Elderly with Normal Hearing and Elderly Wearing Hearing Aids
    Do-Yun Kim, Junghwa Bahng
    Audiology and Speech Research.2022; 18(2): 102.     CrossRef
  • Validation of Expanded form of Lubben Social Network Scale among Community-Dwelling Geriatric Population in India
    K. Bincy, Muthunarayan Logaraj, V. V. Anatharaman
    Indian Journal of Community Medicine.2022; 47(2): 244.     CrossRef
  • Independent predictors of depressive symptoms and social isolation on 2-year all-cause mortality among the Korean elderly in a population-based cohort study: gender differences
    Hyunsuk Jeong, Hyeon Woo Yim, Beom-Woo Nam
    Epidemiology and Health.2022; 44: e2022012.     CrossRef
  • Association between Psychological Suffering and Suicidal Thinking in Patients with Urologic Cancer Using Real-World Data
    Kounseok Lee, Gyoohwan Jung, Na Yeon Choi, Sunhae Kim, Jung Ki Jo
    Journal of Clinical Medicine.2022; 11(24): 7336.     CrossRef
  • Factors Associated with the Quality of Life of Patients with Cancer Undergoing Radiotherapy
    Ki Ho Seol, Su Hyun Bong, Dae Hun Kang, Jun Won Kim
    Psychiatry Investigation.2021; 18(1): 80.     CrossRef
  • Impact of Social Network Size and Contact Frequency on Resilience in Community-Dwelling Healthy Older Adults Living Alone in the Republic of Korea
    Sangmi Park, Tae-Hui Kim, Tae-Rim Eom
    International Journal of Environmental Research and Public Health.2021; 18(11): 6061.     CrossRef
  • Social Isolation, Loneliness and Their Relationships with Mental Health Status in South Korea
    Myung Hyun Kim, Ji Hyun An, Hye Rin Lee, Seo Hyun Jeong, Soo Jin Hwang, Jin Pyo Hong
    Psychiatry Investigation.2021; 18(7): 652.     CrossRef
  • The health status, aging anxiety, social networking, generativity, and happiness of late middle-aged adults
    Hae Kyung Chang
    The Journal of Korean Academic Society of Nursing Education.2021; 27(4): 392.     CrossRef
  • Clinical Practice Guidelines for Managing Frailty in Community-Dwelling Korean Elderly Adults in Primary Care Settings
    Hyo-Sun You, Yu-Jin Kwon, Sunyoung Kim, Yang-Hyun Kim, Ye-seul Kim, Yonghwan Kim, Yong-kyun Roh, Byoungjin Park, Young Kyu Park, Chang-Hae Park, Joung Sik Son, Jinyoung Shin, Hyun-Young Shin, Bumjo Oh, Jae-woo Lee, Jae Yong Shim, Chang Won Won, Ji Won Yoo
    Korean Journal of Family Medicine.2021; 42(6): 413.     CrossRef
  • Effectiveness of a village-based intervention for depression in community-dwelling older adults: a randomised feasibility study
    In Mok Oh, Maeng Je Cho, Bong-Jin Hahm, Byung-Soo Kim, Jee Hoon Sohn, Hye Won Suk, Bu Young Jung, Hye Jung Kim, Hyeon A. Kim, Ki Bok Choi, Da Hye You, Ah. Reum Lim, In Ok Park, Jeung Hyuck Ahn, Hee Lee, Yeon Hee Kim, Mi Ra Kim, Jee Eun Park
    BMC Geriatrics.2020;[Epub]     CrossRef
  • Effects of a Self-Care Reinforcement Program for Socially Vulnerable Elderly Women with Metabolic Syndrome in Korea
    Mikyung Park, Kiwol Sung
    Journal of Korean Academy of Community Health Nursing.2019; 30(3): 271.     CrossRef
  • EEG correlates associated with the severity of gambling disorder and serum BDNF levels in patients with gambling disorder
    Kyoung Min Kim, Sam-Wook Choi, Jaewon Lee, Jun Won Kim
    Journal of Behavioral Addictions.2018; 7(2): 331.     CrossRef
  • Psychopathological, temperamental, and characteristic factors in adults with remaining childhood attention-deficit hyperactivity symptoms
    Kyoung Min Kim, Sojeong Nam, Soo Yeon Kim, Soo Min Lee, Jae-Won Choi, Taewoong Kang, Jun Won Kim
    International Journal of Psychiatry in Clinical Practice.2017; 21(3): 236.     CrossRef
  • The Association between Hopelessness, Social Support and Community Integration and Depression among Elderly Living Alone
    Hyun ok Kim, Yeun Soon Choi, Jin Hyang Lee, Ae-Rim Seo, Ki Soo Park
    Journal of agricultural medicine and community health.2016; 41(4): 195.     CrossRef
  • The Effect of the BeHaS Exercise Program on Closeness, Self-esteem and the Intention of Exercise Maintenance in Elderly
    Jong Im Kim, Hyo Jin Won, Sun Ae Kim, Ji Hyun Lee
    Journal of muscle and joint health.2016; 23(3): 206.     CrossRef
  • Risk factors associated with depression and suicidal ideation in a rural population
    Yosub Joo, Sangchul Roh
    Environmental Health and Toxicology.2016; 31: e2016018.     CrossRef
  • Social Network Analysis Reveals the Negative Effects of Attention-Deficit/Hyperactivity Disorder (ADHD) Symptoms on Friend-Based Student Networks
    Jun Won Kim, Bung-Nyun Kim, Johanna Inhyang Kim, Young Sik Lee, Kyung Joon Min, Hyun-Jin Kim, Jaewon Lee, Mark Bellgrove
    PLOS ONE.2015; 10(11): e0142782.     CrossRef
  • Physical disability, perceived dependence and depression in women with osteoarthritis
    Ki-Soo Park, Hyeon-Su Yang, Bokyoung Kim, Hye-Ji Jeon
    Journal of agricultural medicine and community health.2015; 40(4): 221.     CrossRef
  • Questionnaires for Assessing Stress and Mental Health
    In Hwan Hwang, Dong Hoon Oh
    Hanyang Medical Reviews.2014; 34(2): 91.     CrossRef
  • Social Support According to Temperament and Character in College Students
    Sung-Hwan Song, Hye-Kyung Lee, Jun Won Kim, Kounseok Lee
    Journal of Korean Neuropsychiatric Association.2013; 52(3): 157.     CrossRef
  • The effects of care management on depression treatment in a psychiatric clinic: a randomized controlled trial
    Hyunsuk Jeong, Hyeon Woo Yim, Sun‐jin Jo, Beomwoo Nam, Soon‐Mo Kwon, Jin‐Yong Choi, Sang‐Kuk Yang
    International Journal of Geriatric Psychiatry.2013; 28(10): 1023.     CrossRef
  • Influence of Malnutrition and Social Network on Health-related Quality of Life in Elders
    Hee Kyung Kim, Hae Kyung Chang, Mi-Ra Lee, Youn-Jung Son, Su Jeong Han, Nam Young Yang, Myoung-Ran Yoo, Seon Young Choi, Youn Mi Kim
    Journal of Korean Academy of Fundamentals of Nursing.2013; 20(2): 98.     CrossRef
  • Reliability and Validity of the Korean Version of Interpersonal Support Evaluation List-12 (ISEL-12)
    Do Hyun Kim, Hye-Kyung Lee, Jun Won Kim, Kounseok Lee
    Journal of Korean Neuropsychiatric Association.2012; 51(6): 416.     CrossRef
  • Factors associated with depressive symptoms in low‐income, older Korean women with hypertension
    Kiwol Sung
    Nursing & Health Sciences.2011; 13(3): 309.     CrossRef
  • Standardization for a Korean Version of Chronic Ear Survey: Translation and Verification of Validity and Reliability
    Jae Yong Byun, Yang-Sun Cho, Hosuk Chu, Shi-Nae Park, Gyu Cheol Han, Byung Chul Cheon, Jung Eun Shin, Jong Woo Chung, Sung Won Chai, Jae Young Choi
    Korean Journal of Otorhinolaryngology-Head and Neck Surgery.2011; 54(11): 755.     CrossRef
  • 4,262 View
  • 165 Download
  • 27 Crossref
Validity of 38 mg Low Dose 13C-Urea Breath Test for the Diagnosis of Helicobacter pylori Infection.
Yong Jin Lee, Eun Chul Jang, Yong Jin Cho, Jung Eun Oh, Yong Bae Kim, Hae Seon Nam
J Korean Acad Fam Med 2008;29(10):788-794.   Published online October 10, 2008
Background: To assess the diagnostic value of 13C-UBT using capsulated 38 mg low dose for H. pylori infection, we investigated the sensitivity and specificity of 13C-UBT and to suggest the optimal positive cut-off value of DOB20 in 13C-UBT using ROC analysis. Methods: The study subjects were 76 healthy individuals (males; 52, females; 24) who visited a health promotion center at a university hospital between July 2005 and June 2007. We tested for H. pylori infection by 38 mg low dose 13C-UBT and histology. We measured the expiratory 13C- urea concentration of basal and 20 minutes value after oral ingestion of 38 mg 13C- labelled urea with capsulated. The breath samples were analysed by gas chromatograph isotope ratio mass spectrometer and expressed as units of delta. Results: Fifty subjects (65.8%) were H. pylori positive as judged from histology. ROC analysis showed an area under the curve (AUC) of 0.943 (95% confidence interval: 0.891∼0.995), indicating an excellent classification performance of the model. The sensitivity of 96%, specificity of 85% were achieved at the optimal cut-off value of DOB20 which was 1.39. The 38 mg low dose 13C-UBT was a non-invasive, simple, short-time required and highly accurate method. Conclusion: The results suggested that capsulated 38 mg low dose 13C-UBT is considered more in term of accuracy, costeffectiveness and convenient method for the diagnosis of H. pylori infection. Further long-term research and meta analysis based on large-scale investigations is needed to establish a standardized testing method in creating protocol of 13C-UBT. (J Korean Acad Fam Med 2008;29:788-794)
  • 1,333 View
  • 9 Download
Validity, Reproducibility of Visual Analogue Scales in Assessment of Appetite Sensations.
Hong Bum Kim, Eon Sook Lee, Sang Woo Oh, Yoon Ho Kim, Dong Eun Lee, Choon Keong Hwang, Eun Young Lee, Yeong Sook Yoon, Yun Jun Yang
J Korean Acad Fam Med 2008;29(10):736-745.   Published online October 10, 2008
Background: Appetite control and weight reduction is important for the treatment of chronic disease such as obesity, hypertension, and diabetes mellitus. Visual analogue scales (VAS) is widely used to assess appetite. We investigated the reproducibility and the validity of the Korean version of VAS for appetite which will be helpful for clinical use. Methods: The subjects received the same test meal and 8 VAS questionnaires between 6 weeks. They started to fill out the questionnaire before lunch, continued after lunch every hour, and ended after dinner. The questionnaire was asked about hunger, satiety, fullness, prospective consumption, sweet, salty, savoury, and fatty. During the test meal, the subjects could eat ad libitum until 'comfortable satisfaction'; and after the test meal we calculated energy intake. We assessed the correlation between test-retest VAS for each appetite and evaluated the validity of VAS for hunger with energy intake as "gold-standard". Results: The VAS curves of each appetite were similar between the test and the retest. The VAS of each appetite on the test day was strongly correlated with that on the retest day. The CRs of 4.5 hour mean VAS (20∼34 mm) was smaller than the CRs of fasting VAS (35∼54 mm). The correlation coefficient of Hunger VAS before dinner and the energy intake was 0.436 on the test day and 0.400 on the retest day. The VAS of the sweet was correlated to the total glucose intake (P<0.05), and the VAS of salty to the salt intake. Conclusion: The validity of the VAS score for appetite, especially hunger, sweet and salty taste was good. Indeed, the reliability of VAS for appetite was good to use this scale in a clinical setting. (J Korean Acad Fam Med 2008;29:736-745)
  • 2,062 View
  • 43 Download
The Accuracy of the Accelerometers (Actical and Actigraph) among Korean People.
Hyun min Kim, Yun jun Yang, Young suk Yun, En suk Lee, Dong en Lee, Hyo jin Jeon
J Korean Acad Fam Med 2008;29(9):668-674.   Published online September 10, 2008
Background: Nowadays, decreased physical activity is considered to be a contributor to increase the prevalence of many diseases such as obesity, coronary heart disease and so on. Many researches demonstrated that regular physical activity reduce all cause mortality. To increase the physical activities of the population, accurate estimation of the activities is needed. Actical and actigraph are confirmed as accurate tools to measure physical activities. But the target populations of the validity studies were not Asian people. Therefore, the accuracy of the accelerometers should be confirmed in Asian people. The accuracy of the tools could be different. Therefore head to head comparison study between the tools would be needed. Methods: Thirty volunteers from the community, ages over 20 yrs, were recruited. The participants put on the two accelerometers (Actical, Actigraph) on the waists, secured with elastic belts, and performed a session of rest and three structured activities (two walking speeds, 4 km/hr and 6 km/hr, and one jogging speed, 8 km/hr). During each activity, expired respiratory gases were collected, and oxygen consumption (VO2) was measured by indirect calorimetry (Model Quark Ղ2). The calories measured by gas analyzer and two accelerometers were compared by correlation analysis using SPSS program. Results: Pearson correlation coefficient between gas analyzer and two accelerometers was calculated at three structured activities. The r in Actical was 0.747, 0.785, and 0.677, at speed of 4, 6, 8 km/hr, respectively (P<0.05), and the same measures in Actigraph was 0.617, 0.737, and 0.530 (P<0.05), respectively. Pearson correlation coefficient was also calculated between the two accelerometers, and the r was 0.881, 0.927, and 0.824, at each speed. Conclusion: The Actical and Actigraph are valid tools for measuring physical activities in Korean people. (J Korean Acad Fam Med 2008;29:668-674)
  • 1,257 View
  • 9 Download
Validity and Reliability of Korean Version of International Physical Activity Questionnaire (IPAQ) Short Form.
Ji Yeon Oh, Yun Jun Yang, Byung Sung Kim, Jae Hun Kang
J Korean Acad Fam Med 2007;28(7):532-541.   Published online July 10, 2007
Background
This study was performed to evaluate the reliability and the validity of the Korean version of IPAQ short form. Method: Sixty-nine volunteer adults completed the questionnaires twice at 1 week interval, and the second one was compared to the results of Actical in order to test validity. Results: The Korean version of IPAQ was accepted as a proper one by the IPAQ developers. Spearman Rho coefficients and Kappa values of test-retest reliability were 0.427∼0.646 (median 0.542) and 0.365∼0.620 (median 0.471), respectively. The Kappa values were above 0.4 in 5 out of 7 questionnaires. The more physically active by the short form questionnaire, the higher the measured value of the Actical (P=0.039). Spearman Rho coefficient was 0.267 for the correlation between the results of the questionnaire and measured values by Actical. Conclusion: The reliability and the validity of the IPAQ short form were proven. Follow-up studies are needed. (J Korean Acad Fam Med 2007;28:532-541)
  • 9,699 View
  • 990 Download
Standardization of the Korean Version of Patient Health Questionnaire-9 as a Screening Instrument for Major Depressive Disorder.
Hong Seok Choi, Ji Ho Choi, Ki Ho Park, Kyu Jin Joo, Hyuk Ga, Hee Jung Ko, Sung Ryul Kim
J Korean Acad Fam Med 2007;28(2):114-119.   Published online February 10, 2007
Background
Depression is the most frequently encountered mental disorder in primary care. In it is necessary to order to, have a screening tool has high sensitivity and specificity and consumes less time. Therefore, the aim of this study was to assess the validity of the Korean version of Patient Health Questionnaire-9 (PHQ-9). Methods: A convenience sample of 160 ambulatory patients in a family practice clinic at Inha university hospital and the health care center at Bakae hospital received the Korean version of PHQ-9. Then the subjects were interviewed by a resident of family medicine according to DSM- IV criteria. The sensitivity, the specificity, the likelihood ratio, the ROC curve, the validity and the reliability of the Korean version of PHQ-9, and the consumptive time were examined. Results: There were 22 pationts in the depression group and 138 in the non-depression group. The Cronbach's α was 0.852. The sensitivity and the specificity were 81.8% and 89.9%, respectively, and the positive likelihood ratio was 8.10. The area under curve had an excellent value, 0.944 (P<0.05). The consumptive time was 2.66⁑1.13 minutes. Conclusion: The Korean version of PHQ-9 hay a good reliability and validity, less consumptive time, and easy calculating score. Therefore, the Korean version of PHQ-9 seems to be a useful measure for detecting depression in primary care. (J Korean Acad Fam Med 2007;28:114-119)
  • 5,283 View
  • 563 Download
Validity and Reliability of Self-Report in Cancer Screening.
Ihn Sook Jeong, Yoon Jin Kim, Sangyeoup Lee, Jin Ho Chun
J Korean Acad Fam Med 2006;27(4):302-312.   Published online April 10, 2006
Background
: The study was aimed to examine the validity and the reliability of self-report of gastric cancer screening (endoscopy or upper GI), mammography, and Pap smear.

Methods : The study subjects for validity included those who had undergone 276 endoscopies or UGIs, 127 mammograms, and 125 Pap smears performed at a health promotion center of P and I university hospital during January 1, 1999 to June 30, 1999 and January 1, 2002 to June 30, 2002. The study subjects for reliability included those who had undergone 86 endoscopies or UGIs, 31 mammograms, and 33 Pap smears who went through two surveys. The data was collected by mail or telephone interview. We calculated the sensitivity of self-reports by comparing the self-report and the laboratory results as a gold standard, and the agreement between repeated reporting.

Results : The sensitivities based on the test year were 49.3% for gastric cancer screening, 56.7% for mammography, and 53.6% Pap smear, and the sensitivities on the test month were 39.1%, 45.7%, and 46.4%, respectively. The agreement between the two self-reporting on the test year were 59.6% for gastric cancer screening, 67.7% for mammography, and 63.6% Pap smear, and the agreement on the test month were 82.3% for gastric cancer screening, 74.2% for mammography, and 72.7% for Pap smear.

Conclusion : Self-report alone may not provide accurate or reliable data on the cancer screening compliance. It is recommended to utilize other objective data for cancer screening. And it would be helpful to utilize a memo- book as a reminder to screen for cancer in order to enhance the validity and the reliability of self-report.
  • 1,365 View
  • 10 Download
The Validity and Reliability of Korean Version of Bathel ADL Index.
Soo Young Kim, Chang Won Won, Yong Gyun Rho
J Korean Acad Fam Med 2004;25(7):534-541.   Published online July 10, 2004
Background
: The functional status of elderly has been measured by many different methods including Karz ADL index, Bathel ADL index and physical self- maintenance scale. Among them, Bathel ADL index has been widely used in many countries because of easiness to scoring and administration. Therefore, we translated the Bathel ADL index and tested the translation validity and psychometric properties (validity and reliability) of Korean version of Bathel ADL index.

Methods : The Bathel ADL index was translated by multidisciplinary committee members. The quality of translation was rated by committee members using three criteria (clarity, use of common language, conceptual equivalence). Reliability was tested by internal consistency (Cronbach's alpha), two weeks test-retest reliability, and intraobserver agreement. Clinical validity and construct validity comparison with brain disability grade were tested for validity testing.

Results : Cronbach's alpha was 0.97. Two weeks test-retest correlations coefficient was 0.95 (P=0.00). Interrator agreements were high in all 10 items (κ=0.82∼1.0). Normal control group had lower scores than the patient group (P=0.000). Correlation coefficients between the Korean version of Bathel ADL index score and brain- disability grade was -0.58 (P=0.000).

Conclusion : The Korean version of Bathel ADL index is a valid and reliable instrument for measuring functional status of the elderly.
  • 2,490 View
  • 104 Download
The Development of Female Sexual Function Questionnaire in Family Medicine Outpatients.
Sang Yeon Suh, Tai Woo Yoo, Bong Yul Huh
J Korean Acad Fam Med 2003;24(2):172-182.   Published online February 10, 2003
Background
: Currently, the high quality of life associated with women's rights is strongly supported and has become an important social issue. As a result, there is an increasing need for studies concerning female sexual function. The objectives of this study was to develop a questionnaire to evaluate sexual function evaluation in Korean women.

Methods : A total of 100 married women, who visited an outpatient clinic of family medicine department of a university hospital in Seoul, were studied. After filling out the self-administered questionnaire, a face-to- face interview was done on all study subjects. The items of this questionnaire were adopted from questionnaires with proven validity and reliability. Factor analysis was done and Crohnbach's alpha was calculated.

Results : The items of this questionnaire were classified into 5 parts: Drive, Excitement, Sexual activity, Satisfaction, and Spouse. The total variance was 51.5%. The total Crohnbach's alpha was 0.82. The internal consistency was high. Study subjects were able to complete this questionnaire within 10 minutes.

Conclusion : The validity and reliability of this female sexual function questionnaire was found to be acceptable. This questionnaire can be utilized as a diagnostic adjunctive tool and feedback for treatment through further studies.
  • 1,450 View
  • 17 Download
Validity and Reliability of the Korean Version of the Arthritis Impact Measurement Scales 2 (Korean-AIMS2) in Patients with Osteoarthritis.
Jae Ho Lee, Ho Cheol Shin, Cheol Hwan Kim, Yun Jun Yang, Chang Won Won, Kyung Hwan Cho, Belong Cho, Hwa Jae Jeong, Seong Il Bin, Eun Sook Park
J Korean Acad Fam Med 2003;24(1):19-44.   Published online January 10, 2003
Background
: The second version of the Arthritis Impact Measurement Scales (AIMS2) is an improvement on an evaluation instrument that was developed to measure patient outcome in the rheumatic diseases. The goal of this study was to validate a translated version of the revised and expanded Arthritis Impact Measurement Scales (AIMS2) to be used by Korean patients with osteoarthritis (OA) of the knee.

Methods : The AIMS2 was translated into Korean according to a recommended translation guideline. The Korean version of AIMS2 (K-AIMS2) was administered to a cohort of 239 outpatients with symptomatic OA of the knee who attended 7 participating University Hospitals in Seoul, Ilsan and Taejon. Forty eight patients readministered the K-AIMS2, 7 days after the first visit, to evaluate the instrument's test-retest reliability. After 6 weeks of NS AIDs therapy, 79 subjects were asked to complete a second survey of the questionnaire.

Results : The internal consistency reliability of each scale score, as estimated by Cronbach's alpha coefficient, was high and indicated that the components of the scale measured the same construct. The items were all correlated with each other, but there was no redundancy; this indicated that each domain addressed a somewhat different aspect of functional disability. The test-retest reliability equalled or exceeded 0.86 for 12 scales. Factor analysis provided a three-factor health status model explaining 58.2% of the variance. The upper limb function scales formed the first factor. Psycho-social scale were loaded on the second factor. Arthritis pain together with physical scales for mobility level and walking and bending were loaded on the third factor (the lower limb function). The scale for support from family and friends was not loaded on any factors. These results demonstrate that the physical health status scales of the K-AIMS2 are valid, as shown by the significant, moderate to high correlations between the K-AIMS2 subscales and the majority of the clinical measures.

Conclusion : Our data suggest that, like the original questionnaire, the Korean version of AIMS2 is a reliable, consistent and valid instrument for measuring health status and physical functioning in patients with OA of the knee.
  • 1,556 View
  • 41 Download
The Reliability and Validity of Korean Version of Questionnaire for Nicotine Dependence.
Hee Kyoung Ahn, Hwa Jin Lee, Do Sik Jung, Seon Yeong Lee, Seong Won Kim, Jae Heon Kang
J Korean Acad Fam Med 2002;23(8):999-1008.   Published online August 10, 2002
Background
: Although the Fagerstrom Tolerance Questionnaire (FTQ) and the Fagerstrom Test for Nicotine Dependence (FTND), which are the tools to measure Nicotine Dependence, have a high internal reliability and a high test-retest reliability, they have not been tested domestically. A Korean-Version Questionnaire for Nicotine Dependence was assessed to find out the internal reliability, test-retest reliability and validity.

Methods : The research subjects were adult smokers of ages between 19 and 77 among hospital visitors, hospital staffs, inpatients and outpatients. The smokers had their carbon monoxide measured after responding to the questionnaire. The questionnaire consisted of Nicotine Dependence (FTQ & FTND), the history of smoking, the variables related to Nicotine Dependence, and factors that influence carbon monoxide(CO) measurement. Micro II smokerlyzer (Bedfont Instruments Ltd, England) was used to analyze CO concentration in expired air. The method used for measuring CO concentration was to deeply inhale and hold one's breath for 15 seconds and measure CO concentration while exhaling.

Results : The total number of subjects was 205 (199 males, 6 females) consisting of 124 hospital visitors, 67 hospital staff, 8 inpatients, and 6 inpatients. The average FTQ was 4.68 and the average FTND was 3.95. Cronbach's alpha, which indicates the internal reliability, was 0.6679 for FTQ and 0.6913 for FTND. The correlation coefficient which indicates test-retest reliability was 0.783 for FTQ and 0.880 for FTND. The correlation coefficient which indicates the relationship between the level of Nicotine Dependence and expired air CO concentration was 0.484 for FTQ and 0.563 for FTND. The correlation coefficient of the smoking period was 0.247 for FTQ and 0.252 for FTND.

Conclusion : This Korean-Version Questionnaires for Nicotine Dependence (FTQ & FTND) were both satisfactory from the aspects of reliability and validity. It was concluded that the Korean-Version of FTND was a reliable method to reflect the level of nicotine dependence of smokers from the fact that the reliability and validity of FTND was higher than that of FTQ.
  • 2,689 View
  • 129 Download
Assessing the Clinical Competence of Family Medicine Clerkship Students Using the OSCE.
Soo Hyun Kim, Do Haeng Lee, Young Mee Lee, Youn Seon Choi, Kyung Hwan Cho, Myung Ho Hong
J Korean Acad Fam Med 2002;23(5):583-592.   Published online May 31, 2002
  • 1,303 View
  • 25 Download
The reliability and validity of the Korean family function assessment tool.
Ji Ho Choi, Ho Cheol Shin, Hyun Lim Choi, Byung Sung Kim, Jang Won Won
J Korean Acad Fam Med 2002;23(3):292-300.   Published online March 1, 2002
Background
: We developed Korean Family Function Assessment Tool(KFFAT). In order to confide in the results of the KFFAT, it was necessary to verify the psychometric properties(validity and reliability).

Methods : To evaluate the reliability of the KFFAT, internal consistency and scale-item correlation was carried out with 800 middle and high school students and their 800 parents. A three-week interval test-retest was also carried out with 50 high school students and their 50 parents.
In addition, the KFFAT was compared to the family APGAR and the FACES III to evaluate the validity with 800 middle and high school students and their 800 parents.

Results : Cronbach alpha of each scale was 0.55-0.88 and overall scale-item correlation coefficient was believed to be appropriate. Pearson's correlation coefficient of test-retest was 0.49-0.79 in each scale. There is little correlation between the Family APGAR and the FACES III with the KFFAT. However, the KFFAT shows similar results in the function of family with the Family APGAR and the FACES III.

Conclusion : From this reliability and validity test results, the Korean Family Function Assessment Toll(KFFAT) could be used as a assessment tool of Korean family function.
  • 1,394 View
  • 26 Download
Reliability and validity of anxiety screening scale.
Ji Yeon Lim, Seung Hoon Lee, Yeon Soon Cha, Hye Soon Park, Sung Sunwoo
J Korean Acad Fam Med 2001;22(8):1224-1232.   Published online August 1, 2001
Background
: Anxiety is a common disorder, but its diagnosis is often overlooked. Although there are several evaluating instruments, they are difficult to use in busy outpatient clinics because of its length. Furthermore, scales developed for screening are insufficient in the standardization. The purpose of this study is to measure reliability and validity of scale that can efficiently detect the anxiety patients in busy primary care setting.

Methods : With translation and assistance from psychiatrist, the questionnaire was developed. From March to July 2000, anxiety and control group at the department of family medicine in Seoul Joongang Hospital were tested with the questionnaire. After one week later, test was retaken. Reliability was verified by calculating Kappa value. Also validity was validity was verified by comparing the scores between the anxiety group and the control group. Then sensitivity and specificity were evaluated, and the cutoff point was determined.

Results : Kappa values were ranging from 0.65 to 0.88. For each cutoff point 3,4,5 and 6 in validity. As the purpose was screening, we determined score 5 as the best cutoff points.
  • 2,105 View
  • 73 Download
Reliability and validity of Korean templer's death anxiety scale, death depression scale and sense of symbolic immortality scale.
Mi Ryung An, Ye Kyung So, Byung Su Ko, Young Eun Choi, Jae Yong Shim, Hye Ree Lee
J Korean Acad Fam Med 2000;21(7):893-900.   Published online July 1, 2000
Background
: Means to measure death anxiety, death depression and sense of symbolic immortality with approved validity and reliability does not yet exist in Korea.

Methods : Existing English questionnaires such as Templer Death Anxiety Scale (TDAS), Death Depression Scale (DDS), Sense of Symbolic Immortaligy Scale (SSIS) were translated into Korean by 5 translators, and then reviewed by 3 non-participants of translation for collegial summary and this summary was counter-translated again by another 2 non-participants. Another 3 non-participants of translation and counter-translation were chosen to examine the two sentences of each item. Then reexamination was done by retranslating and counter-translating the parts with errors. After pretest on ordinary people. The completed questionnaires were given to medical students, residents and nurses of a university hospital. Pastors and missionaries were selected as comparison group.

Results : Kuder-Richardson or Cronbach-α that represent internal consistency of TDAS, DDS and SSIs was 0.69, 0.84 and 0.78. The three sentences that lowered internal consistency of SSIS was deleted. BDI and DDS showed a positive correlation (0.32, P=0.02), suggesting proved construct validity. Correlation coefficient that proves construct validity of TDAS and DDS was 0.54 (P<0.01), of SSIS and TDAS -0.23(P=0.04), of SSIS and DDS -0.29(P=0.01). The TDAS and DDS(P<0.01), DDS and BDI(P=0.02) have shown a positive correlation were shown. There was significant difference in the score of SSIS(P<0.01). The same results in cases where the 3 sentences was deleted.

Conclusion : Korean versions of TDAS, DDS and SSIS were reliable and valid.
  • 1,586 View
  • 61 Download
Development and validation of a screening questionnaire for detection of adolescent psychiatric problems in primary care.
woo Sung Sun, Young Sik Kim, Chang Wha Lee, Gwang Soo Uh
J Korean Acad Fam Med 2000;21(7):884-892.   Published online July 1, 2000
Background
: Because of many physical, psychological, and social stresses, adolescence is a vulnerable period to psychiatric disorders. But in Korea, there is actually not enough time for primary care physicians to screen such patients during ordinary medical interviews. Therefore this research was done to develop and validate a brief screening questionnaire for the detection of adolescent patients with psychiatric problems.

Methods : Three family physicians in charge of their own adolescent clinics developed a five-item questionnaire for screening adolescents with psychiatric problems by reviewing related literature with consultation by a psychiatrist. After performing a pretest and gathering second opinions from other psychiatrists and nurse-teachers, final questionnaire was redeveloped. Verification of its reliability by using test-retest method and internal consistency by calculating Cronbach's alpha coefficient was done. Also inspection of its validity by comparing the scores of psychiatric patient group to normal group was done. And finally the discrimination point was obtained.

Results : For reliability Kappa value or new questionnaires ranged from 0.33 to 0.63. One item was dropped because of its negative influence to the internal consistency and the discrimination power. With the four final items, we estimated the validity for distinguishing psychiatric patients from the normal group by calculating the sensitivity and specificity of each cutting point of scores. For the each cutting point 1, 2, and 3, sensitivity was 85%, 75%, 40%, respectively, and specificity was 27%, 62%, 84%, respectively. We considered score 1 as the best cutting point because the purpose of the questionnaire was screening rather than diagnosis.

Conclusion : A brief four-item screening questionnaire(SAPPO. Screening method of Adolescent Psychiatric Problems in Outpatient clinic) was developed and its reliability and validity was estimated.
  • 1,096 View
  • 13 Download
A study on developing minimum requirement guidelines for standard questionnaire translation, validation using delphi method.
Soo Young Kim, Myung HO Hong
J Korean Acad Fam Med 2000;21(4):457-470.   Published online April 1, 2000
Background
: A standard questionnaire is usually characterized by a set of questions, a scoring method, and psychometric properties. But many studies suggested that previously translated standard questionnaire in Korea had bee used without testing translation validity, scoring system and psychometric properties.

Methods : After developing a preliminary delphi questionnaire from references by a researcher, it was modified from pretest procedure, which was performed to 6 family physicians who had experiences in translating standard questionnaires. Some experts were chosen among authors of standard questionnaire, translation articles in four questionnaire related journals and others were recommended by other experts.

Results : The total number of experts was 53 including 22 family physicians, 15 psychiatrists, 2 psychologists, 8 faculties of preventive medicine and 6 faculties of nursing. The response rates were 85%, 87%, 92% on 1st, 2nd, 3rd delphi round, respectively, and the total response rate was 69%. According to Delphi surveys, minimal requirements for a standard questionnaire translation were translation by two translators, pretest techniques, consideration of age·sex·education level in pretest procedure, reliability validation, validity validation and 0.5 or more of correlation coefficient level in convergent validity validation. Minimal requirement for reliability coefficients was 0.7 or more, but the results did not reach adequate consensus.

Conclusion : Developing minimum requirement guidelines for standard questionnaire translation using Delphi method can be done.
  • 1,473 View
  • 41 Download
The Development of Korean Health Related Quality of Life Scale (KQUOLS): Testing Reliability and Validity.
Soo Young Kim, Jae Yong Shim, Won Jang Won, Woo Sung Sun, Hoon Ki Park, Jung kwon Lee
J Korean Acad Fam Med 2000;21(3):382-394.   Published online March 1, 2000
Background
: Korean health related Quality of Life Scale(KQOLS) was developed to measure the quality of life reflecting Korean’s own language expression and culture. In order to confide in the results of KQOLS, it is necessary to establish verification of the psychometric properties(reliability, validity, responsiveness).

Methods : KQOLS’s final 46 items and item option responses were established by expert panels. Reliability was tested by 2 weeks test-retest method and internal consistency methods. Validity was tested by factor analysis and clinical validity. Sensitivity and specificity for detecting treatment-related changes were also tested.

Results : A high degree of internal consistency was observed for each of domains(Cronbach’s alpha value of 0.77 or higher). Two weeks test-retest reliability correlation coefficients scores were highly significant except health perception domain. A principal components analysis identified 9 factors with eight values greater than 1.0 which were approximately the same as intended domains. Normal control group had statistically significant higher scores than patients group except in spiritual health and social function domains. Improved group of patients had statistically significant higher scores than non-improve group of patients after treatment except in spiritual health and health status perception domains.

Conclusion : Korean health related Quality of Life Scale(KQOLS) is both a valid and a reliable instrument, but fine refinements such as items revision and item response options modification will be needed.
  • 1,542 View
  • 35 Download
Background
: FACES III is a useful instrument for the evaluation of family function. It was translated with evaluation of it's validity and reliability and used in many researches in Korea. But following studies for validity and realiability of FACES III didn't show consistent results. And for the evaluation of family function of middle school students, FACES III can be a useful tool. But it is important to reinvestigate the validity and reliability of FACES III to apply this instrument to them.

Methods : In 1997, self-report instrument FACES III questionnaires were distributed to all members of one boys' middle school students in Inchon. The 1150 questionnaires except incomplete questionnaires form 1249 students were analyzed.

Results : The Cronbach's alpha coefficients for internal consistency reliability were 0.71 for adaptability and 0.80 for cohesion. The Pearson's correlation coefficient between cohesion and adaptability for construct validity was 0.59. Correlations between total scores and each item scores were moderate to strong, cor-relations between items in subcategory were weak. In factor analysis, there were many items that were not compatible with factors according to concept of FACES III.

Conclusion : The validity and reliability of FACES III can not be guaranteed when applied to the evaluaton of middle school students' family function.
  • 1,201 View
  • 18 Download
Validity analysis of for exercise tests in assessing aerobic capacity of young men.
Chang Jin Choi, Kyung Soo Kim, Sun Myeong Ock, Chan Hee Song, Keun Sang Yeum, Yeun Sook Park, Hong In Kim
J Korean Acad Fam Med 1999;20(12):1752-1760.   Published online December 1, 1999
Background
: Assessment of aerobic capacity(VO₂max) is one of the essential components in exercise prescription for health promotion and maintenance. This study was conducted to compare the validity of four exercise tests to assess aerobic capacity in young adult male subjects by comparing them to the values measured from maximal ergometer exercise test(criterion VO₂max).

Methods : twenty young healthy adult males(M±SD=21.1±1.5 years) volunteered as subjects. Criterion VO₂max was calculated and printed out automatically by computerized analysis system of expired air samples collected during maximal ergometer exercise test. VO₂max was estimated for each subjects from heart rate at submaximal workloads on the cycle ergometer using the Åstrand-Rhyming nomogram(A/R) and Fox protocol(FOX) and the computerized multiple extrapolation method (XTP). The score got from Harvard step test(H/S) was used to compare the validity. The validity of the procedures was based on the evaluation of the predicted VO₂max (from A/R, FOX, XTP, and H/S) versus the criterion VO₂max via the calculation of constant error(CE=mean difference for predicted minus criterion VO₂max), r value, standard error of the estimate[SEE=SD-(1-r²)1/2], total error[TE=(∑(predicted VO₂max ? criterion VO₂max)²/n)1/2].

Results : In relation to criterion VO₂max, the XTP and A/R underpredicted (XTP : 40.8 ml/kg/min SD = 4.1; A/R: 37.3 8 ml/kg/min SD = 5.0) and the H/S and FOX overpredicted(H/S: 48.0 8 ml/kg/min SD = 5.9; FOX 46.3 8 ml/kg/min SD = 5.5). Dunnett post-hoc procedures revealed that there were significant(P<0.05) mean differences(CE) for VO₂max from A/R versus criterion. The validity coefficients for VO₂max derived from XTP, H/S, A/R, and FOX were 0.68,0.53,0.50, and 0.49, respectively. TE of the XTM, FOX, H/S and A/R, which accounts for the effects of both the CE and SEE, were5.73,6.13,6.75, and 8.87, respectively.

Conclusion : These results suggest that the XTP is recommended first for estimation VO₂max in young adult males. It is also considered that further studies about female and other age groups are necessary.
  • 1,167 View
  • 17 Download
Relationship between control measurement point (CMP) value of Electroacupucture according to Voll(EAV) and clinical laboratory findings and subjective symptoms of patients.
Eun Sook Park, Yong Chul Kim, Sekyung Oh, Dokyoung Yoon, Seon Mee Kim, Kyung Hwan Cho, Yong Kyun Roh, Jeong Yeol Oh, Hee Tak Yoo
J Korean Acad Fam Med 1998;19(9):736-744.   Published online September 1, 1998
Background
: The objective confirmation of subjective symptom of patient is important in the primary care consisted largely by functional disorders of which mechanism could not explain the symptoms clearly. Definite diagnostic method is not established yet for the functional disorders densptie the fact that various investigations have been done. So, we tried to reveal the relationship between the value of indicator drop(ID) from electroacupunctrure point accordint to Voll and the clinical diagnosis and subjective symptom by using noninvasive electroacupuncture diagnosis according to Voll.

Methods : Among the patients of three university level hospitals health care centers from April to June 1997, consenting 203 persons were enrolled .Various laboratory finding and ID from EAV were measured by double blind test methods. In parallel, subjective symptoms were classified by each organ. Validity was tested by the relationship between the gastrofiberscopy finding and the stomach control measurement point ID.

Results : There were statistically significant ID increases in the CMPs of endocrine, lung, circulation system, gastrointestinal system, kidney and bladder compared to a laboratory findings or subjective symptom by the comparison between the variables of the assessed clinical or laboratory findings and organ specific CMP score. Especially, the ID increase of stomach shows 79.3%-90.9% positive predictive value to positive findings of gastrofiberscopy when gastrofiberscopy is definded to confirmation test of gastritis, gastric ulcer and duodenal ulcer.

Conclusion : Our results show that the noninvasive electrodiagnostic method result by measuring EAV of organ system is related statistically to subjective symptoms and laboratory findings. Also they show that it could be useful tool as a clinical diagnostic method. We suggest that further study is needed to reveal organ specific sensitivity, specificity, positive and negative predictive value by using confirmation method of organ specific disease.
  • 1,186 View
  • 14 Download
TOP