Measurement of Interobserver Disagreement: Correction of Cohen’s Kappa for Negative Values by Tarald O. Kvålseth

“…As measures of interobserver agreement for both nominal and ordinal categories, Cohen’s kappa coefficients appear to be the most widely used with simple and meaningful interpretations. …”
Get full text

Leveraging on large language model to classify sentences: a case study applying STAGES scoring methodology for sentence completion test on ego development by Xavier Bronlet

Subjects: Get full text

Are all tuberculosis deaths correctly attributed due to tuberculosis? Analysis of causes of death (COD) using verbal autopsy: A cross-sectional study in Puducherry by Reenaa Mohan, M Rajalakshmi, G Kalaiselvan

“…Among them 34.9% of the declared TB deaths are not due to TB. Cohen’s kappa = 0.4; 95% CI: (0.858–0.985) showed moderate agreement between the raters. …”
Get full text

Evaluating physician concordance in interpretation of tracheobronchomalacia diagnosis and phenotyping using dynamic expiratory chest computed tomography by G. A. Cortes-Puentes, M. Matatko, B. J. Bartholmai, E. S. Edell, K. G. Lim

“…Inter-rater agreement was assessed using Fleiss’s Kappa for TBM diagnosis and Cohen’s Kappa for TBM phenotype classification into six categories: No TBM, Excessive Dynamic Airway Collapse (EDAC), Crescent Type, Circumferential Type, Saber-Sheath Type, and Mixed Type. …”
Get full text

Clinico-dermoscopic and Histopathological Evaluation of Benign Skin, Soft Tissue and Appendageal Tumours of Skin: A Cross-sectional Study from a Tertiary Care Hospital by Saika Reyaz, Shagufta Rather, Sheikh Bilal, Taiba Trumboo, Mateen Hussain

“…A good agreement between dermoscopic and clinical diagnosis was found (Cohen's Kappa = 0.879) and between dermoscopic and histopathological diagnosis was also found (Cohen's Kappa = 0.789). …”
Get full text

The Intra- and Inter-rater Reliability of an Arm Care Screening Tool in High School Baseball Coaches by Kyle A. Matsel, Stephanie N. Brown, Matt C. Hoch, Robert J. Butler, Philip M. Westgate, Terry R. Malone, Tim L. Uhl

“…The mean Cohen’s kappa coefficient for intra-rater reliability was 0.76 (95% confidence interval, 0.54-0.95) and percent absolute agreement ranged from 0.82-0.94 among all raters. …”
Get full text

Agreement Between Isokinetic Dynamometer and Hand-held Isometric Dynamometer as Measures to Detect Lower Limb Asymmetry in Muscle Torque After Anterior Cruciate Ligament Reconstruc... by Angelica Ivarsson, Anna Cronström

“…Bland & Altman plots and Cohen's Kappa coefficient were used to assess agreement between measurements obtained from the instruments…”
Get full text

Validity and reliability International Classification of Diseases-10 codes for all forms of injury: A systematic review. by Sarah Paleczny, Nosakhare Osagie, Jai Sethi, Michael Cusimano

“…Reliability was defined by inter-rater reliability (IRR), measured by Krippendorff's alpha, Cohen's Kappa, and/or Fleiss' kappa.<h4>Results</h4>Twenty-seven published studies from 2006 to 2023 were included. …”
Get full text

Radiography may not be accurate in assessing acute ankle sprains in children by Xiongtao Li, Xiantao Shen, Si Wang, Jie Sun, Zhaoting Liu

“…Cohen’s kappa and McNemar’s tests were also utilized to assess the reliability of radiography and ultrasonography in comparison to MRI. …”
Get full text

RadiomixNet: Integrating Radiomics and Feature Extraction for Advanced Pneumonia Diagnosis by Rahul Gowtham Poola, Siva Sankar Yellampalli

“…Among these, Gradient Boosting demonstrated superior performance across all feature sets, achieving a Cohen&#x2019;s Kappa of 0.93, MCC of 0.88, Youden&#x2019;s Index of 0.82, and a Log Loss of 0.27.…”
Get full text

Qualitative and quantitative agreement research on three diagnostic methods for maxillary transverse discrepancy by Zhang Ningbo, Wang Tianxiao, Yan Feng, Chen Rui, Fu Xinyu, Ren Liling

“…The intraclass correlation coefficient (ICC) was used to evaluate quantitative agreement, while Cohen's kappa was used to measure qualitative agreement. …”
Get full text

An Intelligent Gesture Classification Model for Domestic Wheelchair Navigation with Gesture Variance Compensation by H. M. Ravindu T. Bandara, K. S. Priyanayana, A. G. Buddhika P. Jayasekara, D. P. Chandima, R. A. R. C. Gopura

“…Further, those results were analyzed using Cohen’s kappa analysis in which overall accuracy, misclassification rate, precision, and Cohen’s kappa values were calculated.…”
Get full text

Field study on the suitability of oral fluid samples for monitoring of Lawsonia intracellularis and Brachyspira hyodysenteriae by multiplex qPCR under field conditions by Matthias Eddicks, Gerald Reiner, Sigena Junker, Hermann Willems, Sabrina Becker, Julia Stadler, Josefine Hagn, Mathias Ritzmann

“…Therefore, we collected oral fluids at an age of 12, 16 and 20 weeks of life and compared them to pooled fecal samples collected from the same pens on two fattening farms. Results Cohen´s Kappa analysis revealed a substantial agreement between oral fluids and pooled fecal samples on pen level (Cohen´s Kappa: 0.745; p < 0.001). …”
Get full text

Comparison of the performances between ChatGPT and Gemini in answering questions on viral hepatitis by Meryem Sahin Ozdemir, Yusuf Emre Ozdemir

“…The answers of the chatbots were evaluated by two different infectious diseases specialists on a scoring scale from 1 to 4. Cohen’s kappa coefficient was calculated to assess inter-rater reliability. …”
Get full text

The usefulness of automated high frequency ultrasound image analysis in atopic dermatitis staging by Joanna Czajkowska, Adriana Polańska, Anna Slian, Aleksandra Dańczak-Pazdrowska

“…The overall accuracy of the AD assessment was equal to 69% (Cohen’s kappa 0.78) and was comparable with the experts’ assessment, ranging between 64% and 70% (Cohen’s kappa 0.73–0.79). …”
Get full text

Artificial intelligence in suicide prevention: Utilizing deep learning approach for early detection by Vikas Gaur, Gaurav Maggu, Khushboo Bairwa, Suprakash Chaudhury, Sana Dhamija, Tahoora Ali

“…Training and testing of the model are conducted using fictional and simulated profiles, respectively, and model performance is assessed through statistical metrics and the Cohen’s Kappa coefficient, benchmarked against expert evaluations. …”
Get full text

Vascular Access Device Infections: Current Management Practices and the Role of Multidisciplinary Teams at a Large Hospital in Northern Italy by Marta Colaneri, Lucia Galli, Martina Offer, Fabio Borgonovo, Giovanni Scaglione, Camilla Genovese, Rebecca Fattore, Monica Schiavini, Giovanni De Capitani, Maria Calloni, Arianna Bartoli, Antonio Gidaro, Chiara Cogliati, Spinello Antinori, Andrea Gori, Antonella Foschi

“…Concordance between real-life practices and VAT recommendations was evaluated using Cohen’s kappa coefficient. <b>Results</b>: Of 2419 VAD placements, 146 (6%) developed infections (84 CABSI, 62 CRBSI). …”
Get full text

Mask-UnMask Regions (MUMR) Framework for Classifying AMD Grades Using Inter-Regional Interaction Analysis by Ibrahim Abdelhalim, Namuunaa Nadmid, Mohamed Elsharkawy, Mohammed Ghazal, Ali H. Mahmoud, Ayman El-Baz

“…Our model consistently outperforms state-of-the-art approaches, achieving mean accuracy, mean F1-score, and mean Cohen&#x2019;s Kappa of 92.55%, 92.59%, and 89.97%, respectively. …”
Get full text

Effectiveness and utilization of a cognitive screening program for primary geriatric care by David P. Salmon, Anna Malkina, Melanie L. Johnson, Christina Gigliotti, Emily A. Little, Douglas Galasko

“…Classification accuracy was shown by high agreement with the eventual clinical diagnosis in the medical record (69%; Cohen’s Kappa = .38; p < .001; 77% if MCI and dementia were collapsed; Cohen’s Kappa = .58; p < .001) and longitudinal decline in cognitive test scores only in those initially classified as having MCI or dementia. …”
Get full text

Evaluation of Efficacy of Artificial Intelligence in Orthopantomogram in Detecting and Classifying Radiolucent Lesions by Sheetal Singar, Ajay Parihar, Prashanthi Reddy

“…The descriptive statistics was performed. The Cohen kappa correlation coefficient was used for assessment of reliability of the diagnostic methods. …”
Get full text