Article Category:
Research Article

Identifying Borderline Trachoma Grades Using a Three-Latent Class Model

Vinayak Prathikanti F. I. Proctor Foundation, Department of Ophthalmology, University of California, San Francisco, California;

Search for other papers by Vinayak Prathikanti in
Current site
Google Scholar
PubMed Close
,
Renee Casentini F. I. Proctor Foundation, Department of Ophthalmology, University of California, San Francisco, California;

Search for other papers by Renee Casentini in
Current site
Google Scholar
PubMed Close
,
Jonathan Hwang F. I. Proctor Foundation, Department of Ophthalmology, University of California, San Francisco, California;

Search for other papers by Jonathan Hwang in
Current site
Google Scholar
PubMed Close
,
Amza Abdou Programme National de Lutte Contre la Cecité, Niamey, Niger;

Search for other papers by Amza Abdou in
Current site
Google Scholar
PubMed Close
,
Nassirou Beidou Programme National de Lutte Contre la Cecité, Niamey, Niger;

Search for other papers by Nassirou Beidou in
Current site
Google Scholar
PubMed Close
,
Boubacar Kadri Programme National de Sante Oculaire, Niamey, Niger

Search for other papers by Boubacar Kadri in
Current site
Google Scholar
PubMed Close
,
Ariktha Srivathsan F. I. Proctor Foundation, Department of Ophthalmology, University of California, San Francisco, California;

Search for other papers by Ariktha Srivathsan in
Current site
Google Scholar
PubMed Close
,
Isabelle Prieto F. I. Proctor Foundation, Department of Ophthalmology, University of California, San Francisco, California;

Search for other papers by Isabelle Prieto in
Current site
Google Scholar
PubMed Close
,
Winnie Huang F. I. Proctor Foundation, Department of Ophthalmology, University of California, San Francisco, California;

Search for other papers by Winnie Huang in
Current site
Google Scholar
PubMed Close
,
Daniel G. Eyassu F. I. Proctor Foundation, Department of Ophthalmology, University of California, San Francisco, California;

Search for other papers by Daniel G. Eyassu in
Current site
Google Scholar
PubMed Close
,
Elisabeth Gebreegziabher F. I. Proctor Foundation, Department of Ophthalmology, University of California, San Francisco, California;

Search for other papers by Elisabeth Gebreegziabher in
Current site
Google Scholar
PubMed Close
,
Corinne Pierce F. I. Proctor Foundation, Department of Ophthalmology, University of California, San Francisco, California;

Search for other papers by Corinne Pierce in
Current site
Google Scholar
PubMed Close
,
Hadley Burroughs F. I. Proctor Foundation, Department of Ophthalmology, University of California, San Francisco, California;

Search for other papers by Hadley Burroughs in
Current site
Google Scholar
PubMed Close
,
Jeremy D. Keenan F. I. Proctor Foundation, Department of Ophthalmology, University of California, San Francisco, California;

Search for other papers by Jeremy D. Keenan in
Current site
Google Scholar
PubMed Close
, and
Thomas M. Lietman F. I. Proctor Foundation, Department of Ophthalmology, University of California, San Francisco, California;

Search for other papers by Thomas M. Lietman in
Current site
Google Scholar
PubMed Close
DOI:
https://doi.org/10.4269/ajtmh.24-0321
Volume/Issue:
Volume 112: Issue 5
Page(s):
1087–1090
Restricted access
Get Permissions

ABSTRACT.

The WHO has a simplified grading system for assessing trachoma. However, even for experts, it can be difficult to classify certain cases as strictly positive or negative for a given grade. Given the absence of a true gold standard, we performed a Latent Class Analysis (LCA) on a set of 200 graded photos of the superior tarsal conjunctiva. Ten trained graders assessed the presence of two trachoma grades: trachomatous inflammation–follicular (TF) and trachomatous inflammation–intense (TI). The LCA was modeled in two different ways: first with two classes (presence/absence), and then with three classes, with the extra class presumed to represent a more discrepant “borderline” case. Cohen’s κ-statistics measuring agreement between graders were calculated for TF and TI grades (separately) before and after removing the third latent class. The κ-statistic increased by 0.10 (95% CI = 0.72–0.85; P <0.001) for TF and 0.13 (95% CI = 0.81–0.90; P <0.001) for TI, indicating that the third latent class represented a discrepant-case borderline class. The identification of borderline grading cases using a three-class LCA may be useful in creating balanced grader certification examinations that represent the full spectrum of disease. Additionally, a multiclass LCA could act as a probabilistic gold standard used to train and analyze future convolutional neural network models.

Author Notes

Financial support: The Trachoma Elimination Follow-up trial received financial support from the Bernard Osher Foundation, the International Trachoma Initiative, the Bodri Foundation, the South Asia Research Fund, the Harper Inglis Trust, Research to Prevent Blindness, All May See Foundation, and the NIH (Grants R01EY025350, UG1EY030833, and UG1EY028088). The Partnership for Rapid Elimination of Trachoma trial was funded by the Bill and Melinda Gates Foundation, and azithromycin was donated to the National Trachoma Control Programs of each country by Pfizer Inc. through the International Trachoma Initiative.

Disclosure: Upon review by the UCSF Committee on Human Research/Institutional Review Board, this study used deidentified photos and was classified as exempt research.

Current contact information: Vinayak Prathikanti, Renee Casentini, Jonathan Hwang, Ariktha Srivathsan, Isabelle Prieto, Winnie Huang, Daniel G. Eyassu, Elisabeth Gebreegziabher, Corinne Pierce, Hadley Burroughs, Jeremy D. Keenan, and Thomas M. Lietman, F. I. Proctor Foundation, Department of Ophthalmology, University of California, San Francisco, CA, E-mails: vinayak.prathikanti@gmail.com, casentini1@kenyon.edu, jonhwan@nuevaschool.org, ariktha.srivathsan@ucsf.edu, isabelleprieto1@gmail.com, winnieh531@gmail.com, deyassu@tulane.edu, elisabeth.gebreegziabher@ucsf.edu, coreypierce@berkeley.edu, hadley.burroughs@ucsf.edu, jeremy.keenan@ucsf.edu, and tom.lietman@ucsf.edu. Amza Abdou, Nassirou Beidou, and Boubacar Kadri, Programme National De Santé Oculaire, Ministère De La Santé Publique, Niamey, Niger, E-mails: dr.amzaabdou@gmail.com, nasbeido@yahoo.fr, and boubacarkadri@gmail.com.

Address correspondence to Thomas M. Lietman, F.I. Proctor Foundation, University of California, 490 Illinois St. #25, San Francisco, CA 94158. E-mail: tom.lietman@ucsf.edu
Copyright:
© American Society of Tropical Medicine and Hygiene 2025
Received:
14 May 2024
|
Accepted:
21 Nov 2024
|
Published Online:
25 Feb 2025
Cover The American Journal of Tropical Medicine and Hygiene
The American Journal of Tropical Medicine and Hygiene
Print ISSN:
0002-9637
Online ISSN:
1476-1645
  • 1.

    Thylefors B, Dawson CR, Jones BR, West SK, Taylor HR, 1987. A simple system for the assessment of trachoma and its complications. Bull World Health Organ 65: 477–483.

  • 2.

    Gebresillasie S, Tadesse Z, Shiferaw A, Yu SN, Stoller NE, Zhou Z, Emerson PM, Gaynor BD, Lietman TM, Keenan JD, 2015. Inter-rater agreement between trachoma graders: Comparison of grades given in field conditions versus grades from photographic review. Ophthalmic Epidemiol 22: 162–169.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 3.

    Whitson CC et al., 2023. Photographic grading for trachoma diagnosis within trachoma impact surveys in Amhara region, Ethiopia. Trans R Soc Trop Med Hyg 117: 111–117.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 4.

    Dawson CR, Jones BR, Tarizzo ML, 1981. Guide to Trachoma Control in Programmes for the Prevention of Blindness. Geneva, Switzerland: World Health Organization.

  • 5.

    See CW, Alemayehu W, Melese M, Zhou Z, Porco TC, Shiboski S, Gaynor BD, Eng J, Keenan JD, Lietman TM, 2011. How reliable are tests for trachoma?—A latent class approach. Invest Ophthalmol Vis Sci 52: 6133–6137.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 6.

    Amza A et al., 2017. A cluster-randomized trial to assess the efficacy of targeting trachoma treatment to children. Clin Infect Dis Off Dis 64: 743–750.

  • 7.

    Amza A et al.; PRET Partnership, 2012. Community risk factors for ocular Chlamydia infection in Niger: Pre-treatment results from a cluster-randomized trachoma trial. PLoS Negl Trop Dis 6: e1586.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 8.

    Amza A et al., 2013. The easiest children to reach are most likely to be infected with ocular Chlamydia trachomatis in trachoma endemic areas of Niger. PLoS Negl Trop Dis 7: e1983.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 9.

    Harding-Esch EM et al.; Partnership for Rapid Elimination of Trachoma (PRET) study group, 2013. Mass treatment with azithromycin for trachoma: When is one round enough? Results from the PRET trial in the Gambia. PLoS Negl Trop Dis 7: e2115.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 10.

    Melese M et al., 2008. Comparison of annual and biannual mass antibiotic administration for elimination of infectious trachoma. JAMA 299: 778–784.

  • 11.

    Chidambaram JD et al., 2006. Effect of a single mass antibiotic distribution on the prevalence of infectious trachoma. JAMA 295: 1142–1146.

  • 12.

    Weller BE, Bowen NK, Faubert SJ, 2020. Latent class analysis: A guide to best practice. J Black Psychol 46: 287–311.

  • 13.

    Gamer M, Lemon J, Singh IFP, 2019. irr: Various Coefficients of Interrater Reliability and Agreement. Vienna, Austria: Comprehensive R Archive Network.

  • 14.

    R Core Team, 2023. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing.

  • 15.

    Gaynor BD, Amza A, Gebresailassie S, Kadri B, Nassirou B, Stoller NE, Yu SN, Cuddapah PA, Keenan JD, Lietman TM, 2014. Importance of including borderline cases in trachoma grader certification. Am J Trop Med Hyg 91: 577–579.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 16.

    Renneker KK et al., 2022. Global progress toward the elimination of active trachoma: An analysis of 38 countries. Lancet Glob Health 10: e491–e500.

  • 17.

    Naufal F, Brady CJ, Wolle MA, Kashaf MS, Mkocha H, Bradley C, Kabona G, Ngondi J, Massof RW, West SK, 2021. Evaluation of photography using head-mounted display technology (ICAPS) for district trachoma surveys. PLoS Negl Trop Dis 15: e0009928.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 18.

    Socia D, Brady CJ, West SK, Cockrell RC, 2022. Detection of trachoma using machine learning approaches. PLoS Negl Trop Dis 16: e0010943.

  • 19.

    Kim MC, Okada K, Ryner AM, Amza A, Tadesse Z, Cotter SY, Gaynor BD, Keenan JD, Lietman TM, Porco TC, 2019. Sensitivity and specificity of computer vision classification of eyelid photographs for programmatic trachoma assessment. PLoS One 14: e0210463.

    • PubMed
    • Search Google Scholar
    • Export Citation
  • 20.

    Tielsch JM, West KP, Johnson GJ, Tizazu T, Schwab L, Chirambo MC, Taylor HR, 1987. Trachoma grading: Observer trials conducted in southern Malawi. Br J Ophthalmol 71: 371–374.

Past two years Past Year Past 30 Days
Abstract Views 19073 19073 8774
Full Text Views 65 65 22
PDF Downloads 39 39 21
 

 

 

 
 
Affiliate Membership Banner
 
 
Research for Health Information Banner
 
 
CLOCKSS
 
 
 
Society Publishers Coalition Banner
Save