<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1d1 20130915//EN" "http://jats.nlm.nih.gov/publishing/1.1d1/JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article" xml:lang="en">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">JPHIA</journal-id>
<journal-title-group>
<journal-title>Journal of Public Health in Africa</journal-title>
</journal-title-group>
<issn pub-type="ppub">2038-9922</issn>
<issn pub-type="epub">2038-9930</issn>
<publisher>
<publisher-name>AOSIS</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">JPHIA-16-1536</article-id>
<article-id pub-id-type="doi">10.4102/jphia.v16i1.1536</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Original Research</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Developing and validating an appendectomy algorithm for use in a South African database</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0001-8017-7575</contrib-id>
<name>
<surname>Louw</surname>
<given-names>Johnelize</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
<xref ref-type="aff" rid="AF0002">2</xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-2757-0663</contrib-id>
<name>
<surname>Nyasulu</surname>
<given-names>Peter</given-names>
</name>
<xref ref-type="aff" rid="AF0003">3</xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0001-9567-8591</contrib-id>
<name>
<surname>English</surname>
<given-names>Rene</given-names>
</name>
<xref ref-type="aff" rid="AF0002">2</xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-8923-7447</contrib-id>
<name>
<surname>Chu</surname>
<given-names>Kathryn</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
</contrib>
<aff id="AF0001"><label>1</label>Department of Surgical Sciences, Faculty of Medicine and Health Sciences, Stellenbosch University, Cape Town, South Africa</aff>
<aff id="AF0002"><label>2</label>Division of Public Health and Health Systems, Department of Global Health, Faculty of Medicine and Health Sciences, Stellenbosch University, Cape Town, South Africa</aff>
<aff id="AF0003"><label>3</label>Division of Epidemiology and Biostatistics, Department of Global Health, Faculty of Medicine and Health Sciences, Stellenbosch University, Cape Town, South Africa</aff>
</contrib-group>
<author-notes>
<corresp id="cor1"><bold>Corresponding author:</bold> Johnelize Louw, <email xlink:href="18205585@sun.ac.za">18205585@sun.ac.za</email></corresp>
</author-notes>
<pub-date pub-type="epub"><day>26</day><month>11</month><year>2025</year></pub-date>
<pub-date pub-type="collection"><year>2025</year></pub-date>
<volume>16</volume>
<issue>1</issue>
<elocation-id>1536</elocation-id>
<history>
<date date-type="received"><day>01</day><month>07</month><year>2025</year></date>
<date date-type="accepted"><day>19</day><month>09</month><year>2025</year></date>
</history>
<permissions>
<copyright-statement>&#x00A9; 2025. The Authors</copyright-statement>
<copyright-year>2025</copyright-year>
<license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by/4.0/">
<license-p>Licensee: AOSIS. This work is licensed under the Creative Commons Attribution 4.0 International (CC BY 4.0) license.</license-p>
</license>
</permissions>
<abstract>
<sec id="st1">
<title>Background</title>
<p>Identifying surgical patients through administrative and clinical data can inform the quality and demand for surgical care. In South Africa, a database exists that comprises data from the public health sector. However, algorithms are lacking to identify surgical procedures like appendectomy in these systems in our setting.</p>
</sec>
<sec id="st2">
<title>Aim</title>
<p>To develop and validate an appendectomy algorithm for use in a South African database.</p>
</sec>
<sec id="st3">
<title>Setting</title>
<p>Data from public hospitals in South Africa were the reference standard and comprised appendectomy and other general surgery procedure controls. The index test was the appendectomy algorithm developed and validated using the provincial database in the country.</p>
</sec>
<sec id="st4">
<title>Methods</title>
<p>A diagnostic test accuracy study was done. The algorithm was developed using four phases: exploration and selection, development, refinement and validation. Data analyses were performed using STATA version 18.</p>
</sec>
<sec id="st5">
<title>Results</title>
<p>The final algorithm comprised two procedures and nine diagnostic codes and reached a <italic>sensitivity</italic> of 91.3&#x0025; and a <italic>specificity</italic> of 96&#x0025;.</p>
</sec>
<sec id="st6">
<title>Conclusion</title>
<p>Our study is the first to validate an appendectomy algorithm in a low-and middle-income country setting. While not the first globally, it addresses a critical gap in the literature by demonstrating that robust, <italic>high-specificity</italic> algorithms can be developed in resource-constrained settings. Future research should focus on applying the algorithm to evaluate median delays in accessing care within the public health system.</p>
</sec>
<sec id="st7">
<title>Contribution</title>
<p>This study demonstrates that surgical procedure algorithms can be developed and validated with sufficient <italic>sensitivity</italic> and <italic>specificity</italic> using diagnostic and procedure codes for application in a low- and middle-income country setting.</p>
</sec>
</abstract>
<kwd-group>
<kwd>appendectomy</kwd>
<kwd>appendicitis</kwd>
<kwd>algorithm</kwd>
<kwd>health information system</kwd>
<kwd>procedure codes</kwd>
<kwd>diagnostic codes</kwd>
<kwd>healthcare</kwd>
</kwd-group>
<funding-group>
<funding-statement><bold>Funding information</bold> This research was funded by the National Research Foundation.</funding-statement>
</funding-group>
</article-meta>
</front>
<body>
<sec id="s0001">
<title>Introduction</title>
<p>Nearly one-third of the global disease burden is attributable to surgical conditions. Globally, inadequate access to safe, timely and affordable surgical care contributes to four times more deaths than those from HIV or AIDS.<sup><xref ref-type="bibr" rid="CIT0001">1</xref>,<xref ref-type="bibr" rid="CIT0002">2</xref></sup> Despite being one of the most cost-effective health interventions, surgery remains under-researched and is often referred to as the &#x2018;neglected stepchild&#x2019; of global health.<sup><xref ref-type="bibr" rid="CIT0003">3</xref></sup> In low- and middle-income countries (LMICs), data on the types and number of surgical procedures are scarce because of the absence of dedicated operative registries and comprehensive clinical or administrative databases.<sup><xref ref-type="bibr" rid="CIT0004">4</xref>,<xref ref-type="bibr" rid="CIT0005">5</xref>,<xref ref-type="bibr" rid="CIT0006">6</xref></sup> Such systems are essential for research, quality improvement and resource planning and identifying specific patient groups within them requires validated algorithms. While algorithms have been developed for various health events and conditions,<sup><xref ref-type="bibr" rid="CIT0007">7</xref>,<xref ref-type="bibr" rid="CIT0008">8</xref>,<xref ref-type="bibr" rid="CIT0009">9</xref>,<xref ref-type="bibr" rid="CIT0010">10</xref>,<xref ref-type="bibr" rid="CIT0011">11</xref>,<xref ref-type="bibr" rid="CIT0012">12</xref>,<xref ref-type="bibr" rid="CIT0013">13</xref>,<xref ref-type="bibr" rid="CIT0014">14</xref>,<xref ref-type="bibr" rid="CIT0015">15</xref>,<xref ref-type="bibr" rid="CIT0016">16</xref>,<xref ref-type="bibr" rid="CIT0017">17</xref></sup> fewer exist for surgical procedures such as appendectomy.<sup><xref ref-type="bibr" rid="CIT0005">5</xref>,<xref ref-type="bibr" rid="CIT0018">18</xref></sup></p>
<p>Accurate coding of surgical conditions and procedures is essential for functions such as billing, epidemiological surveillance, and health system planning.<sup><xref ref-type="bibr" rid="CIT0019">19</xref></sup> Yet there are several challenges associated with coding, such as misdiagnoses, incomplete records, inconsistent discharge summaries, and financial incentives that could influence coding practices.<sup><xref ref-type="bibr" rid="CIT0004">4</xref>,<xref ref-type="bibr" rid="CIT0020">20</xref>,<xref ref-type="bibr" rid="CIT0021">21</xref>,<xref ref-type="bibr" rid="CIT0022">22</xref>,<xref ref-type="bibr" rid="CIT0023">23</xref>,<xref ref-type="bibr" rid="CIT0024">24</xref>,<xref ref-type="bibr" rid="CIT0025">25</xref>,<xref ref-type="bibr" rid="CIT0026">26</xref></sup> Assigning codes is further complicated by the multiple possible codes that may apply to a single condition or procedure, depending on severity or treatment type.</p>
<p>In the Western Cape, South Africa, a provincial database was developed that consolidates data from various sources into one of the country&#x2019;s most comprehensive provincial repositories. Algorithms have successfully been developed to identify patients with chronic health conditions such as HIV, hypertension, and diabetes mellitus in this health information system,<sup><xref ref-type="bibr" rid="CIT0027">27</xref>,<xref ref-type="bibr" rid="CIT0028">28</xref>,<xref ref-type="bibr" rid="CIT0029">29</xref>,<xref ref-type="bibr" rid="CIT0030">30</xref></sup> often using laboratory results and prescribed medications as key indicators. However, surgical conditions and procedures lack a distinct, longitudinal clinical signature, making them more challenging to identify.</p>
<p>Internationally, the study by Kleif et al. validated having a diagnosis of appendicitis and a registered appendix removal procedure code in a high-income country (HIC) with a national patient registry.<sup><xref ref-type="bibr" rid="CIT0005">5</xref></sup> Their findings showed that combining diagnostic and procedure codes improved the accuracy of identifying cases. Until now, this type of algorithm has not been validated in an LMIC context, where coding completeness, accuracy and data integration may be more variable.</p>
<p>Appendicitis is one of the most common time-sensitive surgical conditions globally and has a global incidence of 229.9 per 100 000 and a lifetime risk of 7&#x0025;.<sup><xref ref-type="bibr" rid="CIT0031">31</xref>,<xref ref-type="bibr" rid="CIT0032">32</xref></sup> The standard treatment is appendectomy, which is the surgical removal of the appendix. This can be performed laparoscopically or through open surgery, with the choice influenced by disease severity, patient factors, surgeon skill and available resources. In uncomplicated acute appendicitis, conservative management with antibiotics may be considered as an alternative to surgery,<sup><xref ref-type="bibr" rid="CIT0033">33</xref></sup> although the failure rate is still higher than appendectomy. Given the large number of complicated cases and the challenges in outpatient follow-up, this approach is less common in LMICs.</p>
<p>This study addresses a critical gap by developing and validating an appendectomy algorithm for use in an LMIC.</p>
</sec>
<sec id="s0002">
<title>Research methods and design</title>
<sec id="s20003">
<title>Study design</title>
<p>A diagnostic test accuracy study was conducted using routinely collected patient data within the Western Cape public health system.</p>
</sec>
<sec id="s20004">
<title>Development of the algorithm</title>
<p>Algorithm development and validation followed four phases: exploration and selection, algorithm development, refinement and validation (<xref ref-type="fig" rid="F0001">Figure 1</xref>). Secondary data were retrieved from an existing provincial database for 01 January 2019 &#x2013; 31 July 2020 and divided into four datasets, each corresponding to a unique phase.</p>
<fig id="F0001">
<label>FIGURE 1</label>
<caption><p>A summary of the study procedure that comprises four phases.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="JPHIA-16-1536-g001.tif"/>
</fig>
</sec>
<sec id="s20005">
<title>Data source and sampling</title>
<sec id="s30006">
<title>Provincial database</title>
<p>The index test, the appendectomy algorithm, was developed using data from the provincial database, the Provincial Health Data Centre (PHDC), and exist in the Western Cape. The PHDC was established to enhance service delivery in the Western Cape and is a central repository that stores information related to public health care facilities, patients and clinical data. Clinicom&#x2122;, one of the primary sources of data for the PHDC, is based on the Cache&#x2122; hierarchical database and is searched daily for new patient entries, admission and discharge dates, procedure and diagnostic codes. Other sources of data are laboratory and pharmacy data and other databases that were created to help manage priority conditions.<sup><xref ref-type="bibr" rid="CIT0020">20</xref></sup> Gaps in the database include patients&#x2019; histological data and any cause of death information.<sup><xref ref-type="bibr" rid="CIT0020">20</xref></sup></p>
</sec>
<sec id="s30007">
<title>Reference standard: Appendectomy cases and controls</title>
<p>The reference standard comprised appendectomy cases and other general surgery operation controls identified through searching the operative registries of four hospitals known to maintain electronic records. Patients who had a procedure that included the word &#x2018;appendectomy&#x2019; were identified as cases. Each hospital&#x2019;s clerical or clinical staff searched the general surgery operative registries. Variables included the patient&#x2019;s name, surname, date of birth, medical record number, operation date and procedure code or description.</p>
</sec>
</sec>
<sec id="s20008">
<title>Data management and analysis</title>
<p>Microsoft<sup>&#x00AE;</sup> Excel was used to manage the data. The reference standard was shared with the database data scientists as a password-protected Microsoft<sup>&#x00AE;</sup> Excel file. Data scientists deidentified and pseudonymised any data shared with the researcher by assigning each patient a unique study identifier.<sup><xref ref-type="bibr" rid="CIT0034">34</xref></sup></p>
<p>Data analyses were performed using STATA, a statistical software, version 18 (Stata Corp LP, College Station, Texas, United States [US]). For each phase of the algorithm development, we calculated <italic>Sensitivity (Se)</italic> and <italic>Specificity (Sp)</italic> for variables and combinations that met the eligibility criteria (see <xref ref-type="disp-formula" rid="FD1">Equation 1</xref> and <xref ref-type="disp-formula" rid="FD2">Equation 2</xref>):
<disp-formula id="FD1"><alternatives><mml:math display="block" id="M1"><mml:mrow><mml:mi>S</mml:mi><mml:mi>e</mml:mi><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mtext>True positives</mml:mtext></mml:mrow><mml:mrow><mml:mtext>True positives</mml:mtext><mml:mo>+</mml:mo><mml:mtext>False negatives</mml:mtext></mml:mrow></mml:mfrac></mml:mrow></mml:math><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="JPHIA-16-1536-e001.tif"/></alternatives><label>[Eqn 1]</label></disp-formula>
<disp-formula id="FD2"><alternatives><mml:math display="block" id="M2"><mml:mrow><mml:mi>S</mml:mi><mml:mi>p</mml:mi><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mtext>True negatives</mml:mtext></mml:mrow><mml:mrow><mml:mtext>True negatives</mml:mtext><mml:mo>+</mml:mo><mml:mtext>False positives</mml:mtext></mml:mrow></mml:mfrac></mml:mrow></mml:math><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="JPHIA-16-1536-e002.tif"/></alternatives><label>[Eqn 2]</label></disp-formula></p>
<p>In this study, a true positive was a patient listed for appendectomy on the operative list who also had evidence in the provincial database consistent with an appendectomy case. A true negative was a control patient (non-appendectomy) on the operative list who was not identified as a case in the database. False negatives were patients listed as a case on the operative list but not identified as a case in the database using the included variables. False positives were a control on the operative list but were picked up as a case in the database. Various combinations were made within and across selected variables and corresponding values, which was necessary to improve the performance of the final algorithm (<xref ref-type="fig" rid="F0001">Figure 1</xref>).</p>
</sec>
<sec id="s20009">
<title><italic>Sensitivity</italic> and <italic>Specificity</italic> thresholds set for the algorithm</title>
<p>A prior study carried out in Denmark validated an appendicitis and appendectomy algorithm and reported a <italic>Se</italic> and <italic>Sp</italic> of 92.8&#x0025; and 99.5&#x0025;.<sup><xref ref-type="bibr" rid="CIT0005">5</xref></sup> We selected slightly lower thresholds because we expected the data coding and quality to be poorer in an LMIC setting. Therefore, we selected a <italic>Se</italic> of &#x2265; 85&#x0025; to maximise the number of cases identified and a higher <italic>Sp</italic> of &#x2265; 95&#x0025; to minimise the false positives included.</p>
</sec>
<sec id="s20010">
<title>Study procedure</title>
<sec id="s30011">
<title>Phase 1: Variable exploration and selection</title>
<p>All available variables for reference dataset 1 were extracted from the database and explored. Case data were used for algorithm development, and the control data informed the <italic>Se</italic> and <italic>Sp</italic> analysis (<xref ref-type="table" rid="T0001">Table 1</xref>). Variables were included if they were clinically relevant for appendectomy, had complete data and met the predefined <italic>Se</italic> or <italic>Sp</italic> thresholds (<xref ref-type="fig" rid="F0001">Figure 1</xref>). If any of the criteria were not met, the variable was excluded.</p>
<table-wrap id="T0001">
<label>TABLE 1</label>
<caption><p>Procedure codes recorded for appendectomy cases in order of the highest <italic>Se</italic> based on reference dataset 1.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left">Codes</th>
<th align="left">Definition</th>
<th align="center"><italic>Se</italic> (&#x0025;)</th>
<th align="center"><italic>Sp</italic> (&#x0025;)</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">47.01</td>
<td align="left">Laparoscopic appendectomy</td>
<td align="center">23.8</td>
<td align="center">99.9</td>
</tr>
<tr>
<td align="left">47.09</td>
<td align="left">Other appendectomy</td>
<td align="center">9.8</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">54.21</td>
<td align="left">Laparoscopy</td>
<td align="center">4.0</td>
<td align="center">99.6</td>
</tr>
<tr>
<td align="left">47.0</td>
<td align="left">Appendectomy</td>
<td align="center">3.8</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">54.11</td>
<td align="left">Exploratory laparotomy</td>
<td align="center">3.0</td>
<td align="center">99.1</td>
</tr>
<tr>
<td align="left">47.91</td>
<td align="left">Appendicostomy</td>
<td align="center">2.5</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">54.19</td>
<td align="left">Another laparotomy</td>
<td align="center">2.3</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">96.59</td>
<td align="left">Other irrigation of the wound</td>
<td align="center">1.3</td>
<td align="center">98.7</td>
</tr>
<tr>
<td align="left">54.1</td>
<td align="left">Laparotomy</td>
<td align="center">1.0</td>
<td align="center">98.9</td>
</tr>
<tr>
<td align="left">47.9</td>
<td align="left">Other operations on appendix</td>
<td align="center">0.8</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">54.12</td>
<td align="left">Reopening of the recent laparotomy site</td>
<td align="center">0.8</td>
<td align="center">99.8</td>
</tr>
<tr>
<td align="left">93.57</td>
<td align="left">Application of other wound dressings</td>
<td align="center">0.5</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">86.22</td>
<td align="left">Excisional debridement of wound, infection or burn</td>
<td align="center">0.5</td>
<td align="center">98.2</td>
</tr>
<tr>
<td align="left">54.91</td>
<td align="left">Lysis of peritoneal adhesions</td>
<td align="center">0.3</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">99.9</td>
<td align="left">Other miscellaneous procedures</td>
<td align="center">0.3</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">79.3</td>
<td align="left">Open reduction of fracture with internal fixation</td>
<td align="center">0.3</td>
<td align="center">99.8</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s30012">
<title>Phase 2: Algorithm development</title>
<p>Step 1: Variables and corresponding values that met the eligibility criteria were used to extract potential cases from the database. <italic>Se</italic> and <italic>Sp</italic> for each value were calculated and compared with the reference dataset 2. If no individual values met the <italic>Se</italic> or <italic>Sp</italic> threshold, values were combined to improve overall performance. Pairwise, incremental and systematic combinations were created within variables, and <italic>Sp</italic> and <italic>Se</italic> were calculated for each combination. To optimise <italic>Sp</italic>, values within a variable were combined using the &#x2018;AND&#x2019; operator. To optimise <italic>Se</italic>, values were combined using the &#x2018;OR&#x2019; operator.</p>
<p>Step 2: Intervariable combinations were then created to optimise performance further. If the <italic>Se</italic> and <italic>Sp</italic> thresholds were achieved at this stage, the algorithm proceeded to validation (Phase 4). If not, the algorithm was refined.</p>
</sec>
<sec id="s30013">
<title>Phase 3: Algorithm refinement</title>
<p>Phase 2 was repeated by extracting data from the database and creating combinations between the selected variables to achieve the desired <italic>Se</italic> and <italic>Sp</italic> by comparing the results to reference dataset 3 (<xref ref-type="fig" rid="F0001">Figure 1</xref>). This would continue until the optimal <italic>Se</italic> and <italic>Sp</italic> were met, and the algorithm could be validated.</p>
</sec>
<sec id="s30014">
<title>Phase 4: Validation</title>
<p>To validate the final algorithm, the combination of variables and values with the highest <italic>Sp</italic> and <italic>Se</italic> was used to extract cases. The final <italic>Sp</italic> and <italic>Se</italic> were determined and compared with the reference dataset 4 (<xref ref-type="fig" rid="F0001">Figure 1</xref>).</p>
</sec>
</sec>
<sec id="s20015">
<title>Ethical considerations</title>
<p>This study was approved by the Health Research Ethics Committee of Stellenbosch University (S21/02/031 [PhD]), the Health Research Ethics Committee of the University of Cape Town (Project 2021/226) and the Western Cape Department of Health (WC_202104_030).</p>
</sec>
</sec>
<sec id="s0016">
<title>Results</title>
<p>All appendectomy cases (<italic>n</italic> = 1177) and general surgery procedure controls (<italic>n</italic> = 5057) from the study hospitals were included. The reference standard was divided into four datasets for the different study phases (<xref ref-type="fig" rid="F0001">Figure 1</xref>).</p>
<sec id="s20017">
<title>Phase 1: Variable exploration and selection</title>
<p>Two variables in the database met the eligibility criteria, procedure and diagnostic coding. Distinguishing between primary and secondary codes was crucial given that surgical conditions and procedures are often associated with multiple diagnostic and procedure codes. Sixteen primary procedure codes were recorded for cases. While all the codes were &#x2265; 95&#x0025; <italic>Sp</italic>, none on their own met the &#x2265; 85&#x0025; <italic>Se</italic> threshold (<xref ref-type="table" rid="T0001">Table 1</xref>). Laparoscopic appendectomy (47.01) achieved the highest <italic>Se</italic> (23.8&#x0025;) with an <italic>Sp</italic> of 99.9&#x0025; (<xref ref-type="table" rid="T0001">Table 1</xref>), which meant that at least 76.2&#x0025; of appendectomy cases were missed.</p>
<p>Twenty-seven diagnostic codes were associated with the cases (<xref ref-type="table" rid="T0002">Table 2</xref>). Similarly, the diagnostic codes were <italic>Sp</italic> for the cases, while the highest recorded <italic>Se</italic> was 28.5&#x0025;.</p>
<table-wrap id="T0002">
<label>TABLE 2</label>
<caption><p>Diagnostic codes recorded for appendectomy cases in order of the highest <italic>Se</italic> based on reference dataset 1.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left">Codes</th>
<th align="left">Definition</th>
<th align="center"><italic>Se</italic> (&#x0025;)</th>
<th align="center"><italic>Sp</italic> (&#x0025;)</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">K35.8</td>
<td align="left">Acute appendicitis, other and unspecified</td>
<td align="center">28.5</td>
<td align="center">99.8</td>
</tr>
<tr>
<td align="left">K35.3</td>
<td align="left">Acute appendicitis with localised peritonitis</td>
<td align="center">27.8</td>
<td align="center">99.9</td>
</tr>
<tr>
<td align="left">K35.2</td>
<td align="left">Acute appendicitis with generalised peritonitis</td>
<td align="center">12.5</td>
<td align="center">99.5</td>
</tr>
<tr>
<td align="left">R10.4</td>
<td align="left">Other and unspecified abdominal pain</td>
<td align="center">10.3</td>
<td align="center">97.5</td>
</tr>
<tr>
<td align="left">K37</td>
<td align="left">Unspecified appendicitis</td>
<td align="center">9.3</td>
<td align="center">99.9</td>
</tr>
<tr>
<td align="left">K38.9</td>
<td align="left">Disease of the appendix, unspecified</td>
<td align="center">3.8</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">K36</td>
<td align="left">Other appendicitis</td>
<td align="center">2.0</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">N73.9</td>
<td align="left">Female pelvic inflammatory disease, unspecified</td>
<td align="center">1.8</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">R10.0</td>
<td align="left">Acute abdomen</td>
<td align="center">1.3</td>
<td align="center">99.9</td>
</tr>
<tr>
<td align="left">Z03.9</td>
<td align="left">Observation for suspected disease or condition, unspecified</td>
<td align="center">1.3</td>
<td align="center">98.6</td>
</tr>
<tr>
<td align="left">K38</td>
<td align="left">Other diseases of the appendix</td>
<td align="center">1.0</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">A09.9</td>
<td align="left">Gastroenteritis and colitis of unspecified origin</td>
<td align="center">1.0</td>
<td align="center">98.9</td>
</tr>
<tr>
<td align="left">K56.6</td>
<td align="left">Other and unspecified intestinal obstruction</td>
<td align="center">1.0</td>
<td align="center">98.6</td>
</tr>
<tr>
<td align="left">Z53.2</td>
<td align="left">Procedure not carried out because of the patient&#x2019;s decision</td>
<td align="center">0.8</td>
<td align="center">99.1</td>
</tr>
<tr>
<td align="left">N73.8</td>
<td align="left">Other specified female pelvic inflammatory diseases</td>
<td align="center">0.5</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">J22</td>
<td align="left">Unspecified acute lower respiratory infection</td>
<td align="center">0.5</td>
<td align="center">99.6</td>
</tr>
<tr>
<td align="left">R11</td>
<td align="left">Nausea and vomiting</td>
<td align="center">0.5</td>
<td align="center">99.6</td>
</tr>
<tr>
<td align="left">A41.9</td>
<td align="left">Sepsis, unspecified organism</td>
<td align="center">0.5</td>
<td align="center">98.0</td>
</tr>
<tr>
<td align="left">K38.3</td>
<td align="left">Mucocele of the appendix</td>
<td align="center">0.3</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">F50</td>
<td align="left">Eating disorders (e.g. anorexia nervosa, bulimia)</td>
<td align="center">0.3</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">G70.0</td>
<td align="left">Myasthenia gravis without (acute) exacerbation</td>
<td align="center">0.3</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">K56.5</td>
<td align="left">Intestinal adhesions (bands) with obstruction (postoperative)</td>
<td align="center">0.3</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">N11.0</td>
<td align="left">Chronic pyelonephritis</td>
<td align="center">0.3</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">N30.0</td>
<td align="left">Acute cystitis</td>
<td align="center">0.3</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">S40.9</td>
<td align="left">Superficial injury of the shoulder and upper arm, unspecified</td>
<td align="center">0.3</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">K38.8</td>
<td align="left">Other specified diseases of the appendix</td>
<td align="center">0.3</td>
<td align="center">100.0</td>
</tr>
<tr>
<td align="left">R52.9</td>
<td align="left">Pain, unspecified</td>
<td align="center">0.3</td>
<td align="center">99.6</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Given the overall low <italic>Se</italic> of all procedure and diagnostic codes, based on clinical association with appendectomy, procedure codes with the words &#x2018;appendectomy&#x2019;, &#x2018;laparotomy&#x2019; OR &#x2018;laparoscopy&#x2019; OR diagnostic codes containing the words &#x2018;appendicitis&#x2019; OR &#x2018;appendix&#x2019; were included in the algorithm (<xref ref-type="table" rid="T0001">Table 1</xref> and <xref ref-type="table" rid="T0002">Table 2</xref>).</p>
</sec>
<sec id="s20018">
<title>Phase 2: Algorithm development</title>
<p>The selected codes were used to extract potential cases from the database and compared with the reference dataset 2. All but one of the codes (47.09 &#x2013; other appendectomy) were &#x2265; 95&#x0025; <italic>Sp;</italic> however, none were &#x2265; 85&#x0025; <italic>Se</italic> (<xref ref-type="table" rid="T0003">Table 3</xref>).</p>
<table-wrap id="T0003">
<label>TABLE 3</label>
<caption><p>Selected procedure and diagnostic codes for inclusion in the appendectomy algorithm and the relevant <italic>Se</italic> and <italic>Sp</italic>, using reference dataset 2.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left">Variable</th>
<th align="left">Codes</th>
<th align="center"><italic>Se</italic> (&#x0025;)</th>
<th align="center"><italic>Sp</italic> (&#x0025;)</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" rowspan="9">Procedure codes</td>
<td align="left">47.0 &#x2013; Appendectomy</td>
<td align="center">33.3</td>
<td align="center">96.7</td>
</tr>
<tr>
<td align="left">47.01 &#x2013; Laparoscopic appendectomy</td>
<td align="center">23.7</td>
<td align="center">97.5</td>
</tr>
<tr>
<td align="left">47.91 &#x2013; Appendicostomy</td>
<td align="center">23.7</td>
<td align="center">97.4</td>
</tr>
<tr>
<td align="left">47.9 &#x2013; Other operations on the appendix</td>
<td align="center">23.3</td>
<td align="center">97.4</td>
</tr>
<tr>
<td align="left">54.11 &#x2013; Exploratory laparotomy</td>
<td align="center">17.0</td>
<td align="center">96.3</td>
</tr>
<tr>
<td align="left">47.09 &#x2013; Other appendectomy</td>
<td align="center">16.3</td>
<td align="center">90.6</td>
</tr>
<tr>
<td align="left">54.21 &#x2013; Laparoscopy</td>
<td align="center">15.3</td>
<td align="center">99.3</td>
</tr>
<tr>
<td align="left">54.19 &#x2013; Other laparotomy</td>
<td align="center">13.0</td>
<td align="center">99.5</td>
</tr>
<tr>
<td align="left">54.1 &#x2013; Laparotomy</td>
<td align="center">3.3</td>
<td align="center">98.6</td>
</tr>
<tr>
<td align="left" rowspan="9">Diagnostic codes</td>
<td align="left">K35.8 &#x2013; Acute appendicitis, other and unspecified</td>
<td align="center">41.3</td>
<td align="center">96.2</td>
</tr>
<tr>
<td align="left">K35.2 &#x2013; Acute appendicitis with generalised peritonitis</td>
<td align="center">40.7</td>
<td align="center">95.6</td>
</tr>
<tr>
<td align="left">K35.3 &#x2013; Acute appendicitis with localised peritonitis</td>
<td align="center">25.3</td>
<td align="center">97.3</td>
</tr>
<tr>
<td align="left">K37 &#x2013; Unspecified appendicitis</td>
<td align="center">7.3</td>
<td align="center">96.4</td>
</tr>
<tr>
<td align="left">K38.9 &#x2013; Disease of appendix, unspecified</td>
<td align="center">5.3</td>
<td align="center">98.2</td>
</tr>
<tr>
<td align="left">K38.3 &#x2013; Fistula of the appendix</td>
<td align="center">4.3</td>
<td align="center">97.8</td>
</tr>
<tr>
<td align="left">K36 &#x2013; Other appendicitis</td>
<td align="center">3.0</td>
<td align="center">98.6</td>
</tr>
<tr>
<td align="left">K38.0 &#x2013; Hyperplasia of the appendix</td>
<td align="center">1.3</td>
<td align="center">99.3</td>
</tr>
<tr>
<td align="left">K38.8 &#x2013; Other specified diseases of the appendix</td>
<td align="center">0.3</td>
<td align="center">99.4</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Stepwise combinations were made within procedure codes to optimise the algorithm&#x2019;s performance. The &#x2018;OR&#x2019; combinations led to a higher <italic>Se</italic> while reducing the algorithm&#x2019;s <italic>Sp</italic>. Combinations with &#x2018;AND&#x2019; showed the opposite results, with a very low <italic>Se</italic> and nearly 100&#x0025; <italic>Sp</italic>. Similar findings were observed for diagnostic codes. In the process of combining procedure and diagnostic codes separated with the &#x2018;OR&#x2019; operator, two procedure codes were dropped &#x2013; &#x2018;Exploratory laparotomy&#x2019; and &#x2018;Other appendectomy&#x2019; &#x2013; because of their effect on the overall <italic>Se</italic> of the algorithm. The highest <italic>Se</italic> achieved was 64&#x0025;, with a lowered <italic>Sp</italic> of 90&#x0025; by P&#x0026;D Combo53_or (Procedure codes [&#x2018;Appendectomy&#x2019; OR &#x2018;Laparoscopic appendectomy&#x2019; OR &#x2018;Other laparotomy&#x2019;] OR Diagnostic codes [&#x2018;Acute appendicitis, other and unspecified&#x2019; OR &#x2018;Acute appendicitis with generalised peritonitis&#x2019; OR &#x2018;Acute appendicitis with localised peritonitis&#x2019;]). Therefore, the algorithm required further refining before it could be finalised.</p>
</sec>
<sec id="s20019">
<title>Phase 3: Algorithm refinement</title>
<p>The algorithm combinations from Phase 2 were further refined. This meant reordering the codes to achieve the highest <italic>Se</italic> and <italic>Sp</italic>. The results are shown in <xref ref-type="table" rid="T0004">Table 4</xref>. Any one of two procedures or nine diagnostic codes (P&#x0026;D Combo1_or) could identify a case in the provincial database.</p>
<table-wrap id="T0004">
<label>TABLE 4</label>
<caption><p>Combinations of codes from procedure and diagnostic codes and the <italic>Se</italic> and <italic>Sp</italic> analysis based on reference dataset 3.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left">Values and combinations</th>
<th align="center"><italic>Se</italic> (&#x0025;)</th>
<th align="center"><italic>Sp</italic> (&#x0025;)</th>
<th align="center">47.0 &#x2013; Appendectomy</th>
<th align="center">47.01 &#x2013; Laparoscopic appendectomy</th>
<th align="center">47.91 &#x2013; Appendicostomy</th>
<th align="center">47.9 &#x2013; Other operations on the appendix</th>
<th align="center">54.21 &#x2013; Laparoscopy</th>
<th align="center">54.19 &#x2013; Other laparotomy</th>
<th align="center">54.1 &#x2013; Laparotomy</th>
<th align="center">K35.8 &#x2013; Acute appendicitis, other and unspecified</th>
<th align="center">K35.2 &#x2013; Acute appendicitis with generalised peritonitis</th>
<th align="center">K35.3 &#x2013; Acute appendicitis with localised peritonitis</th>
<th align="center">K37 &#x2013; Unspecified appendicitis</th>
<th align="center">K38.9 &#x2013; Disease of appendix, unspecified</th>
<th align="center">K38.3 &#x2013; Fistula of the appendix</th>
<th align="center">K36 &#x2013; Other appendicitis</th>
<th align="center">K38.0 &#x2013; Hyperplasia of the appendix</th>
<th align="center">K38.8 &#x2013; Other specified diseases of the appendix</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">P&#x0026;D_Combo1_or</td>
<td align="center">90.2</td>
<td align="center">96.8</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
</tr>
<tr>
<td align="left">P&#x0026;D_Combo2_or</td>
<td align="center">86.4</td>
<td align="center">93.9</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
</tr>
<tr>
<td align="left">P&#x0026;D_Combo3_or</td>
<td align="center">85.4</td>
<td align="center">97.3</td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="left"></td>
<td align="left"></td>
<td align="left"></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
</tr>
<tr>
<td align="left">P&#x0026;D_Combo4_or</td>
<td align="center">85.4</td>
<td align="center">97.1</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
</tr>
<tr>
<td align="left">P&#x0026;D_Combo5_or</td>
<td align="center">85.4</td>
<td align="center">97.1</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
</tr>
<tr>
<td align="left">P&#x0026;D_Combo6_or</td>
<td align="center">84.2</td>
<td align="center">96.6</td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
</tr>
<tr>
<td align="left">P&#x0026;D_Combo7_or</td>
<td align="center">84.2</td>
<td align="center">96.4</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
</tr>
<tr>
<td align="left">P&#x0026;D_Combo8_or</td>
<td align="center">83.9</td>
<td align="center">97.2</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
</tr>
<tr>
<td align="left">P&#x0026;D_Combo9_or</td>
<td align="center">83.9</td>
<td align="center">97.2</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
</tr>
<tr>
<td align="left">P&#x0026;D_Combo10_or</td>
<td align="center">83.2</td>
<td align="center">97.2</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
</tr>
<tr>
<td align="left">P&#x0026;D_Combo11_or</td>
<td align="center">81.6</td>
<td align="center">97.3</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
</tr>
<tr>
<td align="left">P&#x0026;D_Combo12_or</td>
<td align="center">81.6</td>
<td align="center">97.3</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
</tr>
<tr>
<td align="left">P&#x0026;D_Combo13_or</td>
<td align="center">72.8</td>
<td align="center">97.5</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
</tr>
<tr>
<td align="left">P&#x0026;D_Combo14_or</td>
<td align="center">70.6</td>
<td align="center">97.2</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
</tr>
<tr>
<td align="left">P&#x0026;D_Combo15_or</td>
<td align="center">64.2</td>
<td align="center">97.3</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
</tr>
<tr>
<td align="left">P&#x0026;D_Combo16_or</td>
<td align="center">62.0</td>
<td align="center">97.3</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0001">&#x2020;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center">-</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0002">&#x2021;</xref></td>
<td align="center">-</td>
<td align="center">-</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p>P&#x0026;D, procedure and diagnostic.</p></fn>
<fn id="TFN0001"><label>&#x2020;</label><p>, Procedure codes included in the relevant combination(s);</p></fn>
<fn id="TFN0002"><label>&#x2021;</label><p>, Diagnostic codes included in the relevant combination(s).</p></fn>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="s20020">
<title>Phase 4: Validation</title>
<p>The final algorithm comprised procedure codes (&#x2018;Appendectomy&#x2019; OR &#x2018;Laparoscopic appendectomy&#x2019;) OR diagnostic codes (&#x2018;Acute appendicitis, other and unspecified&#x2019; OR &#x2018;Acute appendicitis with generalised peritonitis&#x2019; OR &#x2018;Acute appendicitis with localised peritonitis&#x2019; OR &#x2018;Unspecified appendicitis&#x2019; OR &#x2018;Disease of appendix, unspecified&#x2019; OR &#x2018;Fistula of appendix&#x2019; OR &#x2018;Other appendicitis&#x2019; OR &#x2018;Hyperplasia of appendix&#x2019; OR &#x2018;Other specified diseases of appendix&#x2019;) and was validated using reference dataset 4. A final <italic>Se</italic> of 91.3&#x0025; and an <italic>Sp</italic> of 96&#x0025; were confirmed (<xref ref-type="table" rid="T0005">Table 5</xref>).</p>
<table-wrap id="T0005">
<label>TABLE 5</label>
<caption><p>The final algorithm including the <italic>Se</italic> and <italic>Sp</italic> analysis results using reference dataset 4.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left">Values and combinations</th>
<th align="center"><italic>Se</italic> (&#x0025;)</th>
<th align="center"><italic>Sp</italic> (&#x0025;)</th>
<th align="center">47.0 &#x2013; Appendectomy</th>
<th align="center">47.01 &#x2013; Laparoscopic appendectomy</th>
<th align="center">K35.8 &#x2013; Acute appendicitis, other and unspecified</th>
<th align="center">K35.2 &#x2013; Acute appendicitis with generalised peritonitis</th>
<th align="center">K35.3 &#x2013; Acute appendicitis with localised peritonitis</th>
<th align="center">K37 &#x2013; Unspecified appendicitis</th>
<th align="center">K38.9 &#x2013; Disease of appendix, unspecified</th>
<th align="center">K38.3 &#x2013; Fistula of the appendix</th>
<th align="center">K36 &#x2013; Other appendicitis</th>
<th align="center">K38.0 &#x2013; Hyperplasia of the appendix</th>
<th align="center">K38.8 &#x2013; Other specified diseases of the appendix</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">P&#x0026;D_Combo1_or</td>
<td align="center">91.3</td>
<td align="center">96.0</td>
<td align="center"><xref ref-type="table-fn" rid="TFN0003">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0003">&#x2020;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0004">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0004">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0004">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0004">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0004">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0004">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0004">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0004">&#x2021;</xref></td>
<td align="center"><xref ref-type="table-fn" rid="TFN0004">&#x2021;</xref></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p>P&#x0026;D, procedure and diagnostic.</p></fn>
<fn id="TFN0003"><label>&#x2020;</label><p>, Procedure codes included in the relevant combination(s);</p></fn>
<fn id="TFN0004"><label>&#x2021;</label><p>, Diagnostic codes included in the relevant combination(s).</p></fn>
</table-wrap-foot>
</table-wrap>
</sec>
</sec>
<sec id="s0021">
<title>Discussion</title>
<p>Data on surgical procedures are severely lacking in South Africa. The provincial database in the Western Cape, South Africa, is one of the few databases in the country and is continually refined. Several algorithms have been developed to identify pregnant women and persons with certain comorbidities for use in these databases.<sup><xref ref-type="bibr" rid="CIT0027">27</xref>,<xref ref-type="bibr" rid="CIT0028">28</xref>,<xref ref-type="bibr" rid="CIT0029">29</xref>,<xref ref-type="bibr" rid="CIT0030">30</xref></sup> However, surgical conditions and procedure algorithms are more challenging to develop owing to the lack of a unique clinical signature.<sup><xref ref-type="bibr" rid="CIT0020">20</xref></sup> Our study highlights the potential for similar approaches to be applied to other surgical procedures in comparable settings such as South Africa.</p>
<p>Our study found similar results to an HIC study, validating diagnostic and procedure codes as the best variables to identify appendectomy cases. Initially, we had hypothesised that other variables might be more <italic>Se</italic> and <italic>Sp</italic> to identify appendectomy cases because coding can be a real challenge in LMICs. However, data completeness varied across facilities, and only two variables, procedure and diagnostic codes, met the eligibility criteria for inclusion in the algorithm. Many public hospitals still rely on surgical logbooks and other paper-based systems, which leads to incomplete, inaccessible and inconsistent patient data in LMICs.<sup><xref ref-type="bibr" rid="CIT0035">35</xref>,<xref ref-type="bibr" rid="CIT0036">36</xref></sup> Although e-health systems are used in some facilities, integrating them into a unified national system remains a challenge in LMICs.<sup><xref ref-type="bibr" rid="CIT0037">37</xref></sup> Barriers include a lack of national leadership and coordination, insufficient understanding of the requirements of scaling up, workforce shortages and a lack of investment in infrastructure.<sup><xref ref-type="bibr" rid="CIT0037">37</xref></sup></p>
<p>In our dataset, appendectomy cases were associated with 16 procedures and 27 diagnostic codes, and nine of each variable were selected based on the eligibility criteria. These codes had high <italic>Sp</italic> but low <italic>Se</italic>, highlighting the quality of coding practices in the public health sector in LMICs compared to HICs. Similar findings were observed in other studies that showed International Classification of Diseases (ICD) coding often has a high <italic>Sp</italic> but low <italic>Se</italic>.<sup><xref ref-type="bibr" rid="CIT0007">7</xref>,<xref ref-type="bibr" rid="CIT0008">8</xref>,<xref ref-type="bibr" rid="CIT0009">9</xref>,<xref ref-type="bibr" rid="CIT0010">10</xref>,<xref ref-type="bibr" rid="CIT0011">11</xref>,<xref ref-type="bibr" rid="CIT0012">12</xref>,<xref ref-type="bibr" rid="CIT0013">13</xref>,<xref ref-type="bibr" rid="CIT0014">14</xref>,<xref ref-type="bibr" rid="CIT0015">15</xref>,<xref ref-type="bibr" rid="CIT0016">16</xref>,<xref ref-type="bibr" rid="CIT0017">17</xref></sup> The coding quality could be affected by insufficient numbers of adequately trained staff or a lack of a large enough workforce. A South African study assessing a training and support programme for discharge ICD coding at two central hospitals found improved completeness but no change in the accuracy of primary ICD codes.<sup><xref ref-type="bibr" rid="CIT0019">19</xref></sup> The authors recommended that policymakers consider implementing affordable components of such interventions to enhance coding quality.<sup><xref ref-type="bibr" rid="CIT0019">19</xref></sup> Increasing the workforce supply could also potentially improve the quality of coding practices, enabling adequate time to dedicate to these practices.</p>
<p>Beyond its immediate application to appendectomy, this study demonstrates the potential of validated algorithms to address the broader gap in data on the number and types of surgical procedures performed over a defined period in LMICs. This is a crucial Lancet indicator and serves as a measure of the strength of the national surgical system while contributing to our understanding of surgical capacity. In many LMICs, including South Africa, these metrics are poorly documented because of fragmented data systems and the absence of dedicated operative registries. By showing that a reliable algorithm can be developed from routinely collected health information system data, our work provides a methodological framework that could be adapted to identify other surgical procedures, enabling more accurate measurement of surgery. This, in turn, could strengthen surgical surveillance, inform workforce and infrastructure planning and guide policy decisions to improve access to safe, timely surgical care.</p>
<sec id="s20022">
<title>Limitations</title>
<p>The creation of the algorithm was limited by the quality of healthcare records and the number of variables that were <italic>Sp</italic> and sufficiently completed for appendectomy. Despite these limitations, the final algorithm achieved high <italic>Se</italic> and <italic>Sp</italic>. Our algorithm was based on the coding used in the ICD-9 and ICD-10 coding systems and should be revisited with the adoption and use of ICD-11. The reference standard comprised patients from four selected hospitals where diagnostic and procedure codes were 100&#x0025; complete. However, this level of completeness might not be consistent across facilities in South Africa. Therefore, a follow-up study is recommended to assess the algorithm&#x2019;s performance across healthcare settings.</p>
</sec>
</sec>
<sec id="s0023">
<title>Conclusion</title>
<p>This study demonstrates the feasibility of developing and validating a high-performing appendectomy algorithm within an LMIC database. Using routinely collected data from the Western Cape provincial database, the algorithm achieved high <italic>Se</italic> and <italic>Sp</italic> despite variability in coding completeness and quality across facilities. Differences in data infrastructure, coding practices, and resource availability influence algorithm performance in LMICs compared to HICs. Importantly, this work addresses a critical gap in LMIC surgical data by providing a reproducible method for identifying a specific surgical procedure from routine health information system data. Such algorithms can be adapted to improve the availability and accessibility of data on surgical conditions and procedures regarding range and volume on a large scale. Strengthening these data streams is essential for monitoring surgical capacity, guiding resource allocation and informing policy to improve equitable access to safe, timely surgical care.</p>
</sec>
</body>
<back>
<ack>
<title>Acknowledgements</title>
<p>The authors would like to acknowledge the data scientists at the Provincial Health Data Centre, and the health care providers at the study hospitals for their assistance with the data required for the study.</p>
<p>This article is based on research originally conducted as part of J.L.&#x2019;s doctoral thesis titled &#x2018;Exploring Pathways to Accessing Care for Appendectomy in the Western Cape Government Health System, South Africa&#x2019;, submitted to the Department of Global Health, Faculty of Medicine and Health Sciences, Stellenbosch University in 2025. The thesis was supervised by Kathryn Chu, Rene English, and Peter Nyasulu. The article has since been revised and adapted for journal publication.</p>
<p>The author, P.N., serves as an editorial board member of this journal. P.N. has no other competing interests to declare.</p>
<sec id="s20024" sec-type="COI-statement">
<title>Competing interests</title>
<p>The author reported that they received funding from the National Research Foundation, which may be affected by the research reported in the enclosed publication. The author has disclosed those interests fully and has implemented an approved plan for managing any potential conflicts arising from their involvement. The terms of these funding arrangements have been reviewed and approved by the affiliated university in accordance with its policy on objectivity in research.</p>
</sec>
<sec id="s20025">
<title>Authors&#x2019; contributions</title>
<p>K.C. and J.L. conceived the study and contributed to the design of the study. J.L. analysed the data and wrote the first draft of the article. K.C., P.N. and R.E. reviewed the first draft and edited the article. All authors reviewed and approved the final version of the article.</p>
</sec>
<sec id="s20026" sec-type="data-availability">
<title>Data availability</title>
<p>The data that support the findings of this study are available from the corresponding author, J.L., upon reasonable request.</p>
</sec>
<sec id="s20027">
<title>Disclaimer</title>
<p>The views and opinions expressed in this article are those of the authors and are the product of professional research. They do not necessarily reflect the official policy or position of any affiliated institution, funder, agency or that of the publisher. The authors are responsible for this article&#x2019;s results, findings and content.</p>
</sec>
</ack>
<ref-list id="references">
<title>References</title>
<ref id="CIT0001"><label>1</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Meara</surname> <given-names>JG</given-names></string-name>, <string-name><surname>Greenberg</surname> <given-names>SLM</given-names></string-name></person-group>. <article-title>The Lancet Commission on global surgery global surgery 2030: Evidence and solutions for achieving health, welfare and economic development</article-title>. <source>Surgery (United States)</source>. <year>2015</year>;<volume>157</volume>(<issue>5</issue>):<fpage>834</fpage>&#x2013;<lpage>835</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.surg.2015.02.009">https://doi.org/10.1016/j.surg.2015.02.009</ext-link></comment></mixed-citation></ref>
<ref id="CIT0002"><label>2</label><mixed-citation publication-type="web"><person-group person-group-type="author"><collab>World Bank Group</collab></person-group>. <source>Surgery could save millions of lives in developing countries [homepage on the Internet]. DCP3 and essential surgery 2015</source>. <comment>[cited 2024 Dec 17]. Available from: <ext-link ext-link-type="uri" xlink:href="https://www.worldbank.org/en/news/feature/2015/03/26/surgery-could-save-millions-of-lives-in-developing-countries">https://www.worldbank.org/en/news/feature/2015/03/26/surgery-could-save-millions-of-lives-in-developing-countries</ext-link>.</comment></mixed-citation></ref>
<ref id="CIT0003"><label>3</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Farmer</surname> <given-names>PE</given-names></string-name>, <string-name><surname>Kim</surname> <given-names>JY</given-names></string-name></person-group>. <article-title>Surgery and global health: A view from beyond the OR</article-title>. <source>World J Surg</source>. <year>2008</year>;<volume>32</volume>(<issue>4</issue>):<fpage>533</fpage>&#x2013;<lpage>536</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s00268-008-9525-9">https://doi.org/10.1007/s00268-008-9525-9</ext-link></comment></mixed-citation></ref>
<ref id="CIT0004"><label>4</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Subramanian</surname> <given-names>MP</given-names></string-name>, <string-name><surname>Hu</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Puri</surname> <given-names>V</given-names></string-name>, <string-name><surname>Kozower</surname> <given-names>BD</given-names></string-name></person-group>. <article-title>Administrative versus clinical databases</article-title>. <source>J Thorac Cardiovasc Surg</source>. <year>2021</year>;<volume>162</volume>(<issue>4</issue>):<fpage>1173</fpage>&#x2013;<lpage>1176</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.jtcvs.2020.03.183">https://doi.org/10.1016/j.jtcvs.2020.03.183</ext-link></comment></mixed-citation></ref>
<ref id="CIT0005"><label>5</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Kleif</surname> <given-names>J</given-names></string-name>, <string-name><surname>Thygesen</surname> <given-names>LC</given-names></string-name>, <string-name><surname>G&#x00F6;genur</surname> <given-names>I</given-names></string-name></person-group>. <article-title>Validity of the diagnosis of appendicitis in the Danish National Patient Register</article-title>. <source>Scand J Public Health</source>. <year>2020</year>;<volume>48</volume>(<issue>1</issue>):<fpage>38</fpage>&#x2013;<lpage>42</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/1403494818761765">https://doi.org/10.1177/1403494818761765</ext-link></comment></mixed-citation></ref>
<ref id="CIT0006"><label>6</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Kluyts</surname> <given-names>HL</given-names></string-name>, <string-name><surname>Biccard</surname> <given-names>BM</given-names></string-name></person-group>. <article-title>The role of peri-operative registries in improving the quality of care in low-resource environments</article-title>. <source>Anaesthesia</source>. <year>2021</year>;<volume>76</volume>(<issue>7</issue>):<fpage>888</fpage>&#x2013;<lpage>891</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1111/anae.15445">https://doi.org/10.1111/anae.15445</ext-link></comment></mixed-citation></ref>
<ref id="CIT0007"><label>7</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Ehrenstein</surname> <given-names>V</given-names></string-name>, <string-name><surname>Petersen</surname> <given-names>I</given-names></string-name>, <string-name><surname>Smeeth</surname> <given-names>L</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Helping everyone do better: A call for validation studies of routinely recorded health data</article-title>. <source>Clin Epidemiol</source>. <year>2016</year>;<volume>8</volume>:<fpage>49</fpage>&#x2013;<lpage>51</lpage>.</mixed-citation></ref>
<ref id="CIT0008"><label>8</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Paleczny</surname> <given-names>S</given-names></string-name>, <string-name><surname>Osagie</surname> <given-names>N</given-names></string-name>, <string-name><surname>Sethi</surname> <given-names>J</given-names></string-name>, <string-name><surname>Cusimano</surname> <given-names>MD</given-names></string-name></person-group>. <article-title>Validity and reliability International Classification of Diseases-10 codes for all forms of injury: A systematic review</article-title>. <source>PLoS One</source>. <year>2024</year>;<volume>19</volume>(<issue>2</issue>):<fpage>e0298411</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1371/journal.pone.0298411">https://doi.org/10.1371/journal.pone.0298411</ext-link></comment></mixed-citation></ref>
<ref id="CIT0009"><label>9</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Peng</surname> <given-names>M</given-names></string-name>, <string-name><surname>Eastwood</surname> <given-names>C</given-names></string-name>, <string-name><surname>Boxill</surname> <given-names>A</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Coding reliability and agreement of International Classification of Disease, 10th revision (ICD-10) codes in emergency department data</article-title>. <source>Int J Popul Data Sci</source>. <year>2018</year>;<volume>3</volume>(<issue>1</issue>):<fpage>445</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.23889/ijpds.v3i1.445">https://doi.org/10.23889/ijpds.v3i1.445</ext-link></comment></mixed-citation></ref>
<ref id="CIT0010"><label>10</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Shrestha</surname> <given-names>S</given-names></string-name>, <string-name><surname>Dave</surname> <given-names>AJ</given-names></string-name>, <string-name><surname>Losina</surname> <given-names>E</given-names></string-name>, <string-name><surname>Katz</surname> <given-names>JN</given-names></string-name></person-group>. <article-title>Diagnostic accuracy of administrative data algorithms in the diagnosis of osteoarthritis: A systematic review</article-title>. <source>BMC Med Inform Decis Mak</source>. <year>2016</year>;<volume>16</volume>(<issue>1</issue>):<fpage>82</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1186/s12911-016-0319-y">https://doi.org/10.1186/s12911-016-0319-y</ext-link></comment></mixed-citation></ref>
<ref id="CIT0011"><label>11</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Oger</surname> <given-names>E</given-names></string-name>, <string-name><surname>Botrel</surname> <given-names>MA</given-names></string-name>, <string-name><surname>Juchault</surname> <given-names>C</given-names></string-name>, <string-name><surname>Bouget</surname> <given-names>J</given-names></string-name></person-group>. <article-title>Sensitivity and specificity of an algorithm based on medico-administrative data to identify hospitalized patients with major bleeding presenting to an emergency department</article-title>. <source>BMC Med Res Methodol</source>. <year>2019</year>;<volume>19</volume>(<issue>1</issue>):<fpage>1</fpage>&#x2013;<lpage>7</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1186/s12874-019-0841-6">https://doi.org/10.1186/s12874-019-0841-6</ext-link></comment></mixed-citation></ref>
<ref id="CIT0012"><label>12</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Thurin</surname> <given-names>NH</given-names></string-name>, <string-name><surname>Bosco-Levy</surname> <given-names>P</given-names></string-name>, <string-name><surname>Blin</surname> <given-names>P</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Intra-database validation of case-identifying algorithms using reconstituted electronic health records from healthcare claims data</article-title>. <source>BMC Med Res Methodol</source>. <year>2021</year>;<volume>21</volume>(<issue>1</issue>):<fpage>95</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1186/s12874-021-01285-y">https://doi.org/10.1186/s12874-021-01285-y</ext-link></comment></mixed-citation></ref>
<ref id="CIT0013"><label>13</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Jacob</surname> <given-names>N</given-names></string-name>, <string-name><surname>Rice</surname> <given-names>B</given-names></string-name>, <string-name><surname>Kalk</surname> <given-names>E</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Digitising point of care HIV test results to accurately measure, and improve performance towards, the UNAIDS 90-90-90 targets</article-title>. <source>medRxiv</source>. <volume>15</volume>:<fpage>19012302</fpage>.</mixed-citation></ref>
<ref id="CIT0014"><label>14</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Arroyo-Rangel</surname> <given-names>C</given-names></string-name>, <string-name><surname>Lim&#x00F3;n</surname> <given-names>IO</given-names></string-name>, <string-name><surname>Vera</surname> <given-names>&#x00C1;G</given-names></string-name>, <string-name><surname>Guardiola</surname> <given-names>PM</given-names></string-name>, <string-name><surname>S&#x00E1;nchez-Valdivieso</surname> <given-names>EA</given-names></string-name></person-group>. <article-title>Sensitivity, specificity and reliability of the RIPASA Score for diagnosis of acute appendicitis in relation to the Alvarado Score</article-title>. <source>Cir Esp (Engl Ed)</source>. <year>2018</year>;<volume>96</volume>(<issue>3</issue>):<fpage>149</fpage>&#x2013;<lpage>154</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.cireng.2017.11.014">https://doi.org/10.1016/j.cireng.2017.11.014</ext-link></comment></mixed-citation></ref>
<ref id="CIT0015"><label>15</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Al-Wageeh</surname> <given-names>S</given-names></string-name>, <string-name><surname>Alyhari</surname> <given-names>QA</given-names></string-name>, <string-name><surname>Ahmed</surname> <given-names>F</given-names></string-name>, <string-name><surname>Altam</surname> <given-names>A</given-names></string-name>, <string-name><surname>Alshehari</surname> <given-names>G</given-names></string-name>, <string-name><surname>Badheeb</surname> <given-names>M</given-names></string-name></person-group>. <article-title>Evaluating the diagnostic accuracy of the Alvarado score and abdominal ultrasound for acute appendicitis: A retrospective single-center study</article-title>. <source>Open Access Emerg Med</source>. <year>2024</year>;<volume>16</volume>:<fpage>159</fpage>&#x2013;<lpage>166</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.2147/OAEM.S462013">https://doi.org/10.2147/OAEM.S462013</ext-link></comment></mixed-citation></ref>
<ref id="CIT0016"><label>16</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Pifeleti</surname> <given-names>S</given-names></string-name>, <string-name><surname>Hansell</surname> <given-names>D</given-names></string-name>, <string-name><surname>Kaspar</surname> <given-names>A</given-names></string-name></person-group>. <article-title>Sensitivity and specificity of the Alvarado Score for the timely differential diagnosis of acute appendicitis for a case series in Samoa</article-title>. <source>Ann Med Surg</source>. <year>2022</year>;<volume>73</volume>:<fpage>103219</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.amsu.2021.103219">https://doi.org/10.1016/j.amsu.2021.103219</ext-link></comment></mixed-citation></ref>
<ref id="CIT0017"><label>17</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Elsherbiny</surname> <given-names>MW</given-names></string-name>, <string-name><surname>Emile</surname> <given-names>SH</given-names></string-name>, <string-name><surname>Abdelnaby</surname> <given-names>M</given-names></string-name>, <string-name><surname>Khafagy</surname> <given-names>W</given-names></string-name>, <string-name><surname>Elshobaky</surname> <given-names>A</given-names></string-name></person-group>. <article-title>Assessment of the diagnostic accuracy of alvarado scoring system combined with focused ultrasound in the diagnosis of acute appendicitis</article-title>. <source>J Br Surg</source>. <year>2020</year>;<volume>107</volume>(<issue>12</issue>):<fpage>e594</fpage>&#x2013;<lpage>e595</lpage>.</mixed-citation></ref>
<ref id="CIT0018"><label>18</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Fonnes</surname> <given-names>S</given-names></string-name>, <string-name><surname>Erichsen</surname> <given-names>R</given-names></string-name>, <string-name><surname>Rosenberg</surname> <given-names>J</given-names></string-name></person-group>. <article-title>Validity of the coding for appendicitis, appendectomy, and diagnostic laparoscopy in the Danish National Patient Registry</article-title>. <source>Scand J Surg</source>. <year>2023</year>;<volume>112</volume>(<issue>1</issue>):<fpage>48</fpage>&#x2013;<lpage>55</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/14574969221148078">https://doi.org/10.1177/14574969221148078</ext-link></comment></mixed-citation></ref>
<ref id="CIT0019"><label>19</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Dyers</surname> <given-names>R</given-names></string-name>, <string-name><surname>Ward</surname> <given-names>G</given-names></string-name>, <string-name><surname>Du Plooy</surname> <given-names>S</given-names></string-name>, <string-name><surname>Fourie</surname> <given-names>S</given-names></string-name>, <string-name><surname>Evans</surname> <given-names>J</given-names></string-name>, <string-name><surname>Mahomed</surname> <given-names>H</given-names></string-name></person-group>. <article-title>Training and support to improve ICD coding quality: A controlled before-and-after impact evaluation</article-title>. <source>S Afr Med J</source>. <year>2017</year>;<volume>107</volume>(<issue>6</issue>):<fpage>501</fpage>&#x2013;<lpage>506</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.7196/SAMJ.2017.v107i6.12075">https://doi.org/10.7196/SAMJ.2017.v107i6.12075</ext-link></comment></mixed-citation></ref>
<ref id="CIT0020"><label>20</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Boulle</surname> <given-names>A</given-names></string-name>, <string-name><surname>Heekes</surname> <given-names>A</given-names></string-name>, <string-name><surname>Tiffin</surname> <given-names>N</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Data centre profile: The provincial health data centre of the Western Cape Province, South Africa</article-title>. <source>Int J Popul Data Sci</source>. <year>2019</year>;<volume>4</volume>(<issue>2</issue>):<fpage>1</fpage>&#x2013;<lpage>11</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.23889/ijpds.v4i2.1143">https://doi.org/10.23889/ijpds.v4i2.1143</ext-link></comment></mixed-citation></ref>
<ref id="CIT0021"><label>21</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Duraiswamy</surname> <given-names>S</given-names></string-name>, <string-name><surname>Ignacio</surname> <given-names>A</given-names></string-name>, <string-name><surname>Weinberg</surname> <given-names>J</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Comparative accuracy of ICD-9 vs ICD-10 codes for acute appendicitis</article-title>. <source>J Am College Surg</source>. <year>2022</year>;<volume>234</volume>(<issue>3</issue>):<fpage>377</fpage>&#x2013;<lpage>383</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1097/XCS.0000000000000058">https://doi.org/10.1097/XCS.0000000000000058</ext-link></comment></mixed-citation></ref>
<ref id="CIT0022"><label>22</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Sukanya</surname> <given-names>C</given-names></string-name></person-group>. <article-title>Validity of principal diagnoses in discharge summaries and ICD-10 coding assessments based on national health data of Thailand</article-title>. <source>Healthc Inform Res</source>. <year>2017</year>;<volume>23</volume>(<issue>4</issue>):<fpage>293</fpage>&#x2013;<lpage>303</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4258/hir.2017.23.4.293">https://doi.org/10.4258/hir.2017.23.4.293</ext-link></comment></mixed-citation></ref>
<ref id="CIT0023"><label>23</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Aylin</surname> <given-names>P</given-names></string-name>, <string-name><surname>Bottle</surname> <given-names>A</given-names></string-name>, <string-name><surname>Majeed</surname> <given-names>A</given-names></string-name></person-group>. <article-title>Use of administrative data or clinical databases as predictors of risk of death in hospital: Comparison of models</article-title>. <source>BMJ</source>. <year>2007</year>;<volume>334</volume>(<issue>7602</issue>):<fpage>1044</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1136/bmj.39168.496366.55">https://doi.org/10.1136/bmj.39168.496366.55</ext-link></comment></mixed-citation></ref>
<ref id="CIT0024"><label>24</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Bortolussi</surname> <given-names>G</given-names></string-name>, <string-name><surname>McNulty</surname> <given-names>D</given-names></string-name>, <string-name><surname>Waheed</surname> <given-names>H</given-names></string-name>, <string-name><surname>Mawhinney</surname> <given-names>JA</given-names></string-name>, <string-name><surname>Freemantle</surname> <given-names>N</given-names></string-name>, <string-name><surname>Pagano</surname> <given-names>D</given-names></string-name></person-group>. <article-title>Identifying cardiac surgery operations in hospital episode statistics administrative database, with an OPCS-based classification of procedures, validated against clinical data</article-title>. <source>BMJ Open</source>. <year>2019</year>;<volume>9</volume>(<issue>3</issue>):<fpage>e023316</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1136/bmjopen-2018-023316">https://doi.org/10.1136/bmjopen-2018-023316</ext-link></comment></mixed-citation></ref>
<ref id="CIT0025"><label>25</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Heywood</surname> <given-names>NA</given-names></string-name>, <string-name><surname>Gill</surname> <given-names>MD</given-names></string-name>, <string-name><surname>Charlwood</surname> <given-names>N</given-names></string-name>, <string-name><surname>Brindle</surname> <given-names>R</given-names></string-name>, <string-name><surname>Kirwan</surname> <given-names>CC</given-names></string-name>; <collab>Northwest Research Collaborative</collab></person-group>. <article-title>Improving accuracy of clinical coding in surgery: Collaboration is key</article-title>. <source>J Surg Res</source>. <year>2016</year>;<volume>204</volume>(<issue>2</issue>):<fpage>490</fpage>&#x2013;<lpage>495</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.jss.2016.05.023">https://doi.org/10.1016/j.jss.2016.05.023</ext-link></comment></mixed-citation></ref>
<ref id="CIT0026"><label>26</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Januel</surname> <given-names>J-M</given-names></string-name>, <string-name><surname>Luthi</surname> <given-names>JC</given-names></string-name>, <string-name><surname>Quan</surname> <given-names>H</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Improved accuracy of co-morbidity coding over time after the introduction of ICD-10 administrative data</article-title>. <source>BMC Health Serv Res</source>. <year>2011</year>;<volume>11</volume>:<fpage>1</fpage>&#x2013;<lpage>10</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1186/1472-6963-11-194">https://doi.org/10.1186/1472-6963-11-194</ext-link></comment></mixed-citation></ref>
<ref id="CIT0027"><label>27</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Heekes</surname> <given-names>A</given-names></string-name>, <string-name><surname>Tiffin</surname> <given-names>N</given-names></string-name>, <string-name><surname>Dane</surname> <given-names>P</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Self-enrolment antenatal health promotion data as an adjunct to maternal clinical information systems in the Western Cape Province of South Africa</article-title>. <source>BMJ Global Health</source>. <year>2018</year>;<volume>3</volume>:<fpage>1</fpage>&#x2013;<lpage>9</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1136/bmjgh-2017-000565">https://doi.org/10.1136/bmjgh-2017-000565</ext-link></comment></mixed-citation></ref>
<ref id="CIT0028"><label>28</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Hermans</surname> <given-names>SM</given-names></string-name>, <string-name><surname>Zinyakatira</surname> <given-names>N</given-names></string-name>, <string-name><surname>Caldwell</surname> <given-names>J</given-names></string-name>, <string-name><surname>Cobelens</surname> <given-names>FGJ</given-names></string-name>, <string-name><surname>Boulle</surname> <given-names>A</given-names></string-name>, <string-name><surname>Wood</surname> <given-names>R</given-names></string-name></person-group>. <article-title>High rates of recurrent tuberculosis disease: A population-level cohort study</article-title>. <source>Clin Infect Dis</source>. <year>2021</year>;<volume>72</volume>(<issue>11</issue>):<fpage>1919</fpage>&#x2013;<lpage>1926</lpage>.</mixed-citation></ref>
<ref id="CIT0029"><label>29</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Osler</surname> <given-names>M</given-names></string-name>, <string-name><surname>Cornell</surname> <given-names>M</given-names></string-name>, <string-name><surname>Ford</surname> <given-names>N</given-names></string-name>, <string-name><surname>Hilderbrand</surname> <given-names>K</given-names></string-name>, <string-name><surname>Goemaere</surname> <given-names>E</given-names></string-name>, <string-name><surname>Boulle</surname> <given-names>A</given-names></string-name></person-group>. <article-title>Population-wide differentials in HIV service access and outcomes in the Western Cape for men as compared to women, South Africa: 2008 to 2018: A cohort analysis</article-title>. <source>J Int AIDS Soc</source>. <year>2020</year>;<volume>23</volume>(<supplement>S2</supplement>):<fpage>5</fpage>&#x2013;<lpage>14</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1002/jia2.25530">https://doi.org/10.1002/jia2.25530</ext-link></comment></mixed-citation></ref>
<ref id="CIT0030"><label>30</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Jacob</surname> <given-names>N</given-names></string-name>, <string-name><surname>Rice</surname> <given-names>B</given-names></string-name>, <string-name><surname>Kalk</surname> <given-names>E</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Utility of digitising point of care HIV test results to accurately measure, and improve performance towards, the UNAIDS 90-90-90 targets</article-title>. <source>PLoS One</source>. <year>2020</year>;<volume>15</volume>(<issue>6</issue>):<fpage>e0235471</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1371/journal.pone.0235471">https://doi.org/10.1371/journal.pone.0235471</ext-link></comment></mixed-citation></ref>
<ref id="CIT0031"><label>31</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Guan</surname> <given-names>L</given-names></string-name>, <string-name><surname>Liu</surname> <given-names>Z</given-names></string-name>, <string-name><surname>Pan</surname> <given-names>G</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>The global, regional, and national burden of appendicitis in 204 countries and territories, 1990&#x2013;2019: A systematic analysis from the Global Burden of Disease Study 2019</article-title>. <source>BMC Gastroenterol</source>. <year>2023</year>;<volume>23</volume>(<issue>1</issue>):<fpage>44</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1186/s12876-023-02678-7">https://doi.org/10.1186/s12876-023-02678-7</ext-link></comment></mixed-citation></ref>
<ref id="CIT0032"><label>32</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Hardin</surname> <suffix>Jr</suffix>, <given-names>DM</given-names></string-name></person-group>. <article-title>Acute appendicitis: Review and update</article-title>. <source>Am Fam Phys</source>. <year>1999</year>;<volume>60</volume>(<issue>7</issue>):<fpage>2027</fpage>&#x2013;<lpage>2034</lpage>.</mixed-citation></ref>
<ref id="CIT0033"><label>33</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>De Almeida Leite</surname> <given-names>RM</given-names></string-name>, <string-name><surname>Seo</surname> <given-names>DJ</given-names></string-name>, <string-name><surname>Gomez-Eslava</surname> <given-names>B</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Nonoperative vs operative management of uncomplicated acute appendicitis: A systematic review and meta-analysis</article-title>. <source>JAMA Surg</source>. <year>2022</year>;<volume>157</volume>(<issue>9</issue>):<fpage>828</fpage>&#x2013;<lpage>834</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1001/jamasurg.2022.2937">https://doi.org/10.1001/jamasurg.2022.2937</ext-link></comment></mixed-citation></ref>
<ref id="CIT0034"><label>34</label><mixed-citation publication-type="conference"><person-group person-group-type="author"><string-name><surname>Katurura</surname> <given-names>M</given-names></string-name>, <string-name><surname>Cilliers</surname> <given-names>L</given-names></string-name></person-group>. <article-title>The extent to which the POPI act makes provision for patient privacy in mobile personal health record systems</article-title>. In <conf-name>2016 IST-Africa Week Conference</conf-name>. <conf-date>May 11</conf-date>. <conf-loc>South Africa: IEEE</conf-loc>, <year>2016</year>; p. <fpage>1</fpage>&#x2013;<lpage>8</lpage>.</mixed-citation></ref>
<ref id="CIT0035"><label>35</label><mixed-citation publication-type="conference"><person-group person-group-type="author"><string-name><surname>Els</surname> <given-names>F</given-names></string-name>, <string-name><surname>Cilliers</surname> <given-names>L</given-names></string-name></person-group>. <article-title>Improving the information security of personal electronic health records to protect a patient&#x2019;s health information</article-title>. In <conf-name>2017 Conference on Information Communication Technology and Society (ICTAS)</conf-name>. <conf-date>Mar 8</conf-date>. <conf-loc>South Africa: IEEE</conf-loc>, <year>2017</year>; p. <fpage>1</fpage>&#x2013;<lpage>6</lpage>.36.</mixed-citation></ref>
<ref id="CIT0036"><label>36</label><mixed-citation publication-type="web"><person-group person-group-type="author"><string-name><surname>Mars</surname> <given-names>M</given-names></string-name>, <string-name><surname>Seebregts</surname> <given-names>C</given-names></string-name></person-group>. <source>Country case study for e-health South Africa [homepage on the Internet]</source>. <year>2008</year> <comment>[cited 2013 Mar 12]. Available from: <ext-link ext-link-type="uri" xlink:href="http://ehealthconnection.org/files/resources/County&#x0025;20Case&#x0025;20Study&#x0025;20for&#x0025;20eHealth&#x0025;20South&#x0025;20Africa.pdf">http://ehealthconnection.org/files/resources/County&#x0025;20Case&#x0025;20Study&#x0025;20for&#x0025;20eHealth&#x0025;20South&#x0025;20Africa.pdf</ext-link></comment></mixed-citation></ref>
<ref id="CIT0037"><label>37</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Zharima</surname> <given-names>C</given-names></string-name>, <string-name><surname>Griffiths</surname> <given-names>F</given-names></string-name>, <string-name><surname>Goudge</surname> <given-names>J</given-names></string-name></person-group>. <article-title>Exploring the barriers and facilitators to implementing electronic health records in a middle-income country: A qualitative study from South Africa</article-title>. <source>Front Digital Health</source>. <year>2023</year>;<volume>5</volume>:<fpage>1207602</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fdgth.2023.1207602">https://doi.org/10.3389/fdgth.2023.1207602</ext-link></comment></mixed-citation></ref>
</ref-list>
<fn-group>
<fn><p><bold>How to cite this article:</bold> Louw J, Nyasulu P, English R, Chu K. Developing and validating an appendectomy algorithm for use in a South African database. J Public Health Africa. 2025;16(1), a1536. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4102/jphia.v16i1.1536">https://doi.org/10.4102/jphia.v16i1.1536</ext-link></p></fn>
</fn-group>
</back>
</article>