<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">Wellcome Open Res</journal-id>
            <journal-title-group>
                <journal-title>Wellcome Open Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2398-502X</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/wellcomeopenres.15996.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Research Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Assessing the age- and gender-dependence of the severity and case fatality rates of COVID-19 disease in Spain</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 2 approved]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Moraga</surname>
                        <given-names>Paula</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-5266-0201</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Ketcheson</surname>
                        <given-names>David I.</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Ombao</surname>
                        <given-names>Hernando C.</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Duarte</surname>
                        <given-names>Carlos M.</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a3">3</xref>
                    <xref ref-type="aff" rid="a3">3</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Department of Mathematical Sciences, University of Bath, Bath, Somerset, BA2 7AY, UK</aff>
                <aff id="a2">
                    <label>2</label>Computer, Electrical, and Mathematical Sciences &amp; Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal, Saudi Arabia</aff>
                <aff id="a3">
                    <label>3</label>Biological and Environmental Science and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal, Saudi Arabia</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:paumose@gmail.com">paumose@gmail.com</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>2</day>
                <month>6</month>
                <year>2020</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2020</year>
            </pub-date>
            <volume>5</volume>
            <elocation-id>117</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>28</day>
                    <month>5</month>
                    <year>2020</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2020 Moraga P et al.</copyright-statement>
                <copyright-year>2020</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://wellcomeopenresearch.org/articles/5-117/pdf"/>
            <abstract>
                <p>
                    <bold>Background:</bold> The assessment of the severity and case fatality rates of coronavirus disease 2019 (COVID-19) and the determinants of its variation is essential for planning health resources and responding to the pandemic. The interpretation of case fatality rates (CFRs) remains a challenge due to different biases associated with surveillance and reporting. For example, rates may be affected by preferential ascertainment of severe cases and time delay from disease onset to death. Using data from Spain, we demonstrate how some of these biases may be corrected when estimating severity and case fatality rates by age group and gender, and identify issues that may affect the correct interpretation of the results.</p>
                <p>
                    <bold>Methods:</bold> Crude CFRs are estimated by dividing the total number of deaths by the total number of confirmed cases. CFRs adjusted for preferential ascertainment of severe cases are obtained by assuming a uniform attack rate in all population groups, and using demography-adjusted under-ascertainment rates. CFRs adjusted for the delay between disease onset and death are estimated by using as denominator the number of cases that could have a clinical outcome by the time rates are calculated. A sensitivity analysis is carried out to compare CFRs obtained using different levels of ascertainment and different distributions for the time from disease onset to death.</p>
                <p>
                    <bold>Results:</bold> COVID-19 outcomes are highly influenced by age and gender. Different assumptions yield different CFR values but in all scenarios CFRs are higher in old ages and males.</p>
                <p>
                    <bold>Conclusions:</bold> The procedures used to obtain the CFR estimates require strong assumptions and although the interpretation of their magnitude should be treated with caution, the differences observed by age and gender are fundamental underpinnings to inform decision-making.</p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>COVID-19</kwd>
                <kwd>epidemics</kwd>
                <kwd>mortality</kwd>
                <kwd>case fatality rate</kwd>
                <kwd>age</kwd>
                <kwd>gender</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1" xlink:href="http://dx.doi.org/10.13039/100004440">
                    <funding-source>Wellcome Trust</funding-source>
                    <award-id>219698</award-id>
                </award-group>
                <funding-statement>This work was supported by the Wellcome Trust [219698].</funding-statement>
                <funding-statement>
                    <italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic>
                </funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec sec-type="intro">
            <title>Introduction</title>
            <p>The coronavirus disease 2019 (COVID-19) has spread to nearly every country in the world since it first emerged in the Hubei province of China in 2019. As of 14 May 2020, more than 4.22 million cases and more than 290,000 deaths have been reported worldwide
                <sup>
                    <xref ref-type="bibr" rid="ref-1">1</xref>
                </sup>. While people of any age may get infected, COVID-19 symptoms are particularly severe for the elderly and those with underlying health conditions, which creates a disproportionate risk and need for intensive care in these groups. Understanding the severity of the disease in the different population groups is essential to help predict the demand of healthcare resources and to design effective mitigation policies.</p>
            <p>Case fatality rates (CFR) are often used to characterize the severity of the disease. The crude CFR is obtained by dividing the cumulative number of deaths by the cumulative number of reported cases. This indicator is simple to calculate but is difficult to interpret due to different biases
                <sup>
                    <xref ref-type="bibr" rid="ref-2">2</xref>
                </sup>. First, the clinical outcome (recovery or death) of the most recent cases may be unknown due to the delay between disease onset and death which may underestimate the true CFR. Moreover, limited capabilities in testing result in most of people tested being only those with the most severe symptoms and most likely to experience fatal outcomes. As a result, crude CFRs may overestimate rates that are defined based on the actual number of infected people (including those with weak or no symptoms).</p>
            <p>Crude fatality rates can be adjusted in a number of ways to obtain estimates that more accurately represent the severity of the disease in each of the population groups. For example, censoring can be taken into account by using the distribution of the time between disease onset and death to determine the number of cases that could experience an outcome by the point in time when the rates are calculated. The under-ascertainment of COVID-19 in different groups can also be corrected by using the population demographics.</p>
            <p>Here, we calculate crude and adjusted fatality rates by age group and gender in Spain. Spain is one of the hardest-hit countries in the pandemic with 272646 cases and 27321 deaths as of 14 May 2020. The country is characterized by one of the longest life expectancies and lowest birth rates in the world
                <sup>
                    <xref ref-type="bibr" rid="ref-3">3</xref>
                </sup> and, thus, has a large percentage of older adults. Moreover, it is characterized by a sociable lifestyle and extensive inter-generational interactions which may accelerate the spread of the virus. Accurate assessment of CFRs by age group and gender is essential to help planning responses that help save lives.</p>
            <p>First, we present the data on population, confirmed cases and deaths of Spain. We then demonstrate how to calculate crude and adjusted CFRs by population group and present the estimates for Spain. We discuss the limitations of the methods and conduct a sensitivity analysis where we compare CFRs adjusted under different assumptions.</p>
        </sec>
        <sec sec-type="methods">
            <title>Methods</title>
            <sec>
                <title>Data</title>
                <p>Population data for Spain stratified by age group and gender for 2019 are obtained from the National Institute of Statistics of Spain
                    <sup>
                        <xref ref-type="bibr" rid="ref-4">4</xref>
                    </sup> (
                    <xref ref-type="fig" rid="f1">Figure 1</xref>). We note the large percentage of older adults with over-60 males and females representing 11.41% and 14.16% of the whole population, respectively.</p>
                <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                    <label>Figure 1. </label>
                    <caption>
                        <title>Population by age group and gender in Spain, 2019.</title>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://wellcomeopenresearch-files.f1000.com/manuscripts/17545/d86865da-6bb8-4326-aa48-c2a0d9dd740f_figure1.gif"/>
                </fig>
                <p>Data on the daily total confirmed cases and deaths, as well as daily confirmed cases and deaths by age group and gender from a subset of the population are reported by the Spanish Ministry of Health and provided by 
                    <xref ref-type="bibr" rid="ref-5">5</xref>. Assuming this subset is representative of all cases, in terms of the relative distribution among age group and gender, we can estimate the daily number of confirmed cases in each group by multiplying the total number of cases by the proportion of cases in each group. Daily number of deaths in each age group and gender are calculated following a similar procedure. 
                    <xref ref-type="fig" rid="f2">Figure 2</xref> and 
                    <xref ref-type="fig" rid="f3">Figure 3</xref> show the proportion of cases and deaths, respectively, in each age group and gender. We observe a low proportion of confirmed cases in young people (under 20 years old) and a high proportion of deaths in older age groups and males. 
                    <xref ref-type="fig" rid="f4">Figure 4</xref> shows the total number of confirmed cases and deaths over time.</p>
                <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                    <label>Figure 2. </label>
                    <caption>
                        <title>Proportion of confirmed cases by age group and gender.</title>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://wellcomeopenresearch-files.f1000.com/manuscripts/17545/d86865da-6bb8-4326-aa48-c2a0d9dd740f_figure2.gif"/>
                </fig>
                <fig fig-type="figure" id="f3" orientation="portrait" position="float">
                    <label>Figure 3. </label>
                    <caption>
                        <title>Proportion of deaths by age group and gender.</title>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://wellcomeopenresearch-files.f1000.com/manuscripts/17545/d86865da-6bb8-4326-aa48-c2a0d9dd740f_figure3.gif"/>
                </fig>
                <fig fig-type="figure" id="f4" orientation="portrait" position="float">
                    <label>Figure 4. </label>
                    <caption>
                        <title>Cumulative total number of confirmed cases and deaths over time.</title>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://wellcomeopenresearch-files.f1000.com/manuscripts/17545/d86865da-6bb8-4326-aa48-c2a0d9dd740f_figure4.gif"/>
                </fig>
            </sec>
            <sec>
                <title>Relative risk</title>
                <p>We can examine the relative risks in each age group and gender to compare the severity of the disease between population groups. The relative risk in each population group is obtained by dividing the number of deaths in a group by the total population in that group, and normalizing the values so the risk of males older than 80 is equal to 1. We observe a roughly tenfold increase in risk for every 20 year increase in age, consistent with an earlier smaller study of cases in China
                    <sup>
                        <xref ref-type="bibr" rid="ref-6">6</xref>
                    </sup>.</p>
            </sec>
            <sec>
                <title>Case fatality rate</title>
                <p>At any point in time, the crude CFR is calculated by dividing the cumulative number of deaths by the cumulative number of reported cases. As noted, CFRs may be affected by preferential ascertainment of severe cases. This is likely to occur in COVID-19 where cases asymptomatic or with mild symptoms are less likely to seek medical care or be included in the surveillance data. This could result in an upward bias (or overestimate) of the crude CFRs by under-reporting of cases. We can partially correct this bias by calculating the adjusted daily number of confirmed cases following the procedure detailed in 
                    <xref ref-type="bibr" rid="ref-6">6</xref>. Specifically, we calculate NC
                    <sub>
                        <italic toggle="yes">a</italic>
                    </sub> = pop
                    <sub>
                        <italic toggle="yes">a</italic>
                    </sub>/cases
                    <sub>
                        <italic toggle="yes">a</italic>
                    </sub> where pop
                    <sub>
                        <italic toggle="yes">a</italic>
                    </sub> and cases
                    <sub>
                        <italic toggle="yes">a</italic>
                    </sub> are the population and the number of cases, respectively, in group 
                    <italic toggle="yes">a</italic>, 
                    <italic toggle="yes">a</italic> &#x2208; { males 0&#x2013;9, males 10&#x2013;19, males 20&#x2013;29, males 30&#x2013;39, males 40&#x2013;49, males 50&#x2013;59, males 60&#x2013;69, males 70&#x2013;79, males 80+, females 0&#x2013;9, females 10&#x2013;19, females 20&#x2013;29, females 30&#x2013;39, females 40&#x2013;49, females 50&#x2013;59, females 60&#x2013;69, females 70&#x2013;79, females 80+ }. We assume perfect ascertainment in the group with maximum 1/NC
                    <sub>
                        <italic toggle="yes">a</italic>
                    </sub> value which is the group of males older than 80. Then, we assume the attack rate is the same in all groups and estimate the adjusted number of cases in each population group by multiplying the confirmed cases by NC
                    <sub>
                        <italic toggle="yes">a</italic>
                    </sub>/NC
                    <sub>males 80+</sub>. 
                    <xref ref-type="fig" rid="f6">Figure 6</xref> and 
                    <xref ref-type="fig" rid="f7">Figure 7</xref> show the cumulative confirmed cases and the cases adjusted for preferential ascertainment over time for each age group and gender. Finally, we calculate the CFRs adjusted for preferential ascertainment by dividing the cumulative number of deaths by the cumulative number of adjusted cases in each population group. We also calculate 95% confidence intervals using exact binomial tests
                    <sup>
                        <xref ref-type="bibr" rid="ref-7">7</xref>
                    </sup>.</p>
                <fig fig-type="figure" id="f5" orientation="portrait" position="float">
                    <label>Figure 5. </label>
                    <caption>
                        <title>Log-normal distribution of the time from disease onset to death with mean 13 days and standard deviation 12.7 days.</title>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://wellcomeopenresearch-files.f1000.com/manuscripts/17545/d86865da-6bb8-4326-aa48-c2a0d9dd740f_figure5.gif"/>
                </fig>
                <fig fig-type="figure" id="f6" orientation="portrait" position="float">
                    <label>Figure 6. </label>
                    <caption>
                        <title>Cumulative confirmed and adjusted cases over time for each age group in males.</title>
                        <p>Adjusted cases 1 are cases adjusted for preferential ascertainment of severe cases. Adjusted cases 2 are cases adjusted for preferential ascertainment of severe cases and time delay between confirmation and death.</p>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://wellcomeopenresearch-files.f1000.com/manuscripts/17545/d86865da-6bb8-4326-aa48-c2a0d9dd740f_figure6.gif"/>
                </fig>
                <fig fig-type="figure" id="f7" orientation="portrait" position="float">
                    <label>Figure 7. </label>
                    <caption>
                        <title>Cumulative confirmed and adjusted cases over time for each age group in females.</title>
                        <p>Adjusted cases 1 are cases adjusted for preferential ascertainment of severe cases. Adjusted cases 2 are cases adjusted for preferential ascertainment of severe cases and time delay between confirmation and death.</p>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://wellcomeopenresearch-files.f1000.com/manuscripts/17545/d86865da-6bb8-4326-aa48-c2a0d9dd740f_figure7.gif"/>
                </fig>
                <p>CFRs can also be biased due to the delay between disease onset and death. At any moment in time, the cumulative number of confirmed cases includes people who have not yet died but may do so in the future. Therefore, crude fatality rates may underestimate the true severity of the disease. We can correct this bias by replacing the denominator with an estimate of the cumulative number of cases with known outcomes by the time rates are calculated. Specifically, we adjust for this bias as follows. Let 
                    <italic toggle="yes">T</italic> be the point in time when the CFRs are calculated. The probability that a case confirmed at time 
                    <italic toggle="yes">t</italic>, 
                    <italic toggle="yes">t</italic> = 1, . . . , 
                    <italic toggle="yes">T</italic>, has a known outcome by time 
                    <italic toggle="yes">T</italic> is expressed as 
                    <inline-formula>
                        <mml:math display="inline" id="M1">
                            <mml:mrow>
                                <mml:msub>
                                    <mml:mi>p</mml:mi>
                                    <mml:mi>t</mml:mi>
                                </mml:msub>
                                <mml:mo>=</mml:mo>
                                <mml:mstyle displaystyle="true">
                                    <mml:mrow>
                                        <mml:msubsup>
                                            <mml:mo>&#x222b;</mml:mo>
                                            <mml:mrow>
                                                <mml:mi>m</mml:mi>
                                                <mml:mo>=</mml:mo>
                                                <mml:mn>0</mml:mn>
                                            </mml:mrow>
                                            <mml:mrow>
                                                <mml:mi>T</mml:mi>
                                                <mml:mo>&#x2212;</mml:mo>
                                                <mml:mi>t</mml:mi>
                                            </mml:mrow>
                                        </mml:msubsup>
                                        <mml:mrow>
                                            <mml:mi>g</mml:mi>
                                            <mml:mo stretchy="false">(</mml:mo>
                                            <mml:mi>m</mml:mi>
                                            <mml:mo stretchy="false">)</mml:mo>
                                            <mml:mi>d</mml:mi>
                                            <mml:mi>m</mml:mi>
                                            <mml:mo>,</mml:mo>
                                        </mml:mrow>
                                    </mml:mrow>
                                </mml:mstyle>
                            </mml:mrow>
                        </mml:math>
                    </inline-formula> where 
                    <italic toggle="yes">g</italic>(
                    <italic toggle="yes">m</italic>) denotes the probability density that a case has a known outcome 
                    <italic toggle="yes">m</italic> days after the disease onset. The cumulative number of cases in group 
                    <italic toggle="yes">a</italic> with known outcomes by time 
                    <italic toggle="yes">T</italic> can be calculated as 
                    <disp-formula id="e1">
                        <mml:math display="block" id="math1">
                            <mml:mrow>
                                <mml:mtext>case</mml:mtext>
                                <mml:msub>
                                    <mml:mtext>s</mml:mtext>
                                    <mml:mi>a</mml:mi>
                                </mml:msub>
                                <mml:mo>=</mml:mo>
                                <mml:mstyle displaystyle="true">
                                    <mml:munderover>
                                        <mml:mo>&#x2211;</mml:mo>
                                        <mml:mrow>
                                            <mml:mi>t</mml:mi>
                                            <mml:mo>=</mml:mo>
                                            <mml:mn>1</mml:mn>
                                        </mml:mrow>
                                        <mml:mi>T</mml:mi>
                                    </mml:munderover>
                                    <mml:mrow>
                                        <mml:mtext>ncase</mml:mtext>
                                        <mml:msub>
                                            <mml:mtext>s</mml:mtext>
                                            <mml:mrow>
                                                <mml:mi>a</mml:mi>
                                                <mml:mi>t</mml:mi>
                                            </mml:mrow>
                                        </mml:msub>
                                    </mml:mrow>
                                </mml:mstyle>
                                <mml:mo>&#x00d7;</mml:mo>
                                <mml:msub>
                                    <mml:mi>p</mml:mi>
                                    <mml:mrow>
                                        <mml:mi>t</mml:mi>
                                        <mml:mo>,</mml:mo>
                                    </mml:mrow>
                                </mml:msub>
                            </mml:mrow>
                        </mml:math>
                    </disp-formula> where ncases
                    <sub>
                        <italic toggle="yes">at</italic>
                    </sub> denotes the new number of cases in population group 
                    <italic toggle="yes">a</italic> and date 
                    <italic toggle="yes">t</italic>. Here we calculate the number of adjusted cases assuming a log-normal distribution of the time from disease onset to death with mean equal to 13 days and a standard deviation equal to 12.7
                    <sup>
                        <xref ref-type="bibr" rid="ref-8">8</xref>
                    </sup> (
                    <xref ref-type="fig" rid="f5">Figure 5</xref>). 
                    <xref ref-type="fig" rid="f6">Figure 6</xref> and 
                    <xref ref-type="fig" rid="f7">Figure 7</xref> show cumulative cases adjusted for preferential ascertainment of severe cases and time delay between confirmation and death for each population group. Then we calculate corrected CFRs using the adjusted cases as denominator and 95% confidence intervals using an exact binomial test.</p>
            </sec>
            <sec>
                <title>Sensitivity analysis</title>
                <p>The procedure we used to obtain adjusted CFRs requires strong assumptions that could greatly affect the results. First, we have adjusted crude CFRs by preferential ascertainment of severe cases by assuming complete ascertainment in the group with the highest attack rates (males older than 80). We then have assumed a uniform attack rate in all population groups, and used demography-adjusted under-ascertainment rates to obtain estimates of the number of infected individuals in each population group. However, there could also be under-ascertainment in the males older than 80 group due to extensive strain on the health system, and this fact could mean the CFR estimates are only an upper bound on the real values. We could correct this bias by further scaling the number of cases after the initial demographic adjustment. For example, we could multiply the adjusted cases by a value 
                    <italic toggle="yes">&#x03b1;</italic> &gt; 1 to obtain a higher number of infected cases and lower CFRs. Moreover, the uniform attack rate assumption could be incorrect if certain population groups have more interactions with other people and are more exposed to the disease.</p>
                <p>CFRs may also be biased due to the delay between disease onset and death. To correct this bias, we have considered a log-normal distribution with mean 13 days and standard deviation 12.7 days for the time from disease onset to death
                    <sup>
                        <xref ref-type="bibr" rid="ref-8">8</xref>
                    </sup>, and estimated the CFRs using as denominator the cumulative number of cases that could have a clinical outcome by the time rates are calculated. However, other distributions may be considered that could change the results.</p>
                <p>To illustrate these limitations, we conduct a sensitivity analysis where we calculate the CFRs using different levels of ascertainment and different distributions for the time from disease onset to death. Specifically, we estimate the adjusted number of cases in each population group by multiplying the confirmed cases by NC
                    <sub>
                        <italic toggle="yes">a</italic>
                    </sub>/NC
                    <sub>males 80+</sub>&#x00d7; 
                    <italic toggle="yes">&#x03b1;</italic> using 
                    <italic toggle="yes">&#x03b1;</italic> values equal to 1, 1.5 and 2. We also use delay distributions equal to a log-normal distribution with mean 13 days and standard deviation 12.7 days
                    <sup>
                        <xref ref-type="bibr" rid="ref-8">8</xref>
                    </sup> (
                    <xref ref-type="fig" rid="f5">Figure 5</xref>), and a Gamma with mean 18.8 days and coefficient of variation 0.45 days
                    <sup>
                        <xref ref-type="bibr" rid="ref-9">9</xref>
                    </sup> (
                    <xref ref-type="fig" rid="f9">Figure 9</xref>).</p>
                <fig fig-type="figure" id="f8" orientation="portrait" position="float">
                    <label>Figure 8. </label>
                    <caption>
                        <title>Relative risk of each population group.</title>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://wellcomeopenresearch-files.f1000.com/manuscripts/17545/d86865da-6bb8-4326-aa48-c2a0d9dd740f_figure8.gif"/>
                </fig>
                <fig fig-type="figure" id="f9" orientation="portrait" position="float">
                    <label>Figure 9. </label>
                    <caption>
                        <title>Gamma distribution of the time from disease onset to death with mean 18.8 days and coefficient of variation 0.45 days.</title>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://wellcomeopenresearch-files.f1000.com/manuscripts/17545/d86865da-6bb8-4326-aa48-c2a0d9dd740f_figure9.gif"/>
                </fig>
            </sec>
            <sec>
                <title>Analysis</title>
                <p>Analysis are performed with the statistical software 
                    <ext-link ext-link-type="uri" xlink:href="https://www.r-project.org/">R</ext-link> version 3.6.1
                    <sup>
                        <xref ref-type="bibr" rid="ref-10">10</xref>
                    </sup>. Plots are created with the 
                    <monospace>R</monospace> package 
                    <monospace>ggplot2</monospace> version 3.3.0
                    <sup>
                        <xref ref-type="bibr" rid="ref-11">11</xref>
                    </sup>.</p>
            </sec>
        </sec>
        <sec sec-type="results">
            <title>Results</title>
            <p>
                <xref ref-type="fig" rid="f8">Figure 8</xref> shows the relative risks in each age group and gender. We note the risk of COVID-19 increases with age and is higher for males than for females for all age groups except 0&#x2013;9 and 10&#x2013;19. 
                <xref ref-type="table" rid="T1">Table 1</xref> shows the crude and adjusted CFRs by age group and gender calculated on 14 May 2020. This table also shows the CFRs by age group obtained from aggregated time series of cases in mainland China by Verity 
                <italic toggle="yes">et al.</italic>
                <sup>
                    <xref ref-type="bibr" rid="ref-6">6</xref>
                </sup>. We observe CFRs are much higher in age groups older than 60 and, for most age groups, in males. We observe the adjusted CFRs obtained with the data from Spain are smaller than the CFRs obtained by Verity 
                <italic toggle="yes">et al.</italic>
                <sup>
                    <xref ref-type="bibr" rid="ref-6">6</xref>
                </sup> for all except the oldest two groups, and the confidence intervals for the CFRs of Spain are much smaller due to the use of a larger dataset. 
                <xref ref-type="table" rid="T2">Table 2</xref> shows the CFRs estimated under different scenarios assuming different levels of ascertainment and distributions for the time from disease onset to death. We observe that in all scenarios CFRs are higher in older age groups and males but yield different values for the CFRs.</p>
            <table-wrap id="T1" orientation="portrait" position="anchor">
                <label>Table 1. </label>
                <caption>
                    <title>Crude and adjusted case fatality rates for preferential ascertainment and time delay between disease onset and death. </title>
                    <p>Adjusted 1 are rates adjusted for preferential ascertainment of severe cases. Adjusted 2 are rates adjusted for preferential ascertainment of severe cases and time delay between confirmation and death. Verity 
                        <italic toggle="yes">et al.</italic> estimates are rates obtained from aggregate time series of cases in mainland China
                        <sup>
                            <xref ref-type="bibr" rid="ref-6">6</xref>
                        </sup>.</p>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="left" colspan="1" rowspan="1" valign="top">Group</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Crude</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Adjusted 1</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Adjusted 2</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Verity 
                                <italic toggle="yes">et al.</italic>
                            </th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">male 0&#x2013;9</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.187 (0.00474, 1.04)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00199 (5.04e-05, 0.0111)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00227 (5.75e-05, 0.0127)</td>
                            <td align="left" colspan="1" rowspan="2" valign="middle">0.0026 (0.000312, 0.0382)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">female 0&#x2013;9</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.217 (0.0055, 1.21)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00212 (5.36e-05, 0.0118)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00241 (6.11e-05, 0.0135)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">male 10&#x2013;19</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.361 (0.0746, 1.05)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00534 (0.0011, 0.0156)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00609 (0.00126, 0.0178)</td>
                            <td align="left" colspan="1" rowspan="2" valign="middle">0.0148 (0.00288, 0.0759)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">female 10&#x2013;19</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.394 (0.107, 1)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00759 (0.00207, 0.0194)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00866 (0.00236, 0.0222)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">male 20&#x2013;29</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.399 (0.244, 0.616)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0364 (0.0222, 0.0562)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0415 (0.0254, 0.0641)</td>
                            <td align="left" colspan="1" rowspan="2" valign="middle">0.06 (0.0317, 0.132)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">female 20&#x2013;29</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.126 (0.0671, 0.215)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0245 (0.013, 0.0418)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0279 (0.0149, 0.0477)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">male 30&#x2013;39</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.601 (0.456, 0.778)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0831 (0.0629, 0.108)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0948 (0.0718, 0.123)</td>
                            <td align="left" colspan="1" rowspan="2" valign="middle">0.146 (0.103, 0.255)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">female 30-39</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.19 (0.129, 0.269)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.045 (0.0306, 0.0638)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0513 (0.0349, 0.0728)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">male 40&#x2013;49</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">1.14 (0.986, 1.32)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.213 (0.183, 0.245)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.243 (0.209, 0.28)</td>
                            <td align="left" colspan="1" rowspan="2" valign="middle">0.295 (0.221, 0.422)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">female 40-49</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.421 (0.343, 0.512)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.116 (0.0943, 0.141)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.132 (0.108, 0.161)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">male 50&#x2013;59</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2.96 (2.74, 3.2)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.802 (0.74, 0.867)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.915 (0.844, 0.989)</td>
                            <td align="left" colspan="1" rowspan="2" valign="middle">1.25 (1.03, 1.55)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">female 50-59</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.899 (0.792, 1.02)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.321 (0.283, 0.364)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.367 (0.323, 0.415)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">male 60&#x2013;69</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">8.39 (8.02, 8.78)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.01 (2.87, 3.15)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.43 (3.28, 3.6)</td>
                            <td align="left" colspan="1" rowspan="2" valign="middle">3.99 (3.41, 4.55)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">female 60&#x2013;69</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.75 (3.48, 4.03)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">1.16 (1.07, 1.25)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">1.32 (1.23, 1.42)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">male 70&#x2013;79</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">22.1 (21.5, 22.7)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">11.4 (11.1, 11.7)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">13 (12.7, 13.4)</td>
                            <td align="left" colspan="1" rowspan="2" valign="middle">8.61 (7.48, 9.99)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">female 70&#x2013;79</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">12.7 (12.1, 13.2)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">4.41 (4.23, 4.6)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">5.03 (4.83, 5.25)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">male 80+</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">35.9 (35.3, 36.5)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">35.9 (35.3, 36.5)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">41 (40.3, 41.7)</td>
                            <td align="left" colspan="1" rowspan="2" valign="middle">13.4 (11.2, 15.9)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">female 80+</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">21.4 (21, 21.8)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">21.2 (20.8, 21.6)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">24.2 (23.8, 24.7)</td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
            <table-wrap id="T2" orientation="portrait" position="anchor">
                <label>Table 2. </label>
                <caption>
                    <title>Case fatality rates adjusted for preferential ascertainment and time delay between disease onset and death under different scenarios.</title>
                    <p>Scaling values 
                        <italic toggle="yes">&#x03b1;</italic> are set to 1, 1.5 and 2, and delay distributions are equal to a log-normal distribution with mean 13 days and standard deviation 12.7 days or a Gamma with mean 18.8 days and coefficient of variation 0.45 days.</p>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="left" colspan="1" rowspan="1" valign="top">Distribution
                                <break/>
                                <italic toggle="yes">&#x03b1;</italic>
                            </th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Log-normal
                                <break/>1</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Log-normal
                                <break/>1.5</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Log-normal
                                <break/>2</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Gamma
                                <break/>1</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Gamma
                                <break/>1.5</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Gamma
                                <break/>2</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">male 0&#x2013;9</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00227 (5.75e-
                                <break/>05, 0.0127)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00151 (3.84e-05,
                                <break/>0.00844)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00114 (2.88e-05,
                                <break/>0.00633)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00245 (6.19e-
                                <break/>05, 0.0136)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00163
                                <break/>(4.13e-05,
                                <break/>0.00909)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00122 (3.1e-
                                <break/>05, 0.00682)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">female 0&#x2013;9</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00241 (6.11e-
                                <break/>05, 0.0135)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00161 (4.07e-05,
                                <break/>0.00897)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00121 (3.06e-05,
                                <break/>0.00673)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0026 (6.58e-
                                <break/>05, 0.0145)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00173
                                <break/>(4.39e-05,
                                <break/>0.00965)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0013 (3.29e-
                                <break/>05, 0.00724)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">male 10&#x2013;19</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00609 (0.00126,
                                <break/>0.0178)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00406 (0.000837,
                                <break/>0.0119)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00304 (0.000628,
                                <break/>0.0089)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00656
                                <break/>(0.00135,
                                <break/>0.0192)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00437
                                <break/>(0.000901,
                                <break/>0.0128)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00328
                                <break/>(0.000676,
                                <break/>0.00958)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">female
                                <break/>10&#x2013;19</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00866 (0.00236,
                                <break/>0.0222)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00577 (0.00157,
                                <break/>0.0148)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00433 (0.00118,
                                <break/>0.0111)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00933
                                <break/> (0.00254,
                                <break/>0.0239)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00622
                                <break/>(0.00169,
                                <break/>0.0159)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.00466
                                <break/>(0.00127,
                                <break/>0.0119)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">male 20&#x2013;29</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0415 (0.0254,
                                <break/>0.0641)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0277 (0.0169,
                                <break/>0.0427)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0208 (0.0127,
                                <break/>0.0321)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0447 (0.0273,
                                <break/>0.069)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0298
                                <break/>(0.0182,
                                <break/>0.046)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0224 (0.0137,
                                <break/>0.0345)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">female
                                <break/>20&#x2013;29</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0279 (0.0149,
                                <break/>0.0477)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0186 (0.00991,
                                <break/>0.0318)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.014 (0.00743,
                                <break/>0.0239)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.03 (0.016,
                                <break/>0.0514)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.02 (0.0107,
                                <break/>0.0343)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.015 (0.008,
                                <break/>0.0257)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">male 30&#x2013;39</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0948 (0.0718,
                                <break/>0.123)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0632 (0.0479,
                                <break/>0.0819)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0474 (0.0359,
                                <break/>0.0614)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.102 (0.0773,
                                <break/>0.132)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0681
                                <break/>(0.0515,
                                <break/>0.0882)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.051 (0.0387,
                                <break/>0.0661)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">female
                                <break/>30&#x2013;39</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0513 (0.0349,
                                <break/>0.0728)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0342 (0.0232,
                                <break/>0.0485)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0257 (0.0174,
                                <break/>0.0364)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0552 (0.0375,
                                <break/>0.0784)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0368 (0.025,
                                <break/>0.0523)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0276 (0.0188,
                                <break/>0.0392)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">male 40&#x2013;49</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.243 (0.209,
                                <break/>0.28)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.162 (0.139, 0.187)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.121 (0.105, 0.14)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.261 (0.225,
                                <break/>0.301)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.174 (0.15,
                                <break/>0.201)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.131 (0.113,
                                <break/>0.151)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">female
                                <break/>40&#x2013;49</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.132 (0.108,
                                <break/>0.161)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0881 (0.0717,
                                <break/>0.107)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0661 (0.0538,
                                <break/>0.0804)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.142 (0.116,
                                <break/>0.173)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0949
                                <break/>(0.0772,
                                <break/>0.115)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.0712 (0.0579,
                                <break/>0.0866)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">male 50&#x2013;59</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.915 (0.844,
                                <break/>0.989)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.61 (0.563, 0.66)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.457 (0.422, 0.495)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.985 (0.909,
                                <break/>1.07)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.656 (0.606,
                                <break/>0.71)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.492 (0.454,
                                <break/>0.533)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">female
                                <break/>50&#x2013;59</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.367 (0.323,
                                <break/>0.415)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.244 (0.215, 0.277)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.183 (0.161, 0.207)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.395 (0.348,
                                <break/>0.447)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.263 (0.232,
                                <break/>0.298)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.197 (0.174,
                                <break/>0.223)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">male 60&#x2013;69</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.43 (3.28, 3.6)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2.29 (2.18, 2.4)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">1.72 (1.64, 1.8)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.7 (3.53, 3.87)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2.47 (2.35,
                                <break/>2.58)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">1.85 (1.76,
                                <break/>1.94)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">female
                                <break/>60&#x2013;69</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">1.32 (1.23, 1.42)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.881 (0.817, 0.948)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.66 (0.613, 0.711)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">1.42 (1.32,
                                <break/>1.53)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.948 (0.88,
                                <break/>1.02)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">0.711 (0.66,
                                <break/>0.765)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">male 70&#x2013;79</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">13 (12.7, 13.4)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">8.68 (8.44, 8.92)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">6.51 (6.32, 6.69)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">14 (13.6, 14.4)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">9.34 (9.08,
                                <break/>9.6)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">7.01 (6.81,
                                <break/>7.21)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">female
                                <break/>70&#x2013;79</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">5.03 (4.83, 5.25)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.36 (3.22, 3.5)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2.52 (2.41, 2.63)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">5.42 (5.2, 5.65)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">3.61 (3.46,
                                <break/>3.77)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2.71 (2.6, 2.83)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">male 80+</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">41 (40.3, 41.7)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">27.3 (26.8, 27.8)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">20.5 (20.1, 20.9)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">44.1 (43.4,
                                <break/>44.8)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">29.4 (28.9,
                                <break/>29.9)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">22.1 (21.7,
                                <break/>22.5)</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">female 80+</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">24.2 (23.8, 24.7)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">16.1 (15.8, 16.5)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">12.1 (11.9, 12.4)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">26.1 (25.6,
                                <break/>26.6)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">17.4 (17.1,
                                <break/>17.7)</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">13 (12.8, 13.3)</td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
        </sec>
        <sec sec-type="discussion">
            <title>Discussion</title>
            <p>In a newly emerging infectious disease like COVID-19 data are assembled in challenging circumstances that may contribute to the underestimation of cases and deaths. Data available on the total confirmed cases and deaths in Spain do not provide age and gender information. Here, we have obtained estimates by population group by multiplying the total confirmed cases and deaths by the proportions occurring in each group of a sample with that information. This is a limitation of our study since it is possible that the sample with demographic information may not be representative of the whole population.</p>
            <p>We have seen that the approach of estimating crude CFRs by dividing the total number of deaths by the total number of confirmed cases produce results that are difficult to interpret due to several biases. For example, the estimated rates may overstate the true rates due to preferential inclusion of severe cases since data assembled during emergency settings typically contain people who seek medical care, have the most severe symptoms, and experience fatal outcomes. Following Verity 
                <italic toggle="yes">et al.</italic>
                <sup>
                    <xref ref-type="bibr" rid="ref-6">6</xref>
                </sup> we have adjusted by preferential ascertainment of severe cases by assuming complete ascertainment in the group with the highest attack rates, and using demography-adjusted under-ascertainment rates to estimate the number of infected individuals in each population group. In addition, CFRs may also be biased due to the delay between disease onset and death. We have adjusted for this bias by considering a specific distribution for the time from disease onset to death. These are strong assumptions that could greatly affect the results. We conducted a sensitivity analysis where we calculated the CFRs using different levels of ascertainment and different distributions for the time from disease onset to death. The sensitivity analysis yielded different values for the CFRs, and in all scenarios CFRs were higher in older age groups and males.</p>
            <p>In addition, CFRs calculated in the initial phase of an epidemic are highly dependant of the point in time they are calculated. Here we provide estimates calculated with data from 14 May but rates calculated at a later point in time could be different.</p>
        </sec>
        <sec sec-type="conclusions">
            <title>Conclusions</title>
            <p>The assessment of the severity of COVID-19 and the determinants of its variation is essential for planning health resources and the design of mitigation policies, including intelligent strategies to release population from confinement while protecting the most vulnerable. In this article we have estimated CFRs by age group and gender in Spain accounting for censoring and ascertainment biases. We have found that COVID-19 is highly influenced by age and gender with higher rates in older ages and males. The procedures used to obtain the CFR estimates require strong assumptions and although the interpretation of their magnitude should be treated with caution, the differences observed by age and gender are fundamental underpinnings to inform decision-making.</p>
        </sec>
        <sec>
            <title>Data availability</title>
            <sec>
                <title>Source data</title>
                <p>Data on total confirmed cases and deaths, as well as confirmed cases and deaths by age group and gender from a subset of the population are reported by the Spanish Ministry of Health and provided by 
                    <xref ref-type="bibr" rid="ref-5">5</xref>. Population data for Spain are obtained from the National Institute of Statistics of Spain
                    <sup>
                        <xref ref-type="bibr" rid="ref-4">4</xref>
                    </sup>.</p>
            </sec>
            <sec>
                <title>Underlying data</title>
                <p>Data used is available from GitHub (
                    <ext-link ext-link-type="uri" xlink:href="https://github.com/Paula-Moraga/coronavirus-cfr">https://github.com/Paula-Moraga/coronavirus-cfr</ext-link>) and archived with Zenodo
                    <sup>
                        <xref ref-type="bibr" rid="ref-12">12</xref>
                    </sup>.</p>
                <p>Zenodo: Paula-Moraga/coronavirus-cfr: First release. 
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5281/zenodo.3856444">http://doi.org/10.5281/zenodo.3856444</ext-link>
                    <sup>
                        <xref ref-type="bibr" rid="ref-12">12</xref>
                    </sup>
                </p>
                <p>This project contains the following underlying data: 
                    <list list-type="bullet">
                        <list-item>
                            <p>ccaa_covid19_casos2020-05-14.csv (number of confirmed cases in each of the 17 regions of Spain from 2020-02-21 to 2020-05-14)</p>
                        </list-item>
                        <list-item>
                            <p>ccaa_covid19_fallecidos2020-05-14.csv (number of deaths in each of the 17 regions of Spain from 2020-03-03 to 2020-05-14)</p>
                        </list-item>
                        <list-item>
                            <p>nacional_covid19_rango_edad2020-05-14.csv (number of confirmed cases, hospitalized, uci, and deaths in Spain for each age group and gender from 2020-03-23 to 2020-5-14)</p>
                        </list-item>
                        <list-item>
                            <p>popspainagegroupsex1Jul19.csv (Spanish population for each age and gender in 2019)</p>
                        </list-item>
                    </list>
</p>
                <p>Data are available under the terms of the 
                    <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/legalcode">Creative Commons Attribution 4.0 International license</ext-link> (CC-BY 4.0).</p>
            </sec>
        </sec>
        <sec>
            <title>Software availability</title>
            <p>Code for the results, figures and tables of this study can be found at 
                <ext-link ext-link-type="uri" xlink:href="https://github.com/Paula-Moraga/coronavirus-cfr">https://github.com/Paula-Moraga/coronavirus-cfr</ext-link>
            </p>
            <p>Archived code at time of publication: 
                <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5281/zenodo.3856444">http://doi.org/10.5281/zenodo.3856444</ext-link>
                <sup>
                    <xref ref-type="bibr" rid="ref-12">12</xref>
                </sup>.</p>
            <p>License: 
                <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/legalcode">Creative Commons Attribution 4.0 International license</ext-link>
            </p>
        </sec>
    </body>
    <back>
        <ref-list>
            <ref id="ref-1">
                <label>1</label>
                <mixed-citation publication-type="journal">
                    <collab>World Health Organization</collab>:
                    <article-title>Coronavirus disease (COVID-19) Pandemic</article-title>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.who.int/emergencies/diseases/novel-coronavirus-2019">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-2">
                <label>2</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Lipsitch</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Donnelly</surname>
                            <given-names>CA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Fraser</surname>
                            <given-names>C</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Potential Biases in Estimating Absolute and Relative Case-Fatality Risks during Outbreaks.</article-title>
                    <source>

                        <italic toggle="yes">PLoS Negl Trop Dis.</italic>
</source>
                    <year>2015</year>;<volume>9</volume>(<issue>7</issue>):<fpage>e0003846</fpage>.
                    <pub-id pub-id-type="pmid">26181387</pub-id>
                    <pub-id pub-id-type="doi">10.1371/journal.pntd.0003846</pub-id>
                    <pub-id pub-id-type="pmcid">4504518</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-3">
                <label>3</label>
                <mixed-citation publication-type="journal">
                    <collab>National Institute of Statistics</collab>:
                    <article-title>Espa&#x00f1;a en cifras</article-title>.<year>2019</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.ine.es/prodyser/espa_cifras/2019/12/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-4">
                <label>4</label>
                <mixed-citation publication-type="journal">
                    <collab>National Institute of Statistics</collab>:
                    <article-title>Population by age group and sex</article-title>.
                    <ext-link ext-link-type="uri" xlink:href="https://ine.es/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-5">
                <label>5</label>
                <mixed-citation publication-type="journal">
                    <collab>Datadista</collab>:
                    <article-title>Datasets related to COVID-19 in Spain</article-title>.
                    <ext-link ext-link-type="uri" xlink:href="https://github.com/datadista/datasets/tree/master/COVID%2019">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-6">
                <label>6</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Verity</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Okell</surname>
                            <given-names>LC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Dorigatti</surname>
                            <given-names>I</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Estimates of the severity of coronavirus disease 2019: a model-based analysis.</article-title>
                    <source>

                        <italic toggle="yes">Lancet Infect Dis.</italic>
</source>
                    <year>2020</year>;<volume>20</volume>:<fpage>669</fpage>&#x2013;<lpage>677</lpage>.
                    <pub-id pub-id-type="pmid">32240634</pub-id>
                    <pub-id pub-id-type="doi">10.1016/S1473-3099(20)30243-7</pub-id>
                    <pub-id pub-id-type="pmcid">7158570</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-7">
                <label>7</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Russell</surname>
                            <given-names>TW</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hellewell</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Jarvis</surname>
                            <given-names>CI</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Estimating the infection and case fatality ratio for coronavirus disease (COVID-19) using age-adjusted data from the out-break on the Diamond Princess cruise ship.</article-title>
                    <source>

                        <italic toggle="yes">Euro Surveill.</italic>
</source>
                    <year>2020</year>;<volume>25</volume>(<issue>12</issue>): pii=2000256.
                    <pub-id pub-id-type="pmid">32234121</pub-id>
                    <pub-id pub-id-type="doi">10.2807/1560-7917.ES.2020.25.12.2000256</pub-id>
                    <pub-id pub-id-type="pmcid">7118348</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-8">
                <label>8</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Linton</surname>
                            <given-names>NM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kobayashi</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Yang</surname>
                            <given-names>Y</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Incubation period and other epidemiological characteristics of 2019 novel coronavirus infections with right truncation: A statistical analysis of publicly available case data.</article-title>
                    <source>

                        <italic toggle="yes">J Clin Med.</italic>
</source>
                    <year>2020</year>;<volume>9</volume>(<issue>2</issue>):<fpage>538</fpage>.
                    <pub-id pub-id-type="pmid">32079150</pub-id>
                    <pub-id pub-id-type="doi">10.3390/jcm9020538</pub-id>
                    <pub-id pub-id-type="pmcid">7074197</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-9">
                <label>9</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Flaxman</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mishra</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Gandy</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Report 13: Estimating the number of infections and the impact of non-pharmaceutical interventions on COVID-19 in 11 European countries</article-title>.<year>2020</year>.
                    <pub-id pub-id-type="doi">10.25561/77731</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-10">
                <label>10</label>
                <mixed-citation publication-type="journal">
                    <collab>R Core Team</collab>:
                    <article-title>R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing</article-title>. Vienna, Austria,<year>2020</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.R-project.org.">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-11">
                <label>11</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Wickham</surname>
                            <given-names>H</given-names>
                        </name>
</person-group>:
                    <article-title>ggplot2: Elegant Graphics for Data Analysis</article-title>. Springer-Verlag New York,<year>2016</year>. ISBN 978-3-319-24277-4. URL
                    <ext-link ext-link-type="uri" xlink:href="https://ggplot2.tidyverse.org">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-12">
                <label>12</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Moraga</surname>
                            <given-names>P</given-names>
                        </name>
</person-group>:
                    <article-title>Assessing the age- and gender-dependence of the severity and case fatality rates of COVID-19 disease in Spain</article-title>.<year>2020</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://www.doi.org/10.5281/zenodo.3856444">http://www.doi.org/10.5281/zenodo.3856444</ext-link>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report43266">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/wellcomeopenres.17545.r43266</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Bezerra Sousa</surname>
                        <given-names>George J&#x00f3;</given-names>
                    </name>
                    <xref ref-type="aff" rid="r43266a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-0291-6613</uri>
                </contrib>
                <aff id="r43266a1">
                    <label>1</label>Cear&#x00e1; State University, Fortaleza, Brazil</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>13</day>
                <month>4</month>
                <year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Bezerra Sousa GJ</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport43266" related-article-type="peer-reviewed-article" xlink:href="10.12688/wellcomeopenres.15996.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>The article &#x201c;Assessing the age- and gender-dependence of the severity and case fatality rates of COVID-19 disease in Spain&#x201d; aims to calculate crude and adjusted fatality rates by age group and gender in Spain. Overall, the manuscript is well written with interesting analysis and important results. Minor considerations are given below. 
                <list list-type="order">
                    <list-item>
                        <p>In the introduction, the part from &#x201c;while people of any age&#x201d; to &#x201c;in these groups&#x201d; needs a reference.</p>
                    </list-item>
                    <list-item>
                        <p>Once the authors decided to go through a methodological approach on the use of models to calculate CFR in the COVID-19 scenario, the epidemiological features of the cases are not well addressed. It is understood that doing this type of analysis during an ongoing pandemic has its limitations. Then, I suggest addressing them as some limitations of the study.</p>
                    </list-item>
                    <list-item>
                        <p>The methods are well-stated and results are clearly presented.</p>
                    </list-item>
                    <list-item>
                        <p>Code and data files are available to download and replicate the study.</p>
                    </list-item>
                </list>
            </p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Yes</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>Infectious Diseases Epidemiology</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report39137">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/wellcomeopenres.17545.r39137</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Russell</surname>
                        <given-names>Timothy</given-names>
                    </name>
                    <xref ref-type="aff" rid="r39137a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-5610-6080</uri>
                </contrib>
                <aff id="r39137a1">
                    <label>1</label>Centre for Mathematical Modelling of Infectious Diseases, Department of Infectious Disease Epidemiology, London School of Hygiene and Tropical Medicine, London, UK</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>14</day>
                <month>7</month>
                <year>2020</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2020 Russell T</copyright-statement>
                <copyright-year>2020</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport39137" related-article-type="peer-reviewed-article" xlink:href="10.12688/wellcomeopenres.15996.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>The authors calculated adjusted CFR estimates for Spain, adjusting directly for the delay between onset to death and indirectly for under-ascertainment and the age structure of the Spanish population. The adjustments for delay and for under-ascertainment require some assumptions, so the authors carry out a sensitivity analysis testing how different ascertainment assumptions and delay distribution assumptions affect the overall results. The sex and age-specific CFR estimates they calculate are consistent with other published CFR estimates and provide a useful and detailed contribution to the evidence base of COVID severity estimates.</p>
            <p> </p>
            <p> The discussion and application of the existing difficulties and biases when estimating many epidemiological parameters during an ongoing outbreak is lucid and well-written. It sheds light on the difficulties present, rather than glossing over them, which is all too often the case in other severity estimate papers.</p>
            <p> </p>
            <p> One minor comment is that the under-ascertainment adjustment includes some assumptions. Specifically, they assume that where cases are most severe (i.e. older age groups), case ascertainment is highest. A very fair assumption! But there are ascertainment estimates, in Verity 
                <italic>et al</italic>. and many other detailed modelling papers (amongst others I'm sure), against which these assumptions could be tested. It is a minor comment, as the estimates are very much inline with other published estimates. But some discussion about the existence of more rigorous ascertainment estimates as a minimum requirement would help. Comparing such estimates to the assumed values would be even better.</p>
            <p> </p>
            <p> The code is available, but it would only run after some difficulty, as I believe some of the data loaded includes letter/accents specific to Spanish. It would not run on first attempt and I had to do quite a bit of digging and tweaking in the code to get it to run. I believe cleaning up the code so that it runs reproducibly and smoothly would also be a great benefit. However, the code is well written and commented and the analysis is relatively straight forward. It is great that it has been shared, as the analysis is almost reproducible just by reading the code to see what it does! Improving it would certainly help though.</p>
            <p> </p>
            <p> Apart from those minor points, this is a sound, interesting and well-written paper which addresses all of the difficulties in calculating CFRs during an outbreak and provides detailed estimates for Spain. I believe it would be of indexable standard if the code base is smoothed out a bit and some discussion of other case ascertainment estimates is included.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Yes</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>Mathematical modelling of infectious diseases.</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
    </sub-article>
</article>
