Skip to main content

Evaluation of the mortality registry in Ecuador (2001–2013) – social and geographical inequalities in completeness and quality

A Correction to this article was published on 18 April 2019

This article has been updated

Abstract

Background

Mortality registries are an essential data source for public health surveillance and for planning and evaluating public policy. Nevertheless, there are still large inequalities in the completeness and quality of mortality registries between and within countries. In Ecuador, there have been few nationwide evaluations of the mortality registry and no evaluations of inequalities between provinces. This kind of analysis is fundamental for strengthening the vital statistics system.

Methods

Ecological study assessing the completeness, quality and internal consistency of mortality data in the provinces of Ecuador, using 13 years of mortality data (2001–2013). Completeness was assessed using three types of death distribution methods (DDMs), quality by estimating the percentages of garbage codes and deaths with unspecified age or sex in the registered deaths, and internal consistency by estimating the percentage of deaths with reported causes of deaths considered impossible in some age–sex combinations. Finally, we propose a classification of the mortality registry in the studied areas based on completeness and quality.

Results

Completeness estimates (mean of the three methods used) in the provinces ranged from 21 to 87% in women and from 35 to 89% in men. The percentage of garbage codes in the provinces ranged from 21 to 56% in women and from 25 to 52% in men. Garbage coding was higher in women and in older age groups. The percentage of deaths with unspecified age or sex, and the percentage of deaths with reported causes of deaths considered impossible in some age–sex combinations was low in all the studied areas. The mortality registry could only be classified as acceptable in one area for men and one area for women.

Conclusions

We found substantial inequalities by sex, geographical areas and age in the completeness and quality of the mortality registry of Ecuador. The findings of this study will be helpful to direct measures to improve Ecuador’s vital statistics system and to generate strategies to reduce bias when using mortality data to analyse health inequalities in the country.

Peer Review reports

Background

Civil registration and vital statistics systems, and particularly mortality registries, are essential components of public health surveillance systems in all countries. An adequate vital statistics system not only allows governments and academia to monitor and analyse the health of a population, but can also be a fundamental tool for the planning and evaluation of public policy [1]. Timely and correct vital statistics not only allow people to claim and exercise their basic human rights but could also be useful to inform and empower the population [2]. Moreover, evidence suggests that countries with better vital statistics systems have better health outcomes (even after consideration of income and other socioeconomic factors) [3].

In many countries, especially high-income ones, mortality registers are usually considered one of the most reliable sources for timely and accurate health statistics. The situation in many low- and middle-income countries is quite different. The 2015 Lancet Series “Counting Births and Deaths” reported disappointing global progress with civil registration and vital statistics systems [4]. In 2007, only 31 of the 192 member states of the World Health Organisation (13% of the world’s population) had mortality statistics with more than 90% completeness, using a recent version of the international statistical classification of diseases and related health problems (ICD8, ICD9 or ICD10), and with 10% or less of ill-defined codes [5]. Moreover, striking inequalities between countries and regions are seen in death registration. In a study analysing mortality data from all WHO member states, Mathers and colleagues reported three interesting issues: first, coverage of death registration ranged from 100% in the WHO Europe Region to less than 10% in the WHO Africa Region; second, completeness ranged from 100% in most high-income countries, to less than 50% in the Dominican Republic, Haiti, Lebanon and Morocco; and third, the percentage of deaths coded with ill-defined codes ranged from 4% in New Zealand to more than 40% in Thailand and Sri Lanka [6].

Inequalities in mortality statistics are not only seen between countries but also within countries, even though studies evaluating within-country differences are still uncommon. In Latin America, for example, studies in Brazil and Chile have found wide differences in the completeness and quality of mortality statistics between sub regions in each country [7, 8]. These types of study are necessary for two main reasons: 1) They help authorities to invest more efforts and resources to strengthen the vital statistics system in areas with the greatest deficiencies; and 2) They allow researchers and public health workers to use the available data, adjusting it for completeness and deficiencies in quality.

Some studies (considering completeness and ill-defined codes used among other indicators) have classified the mortality data in Ecuador as being of either low or medium performance [4, 6]. In addition, a study by Phillips and colleagues (see Additional file 3: Figure S1) suggests that the quality of mortality statistics in the country – and specially completeness – fell between the 1980s and 2010 [9]. In the latest edition of the Pan American Health Organization “Core Indicators – Health Situation in the Americas”, a completeness of 75% was reported at the national level; 9% of the registered deaths were assigned to ill-defined codes, and more than 16% of deaths were “assigned to causes not considered useful for public health purposes” (garbage codes) [10]. No studies analysing geographical inequalities in the death registration system have been carried out in Ecuador.

The objective of this study was to evaluate the completeness, quality and internal consistency of Ecuador’s mortality registry from 2001 to 2013, describing geographical inequalities (between provinces - first administrative level), and social inequalities (by age and sex) within the country.

Methods

In this is ecological study, we collected mortality data from 2001 to 2013 for our analyses (762,131 deaths). Completeness and quality indicators were estimated at the national and provincial level. Ecuador has 24 provinces that can be located geographically in four regions: 1) The Galápagos Islands in the Pacific Ocean; 2) The coastal region in the western part of the continental territory; 3) The Amazonic region in the eastern portion of the continental territory; and 4) the Andean region, between the former two. During the study period, Santo Domingo and Santa Elena provinces were created in Ecuador. Santo Domingo was part of Pichincha and Santa Elena part of Guayas (the two most populated provinces in Ecuador). A stable cartography with 22 provinces was used (joining Pichincha with Santo Domingo, and Guayas with Santa Elena) to compare indicators between areas. At the time of the 2010 census, Ecuador had almost 14.5 million people. The population of the studied areas ranged from almost 4 million in Guayas/Santa Elena to less than 25,000 in Galapagos (details in Table 1).

  1. A)

    Information sources

Table 1 Provincial and national completeness estimates (2001–2010)

To estimate completeness, we used Ecuador’s national censuses from 2001 and 2010 and the mortality registry from 2001 to 2010. To estimate quality and internal consistency indicators, we used the mortality registry for the entire study period. In Ecuador, by law, the declaration and registration of all deaths is mandatory. The mortality registry contains all death certificates completed in the country by health professionals or (in their absence): 1) police or civil authorities or 2) civil registration officials. Death certificates include sociodemographic information (such as age and sex), home and death addresses, and causes of death. The National Institute of Statistics and Censuses (INEC) uses the information in the certificates to determine the underlying causes of death. For the entire study period, cause of death information was coded using the International statistical classification of diseases and related health problems - 10th Revision (ICD10). All databases were obtained from INEC and are available online (http://www.ecuadorencifras.gob.ec/estadisticas/).

  1. B)

    Completeness

Completeness can be defined as the percentage of deaths registered in the population covered by the mortality registration system [9]. To estimate completeness, we used a set of demographic methods called death distribution methods (DDMs). DDMs are one of several types of methods to estimate mortality completeness that also include capture-recapture methods, comparison of mortality with other estimates, and a newly developed empirical method that models key drivers of mortality in a population to estimate completeness [11]. DDMs are the most widely used methods to estimate adult mortality completeness. DDMs compare the age distribution of a population at two points (censuses) with the age distribution of the recorded deaths in that population (in the inter–censal period). To estimate mortality completeness, these methods assume “…that birth and death rates are constant, that there is no net migration in the population, and that the extent of age misreporting and other errors in data collection are minimal…” [12]. The three main types of DDMS were used: 1) Generalized Growth Balance (GGB); 2) Synthetic Extinct Generations (SEG); and 3) GGB and SEG hybrid (GGBSEG). A complete description of these methods can be found elsewhere [12, 13]. For these estimates, national and provincial population counts and the inter-censal mortality counts for men and women in 18 five-year age groups were obtained from both censuses and the mortality registry. Completeness estimates for male and female mortality in the study areas were estimated using the R package DDM [14]. For each sex and for each method used, DDM automatically chooses the age interval that best fits the models and minimizes the residuals. The age groups used for the estimations can be seen in Table 1. For each study area and for all Ecuador (for both men and women), we present the completeness estimates for each DDM method and the harmonic mean of the three methods. A more detailed description of the methods used can be found in Additional file 1: Appendix 1.

  1. C)

    Quality

Quality of the mortality registry can be assessed in many ways. Authors have proposed different strategies based on the review of sex and age distribution, of cause of death patterns and the review of ill-defined causes / “garbage codes” [15, 16]. In this study, the quality of mortality registration was assessed by two means: 1) estimating the percentage of “garbage codes” in the registered deaths in each of the study areas; and 2) estimating the percentage of reported deaths with unspecified age or sex.

Garbage codes can be defined as deaths assigned to codes that provide little or no information for cause of death analysis in public health. Naghavi et al. (2010) described four typologies of garbage codes: 1) “Causes that cannot or should not be considered as underlying causes of death”, such as signs and symptoms (R category in the ICD-10) or essential primary hypertension; 2) “Intermediate causes of death”, such as heart failure or peritonitis; 3) “Immediate causes of death that are the final steps in a disease pathway leading to death”, such as cardiac arrest; and 4) “Unspecified causes within a larger cause grouping”, such as diseases where the site is unspecified [17]. We complemented this garbage code list by comparing it with the Global Burden of Disease (GBD) 2013 and 2015 cause lists [18, 19]. This process allowed us to obtain a consistent list of GBD codes and garbage codes. We then estimated the percentage of garbage codes (total and of each of the 4 types) in each of the studied areas for deaths of men and women. The complete list of garbage codes used can be found in Additional file 2: Table S1. Annual percentages of garbage codes were also obtained to describe the temporal evolution in each study area.

Quality indicators were also analysed by age and sex. Age was categorized in the same 20 age groups used in the GBD: early neonatal (0–6 days old), late neonatal (7–27 days old), post-neonatal (28 to 364 days old), 1–4 years; 5-year age groups from 5 to 9 to 75–79 years, and an open age group of 80 years and older [20].

As the quality of death registration can be affected by the professional background of the people registering the deaths [8], the association between the percentage of garbage codes and the percentage of deaths not coded by a medical doctor (MD) was explored visually through the use of scatterplots and quantitatively through the estimation of Pearson’s correlation coefficients and their 95% confidence intervals.

  1. D)

    Internal consistency

Following previous studies on the subject, the internal consistency of the death registry was assessed by estimating the percentage of deaths with reported causes of death considered impossible in some age–sex combinations [4, 9]. These combinations were created for the study by Phillips et al. (2014) by reviewing medical literature and expert consultation. The list of medically impossible causes of death can be found in Additional file 2: Table S2 [9]. This internal consistency indicator was also estimated for the 20 age groups mentioned previously.

  1. E)

    Evaluation of the mortality registry in the 22 provinces

Based on the indicators of completeness and garbage coding (quality), we classified the study areas in 4 categories: 1) Acceptable: provinces with completeness of 70% or more, and with 35% or less garbage codes; 2) Deficient in completeness: areas with completeness below 70% but with 35% or less garbage codes; 3) Deficient in quality: areas with completeness of 70% or more, but with more than 35% garbage codes; and 4) Deficient in completeness and quality: provinces with completeness of less than 70%, and with more than 35% garbage codes. The 70% threshold for completeness was used in the study by Mathers et al. (2005) to define medium (> 70%) and low-quality data [6]. For garbage codes, the 35% threshold was used as it is the national percentage for the study period (allowing us to identify study areas above or below the national percentage).

Results

Of the 762,131 deaths registered in the study period, 330,450 (43.36%) involved women. More than 50% of the deaths registered involved people living in three provinces: Guayas (26.63%), Pichincha (18.13%), and Manabí (9.64%).

  1. A)

    Completeness

Differences were found between men and women, as well as wide heterogeneity among areas, in the completeness estimates in Ecuador. Table 1 shows the national and provincial completeness estimates using GGB, SEG, GGBSEG, and the harmonic mean of the three estimates for men and women. At the national level, completeness estimates ranged from 57.2% (GGBSEG) to 71.97% (GGB) in women and from 60.09% (GGBSEG) to 74.68% (SEG) in men. When the 22 provinces were analysed (using the harmonic mean of the three estimators), completeness for women ranged from 21.30% (in Galápagos) to 87.44% (in Tungurahua) and from 34.51% (in Galápagos) to 88.66% (in Chimborazo) for men. Figure 1 shows the geographical pattern of completeness (using the harmonic mean of the three estimates) for men and women. In both sexes, the worst completeness estimates were seen in Galápagos, the Amazonic provinces and in some of the coastal areas.

  1. B)

    Quality

Fig. 1
figure 1

Geographical distribution of mortality data completeness (2001–2010). GGB, Generalized growth balance method, SEG, Synthetic extinct generations method. GGB-SEG: Hybrid generalized growth balance and synthetic extinct generations method

Differences in the quality of the mortality registry were observed between men and women and among the study areas in Ecuador. Table 2 shows the national and provincial garbage code percentages (of each of the 4 types). At the national level, garbage codes were used in 36.67% of the reported deaths in women (15.63% type 1, 11.63% type 2, 1.80% type 3, and 7.61% type 4), and in 34.08% of the reported deaths in men (13.28% type 1, 9.71% type 2, 1.49% type 3, and 9.60% type 4). When the 22 provinces were analysed, the percentage of garbage coding (all 4 types) for women ranged from 21.39% (in Galápagos) to 56.88% (in Bolivar) and from 25.17% (in Galápagos) to 52.05% (in Bolivar) for men. Figure 2 represents the geographical pattern of garbage coding (all 4 types) for men and women. The garbage code percentages were consistently higher for women than for men. In addition, in men and women, the highest garbage code percentages were seen in the Amazonic provinces, in the northern coastal provinces and in the central Andean region.

Table 2 Provincial and national garbage code percentages (2001–2013)
Fig. 2
figure 2

Geographical distribution of garbage codes (2001–2013)

The temporal evolution of garbage coding in all the study areas can be seen in Additional file 3: Figure S1 and Additional file 4: Figure S2. When we analyse the temporal evolution of garbage coding, we can observe that there has been a steady descent in garbage codes in Ecuador in the study period; but that the situation in individual provinces is heterogeneous. Provinces located in the Amazonic, northern Coastal and in the central Andean regions show consistently high garbage code percentages through the study period. Other provinces show important declines in garbage code percentages. For example, provinces in the southern Coastal region (Guayas/Santa Elena, Los Rios and El Oro) and Azuay in the Andean region show this trend.

The age pattern of deaths coded with garbage codes showed a clear age gradient in both men and women: with percentages being lower at younger ages (7.01% in the early neonatal age group) and higher in the older age groups (42.64% in the group of people aged 80 years or older). The age pattern of garbage codes can be seen in detail in Additional file 2: Table S3.

The percentage of deaths not registered by an MD ranged from 1.5% (in Pichincha/Santo Domingo) to 50.17% (in Napo) for men; and from 1.03% (in Pichincha/Santo Domingo) to 53.12% (in Napo) for women. In all areas and in both men and women the percentages of garbage codes were higher than the percentage of deaths not coded by an MD. Additional file 5: Figure S3 shows visually how the percentage of deaths not coded by an MD relate to the percentage of garbage codes in the study areas. It can be noticed that many provinces in the Amazonic region and one province in the northern Coastal region (Esmeraldas) have high percentages of deaths not coded by an MD and high percentages of garbage codes. Also, some provinces in the Andean region (and Manabí in the coastal region) have high percentages of garbage codes, even thou their percentages of deaths not coded by an MD is lower. Pearson’s correlation was 0.82 (95%CI 0.61 to 0.92) for men and 0.84 (95%CI 0.65 to 0.93) for women.

When we analysed deaths without age or sex information, we found that all the registered deaths in the study period had sex information and that 948 (0.12%) had no age information (608 men and 240 women). More than half of the deaths with no age information were registered in three provinces: Pichincha (288 deaths), Azuay (124 deaths) and Loja (118 deaths).

  1. C)

    Internal consistency

At the national level, only 0.23% of the registered deaths in the mortality registry had causes of death considered impossible for the age or sex of the deceased. These percentages were similar in men (0.23%) and women (0.24%). In all but one of the areas, the percentage of deaths with causes of death considered impossible for the age / sex combinations was less than 1% (the exception was Galápagos were the percentage for men was 1.01%). The age pattern of these reported deaths showed that, for both men and women, their percentage was much higher at younger ages; especially in deaths occurring in children younger than 1 year (5.63% of the registered deaths in the age group between 28 days and 1 year). The age pattern of deaths with a reported cause impossible for the age/sex of the deceased is shown in detail in Additional file 2: Table S4.

  1. D)

    Mortality registry assessment at the provincial level

Figure 3 shows the classification of each province considering the mortality registry completeness and a quality indicator (percentage of non-garbage codes) for men and women. The size of each dot in the figure represents the population (in the 2010 census). In both men and women, only one area was classified as acceptable (Pichincha/Santo Domingo for women and Azuay for men). Of note, for both men and women, most of the areas located in the coastal region (except Manabí and Esmeraldas) and Galápagos were deficient in completeness; most of the areas located in the Andean region were classified as deficient in quality and almost all of the areas located in the Amazonic region were considered deficient in completeness and quality.

Fig. 3
figure 3

Evaluation of the mortality registry at the provincial level .Completeness: Harmonic mean of the three methods used for completeness estimations

Conclusions

We evaluated the completeness, quality and internal consistency of the mortality registry in the provinces of Ecuador from 2001 to 2013. Our results show that there are substantial inequalities in the registry by sex, geographical area and age. Completeness was lower for women in 20 of the 22 studied areas. The same was true for the country as a whole. The geographical pattern of completeness – for both men and women – showed that Galápagos and the Amazonic provinces had lower completeness estimates. Analysis of the quality of the mortality registry showed that the percentage of garbage codes was higher for women in 19 of the 22 study areas and in all of Ecuador. Analysis of the types of garbage codes showed that the percentages of types 1 to 3 were consistently higher in women and type 4 was more frequent in men. The geographical pattern of garbage coding showed that these codes were more common in the Amazonic provinces, in the central Andean region and in the northern coastal region. These areas also showed little or no improvement in garbage code percentages during the study period. In both sexes, there was a positive correlation between the percentage of deaths not coded by an MD and the percentage of garbage codes. For both sexes, there was also a clear age gradient in garbage coding, the percentage being much higher at older age groups. Internal consistency was high in all the studied areas. Nevertheless, we found that there was also an age gradient for internal consistency, which was lower in younger age groups. Classification of the areas by the completeness and quality of the mortality registry revealed that the mortality registry could not be classified as acceptable for both sexes in any of the study areas (Pichincha/Santo Domingo was acceptable for men and Azuay for women).

The literature reviewed shows wide heterogeneity between the mortality registry completeness estimates reported for Ecuador. This can be attributed to the diversity of the methods that can be used to estimate completeness; methods that are rarely made explicit in the reports from many international health organizations. Murray et.al compared 234 variants of DDMs and recommends using combinations of GGB, SEG and GGBSEG for estimations, a recommendation we followed [12]. Our results are in agreement with those reported by Phillips et al. (Additional file 3: Figure S1), in which the completeness of the mortality registry in Ecuador seems to have a decreasing tendency and in 2010 was between 60 and 70% [9]. Nevertheless, our results are different from the ones in other studies. For example, the UN population division estimates completeness to be a little higher (between 70 and 79%), and the GBD 2016 project estimates a mortality completeness over 80% for the study period [21, 22]. The differences found between the different sources can be explained by the use of diverse methods to estimate completeness and the high uncertainty of the methods. For example, the GGB project uses the three DDM methods as recommended by Murray et al. (2010) to estimate adult mortality. After that, they combine the results from the DDM methods with estimations of under-5 completeness for several time periods. When necessary, they use sibling histories too. Even after all this complex process, they still recognize that estimates may change between GBD revisions [23].

To further compare our results to the ones obtained using different methods, we obtained national and provincial completeness estimates for 2010, applying the empirical method described by Adair and López (2018). This method uses crude death rates, the population age structure, and the under-five mortality rate and registration completeness as predictors of random-effects models that estimate mortality completeness [11]. The method makes two fairly strong assumptions, namely that deaths occur in the sub-national areas of residence and that the estimates of populations are accurate. Moreover, authors state that the models used could perform poorly in countries experiencing high HIV prevalence or high number of violent or alcohol related deaths. This method estimates (for all Ecuador) a completeness over 90% for both sexes; a result that seems unusually high if compared to the rest of estimates of the country (ranging from 60 to 80%).

Moreover, when we estimated the provincial results (see Additional file 2: Table S5), we could observe that some of the most rural provinces (in the Amazonic region), with lowest data quality, and less deaths certified by a medical doctor have high completeness estimates. For example, Amazonic provinces like Napo, Zamora Chinchipe and Sucumbíos have higher completeness estimates than Pichincha (province with mostly urban population and much more accessibility to health services). These results are in concordance to what was found when obtaining sub-national completeness estimates in Brazilian states, where concordance was lower when comparing GGB and the new method. These abnormal results could be explained by: 1) unreliable under-five mortality estimates; 2) unreliable population estimates; 3) poor performance of the method in subnational settings, especially when data quality is low. Certainly, much work is still needed to improve completeness estimation methods worldwide, especially in sub-national contexts.

As mentioned previously, geographical inequalities in the completeness and quality of mortality registries have been seen in other countries in South America. In our study, the pattern of completeness and garbage coding is similar to the pattern of socio-economic deprivation in Ecuador [24]. Moreover, some of the provinces with worst completeness and quality indicators are those with the highest proportions of ethnic groups that have historically been excluded and impoverished (indigenous, afro-ecuadorian, and montubio) [25]. When analysing the temporal evolution of the quality of the mortality registry, these areas show little or no improvements. Attention should be brought also to the provinces that paradoxically have high quality and low completeness or high completeness and low quality of the mortality data. Galapagos has a low percentage of garbage codes (high quality) and also a low completeness estimate. We believe that this could be explained by the low population (and consequent low number of deaths) and relatively high migration rates in the Province that could make DDM methods to perform poorly (completeness being underestimated). On the other side, many provinces in the central Andean region show high mortality completeness estimates and low-quality data. We believe that the particular characteristics of these areas should be studied more in depth in order to explain this phenomenon.

Inequalities in the mortality registry quality and completeness between men and women have scarcely been studied in low- and middle-income countries. In Brazil, differences in completeness and ill-defined causes have been found between men and women [26]. There could be some explanations for the differences found in this study: 1) Gender bias in the diagnosis of various conditions has been reported for many conditions in other countries [27, 28], which could also be an important issue in Ecuador. 2) Because more men die from external causes (which require investigation of the death and autopsy), their deaths could be registered more frequently and with more correct diagnoses. This has been proposed as an explanation for the sex differences in the mortality registry quality observed in Belo Horizonte, Brazil [29]. 3) In other contexts, maternal deaths have been found to be greatly underreported and misclassified [30, 31]. All of these explanations should be studied in greater depth in Ecuador.

The correlation between the professional background of the people who certify deaths and the quality of the mortality registry has been observed in other countries in the region; finding that mostly rural areas have less deaths certified by medical doctors and lower quality of the mortality data [8]. We have found a similar pattern in Ecuador, especially in the provinces in the Amazonic region and Esmeraldas in the Coastal region. Populations in provinces with disperse populations in rural areas could have greater difficulties finding healthcare personnel to certify deaths. One thing that can be noticed is that there is still an important percentage of deaths certified by medical doctors and assigned to garbage codes, especially in many provinces in the Andean region. This means that work is needed not only to improve access to healthcare professionals, but also to improve the quality of death certification by medical doctors.

The age pattern of garbage codes was similar to that observed in other contexts, and could be explained by the difficulty of determining the cause of death accurately in older people (with multiple comorbidities) [32]. For example, we analysed the principal garbage codes in people over 80 years old and found that heart failure (ICD10 code I50), senility (ICD10 code R54) and essential hypertension (ICD10 code I10) accounted for approximately 40% of the garbage codes in that age group. Deaths coded as heart failure accounted for 17.21% of the garbage codes in women and 16.30% in men; senility accounted for 15.34% of garbage codes in women and 13.55% in men; and essential (primary) hypertension accounted for 10.54% of garbage codes in women and 9.76% in men. Even though the internal consistency indicator was low in all of the studied areas, we believe it is important to also notice the age pattern. More research is needed to assess why more “medically impossible” causes of death are assigned at younger ages in Ecuador.

Our study has some limitations. The most important ones relate to the limitations of the estimation of completeness by DDMs. These methods assume that: 1) the studied population is closed to migration; 2) that completeness (of mortality and census counts) are constant in all age groups; and 3) that age misreporting is minimal or non-existent [12]. All these issues could be important, but migratory patterns could be a vital factor in all middle- and low-income countries and especially in Ecuador during the study period (with substantial internal and external migratory waves) [33, 34]. Royuela & Ordoñez (2018) describe the internal migration patterns in the Provinces of Ecuador, using data from the national censuses since 1982. They describe important differences between provinces. For example, in 2010, percentages of net migration ranged from − 8.7 (Bolivar) to 10.9 (Galápagos). We believe that some of the completeness estimates could be underestimated (especially in Guayas and Pichincha) due to this problem. Some authors have proposed approaches to adjust some of the DDM methods for migration [35], but their use is still not widespread. In the future, methods that include migration could be used in the Ecuadorian context. Other important limitation of DDM methods is uncertainty. Murray et al. (2010) reported that “…the uncertainty around relative completeness of registration is likely to be at least +/-20% of the estimated level, and perhaps considerably more…” [12]. In Additional file 1: Appendix 1, we compare completeness estimates presented in the article with estimates obtained using the age groups recommended in the article by Murray and colleagues. We found that, at a national level, results were quite similar between the two approaches (3.43% difference between harmonic mean of the three methods in women and 5.51% in men). Nevertheless, results showed a much greater variability in the provincial estimates. All this means that the completeness estimates presented should be taken as rough estimates, helpful to orientate public policy and have a sense of the geographical pattern of completeness in the country; but not as definitive and precise estimates. Greater work is needed to refine methods to estimate completeness at subnational levels and in countries were data is not completely compliant with the assumptions of DDM methods. As Hill (2017) points out, even thou in the last decade important developments in analytical strategy have been seen, “…very little in the way of new methodology has emerged…” [13]. New methods are scarce, but they have the potential of dealing with some of the limitations of DDMs as the lack of timeliness, complexity and the assumption of no migration. Certainly, there still much work needed in order to have reliable subnational completeness estimates for many middle and low income countries. Another important step to obtain better estimates of mortality completeness by age groups would be to use indirect methods to assess completeness in other age groups (such as infants). Nevertheless, our results provide a good idea of adult mortality completeness and can be used to adjust adult mortality estimates in the future. Regarding the quality and internal consistency indicators, we believe it could be important to assess and adapt the garbage code and “medically impossible” cause lists to the local context. We should also consider that garbage codes, age/sex missingness and internal consistency are proxy indicators of the overall quality of the mortality registry. Other important quality issues as classification accuracy could not be measured in this study.

Our study is the first comprehensive evaluation of the mortality registry in Ecuador and of the inequalities (geographical, age, sex) it contains. The results of this study will be important for public health researchers, planners of national statistics and for the general population. In particular, Ecuador’s National Institute for Statistics and Censuses (INEC) can use this research to determine which areas and populations require greater attention to strengthen and improve the registry and whether it should focus on completeness, quality, or both. If we consider vital statistics systems as “essential public goods” [1], which help us to better understand our societies and tackle inequalities and other important problems, it is imperative to invest in their continuous improvement and maintenance.

Concluding remark

We found that the mortality registry in Ecuador has a series of limitations, which were more substantial in some areas than others. Nonetheless, we believe that the efforts and resources invested in assembling and maintaining the registry should not be lost. We also believe that mortality data in Ecuador can be used to study health inequalities but that, to do so, some additional work is required. Adjustment of mortality data by completeness and the use of redistribution protocols for garbage codes have already been effectively employed in the GBD study [22]. A similar approach can be adopted at a sub-national level to correct mortality estimates and cause of death data until the vital statistics system achieves an optimal level of completeness and quality in the registration of deaths.

Change history

  • 18 April 2019

    Following the publication of this article [1], the authors reported a typesetting error in Table 1 that caused the columns of the table to be ordered incorrectly, and a typographical error in a sentence in the Conclusions section.

References

  1. Setel PW, Macfarlane SB, Szreter S, Mikkelsen L, Jha P, Stout S, et al. A scandal of invisibility: making everyone count by counting everyone. Lancet. 2007;370(9598):1569–77.

    Article  Google Scholar 

  2. AbouZahr C, De Savigny D, Mikkelsen L, Setel PW, Lozano R, Nichols E, et al. Civil registration and vital statistics: Progress in the data revolution for counting and accountability. Lancet. 2015;386(10001):1373–85.

    Article  Google Scholar 

  3. Phillips DE, AbouZahr C, Lopez AD, Mikkelsen L, De Savigny D, Lozano R, et al. Are well functioning civil registration and vital statistics systems associated with better health outcomes? Lancet. 2015;386(10001):1386–94.

    Article  Google Scholar 

  4. Mikkelsen L, Phillips DE, Abouzahr C, Setel PW, De Savigny D, Lozano R, et al. A global assessment of civil registration and vital statistics systems: monitoring data quality and progress. Lancet. 2015;386(10001):1395–406.

    Article  Google Scholar 

  5. Mahapatra P, Shibuya K, Lopez AD, Coullare F, Notzon FC, Rao C, et al. Civil registration systems and vital statistics: successes and missed opportunities. Lancet. 2007;370(9599):1653–63.

    Article  Google Scholar 

  6. Mathers CD, Ma Fat D, Inoue M, Rao C, Lopez AD. Counting the dead and what they died from: an assessment of the global status of cause of death data. Bull World Health Organ. 2005;8383(3):171–7.

    Google Scholar 

  7. de Lima EEC, Queiroz BL. Evolution of the deaths registry system in Brazil: associations with changes in the mortality profile, under-registration of death counts, and ill-defined causes of death. Cad Saude Publica. 2014;30(8):1721–30.

    Article  Google Scholar 

  8. Núñez FML, Icaza NMG. Calidad de las estadísticas de mortalidad en Chile, 1997-2003. Rev Med Chil. 2006;134(9):1191–6.

    Article  Google Scholar 

  9. Phillips DE, Lozano R, Naghavi M, Atkinson C, Gonzalez-Medina D, Mikkelsen L, et al. A composite metric for assessing data on mortality and causes of death: the vital statistics performance index. Popul Health Metrics. 2014;12(1):14.

    Article  Google Scholar 

  10. PAHO. CORE INDICATORS - health situation in the Americas 2016. Washington, D.C: PAHO; 2016.

    Google Scholar 

  11. Adair T, Lopez AD. Estimating the completeness of death registration: An empirical method. Queiroz B, editor. PLoS One. 2018;13(5):e0197047.

    Article  Google Scholar 

  12. Murray CJL, Rajaratnam JK, Marcus J, Laakso T, Lopez AD. What can we conclude from death registration? Improved methods for evaluating completeness. PLoS Med. 2010;7(4):e1000262.

    Article  Google Scholar 

  13. Hill K. Analytical methods to evaluate the completeness and quality of death registration: current state of knowledge; 2017.

    Google Scholar 

  14. Riffe T, Lima E, Queiroz B. Package “DDM”: death registration coverage estimation; 2017.

    Google Scholar 

  15. Abouzahr C, Mikkelsen L, Rampatige R, Lopez A. Mortality statistics: a tool to improve understanding and quality. Brisbane: School of Population Health - The University of Queensland; 2010.

  16. Mikkelsen L, López AD. Guidance for assessing and interpreting the quality of mortality data using ANACONDA: Melbourne: Civil Registration and Vital Statistics Improvement Group, Bloomberg Philanthropies Data for Health Initiative; 2017.

  17. Naghavi M, Makela S, Foreman K, O’Brien J, Pourmalek F, Lozano R. Algorithms for enhancing public health utility of national causes-of-death data. Popul Health Metrics. 2010;8(1):9.

    Article  Google Scholar 

  18. Lozano R, Naghavi M, Foreman K, Lim S, Shibuya K, Aboyans V, et al. Global and regional mortality from 235 causes of death for 20 age groups in 1990 and 2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012;380(9859):2095–128.

  19. Global Burden of Disease Study 2015. Causes of Death and Nonfatal Causes Mapped to ICD Codes. Seattle; 2015. Available from: http://ghdx.healthdata.org/record/global-burden-disease-study-2015-gbd-2015-causes-death-and-nonfatal-causes-mapped-icd-codes. Accessed 15 Sept 2018.

  20. Murray CJ, Ezzati M, Flaxman AD, Lim S, Lozano R, Michaud C, et al. GBD 2010: Design, definitions, and metrics. Lancet. 2012;380:2063–6.

    Article  Google Scholar 

  21. UNSD. Coverage of Birth and Death Registration. Demographic and Social Statistics - Civil Registration and Vital Statistics. 2017. Available from: https://unstats.un.org/unsd/demographic-social/crvs/index.cshtml#coverage. [cited 2018 Sep 9]

    Google Scholar 

  22. Naghavi M, Abajobir AA, Abbafati C, Abbas KM, Abd-Allah F, Abera SF, et al. Global, regional, and national age-sex specific mortality for 264 causes of death, 1980–2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet. 2017;390(10100):1151–210.

  23. Wang H, Naghavi M, Allen C, Barber RM, Bhutta ZA, Carter A, et al. Global, regional, and national life expectancy, all-cause mortality, and cause-specific mortality for 249 causes of death, 1980–2015: a systematic analysis for the global burden of disease study 2015. Lancet. 2016;388(10053):1459–544.

    Article  Google Scholar 

  24. Larrea Maldonado C, Camacho ZG. Atlas de las desigualdades socio-económicas del Ecuador. Quito: Senplades; 2013.

  25. Instituto Geográfico Militar. Atlas de la República del Ecuador. Quito: Instituto Geográfico Militar; 2013.

    Google Scholar 

  26. França E, Rao C, De Abreu DMX, De Souza MDFM, Lopez AD. Comparison of crude and adjusted mortality rates from leading causes of death in northeastern Brazil. Rev Panam Salud Pública. 2012;31(4):275–82.

    Article  Google Scholar 

  27. Chapman KR, Tashkin DP, Pye DJ. Gender bias in the diagnosis of COPD. Chest. 2001;119(6):1691–5.

    Article  CAS  Google Scholar 

  28. Beery TA. DIAGNOSIS AND TREATMENT OF CARDIAC DISEASE Gender bias in the diagnosis and treatment of coronary artery disease; 1995.

    Google Scholar 

  29. Ishitani LH, Teixeira RA, Abreu DMX, Paixão LMMM, França EB, Ishitani LH, et al. Quality of mortality statistics information: garbage codes as causes of death in Belo Horizonte, 2011-2013. Rev Bras Epidemiol. 2017;20(suppl 1):34–45.

    Article  Google Scholar 

  30. Horon IL. Underreporting of Maternal Deaths on Death Certificates and the Magnitude of the Problem of Maternal Mortality. Am J Public Health. 2005;95(3):478–82.

    Article  Google Scholar 

  31. Kao S, Chen LM, Shi L, Weinrich MC. Underreporting and misclassification of maternal mortality in Taiwan. Acta Obstet Gynecol Scand. 1997;76(7):629–36.

    Article  CAS  Google Scholar 

  32. Lee Y-R, Kim YA, Park S-Y, Oh C-M, Kim Y-E, Oh I-H. Application of a modified garbage code algorithm to estimate cause-specific mortality and years of life lost in Korea. J Korean Med Sci. 2016;31:121–8.

    Article  Google Scholar 

  33. Torres A, Amezquita A, Rojas S, Valle A. ECUADOR: La migración internacional en cifras. Quito: Flasco - Unfpa; 2008.

  34. Royuela V, Ordóñez J. Internal migration in a developing country: A panel data analysis of Ecuador (1982-2010). Pap Reg Sci. 2018;97(2):345–67.

    Article  Google Scholar 

  35. Hill K, Queiroz B. Adjusting the general growth balance method for migration. Rev Bras Estud Popul. 2010;27:7–20.

    Article  Google Scholar 

Download references

Acknowledgements

This article forms part of the doctoral dissertation of Andrés Peralta, at Universitat Pompeu Fabra (UPF) in Barcelona, Spain.

Funding

Andrés Peralta was supported by the National Scholarship programme of the Ecuadorian government -National Secretary of Higher Education, Science, Technology and Innovation (SENESCYT – Convocatoria Abierta 2013 – Primera Fase).

Availability of data and materials

All databases used in this study were obtained from INEC and are available online (http://www.ecuadorencifras.gob.ec/estadisticas/). Final databases, syntaxes, tables and other relevant information are available from the corresponding author on reasonable request.

Author information

Authors and Affiliations

Authors

Contributions

All of the authors meet the conditions of authorship. MMDO, JB and AP contributed in the conception and design of the study. AP, and MMDO contributed in the acquisition of data and interpretation of data. AP, MMDO, BL and AP all contributed to the statistical analyses. JB, VE, CB, AP, MMDO and LC-G all significantly contributed with insights for the introduction and conclusions and helped with the interpretation for the results seen in this paper. AP wrote the first draft of the paper. All of the authors critically revised the manuscript and approved the final version of the manuscript.

Corresponding author

Correspondence to Andrés Peralta.

Ethics declarations

Ethics approval and consent to participate

The study presented in this paper used publicly available secondary data. All mortality and censuses data is anonymized. Therefore, no ethics committee approval was necessary for this study.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional information

The original version of this article was revised: the original article contained an error in Table 1.

Additional files

Additional file 1

: Appendix 1. Death Distribution Methods (DDM) Used in the Study (PDF 247 kb)

Additional file 2

: Table S1. List of ICD-10 codes considered garbage codes by type. Table S2. Causes of death considered impossible in some age – sex combinations. Table S3. Distribution of garbage code percentages (2001–2013) by age groups. Table S4. Distribution of causes of death considered impossible in some age – sex combinations (2001–2013) by age groups. Table S5. Completeness estimates using Adair and López (2018) method - 2010 (XLSX 27 kb)

Additional file 3

: Figure S1. Evolution of garbage code percentages (2001–2013) in each of the study areas - Women (PDF 10 kb)

Additional file 4

: Figure S2. Evolution of garbage code percentages (2001–2013) in each of the study areas – Men (PDF 10 kb)

Additional file 5

: Figure S3. Garbage Code percentages and percentages of deaths not coded by a Medical Doctor (2001–2013) for Women and Men – Scatterplot (PDF 6 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Peralta, A., Benach, J., Borrell, C. et al. Evaluation of the mortality registry in Ecuador (2001–2013) – social and geographical inequalities in completeness and quality. Popul Health Metrics 17, 3 (2019). https://doi.org/10.1186/s12963-019-0183-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12963-019-0183-y

Keywords