Sustainability indices for energy utilization using a multi-criteria decision model
Energy, Sustainability and Society volume 10, Article number: 16 (2020)
Energy and water availability are considered vital for a country’s development. An exhaustive review of literature has been undertaken on indicators for sustainable energy development. In addition to energy and water, the resources of the country namely land availability, human capital, and nation’s wealth were also found to be vital for sustainable energy development of any country. These resources have to be optimally used for sustainable energy development which is measured in terms of technical, economic, social, environmental, and institutional indices.
In this research, a multi-criteria decision model was used to measure sustainable energy development efficiency. The natural resource of the country was considered as the input criteria, while the indices were used as the output criteria. This research is unique in finding if the country’s resources are being utilized in an efficient manner for sustainable development using the multi-criteria fuzzy-analytical hierarchical processing—data envelopment analysis model.
From the fuzzy analytical hierarchical processing, it was found that experts were of the opinion that water availability and energy reserves were the most important parameters among the input resources, while environmental and social indices were opined to be the most important parameters among the output indices. Data envelopment analysis model was carried out using assurance region Charnes, Cooper, and Rhodes output-oriented method. The results revealed that Togo was the most efficient country with maximum sustainable energy development efficiency. Sensitivity analysis was also carried out to find which among the resources were sensitive with respect to energy sustainability for a specific country.
The analysis can help countries to benchmark themselves against the country lying in the efficient frontier and draft policies to improve their energy sustainability indices. Similar analysis and comparison can be done for other countries, since this research analysis was carried out only for 48 developing countries.
Sustainable development can be defined as the development that caters to the needs of the present generation without compromising on its ability to meet the needs of the future generation . With globalization and swift changeover taking place from an agricultural economy to an industrial economy  and then from an industrial economy to green economy (https://sustainabledevelopment.un.org/index.php?page=view&type=400&nr=131&menu=1515) in several fronts, the world is witnessing, on the one hand, massive consumption and large scale depletion of its natural resources while on the other hand increased environmental consciousness. Care has to be taken to ensure that such consumption does not happen at the cost of the future generation.
The rapid development in the industrial sector had tousled the planning of the resources. In both developed and developing countries, planners and policymakers are looking at various options for sustainable development, so that the country’s resources are kept available for generations to come. Sustainable development requires judicious use of resources, technology, economic incentives, and strategic policies, at the local and national level .
Energy and water are considered as vital resources for a country’s development. The percentage of renewable energy in the total energy scene has been declining over the years . With rapid industrialization in both developed and developing countries, several energy-intensive industries have sprouted over the years . Developing countries find they can very easily procure the necessary technology and the energy resources for industrialization that enabled them to quickly shift over from an agricultural economy to an industrial economy. However, it is important to note that such a transition should happen keeping sustainability in focus. In addition to energy, water is yet another resource which every country has to judiciously utilize. The development of any country is found to be directly proportional to that country’s endowment of water and energy resources . In addition to water and energy resources, the land is yet another vital input for energy sustainability since energy is a land-use intensive sector . It is the role of policymakers to make use of the available land in an efficient manner for sustainable development. The human capital is another resource available within its national boundaries which need to be optimally utilized, since energy sustainability depends on the manpower available to support the energy activities . Several researchers have established the causality relationship between national income and energy , and hence national income has been considered as an input criterion for energy sustainability. All of these resources have to be used in an optimal manner to meet the needs of the present generation for enhancing energy sustainability without jeopardizing the requirements of future generations.
In this paper, a framework is proposed that considers how to utilize the available resources within a country, namely energy, water, land, human capital, and national wealth in an effective manner so that it can target for higher sustainable energy development. It gives an indication of how a country can judiciously use its limited resources to achieve the desired output. While choosing the energy resources for a country, it is essential to consider the consequences of the same which will be reflected in the output indices selected for sustainable energy development. The sectors wherein course corrections need to be taken are also presented, using a multi-criteria multi-evaluation methodology. Using this framework, the policymakers can strategize their energy portfolio so that they become sustainable in the long run.
Indicators for sustainable development
Researchers have proposed various indices and metrics to find whether a country is progressing in a sustainable manner. A good framework of indicators will help policymakers to understand where the country is headed and how to provide for alternate solutions. The framework needs to present the inter-linkages and tradeoffs. Several indicators have been put forth by researchers since the Brundtland report was published in 1987 [3, 10,11,12].
Latin American Energy Organization (OLADE), Economic Commission for Latin America and the Caribbean (ECLAC), and the German Technical Cooperation Agency (GTZ) proposed eight indicators . Millennium Development Goals’ (MDG) Indicator Program proposed 60 indicators . International Atomic Energy Agency (IAEA) proposed 30 indicators for Energy Indicators for Sustainable Development (EISD) [3, 15]. Collection of data for these numerous indicators is arduous. Further deciphering and inferring information from these numerous indicators, which sometimes are in different units, becomes cumbersome. Though this wide spectrum of dashboard indicators has its own advantages, it was found that composite indicators were relatively easier to measure and compare across multiple dimensions. Some examples include the Energy for Development Index (EDI), Environmental Sustainability Index (ESI), and Environmental Performance Index (EPI).
The Energy for Development Index (EDI)  is a composite index that measures development in terms of energy use. The components include commercial energy consumption per capita, commercial energy share in total energy use, and percentage of the population having access to electricity. The Environmental Sustainability Index (ESI) jointly developed by Yale and Columbia universities, World Economic Forum, and European Commission Joint Research Centre is another example of a composite indicator that summarized the index from 21 indicators to measure environmental sustainability . Environmental Performance Index (EPI) was also developed by the same group with 25 performance indicators. Thus, composite indicators were found to be very comprehensive and robust covering various aspects. Also, the performance of these indicators could be easily compared across dimensions, sectors, and countries. However, all these indicators calculate the status of the measure, namely environmental sustainability and do not provide a mechanism to identify how to achieve a higher level of sustainability.
Composite sustainable indicators for assessing city/region/country
Having established the importance of composite indicators, a review of the literature was undertaken to find how composite indicators can be used to assess a city/region/country’s sustainability.
Siemens Green City Index (http://sg.siemens.com/city_of_the_future/_docs/gci_report_summary.pdf) evaluated more than 120 cities around the world (27 cities in the USA and Canada, 12 cities in Germany, 30 cities in Europe, 17 cities in Latin America, 22 cities in Asia, 7 cities in Australia and New Zealand, and around 15 cities in Africa) using 30 indicators (16 quantitative and 14 qualitative) which included energy, waste, land use, water, air quality, environmental governance, and carbon dioxide (CO2) emissions. The indices have been used without any categorization as to whether they are input or outcome parameters. It is necessary to find whether the input resources available in a country are being optimally transformed into the required output to ensure sustainability. In an indirect way, Bossel  has addressed this aspect. He has presented indicators for sustainable development for a state, country, and globally, in terms of an orientor, namely existence, effectiveness, freedom of action, security, adaptability, coexistence, and psychological needs. He has identified subsystem performance for each, in terms of human, support, and natural and has related it to the total system. Impact on the environment because of personal demands to meet sustainable footprint is found under coexistence dimension.
For measuring sustainability in the urban context, researchers [19,20,21] have used four indices, namely social, economic, community, and cultural (human). Zhang  has developed 22 urban sustainability indicators presented in Table 10 in Appendix which was developed in the context of urban China. The researchers have found the indicators in terms of ratio assigning weights for each. The indicators highlight to what extent urban sustainability has been achieved. As technological innovations are being witnessed across several disciplines, it is emerging as one of the important indices that have to be sustainable. In this paper, in addition to other dimensions, technical sustainability in terms of renewable energy generation and non-renewable energy substitution is measured. Dijk and Mingshun  using the 22 indicators developed by Zhang  measured urban sustainability index (USI) in four Chinese cities. Andriantiatsaholiniaina et al.  measured sustainable development using environmental, economic, social, political, and cultural indices.
Lee and Huang  based on the “3E11” structure of environment, equity (social equity), economy, and institution (politics) [26,27,28,29,30,31] proposed 51 indicators (Table 11 in Appendix). An institutional dimensional indicator has been newly proposed along with the other three indicating its growing importance. The researchers have carried a longitudinal study to measure Taipei’s sustainability over a period of 11 years. Trigg et al.  have included a new parameter, namely quality of life, in addition to resilience and environmental performance to measure sustainability. They have compared and ranked 15 Australian cities.
On the same lines, to assess sustainability among cities, Zhou et al.  identified 33 indicators for low-carbon eco-city planning in China. Kostevšek et al.  developed 20 indicators across energy, economy, and social aspects to assess the district heating system of Ormoz Municipality in Slovenia. Martinez  has used energy, economic, environmental, and social indicators (Table 12 in Appendix) to assess the energy and sustainable development in cities by taking Bogota as a case study. The indices used for measuring sustainable development focuses on energy sustainability with special reference to environmental emission. When cities become sustainable, the expectation is, it will automatically lead to a country’s sustainability. However, this may not be true because of the urban-rural divide in terms of resource availability. The 17 sustainable development goals set by the United Nations are as follows: (i) No Poverty, (ii) Zero Hunger, (iii) Good Health, and Well-being; (iv) Quality Education, (v) Gender Equality, (vi) Clean Water, and Sanitation; (vii) Affordable and Clean Energy; (viii) Decent Work and Economic Growth; (ix) Industry, Innovation, and Infrastructure; (x) Reducing Inequality, (xi) Sustainable Cities, and Communities; (xii) Responsible Consumption and Production; (xiii) Climate Action, (xiv) Life Below Water, (xv) Life On Land, (xvi) Peace, Justice, and Strong Institutions; and (xvii) Partnerships for the Goals. Unless concerted efforts are taken towards achieving these goals, development will take place only in segregated pockets. Sustainable development measurement must be from a holistic perspective wherein every aspect of the economy is covered and which in consequence will lead to global sustainability.
Strunz et al  in their meta-analysis have clearly brought out that the resource input is a major challenge; the global community needs to address first for achieving sustainability followed by the risks associated on the sink side, namely the outcome side in terms of climate change and biodiversity loss resulting from human activity. The authors suggest that a positive framework has to be proposed rather than issuing ecological collapse warnings because such activities are found to be psychologically ineffective since they result only in fear and lack of action. Any new mechanism being ventured into should ensure there is a proper balance between the resource availability and its consumption for the ecosystem to be sustainable.
Kılkış  has developed a composite index, namely Sustainable Development of Energy, Water and Environment Systems (SDEWES) City Sustainability Index (Table 13 in Appendix). This is a comprehensive index drawing inferences from various research work. The index is used to benchmark cities using various themes: (i) energy consumption and climate, (ii) penetration of energy and carbon dioxide saving measures, (iii) renewable energy potential and utilization, (iv) water and environmental quality, (v) carbon dioxide emissions and industrial profile, (vi) city planning and social welfare, and (vii) research and development, innovation, and sustainability policy. It is found that the index stresses on energy, water, and emission. Though the index considers several aspects, there is a need to study sustainability from a country’s perspective. Also, the resources of the country available across the nation have to be accounted for while measuring the sustainability of a country.
A data envelopment analysis (DEA) that considers inputs and outputs to measure the frontier efficiency of a decision unit was used by Yang et al.  to measure urban sustainability in 22 regions in Taiwan. Resources in terms of food, water, gasoline, and electricity have been considered as inputs, while gross domestic product and employment have been considered as desirable outputs, and garbage, sewage, and sulfur-oxides have been considered as undesirable outputs in the determination of urban sustainability. This research is novel in the sense that researchers have proposed a mechanism for improving urban sustainability using DEA technique by considering input resources, namely food, water, gasoline, and electricity. Taking a cue from this, it was proposed to use data envelopment analysis in this present research to identify how energy sustainability can be enhanced with the available input resources within a country. Also, the review indicated that the sustainability of a country is very much dependent on the country’s inherent resources to achieve energy sustainability. Hence, in this research, energy, water, land, human capital, and national wealth have been considered as the input resources to obtain the desired sustainable energy development. In addition to social, economic, and environmental dimensions, the importance of the technical dimension was found to be growing, and its sustainability has to be accounted for and ensured. Similarly, the role of institutions is gaining importance in its contribution to sustainability. A unique contribution of this research is to analyze how energy sustainability can be enhanced in the five dimensions, namely economic, social, environmental, technical, and institutional using data envelopment analysis.
Sustainable energy indicators
Though there are several indicators being published to measure energy sustainability, it was found that these indicators concentrate only on certain aspects, for example, renewable energy sources [39,40,41] or country [42,43,44]. It is found that the resources available in a country have not been considered in the determination of energy sustainability. Singh et al.  based on their review state that an integrated framework is very much needed. The review also highlighted there exists some ambiguity and gaps in the indicators proposed. There is a need for a systematic focus in developing generic sustainable energy indicators.
The major indicators, namely OLADE, ECLAC, and GTZ , EDI , EISD , and multidimensional energy poverty index  have been extensively reviewed in several of the research papers. International Atomic Energy Agency (IAEA)/International Energy Agency (IEA)  under the aegis of Commission on Sustainable Development (CSD) has developed 41 indicators for sustainable energy development (ISED) and has classified them in terms of the indirect driving force, direct driving force and state (Table 14 in Appendix). This was a broad framework which indicated the driving force acts as a sort of input mechanism which results in an output. Vera et al.  have presented how from the original 41 ISED, the IAEA  have developed 30 indicators after long discourse with the United Nations Department of Economic and Social Affairs (UNDESA) and International Energy Agency (IEA). The 30 Energy Indicators for Sustainable Development (EISD) grouped the 30 indicators into three major dimensions—social (4 indicators), economic (16 indicators), and environmental (10 indicators) (Table 15 in Appendix). The indicators included both basic data as well as ratios, and hence summarizing the measures for a composite sustainable index is cumbersome. The indicators captured the consequences of energy production and utilization.
Streimikiene et al.  have applied the EISD tool for analyzing the trends from 1990 to 2002, setting policy goals, and for monitoring the progress towards these goals in the Baltic States. They have provided recommendations for developing sustainable energy policies. Salimov  has calculated the EISD economic dimension for the Azerbaijan Republic from 2007 to 2016 and have studied how the indicators have changed over the years and have highlighted how these indicators have given an impetus for the strategic development of the country.
To ensure all aspects of sustainability is taken care of, Bandura  developed 165 indices to assess sustainable development of which around 8 use some form of energy parameter. Patlitzianas et al.  have carried out a review on sustainable energy indicators and have proposed a framework based on their review. They stated that appropriateness, completeness, and flexibility should be the criteria for sustainable indicators selection. Indicators of security of energy supply, indicators of the competitive energy market, and indicators of environmental protection have been proposed. Jovanović et al.  have measured the energy system of Belgrade using sustainability energy indices from 3 dimensions, namely economy, social, and ecology (Table 16 in Appendix). Though varied aspects have been considered at the sub-indicator level, the importance and the unit of measure of each needs investigation. Mirza and Szirmai  have developed a composite index to calculate energy poverty, in other words, lack of sufficient energy among rural households in rural Pakistan. Vučićević et al.  have assessed the sustainability of energy use in residential buildings (Table 17 in Appendix) for considering economic, social, and environmental dimensions using multi-criteria analysis. This research considers energy sustainability from end-users’ perspective. The review highlights the following: firstly, the majority of researchers have considered sustainability in terms of three indices namely social, economic, and environmental. Secondly, the indicators were very detailed in their calculation some being numeric and some ratio, and arriving at a composite index was very challenging. Thirdly, the indicators do not link the resources of a country to energy sustainability. Any framework being proposed for determining sustainability has to ensure these concerns are addressed.
Iddrisu and Bhattacharyya  have formulated a composite index Sustainability Energy Development Index (SEDI) given in Table 18 in Appendix by combining five indices, namely technical, economic, social, environmental, and institutional. The SEDI has been calculated and compared across several developing countries. They have validated the index by comparing the index with HDI (Human Development Index), EDI (Energy Development Index), and EPI (Environmental Performance Index). Though energy sustainability has been calculated considering all the five indices, the link to the country’s resources has not been addressed. This is vital, since for a country to become sustainable, it is necessary to check if the output delivered is in tune to the resources it is endowed with. A comprehensive composite measure for measuring sustainability index considering the country’s resources is the need of the hour. This will help in comparing energy sustainability in a realistic manner across dimensions, sectors, and countries.
Using a multi-criteria Data Envelopment Analysis (DEA) methodology, it is proposed to identify how a country can progress towards sustainable development by finding a sustainable energy development efficiency (SEDE) considering the resources as the input criteria, namely land, energy, water, manpower, and national wealth and the five indices, namely technical, economic, social, environmental, and institutional as the output criteria. The results also highlight which sectors are sensitive to a certain country so that policies can be drafted keeping in mind that sector for maximizing SEDE.
The research plan is given in Fig. 1. The research flow consists of three stages-fuzzy analytical hierarchical processing (AHP), data envelopment analysis (DEA), and sensitivity analysis.
Fuzzy AHP method
The resources, namely land availability (L), energy reserves (E), water availability (W), human capital (H), and nation’s wealth (N) are considered as input criteria. Land availability (L) is defined as the land area of the country measured in terms of square kilometers (km2). Energy reserves (ED) is defined as the total available energy reserves including all forms of energy in terms of tons of oil (toe). The water availability (W) is defined as the volume of water available within the country on an average measured in terms of cubic kilometers (km3). The human capital (H) is defined as the manpower available for employment (numbers). For this research purpose, the nation’s wealth is defined to be the gross domestic product available per person (GDP per capita). As various units of measure have been used among the input criteria, normalization was carried out before performing DEA. The framework of this research proposes that the available resources have to be utilized optimally to achieve sustainable energy development. However, sustainable energy development is defined to have multiple criteria and maximizing each of these criteria is expected to result in overall maximum sustainable energy development.
Based on the review of literature, five indices have been considered as the output criteria, namely technical (T), economic (EC), social (S), environmental (EN), and institutional (I) that has to be maximized for achieving sustainable energy development. Since there are multiple outputs that have to be simultaneously maximized with the available input resources, a multi-criteria decision model, namely data envelopment analysis is chosen for this research. The values of these five output criteria for various countries calculated by Iddrisu and Bhattacharyya  are used in this research.
To obtain a higher degree of precision, fuzzy AHP has been used to determine the relative weights of the five input and five output criteria based on intuitionistic judgment and to develop a hierarchical multi-criteria decision-making (MCDM) model.
A questionnaire for pairwise comparison among the input and output criteria was designed for distributing to the experts. The criteria weights are based on the expert’s opinion, and hence the selection of the experts has to be judiciously done. The number of experts chosen for the study was based on the expert’s accessibility and availability. Research does not mention the number of experts essential to conduct AHP . It is very important to select the expert with the right competence so that there is unanimity in the decision process. The research also highlighted that the significance of expert competence is inversely proportional to the group size whenever there is group decision-making . The extant literature confirmed that smaller expert size will help in getting an effective response since there will be a concerted effort.
As the decision process involved an evaluation of criteria dealing with sustainable development, seven experts were chosen for the study. The expert group comprised of two government officials, two industrialists, two consultants, and one academician. All the experts chosen for this study were of Indian origin. The first expert who was a government official had a doctorate in energy management with 18 years of government service. He belonged to the Indian administrative service and has been holding various administrative positions in state-owned electricity and pollution control organizations. The second expert—who is again a government official with 22 years of government service—had done his graduation in electrical engineering and has been holding various positions in the state-owned electricity board. The third expert was a science graduate with 18 years of industrial experience working in a renewable energy organization handling solar and wind energy projects. The fourth expert had done mechanical engineering and business administration and is working in an energy organization. He is involved in sanctioning and commissioning of energy projects and has 21 years of industrial experience. The fifth expert was a consultant with 15 years of experience as a consultant. His job profile included preparing feasibility reports and drafting of project proposals in the energy sector for availing bank loans. The sixth expert was a consultant in a quasi-government organization that acts as a facilitator between industrial partners and financial institutions. He was instrumental in scrutinizing the project proposals and facilitated the smooth transfer of bank loans to the industrial partners from the financial institutions. He has a total experience of 20 years as consultant handling projects in various disciplines including energy. The seventh expert was an academician with 27 years of experience. He had completed his graduation in mechanical engineering, post-graduation in thermal sciences, and a doctoral degree in energy systems. His area of expertise is energy management with special reference to renewable energy. The right choice of experts was very important for this study. It was found that the experts’ years of work experience ranged from 15 to 27 years. The area of their expertise included energy and energy-related disciplines.
The experts were requested to do a pairwise comparison of the input and output criteria and rate the importance of using a rating scale (Table 1). Consistency index and consistency ratio (CR) were calculated for each expert [58, 59]. The rating of an expert was accepted if CR ≤ 0.10. The ratings given by the experts were then converted to fuzzy weights using triangular fuzzy scale (TFN) (Table 2) . The weight vectors were determined and normalized to obtain relative weights [58, 59].
Sustainable energy development efficiency using DEA
Data envelopment analysis (DEA) is a multi-criteria multi-evaluation non-parametric method used to measure the relative efficiency of a set of alternatives considering input and output criteria. The fuzzy AHP weights were used as priority weights for the criteria in DEA analysis. Figure 2 shows the hierarchical structure of the DEA model. In the DEA analysis, CCR model, namely Charnes, Cooper, and Rhodes  model was adopted to find the relative efficiency ranging from 0 to 1. This model considered production components as constant return-to-scale. An assurance region Charnes, Cooper, and Rhodes (AR-CCR) output-oriented model was selected to avoid null output in the analysis. The relative efficiency was calculated using a country’s resources as input criteria, the five indices, namely technical, economic, social, environmental, and institutional as output criteria to evaluate the sustainable energy development efficiency among the developing countries. Forty-eight countries have been chosen for the study. The input values (country’s natural reserves) were collected from various sources. The energy reserves data for the 48 countries were collected from several websites (, http://www.economywatch.com/economic-statistics/) for each of the energy sources, namely coal, oil, fuelwood, bagasse, natural gas, nuclear, and wind. The total energy reserves were then calculated in tons of oil equivalent (toe). The land availability (unit km2), human capital (employable labor in numbers), and national wealth (GDP per capita constant US dollar) was collected from World Bank data . The water in terms of renewable water resources (unit km3) for the 48 countries was collected . The data used as input is given in Table 3.
As already highlighted in the literature review, the researcher has found that the triple bottom approach with only economic, environmental, and social criteria for ascertaining the sustainability is insufficient. Considering this, it is found that sustainability needs to be assessed from all perspectives. For energy sustainability from the technical perspective, the proportion of renewable energy utilization as compared to primary energy should be on the increase. Also, the locally available energy should not be exploited to a large extent. In all cases, for technical energy sustainability, the conversion efficiency should be maximum. From the economic perspective, it is essential to ensure the energy intensity declines, the per capita energy consumption is efficient, and the energy being used is productively utilized by its consumers. To ensure environmental sustainability, it is essential that the emissions from the primary energy sources are kept at the base minimum. From the social perspective, the energy consumed is clean and equality is maintained across all consumers. For the institution to achieve energy sustainability, it is prerogative to ensure that energy is produced using indigenous production process for achieving self-sufficiency. Considering these as the goals for achieving energy sustainability, they are treated as the output criteria. It was found from a review that the indices used by Iddrisu and Bhattacharyya  given in Table 18 in Appendix were appropriate for this research, and hence it was used as the output criteria. The values of the output criteria are given in Table 4.
The analysis yielded an efficient frontier which was considered to be the best among the alternatives for a given set of criteria. The results helped in identifying hidden relationships existing among the multiple criteria taken together. DEA is a versatile tool since it is capable of handling multiple inputs and outputs and secondly presents the frontier alternative considering both the input and output parameters. In this research, the DEA result posits if a country is moving in a sustainable manner by using its resources in an efficient manner to achieve the targeted outputs. The SEDE for the various countries was compared with HDI and EDI to draw further inferences.
A sensitivity analysis was performed on the DEA model. Since it was an output-oriented model (i.e., the output is kept as the target), the DEA analysis was run for a 10% decrease and 10% increase in each of the input criteria, namely land availability, energy reserves, water availability, human capital, and nation’s wealth for each country. Sensitivity analysis is performed to find the sensitivity of each of the input criteria. Though a few of these criteria are constant, yet to study its influence on the output criteria, a sensitivity analysis was carried out. For instance, if the land (which is considered to be constant) was found to be sensitive for a country, then it is very important that policymakers take extra care to draft policies and measures for making effective use of the available land leading to increased energy efficiency. The percentage change in the sustainable energy development efficiency was calculated for each input criteria and for each country and analyzed.
The questionnaire for carrying out a pairwise comparison of each of the input criteria as well as the output criteria was given to seven experts. The experts were asked to rate each of the criteria against the other using a table (Table 1). The ratings of the pairwise comparison for the first expert are given in Table 5. Based on the expert’s ratings, the consistency ratio (CR) was calculated. The CR value for the first expert was 0.098938 for the input criteria and 0.059787 for the output criteria. Similarly, the CR value was found for the seven experts. The CR values for the seven experts are given in Table 6. It was found that the CR value for two experts was above 0.1 in either the input or output criteria, and hence the ratings were excluded. The ratings of the remaining five experts were then transformed to fuzzy weights using TFN scale (Table 2) for the first expert. The normalized non-fuzzy weights for the five input criteria were 0.125, 0.155, 0.207, 0.238, and 0.276 and for the output criteria 0.181, 0.133, 0.317, 0.261, and 0.107. In a similar manner, the weights for input and output criteria given by the five experts along with the average weights are given in Table 7.
From the weights, it was found that the maximum weight of 0.253 has been assigned to water availability followed by energy reserves with 0.249. This indicated that among the resources, water availability and energy reserves were important and care has to be exerted to use these reserves in a prudent manner for sustainable development. Among the output indices, it was found that an environmental index with 0.285 is the most important, followed by a social index with 0.263. Experts are of the opinion that the above indices are very important for sustainable development.
DEA using AR-CCR output-oriented model
The mean rating given by the five experts for the input and output criteria for sustainable energy development were used as multiplier constraints in the assurance region of the DEA model. The assurance region multipliers are given in Table 8. As every country would like to maximize its indices with the available resources, the DEA model was aimed at maximizing the output criteria with an output-oriented model. The DEA analysis was carried out using DEA add-in Excel. The efficiency of the selected countries and the decomposition efficiency of the criteria are given in Table 9. The DEA model revealed a country’s proximity to the efficient frontier. The sustainable energy development efficiency (SEDE) was calculated using the DEA model for the 48 countries and is presented in Fig. 3. Using the SEDE score, the countries are ranked. Togo was ranked 1 and identifies as the country lying in the efficient frontier. Among the output indices, it is found that the SEDE is maximum for an environmental index with 0.5688 followed by a technical index at 0.2495. Considering the input criteria, it was found that with the available reserves, Togo has efficiently delivered the desired maximum output resulting in maximum SEDE.
Figure 4 presents a comparison between SEDE and each of the input criteria for various countries. It was clearly visible from the figure that Togo has less of input reserves, and by using that it was able to obtain the maximum output. Figure 5 presents a comparison between SEDE and output criteria for various countries. Though Angola has maximum effectiveness for the technical index yet considering all the output indices, Togo has the maximum SEDE.
As the DEA was run as an output-oriented model, a comparison was made between the aggregate input efficiency against SEDE for the various countries and is presented in Fig. 6. It was found that the countries which are getting maximum SEDE are those that are efficiently and conservatively using their resources. The figure clearly indicated that for a certain input of resources, there was more than a proportionate increase in sustainable energy development efficiency. This was due to the varying nature of the importance of the input criteria and the resources a country is endowed with.
A comparison was made between the SEDE and the Human Development Index (HDI), the SEDE and the Energy Development Index (EDI). The mapping of SEDE versus HDI is given in Fig.7. The figure clearly indicates that even though few countries have higher values for HDI yet they have very low values for SEDE. This indicates that such countries are not using their total resources in a holistic manner which is clearly visible in the SEDE score. Similarly, the mapping of SEDE versus EDI is plotted in Fig. 8. This figure clearly shows that countries are very good in their energy development index. But in the overall, is the resources of the country being used efficiently across all indices, it is found that there are lots of discrepancies. Few countries have got a very high EDI but the SEDE score is very low indicating inefficient use of their country’s total resources.
The input criteria, namely land availability for Iran, were reduced by 10% and the DEA model was run. It was found that there was an increase of 1.5 % in the SEDE score. However, when the land availability was increased by 10%, it was found that SEDI decreased by 1.46%. Similarly, the DEA was run for 10% change in land availability for Argentina, and it was found that when there was a 10% decrease, SEDE increased by 1.73% while when it was increased by 10%, SEDE decreased by 1.67%. Similarly, the DEA was run by first reducing land availability by 10% for each country and then by increasing by 10% of land availability. In each case, the percentage change in SEDE was calculated and the values for all the countries are plotted in Fig. 9. A similar analysis was carried for each of the input criteria, and the percent change is plotted in Fig. 10 for energy reserves, Fig. 11 for water availability, Fig. 12 for human capital, and Fig. 13 for national wealth.
The fuzzy weights given by the experts indicate that four out of five input resources are very important for sustainable development. Also, the experts have given almost equal weight for the four resources, namely water availability, energy reserves, nation’s wealth, and human capital. However, of the four input criteria, water followed by the energy was given the maximum importance indicating these two resources are very vital for sustainable development. These resources have to be used in an effective manner so that higher indices are achieved for sustainable development. Among the output criteria, it was found that achieving higher environmental and social indices were very important for sustainable energy development. It was found that almost all experts have stated that environmental indices need to be carefully monitored for maximizing sustainable energy development. Three experts have indicated social indices as equally important. Experts were of mixed opinion when it comes to technical and economic indices. On the other hand, almost all experts have given the least weight for institutional indices.
As highlighted in the reports [64, 65], a country’s natural resources should never become a curse. It is the responsibility of planners and policymakers to ensure the resources are being judiciously utilized for energy sustainability. In this research, the DEA analysis clearly highlights whether the country’s resources are being efficiently used to obtain the desired outputs. The 5 top-ranked most efficient countries as per the order of ranking are Togo, Benin, Yemen, Jordan, and Zimbabwe. Though these countries have minimal resources, yet they are able to effectively transfer them to desired output as indicated by the higher indices in the environmental and social criteria. This is also clearly visible in Fig. 4. India is a highly populated country and is very high in human capital. But SEDE is very low for India and is ranked at 48th position. This clearly indicated that the resources are not being utilized in an efficient manner. Similarly, for China, the human capital is very high which itself becomes a burden, and the SEDE is very low at 47th position. Also, Ecuador is found to have maximum energy reserves, yet in terms of SEDE, it is ranked 46. Brazil has the maximum renewable water availability while as per SEDE it is ranked 45. This clearly indicates that it is not just sufficient to stock the resources but they need to be transformed into valuable output for achieving higher SEDE. Examining Togo which is at the frontier efficiency, it is found that the country’s resources are very low. Yet with the available resources, it is able to deliver higher value in terms of the five indices which has led to maximum SEDE. Similar values are found for Benin, which also has minimal resources at its disposal. Yet with the minimal resources, it is delivering higher value in terms of output indices which has led to higher SEDE.
Figure 5 highlights the contribution of the five output indices for sustainable energy development. The weights from fuzzy AHP indicated that environmental index is very important followed by a social index. Togo has scored the maximum in the environmental index which could be one of the reasons for it to lie in the efficient frontier while when it comes to the social index it is far behind. As far as the social index is concerned, it is Iran which has been scored the maximum. With regard to technical index, Togo has scored fairly well while for economic index it was almost zero with 0.0085. Benin is ranked at the second position with reference to SEDE. The reason could be it has performed fairly well with reference to environmental, social, and technical indices which are fairly important indices as perceived by the experts. Benin did not score well for economic and institutional index. Notwithstanding this, Benin scored the second position in SEDE. Algeria was found to have the maximum score for institutional index. However, since the weight assigned to the institutional index was less as per the experts’ perception, and also since for all other indices it is far below in its position, it is found that the SEDE ranking for Algeria was at sixth. Comparing China and India, wherein both countries are high on human capital, it was found that their SEDE ranking was at 47th and 48th position respectively. China had scored the maximum with regard to economic index and fairly well in the social index while for all other indices it was very low. India was found to have scored maximum in the technical index while for all other indices it was very low. This indicates India needs to strengthen and make policies towards the environmental and social front so that if these two indices are increased there will be a drastic change in its SEDE position. Similarly, China also needs to take corrective action at its environmental front because it has scored the least in the environmental index, the index considered most important for SEDE by experts. The second action plan China needs to take is to find mechanisms for improving its technical and social index. This will immediately put China in a very competitive position in SEDE ranking. Comparing Figs. 4 and 5 for India, it is clearly visible that India has a remarkably large land area. However, from the results, it is seen that in spite of the land area being vast, it is not facilitating in achieving the desired outcome in terms of a maximum SEDE. As already indicated, resources should never become a liability [66, 67]. Immediate action is required for using this resource in an effective manner so as to enhance sustainability in terms of environmental and social indices for India.
The cross-examination of SEDE with HDI clearly indicates that China, Ecuador, Brazil, Venezuela, Argentina, Uruguay, and Panama have a very high HDI but a very low SEDE score. This indicates that these countries though are good in human development at a national level; they are not using their country’s resources in an efficient manner. Immediate action has to be taken by these countries to ensure their resources are being used so that they can move towards overall sustainable energy development. Similarly, the mapping between SEDE and EDI clearly indicates few countries (for example, Libya, Iran, Venezuela, Argentina, Uruguay, and Egypt), which seem to be doing well with energy development, are not really progressing in a sustainable manner. Proactive measures have to be taken by the countries which are in the upper-left quadrant. For countries which are positioned in the lower-left quadrant, immediate measures have to be taken with a missionary zeal so that they are propelled to move towards the right.
Sensitivity analysis revealed the countries that were sensitive to certain indices. When there was a 10% change in land availability, the percent change in SEDE was considerable for Algeria, followed by Yemen, Mongolia, Zambia, Philippines, Honduras, Angola, Egypt, and Bolivia. This indicated that for improving sustainable energy development efficiency, these countries need to draft policies and take measures in these criteria, namely land availability which is sensitive for their country. For a few countries, the percent change in SEDE was very minimal, namely Sri Lanka, Senegal, Ecuador, Zimbabwe, Costa Rica, and Panama. This shows that for improving SEDE among these countries, it is not advisable to concentrate on these criteria. Similarly, for Ecuador, Iran, Mongolia, Venezuela, India, China, Botswana, and Zimbabwe are advisable to concentrate on how energy resources are being utilized, since this criterion is very sensitive for these countries towards improving SEDE. However, the figure indicated that for several countries the utilization of energy reserves in contributing to SEDE is insensitive. When it comes to water, it is seen that several countries are sensitive. The most sensitive countries are Cambodia, Peru, Bangladesh, Colombia, Brazil, Bolivia, Vietnam, Indonesia, and Nigeria. These countries have to cautiously work on the water availability, so that they might exponentially increase their SEDE score. The countries for which water availability does not cause a major impact on SEDE are Libya, Jordan, Yemen, Tunisia, Algeria, Botswana, and Jamaica. As witnessed by the nature of population explosion in the developing countries, wherein China and India are the forerunners, it becomes doubly important to use human capital in an astute manner, since the human capital which is normally considered an asset in business parlance has become a liability as seen in the SEDE score. The utmost care and prudence need to be exercised by the policymakers and planners of these nations to convert this challenge into a strength. If strategic decisions are not taken immediately, though the country is endowed with rich resources, it will not be far off before the country moves slowly towards a marked rich-poor divide. The quality of life will deteriorate and the resources will be washed off by the heavy population. The other countries that fall in this category include Pakistan, Kenya, Vietnam, Philippines, Bangladesh, Indonesia, and Egypt. Among these countries, innovative measures to transform the human capital asset into potential output indicators that will lead to a higher SEDE score need to be immediately taken, since among these countries human capital criteria are sensitive with reference to SEDE. With regard to how sensitive is the nation’s wealth in contributing to SEDE, it was found that almost all countries are sensitive. Figure 13 clearly shows a funnel-shaped structure indicating a nation’s wealth is a very sensitive criterion for almost all countries. The countries which are very sensitive are Jamaica, Uruguay, Jordan, Costa Rica, El Salvador, Tunisia, Panama, Cuba, and Gabon. How the nation’s wealth is being utilized is a very important factor for any country and this is what the results have also corroborated. Care has to be exercised during the country’s budgeting that every amount that is being spent is contributing to the sustainable development of the nation.
The review of literature highlighted that indicators keep evolving over time and they need to be fine-tuned to the needs of a country depending on the nature of resources a country is endowed with. A cross-sectional study by comparing indicators across countries will serve as a benchmark for a country to progress in a sustainable manner which was undertaken in this research. The indices are compared across 48 countries. The research has identified the country’s resources, namely as land availability, energy reserves, water availability, human capital, and nation’s wealth as the input criteria and five output indicators as technical, economic, social, environmental, and institutional. Based on the expert’s judgment, it was found that water availability and energy reserves were the most important resources for sustainable development. Among the output indices, it was found that environmental and social indices were considered the most important. Using the fuzzy weights, DEA was run and it was found that Togo reached the efficient frontier. This was because with the limited resources at its disposal Togo was able to score well in the environmental index which was identified as the most important index for sustainable development. The analysis also highlighted the position of each of the remaining 47 countries against the efficient frontier and also how the country can improve its position to reach the efficient frontier. For furthering SEDE, sensitivity analysis revealed which of the input resources, each country need to judiciously use, highlighting the sensitive input resource for each country. Nation’s wealth was found to be sensitive among all the countries. In the future, a longitudinal study can be undertaken to find if there is a gradual increase in the indices over the years for the countries. This analysis will indicate if the country is gradually increasing on the path of sustainable development.
Availability of data and materials
The data used for this research will be made available upon request. Also the data is available on relevant authorities’ webpages.
Analytical hierarchical process
Assurance region Charnes, Cooper, and Rhodes
Chinese Yuan Renminbi (currency unit)
- CO2 :
Chemical oxygen demand
Data envelopment analysis
Economic Commission for Latin America and the Caribbean
Energy Development Index
Energy indicators for sustainable development
Environmental Performance Index
Environmental Sustainability Index
Gross domestic product
German Technical Cooperation Agency
Human Development Index
Human Poverty Index
International Atomic Energy Agency
International Energy Agency
Indicators for Sustainable Energy Development
Multi-criteria decision making
Millennium Development Goals
Latin American Energy Organization
Purchasing power parity
Residential energy consumption
Sustainable Development of Energy, Water and Environment Systems
Sustainable energy development efficiency
Sustainability Energy Development Index
- SO2 :
Total final consumption
Triangular fuzzy scale
Total primary energy supply
United Nations Department of Economic and Social Affairs
United Nations Development Program
Volatile organic compounds
WCED (1987) World commission on environment and development: our common future. Oxford University Press, Oxford
Oshima HT (1986) The transition from an agricultural to an industrial economy in East Asia. Econ Dev Cult Change 34:783–809. https://doi.org/10.2307/1153732
IAEA (2005) Energy indicators for sustainable development: guidelines and methodologies.
https://data.worldbank.org/indicator. Renewable energy consumption (% of total final energy consumption) | Data https://data.worldbank.org/indicator/EG.FEC.RNEW.ZS?locations = IN
https://www.worldfinance.com/markets/top-5-of-the-fastest-growing-industries-in-the-world. Top 5 of the fastest-growing industries in the world | World Finance
Venables AJ (2016) Using natural resources for development: why has it proven so difficult? J Econ Perspect 30:161–183. https://doi.org/10.2307/43710015
D’Amato D, Korhonen J, Toppinen A (2019) Circular, green, and bio economy: how do companies in land-use intensive sectors align with sustainability concepts? Ecol Econ 158:116–133. https://doi.org/10.1016/J.ECOLECON.2018.12.026
Ge Y, Zhi Q (2016) Literature review: the green economy, clean energy policy and employment. Energy Procedia 88:257–264. https://doi.org/10.1016/J.EGYPRO.2016.06.159
Tiba S, Omri A (2016) Literature survey on the relationships between energy variables, environment and economic growth. Munich Pers RePEc Arch.
Singh RK, Murty HR, Gupta SK, Dikshit AK (2012) An overview of sustainability assessment methodologies. Ecol Indic 9:189–212. https://doi.org/10.1016/j.ecolind.2008.05.011
Pintér L, Hardi P, Bartelmus P (2005) Sustainable development indicators prepared for the United Nations Division for Sustainable Development (UN-DSD) proposals for a way forward
UNECE J (2013) Framework and suggested indicators to measure sustainable development prepared by the Joint UNECE/Eurostat/OECD Task Force on Measuring Sustainable Development.
Olade (1997) Energy and sustainable development in Latin America and the Caribbean: guide for energy policymaking.
Nussbaumer P, Bazilian M, Modi V (2012) Measuring energy poverty: focusing on what matters. Renew Sustain Energy Rev 16:231–243. https://doi.org/10.1016/J.RSER.2011.07.150
Vera I, Langlois L (2007) Energy indicators for sustainable development. Energy 32:875–882. https://doi.org/10.1016/J.ENERGY.2006.08.006
IEA (2004) World Energy Outlook.
Esty DC, Srebotnjak T, Goodall M, Andonov B, Campbell K, Gregg K, et al (2005) Environmental sustainability index benchmarking national environmental stewardship.
Bossel H (1999) Indicators for sustainable development: theory, method, applications
Cochrane P (2006) Exploring cultural capital and its importance in sustainable development. Ecol Econ 57:318–330
Pugh C (1996) Sustainability, the environment and urbanization. England Earthscan, London
Hardoy J, Mitlin D, Satterthwaite D (1992) Environmental problems in Third World cities
Zhang M (2002) Measuring urban sustainability in China
van MP D, Mingshun Z (2005) Sustainability indices as a tool for urban managers, evidence from four medium-sized Chinese cities. Environ Impact Assess Rev 25:667–688. https://doi.org/10.1016/J.EIAR.2004.10.001
Andriantiatsaholiniaina LA, Kouikoglou VS, Phillis YA (2004) Evaluating strategies for sustainable development: fuzzy logic reasoning and sensitivity analysis. Ecol Econ 48:149–172. https://doi.org/10.1016/J.ECOLECON.2003.08.009
Lee YJ, Huang CM (2007) Sustainability index for Taipei. Environ Impact Assess Rev 27:505–521. https://doi.org/10.1016/J.EIAR.2006.12.005
Blinc R, Zidanšek A, Šlaus I (2006) Sustainable development after Johannesburg and Iraq: the global situation and the cases of Slovenia and Croatia. Energy 31:2259–2268. https://doi.org/10.1016/J.ENERGY.2006.01.023
Spangenberg JH (2002) Institutional sustainability indicators: an analysis of the institutions in Agenda 21 and a draft set of indicators for monitoring their effectivity. Sustain Dev 10:103–115. https://doi.org/10.1002/sd.184
Spangenberg JH (2004) Reconciling sustainability and growth: criteria, indicators, policies. Sustain Dev 12:74–86. https://doi.org/10.1002/sd.229
UNECOSOC (2002) United Nations Economic and Social Council - implementing Agenda 21 — report of the Secretary- General.
UNCSD (2001) United Nations Commission on Sustainable Development - indicators of sustainable development: framework and methodologies. United Nations.
UNDPCSD (1996) United Nations Division for Sustainable Development Department of Policy Co-Ordination and Sustainable Development- indicators of sustainable development: framework and methodologies.
Trigg M, Richter M, Mcmillan S, O’Rourke S, Wong V (2010) Sustainable cities index
Zhou N, He G, Williams C, Fridley D (2015) ELITE cities: A low-carbon eco-city evaluation tool for China. Ecol Indic 48:448–456. https://doi.org/10.1016/J.ECOLIND.2014.09.018
Kostevšek A, Klemeš JJ, Varbanov PS, Čuček L, Petek J (2015) Sustainability assessment of the Locally Integrated Energy Sectors for a Slovenian municipality. J Clean Prod 88:83–89. https://doi.org/10.1016/J.JCLEPRO.2014.04.008
Martínez PCI (2015) Energy and sustainable development in cities: a case study of Bogotá. Energy 92:612–621. https://doi.org/10.1016/J.ENERGY.2015.02.003
Strunz S, Marselle M, Schröter M (2019) Leaving the “sustainability or collapse” narrative behind. Sustain Sci 14:1717–1728. https://doi.org/10.1007/s11625-019-00673-0
Kılkış Ş (2016) Sustainable development of energy, water and environment systems index for Southeast European cities. J Clean Prod 130:222–234. https://doi.org/10.1016/J.JCLEPRO.2015.07.121
Yang WC, Lee YM, Hu JL (2016) Urban sustainability assessment of Taiwan based on data envelopment analysis. Renew Sustain Energy Rev 61:341–353. https://doi.org/10.1016/J.RSER.2016.04.015
Liu G (2014) Development of a general sustainability indicator for renewable energy systems: a review. Renew Sustain Energy Rev 31:611–621. https://doi.org/10.1016/J.RSER.2013.12.038
Kurka T, Blackwood D (2013) Participatory selection of sustainability criteria and indicators for bioenergy developments. Renew Sustain Energy Rev 24:92–102. https://doi.org/10.1016/J.RSER.2013.03.062
Onat N, Bayar H (2010) The sustainability indicators of power production systems. Renew Sustain Energy Rev 14:3108–3115. https://doi.org/10.1016/J.RSER.2010.07.022
Kumar D, Katoch SS (2014) Sustainability indicators for run of the river (RoR) hydropower projects in hydro rich regions of India. Renew Sustain Energy Rev 35:101–108. https://doi.org/10.1016/J.RSER.2014.03.048
Tsai WT (2010) Energy sustainability from analysis of sustainable development indicators: a case study in Taiwan. Renew Sustain Energy Rev 14:2131–2138. https://doi.org/10.1016/J.RSER.2010.03.027
Mandelli S, Barbieri J, Mattarolo L, Colombo E (2014) Sustainable energy in Africa: a comprehensive data and policies review. Renew Sustain Energy Rev 37:656–686. https://doi.org/10.1016/J.RSER.2014.05.069
IEA (2011) World Energy Outlook 2011.
IAEA/IEA (2001) Indicators for sustainable energy development-9th session of the Commission on Sustainable Development.
Vera IA, Langlois LM, Rogner HH, Jalal AI, Toth FL (2005) Indicators for sustainable energy development: an initiative by the International Atomic Energy Agency. Nat Resour Forum 29:274–283. https://doi.org/10.1111/j.1477-8947.2005.00140.x
Streimikiene D, Ciegis R, Grundey D (2007) Energy indicators for sustainable development in Baltic States. Renew Sustain Energy Rev 11:877–893. https://doi.org/10.1016/J.RSER.2005.06.004
Salimov S (2018) Energy indicators for sustainable development of Azerbaijan Republic- economic dimension. Eur J Sustain Dev 7:236–248
Bandura R (2006) A survey of composite indices measuring country performance: 2006 update
Patlitzianas KD, Doukas H, Kagiannas AG, Psarras J (2008) Sustainable energy policy indicators: review and recommendations. Renew Energy 33:966–973. https://doi.org/10.1016/j.renene.2007.05.003
Jovanović M, Afgan N, Radovanović P, Stevanović V (2009) Sustainable development of the Belgrade energy system. Energy 34:532–539. https://doi.org/10.1016/J.ENERGY.2008.01.013
Mirza B, Szirmai A (2010) Towards a new measurement of energy poverty: a cross-community analysis of rural Pakistan. MERIT Work Pap.
Vučićević B, Jovanović M, Afgan N, Turanjanin V (2014) Assessing the sustainability of the energy use of residential buildings in Belgrade through multi-criteria analysis. Energy Build 69:51–61. https://doi.org/10.1016/J.ENBUILD.2013.10.022
Iddrisu I, Bhattacharyya SC (2015) Sustainable Energy Development Index: a multi-dimensional indicator for measuring sustainable energy development. Renew Sustain Energy Rev 50:513–530. https://doi.org/10.1016/J.RSER.2015.05.032
Nixon JD, Dey PK, Davies PA (2010) Which is the best solar thermal collection technology for electricity generation in north-west India? Evaluation of options using the analytical hierarchy process. Energy 35:5230–5240. https://doi.org/10.1016/J.ENERGY.2010.07.042
Tsyganok VV, Kadenko SV, Andriichuk OV (2012) Significance of expert competence consideration in group decision making using AHP. Int J Prod Res 50:4785–4792. https://doi.org/10.1080/00207543.2012.657967
Lee SK, Mogi G, Hui KS (2013) A fuzzy analytic hierarchy process (AHP)/data envelopment analysis (DEA) hybrid model for efficiently allocating energy R&D resources: In the case of energy technologies against high oil prices. Renew Sustain Energy Rev 21:347–355. https://doi.org/10.1016/j.rser.2012.12.067
Lee SK, Mogi G, Li Z, Hui KS, Lee SK, Hui KN et al (2011) Measuring the relative efficiency of hydrogen energy technologies for implementing the hydrogen economy: an integrated fuzzy AHP/DEA approach. Int J Hydrogen Energy 36:12655–12663. https://doi.org/10.1016/J.IJHYDENE.2011.06.135
Kahraman C, Ertay T, Büyüközkan G (2006) A fuzzy optimization model for QFD planning process using analytic network approach. Eur J Oper Res 171:390–411. https://doi.org/10.1016/J.EJOR.2004.09.016
Charnes A, Cooper WW, Rhodes E (1978) Measuring the efficiency of decision making units. Eur J Oper Res 2:429–444. https://doi.org/10.1016/0377-2217(78)90138-8
https://web.archive.org/web/20150612123716/https://www.cia.gov/library/publications/ the-world-factbook/fields/2201.html. The World Factbook
OECD (2011) The economic significance of natural resources: key points for reformers in Eastern Europe, Caucasus and Central Asia.
Patrick SM (2012) Why natural resources are a curse on developing countries and how to fix it - The Atlantic April. https://www.theatlantic.com/international/archive/2012/04/why-natural-resources-are-a-curse-on-developing-countries-and-how-to-fix-it/256508/
Frankel JA (2010) The natural resource curse: a survey. HKS Work Pap NoRWP10-005. https://doi.org/10.2139/ssrn.1565588
Su F, Wei G, Tao R (2016) China and natural resource curse in developing countries: empirical evidence from a cross-country study. China World Econ Inst World Econ Polit Chinese Acad Soc Sci 24:18–40. https://doi.org/10.1111/cwe.12142
Kona A, Melica G, Rivas Calvete S, Zancanella P, Iancu A, Gabrielaitiene I et al (2015) The covenant of mayors in figures and performance indicators: 6-year assessment. https://doi.org/10.2790/774700
Keirstead J (2013) Benchmarking urban energy efficiency in the UK. Energy Policy 63:575–587. https://doi.org/10.1016/J.ENPOL.2013.08.063
Sovacool BK, Brown MA (2010) Twelve metropolitan carbon footprints: a preliminary comparative global assessment. Energy Policy 38:4856–4869. https://doi.org/10.1016/J.ENPOL.2009.10.001
Bi J, Zhang R, Wang H, Liu M, Wu Y (2011) The benchmarks of carbon emissions and policy implications for China’s cities: case of Nanjing. Energy Policy 39:4785–4794. https://doi.org/10.1016/j.enpol.2011.06.045
Dong Y, Xia B, Chen W (2014) Carbon footprint of urban areas: an analysis based on emission sources account model. Environ Sci Policy 44:181–189. https://doi.org/10.1016/j.envsci.2014.07.013
Zhang Y, Linlin X, Weining X (2014) Analyzing spatial patterns of urban carbon metabolism: a case study in Beijing, China. Landsc Urban Plan 130:184–200. https://doi.org/10.1016/j.landurbplan.2014.05.006
Khanna N, Fridley D, Hong L (2014) China’s pilot low-carbon city initiative: a comparative assessment of national goals and local plans. Sustain Cities Soc 12:110–121. https://doi.org/10.1016/J.SCS.2014.03.005
Kramers A, Wangel J, Johansson S, Höjer M, Finnveden G, Brandt N (2013) Towards a comprehensive system of methodological considerations for cities’ climate targets. Energy Policy 62:1276–1287. https://doi.org/10.1016/J.ENPOL.2013.06.093
Alonso A, Monzón A, Cascajo R (2015) Comparative analysis of passenger transport sustainability in European cities. Ecol Indic 48:578–592. https://doi.org/10.1016/J.ECOLIND.2014.09.022
Debnath AK, Chin HC, Haque MM, Yuen B (2014) A methodological framework for benchmarking smart transport cities. Cities 37:47–56. https://doi.org/10.1016/J.CITIES.2013.11.004
Miranda H De F, Rodrigues da Silva AN (2012) Benchmarking sustainable urban mobility: the case of Curitiba, Brazil. Transp Policy 21:141–151. https://doi.org/10.1016/J.TRANPOL.2012.03.009
Zaman AU, Lehmann S (2013) The zero waste index: a performance measurement tool for waste management systems in a “zero waste city”. J Clean Prod 50:123–132. https://doi.org/10.1016/J.JCLEPRO.2012.11.041
Karagiannidis A, Xirogiannopoulou A, Perkoulidis G, Moussiopoulos N (2004) Assessing the collection of urban solid wastes: a step towards municipality benchmarking. Water, Air, Soil Pollut Focus 4:397–409. https://doi.org/10.1023/B:WAFO.0000044813.50757.a7
Wilson DC, Rodic L, Cowing MJ, Velis CA, Whiteman AD, Scheinberg A et al (2015) “Wasteaware” benchmark indicators for integrated sustainable waste management in cities. Waste Manag 35:329–342. https://doi.org/10.1016/J.WASMAN.2014.10.006
Wu L, Mao XQ, Zeng A (2015) Carbon footprint accounting in support of city water supply infrastructure siting decision making: a case study in Ningbo, China. J Clean Prod 103:737–746. https://doi.org/10.1016/J.JCLEPRO.2015.01.060
Venkatesh G, Chan A, Brattebø H (2014) Understanding the water-energy-carbon nexus in urban water utilities: comparison of four city case studies and the relevant influencing factors. Energy 75:153–166. https://doi.org/10.1016/J.ENERGY.2014.06.111
Arribas-Bel D, Kourtit K, Nijkamp P (2013) Benchmarking of world cities through self-organizing maps. Cities 31:248–257. https://doi.org/10.1016/J.CITIES.2012.06.019
Afgan NH, Carvalho MG, Hovanov NV (2000) Energy system assessment with sustainability indicators. Energy Policy 28:603–612. https://doi.org/10.1016/S0301-4215(00)00045-8
The author is thankful to the experts who participated in this study as well as the fellow researchers in the University for their feedback and suggestions.
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Suganthi, L. Sustainability indices for energy utilization using a multi-criteria decision model. Energ Sustain Soc 10, 16 (2020). https://doi.org/10.1186/s13705-020-00249-2