Sustainability assessments of energy scenarios: citizens’ preferences for and assessments of sustainability indicators
Energy, Sustainability and Society volume 12, Article number: 41 (2022)
Given the multitude of scenarios on the future of our energy systems, multi-criteria assessments are increasingly called for to analyze and assess desired and undesired effects of possible pathways with regard to their environmental, economic and social sustainability. Existing studies apply elaborate lists of sustainability indicators, yet these indicators are defined and selected by experts and the relative importance of each indicator for the overall sustainability assessments is either determined by experts or is computed using mathematical functions. Target group-specific empirical data regarding citizens’ preferences for sustainability indicators as well as their reasoning behind their choices are not included in existing assessments.
Approach and results
We argue that citizens’ preferences and values need to be more systematically analyzed. Next to valid and reliable data regarding diverse sets of indicators, reflections and deliberations are needed regarding what different societal actors, including citizens, consider as justified and legitimate interventions in nature and society, and what considerations they include in their own assessments. For this purpose, we present results from a discrete choice experiment. The method originated in marketing and is currently becoming a popular means to systematically analyze individuals’ preference structures for energy technology assessments. As we show in our paper, it can be fruitfully applied to study citizens’ values and weightings with regard to sustainability issues. Additionally, we present findings from six focus groups that unveil the reasons behind citizens’ preferences and choices.
Our combined empirical methods provide main insights with strong implications for the future development and assessment of energy pathways: while environmental and climate-related effects significantly influenced citizens’ preferences for or against certain energy pathways, total systems and production costs were of far less importance to citizens than the public discourse suggests. Many scenario studies seek to optimize pathways according to total systems costs. In contrast, our findings show that the role of fairness and distributional justice in transition processes featured as a dominant theme for citizens. This adds central dimensions for future multi-criteria assessments that, so far, have been neglected by current energy systems models.
The transition of energy systems towards more sustainable forms of energy production and consumption continues to be a key challenge for politicians, stakeholders and societies worldwide. Assessing the sustainability of national transition pathways thereby constitutes an important decision-support for governments [1, 2] and has resulted in scholarly efforts to systematically assess energy scenarios with regard to their ecological, economic and social effects [3,4,5,6]. Such sustainability assessments can serve different purposes: they support the comparability of often very complex scenarios and explicate (un)desired effects of transition processes that are not explicitly included in the scenario studies. This enables decision-makers to better understand and monitor sustainability trade-offs within and across different pathways and, thus, to select suitable alternatives and implement policies that guide the transition process [7,8,9]. When assessing the sustainability of energy scenarios, a broad spectrum of often conflicting environmental, economic, technical and social criteria needs to be considered . Multi-criteria decision analysis (MCDA) has the potential to consider the multidimensionality of sustainability and, therefore, has emerged as a popular method for assessing energy technologies and systems [9,10,11,12,13,14,15,16].
While existing studies have significantly advanced multi-criteria assessments by defining and applying elaborate lists of economic, ecologic, technical and even social indicators [8, 9, 11,12,13,14, 16,17,18], two observations are notable: first, the sustainability indicators to be used for assessments are selected and defined by researchers and decision-makers, or are based on literature reviews. Second, the indicator weights showing the relative importance of each indicator in the final assessment are either determined by researchers/experts or are computed using different mathematical functions as part of the multi-criteria assessment. Few exceptions have discussed sustainability assessments with a wider group of stakeholders in transdisciplinary settings ; yet, target group-specific empirical data regarding preferences, priorities and trade-offs of sustainability indicators remain widely missing.
By definition, the Leitbild of sustainable development is designed to guide today’s decisions about future energy systems  even though the concept of sustainability does not specify indisputable sets of indicators, let alone proposes solutions for indicator conflicts and trade-offs . On the one hand, this means that scientists need to provide definitions and sets of indicators underpinned by valid and reliable data. On the other hand, reflections and deliberations are required regarding what societal actors, including citizens, consider as justified and legitimate interventions in nature and society, and what considerations they include in their own assessments . We therefore argue that sustainability assessments of energy systems need to reflect the perspectives and preferences of citizens for energy systems and technologies. Yet, to date, empirical studies remain scarce, because citizens often lack the necessary background knowledge to discriminately assess different energy technologies and systems . Authors have thus called for the disclosure of complete life-cycle information on energy technologies in order to allow for more informed assessments .
Based on this, we present an empirical approach to address the following research question: What are citizens’ preferences for sustainability indicators when assessing future energy systems and what is their reasoning behind their choices for indicators?
The research presented in this paper is part of the interdisciplinary research project InNOSysFootnote 1 which sought to assess and optimize pathways for the future German energy system by integrating economic, ecologic and social sustainability indicators into a multi-criteria decision analysis. In the project, a list of sustainability indicators was derived to assess existing scenarios for the German energy system in 2050 with GHG emissions reductions of 80–90% and of more than 90%.Footnote 2 The indicators used resemble lists of previously reviewed studies [9,10,11, 13, 14, 18] and pertain to economic, ecological and social dimensions.Footnote 3 As part of the project, we conducted a discrete choice experiment (DCE) that allowed us to analyze the relative importance of different sustainability indicators for citizens’ decisions regarding their preferred future energy systems.
In the discrete choice experiment, citizens had to choose among different future energy systems in Germany. The choices were underpinned using the derived sustainability indicators. Indicator values displayed full life-cycle data and were presented in a transparent and approachable fashion. The integration of all sustainability indicators in the display of the choices ensured that citizens were able to express their preferences for certain future energy futures but at the same time were made aware of the possible ecological, economic and social consequences of their choices.
While the involvement of citizens in the assessment of sustainability indicators presents an important step towards more participatory sustainability assessments, we also acknowledge another form of citizen involvement—that is, the selection of suitable sustainability indicators. In previous MCDA sustainability assessments, indicators have been selected based on the availability of valid data in order to ensure measurability and comparability of assessments [10, 11, 13, 18]. As a result, particularly indicators on social sustainability revolve around a handful of semi-measurable factors, including for instance social acceptability, job creation, human health and energy costs [9,10,11, 14, 18]. In our research, we sought to find out what aspects and indicators citizens associate with the sustainability of energy scenarios that go beyond currently used indicators. For this, we present qualitative findings from six focus groups.
Our paper seeks to make three contributions to the existing literature on sustainability assessments of energy scenarios: first, we document how discrete choice experiments (DCE) can be made fruitful for studying citizens’ preferences for indicators of sustainability and their assessments of sustainability trade-offs when it comes to deciding upon future energy systems. In the past, DCE have been typically used in marketing research to detect consumer preferences; yet, it is increasingly emerging as a research method for gathering individuals’ preferences for a variety of sustainability- and energy-related issues. As we argue in our paper, DCE is particularly suitable because the quantitative data it reveals can be used as inputs for multi-criteria sustainability assessments, as was done by the research team . Second, the actual findings of our DCE suggest indicators on climatic effects and resource consumption to have the strongest effect on whether citizens preferred one energy scenario over another. In contrast, economic-related indicators were regarded as the least relevant ones. As we will discuss, this presents a significant difference to results of existing MCDA analysis that use expert assessments and modeling [9, 11]. Third, insights from our explorative focus groups reveal a discrepancy between what (mostly quantitative, indicator-based) assessment models can capture, and what citizens seem to value most when assessing future energy systems; that is, the role of fairness and distributional justice. We discuss how these aspects can be considered for future sustainability assessments of energy systems.
The paper proceeds as follows: the next chapter briefly reviews existing approaches to sustainability assessments of energy systems. It then discusses how the methods DCE and focus groups have previously been applied to capture citizens’ preferences and perspectives on sustainability and energy systems. This is accompanied by our methodology and data collection processes. The following chapter presents key results. We close with a discussion of the relevance of the findings for decision-makers in transitions and energy systems modelers.
This chapter is sub-divided into three main sections: the first section starts with a review of existing studies on sustainability assessments of energy systems followed by a description of our own research approach. The next two sections, respectively, address focus groups and discrete choice experiment, again including a literature review on the methods’ previous applications in energy contexts and a specification of our own approach.
Sustainability assessments of energy systems
The goal of sustainable energy transitions can be defined as establishing a secure, affordable energy system that spares non-renewable energy sources as well as environmental resources and that meets the needs of both present and future generations [23, 24]. Sustainability has been notably shaped by the Brundtland Report that called for sustainable development processes that satisfy “the needs of the present without compromising the ability of further generations to meet their own needs” [25, 26]. In the aftermath of the report, sustainability has been operationalized using multiple frameworks that differ in the dimensions they incorporate and in how these dimensions relate to each other . While concepts that prioritize ecological preservation historically constitute the oldest [24, 27], the ‘three-pillar concept’ that jointly considers ecological, economic and social aspects prevails in sustainability assessments of energy systems and technologies [11, 13]. Newer concepts, e.g., the Sustainable Development Goals by the UN  or the Integrative Concept of Sustainable Development  move away from the pillar-logic and emphasize elements like “securing human existence”, “maintaining society’s productive potential” and “preserving society’s options for development and action”; these concepts have also been applied for sustainability assessments of energy systems [8, 23].
Given the multidimensionality of sustainability and the availability of various concepts, no standardized methodology exists for sustainability assessments of energy systems and technologies . Existing studies vary in terms of two critical steps in sustainability assessments [11, 24]: (1) the selection and definition of indicators suitable to comprehensively assess future system options as well as the gathering of reliable information about the indicators’ performances in different system futures, and (2) the application of methods to determine indicator weights showing the relative importance of each indicator for the final assessment.
As for the first step, the assessment of energy systems is mostly guided by ecological footprints, systems costs and technological feasibility [30, 31]. In the last years, Life Cycle Sustainability Assessments (LCSA) have also been applied to assess ecologic impacts and life cycle costs for parts of energy systems and individual technologies using diverse sets of indicators backed up by large datasets [12, 13, 16]. Hence, with the usage of LCSA, a more systematic application of economic and ecologic indicators for assessing future energy systems is emerging (see  for a review). In the past years, also social sustainability indicators are receiving increasing attention. In sustainability assessments using MCDA, the “social” dimension is incorporated by using qualitatively and/or quantitatively measurable indicators including social acceptance, job creation, social benefits, human health, or energy costs [9,10,11, 13, 14, 18]. Sustainability assessments without MCDA have developed elaborate lists of social indicators [19, 23]. Again other studies have used empirical data from social LCA databases to assess the social sustainability of energy technologies . However, data on the social sustainability performances is criticized for its methodological shortcomings and the resulting lack of reliability and validity [32,33,34]. In sum, social sustainability is designed as a normative function, i.e., what are acceptable technologies or policy measures for citizens. In this context, some studies also collect data on individuals’ overall attitudes, emotions and perceptions of the technologies . At the same time, the majority of social indicators are defined and assessed exclusively by experts, and in many cases, they also assess the relative importance of the social sustainability indicators compared to ecologic and economic ones as part of multi-criteria assessments. Table 1 provides a non-exhaustive overview of the different kinds of indicators, how they were selected and assessed in previous studies.
Citizens’ preferences for and their perspectives on the sustainability of energy systems and technologies can be analyzed using qualitative and quantitative methods. On the quantitative side, surveys have proved useful in collecting aggregated data on public attitudes towards (sustainable) energy technologies, often with a focus on climate change awareness [35,36,37]. These surveys mostly cover a broad range of sustainability-related topics without zooming in on different sustainability indicators. Only few surveys specifically address public perceptions of social sustainability aspects  and the public’s perceived importance of the Sustainable Development Goals and their indicators . In recent years, discrete choice experiment (DCE) has emerged as a popular quantitative research method to study individuals’ preferences for a variety of sustainability- and energy-related technologies, services and policy measures [40,41,42].
In our approach, we aimed to enable citizens to rank the importance of different indicators of social sustainability while considering information provided by LCA when opting for their preferred future energy system. Therefore, we designed a DCE based on LCA-results for different energy scenarios. Naturally, this approach limits the choice of indicators to be ranked to indicators for which such information is obtainable and might ignore dimensions which are more important to the public, but for which such data are not available. In order to capture such dimensions and to better understand the reasoning behind citizens’ choices, we also conducted focus groups, where citizens could discuss their understanding of social sustainability without being restricted to dimensions for which quantitative information is available. To gain qualitative insights on public perceptions, interviews are suitable but time-consuming and therefore mostly replaced by the use of focus groups. Focus groups present a form of group discussion to systematically access perceptions about and attitudes towards energy issues.
In the best case, the focus groups would have been conducted prior to the DCE and quantitative results for the dimensions that matter the most to the public would have been provided for the DCE. However, given the complexity of the quantitative models involved this was not feasible in the scope of this research project. In our research, 124 citizens participated in the discrete choice experiment while 65 of them also participated in one of six focus groups. Participants for both methods were recruited through a market research company. The recruitment was guided using the following selection criteria: (1) participants needed to live in either Stuttgart or Osnabrück,Footnote 4 (2) an equal distribution of gender, (3) an even number of participants that represent three age groups (students/working/retired), and (4) a good mixture of educational background and professions.
Focus groups have a long history as a method for gaining data in a variety of sciences, starting from psychology, economics and market analysis; it is one of the most known explorative and qualitative methods in sociology and its assigned research fields [44, 45]. Focus groups are a form of group discussion to systematically access arguments on, perceptions about and attitudes towards a given topic. Moderation constitutes a core requirement to provide guidance during the discussion, to ensure that discussions do not get off topic or that single participants dominate and restrain others from voicing their opinion. This way, the group discussion follows the ideal of Habermas  to include as much diverse opinions as participants offer and are willing to share. These characteristics do not only make focus groups more time efficient than interviews; it also reveals the inherent social component of the method: individuals’ statements are always carried out in the presence and awareness of a group. This dynamic alters the entire communication process as statements are checked, agreed or countered immediately by the other participants and, thus, it can foster the depth of insight into a field as previously untapped sources of (civil) knowledge are activated .
As of today, focus groups were used to shed closer light on single aspects within social sustainability, like addressing the social side of rebound effects in energy use . In those studies, focus groups mostly serve as an exploratory method to gain insights into new, previously uncharted aspects of social sustainability, yet without the ambition to triangulate results with existing ecologic or economic data. Others focus on subtopics like the connection between urban lifestyles and sustainability from a social standpoint, like the “Ulysses” project . Holistic scientific programs as the “Nachhaltigkeitsbarometer”  that include a complex multidimensional view on sustainability conduct focus groups almost exclusively among professionals (here working in the energy sector), not lay people, like our study.
Challenges related to the mitigation of climate change and the resulting need to transform energy production and consumption patterns provoke fundamental changes in individuals’ lifestyles and their autonomy. In this context, focus groups have provided great potential for tapping citizens’ local knowledge as explorative data sources [50,51,52]. In reviewing the role of focus groups within energy transition research projects, Gailing and Naumann  state that focus groups do not only reproduce and surface already existing perspectives of individuals’. The methodological setup also creates ‘spaces’ in which the group discussion creates and produces social realities. According to the authors, this can help change social disparities in that participants gain the power to not only respond but to steer the discourse itself. Following this constructivist perspective on focus groups, these effects potentially transcend the protected spaces of the focus groups in that participants have the possibility to participate in a more direct way and with greater power in decisions on energy transition processes .
To explore citizens’ perspectives on the sustainability of future energy systems beyond a set of expert-based indicators, six moderated group discussions were conducted. Our sample (n = 65) consisted of three evenly sized subsamples of seniors, working citizens and students. Both genders were over all equally participating, though in the subsamples the ratio oscillates ± 5% around the aspired 50%. To account for local differences in Germany, three focus groups were conducted in Osnabrück (Lower Saxony) and three in Stuttgart (Baden-Württemberg).Footnote 5 Prior to the focus groups, participants were sent an information package containing descriptions of presently discussed energy technologies for the German energy system (the technologies that were also used later in the DCE) as well as data on their ecological and economic life-cycle effects. This information served as a starting point for the group discussion; see Fig. 1. During the focus groups, participants were guided to discuss beyond this information in that the moderators provoked discussions around the perceived advantages and disadvantages of the technologies as well as their potential consequences for participants’ environment and lifestyle. The auto records of each focus group were transcribed and analyzed using the software MaxQDA. Given the explorative nature of our research, we followed an inductive coding process. From our data, we derived codes to represent single aspects, e.g., technologies, thoughts or entire arguments that were mentioned by participants. During this process of developing a very fine-grained coding scheme, we synthesized thematic clusters and structure our data. For example, within discussions about the dangers and personal consequences of climate change, participants focused on very diverse dimensions that centered around topics such as lost chances for future generations, the need to save ecosystems or the causality between human action and climate change. The aspects were hence aggregated into the codes ‘generational fairness’, ‘ecosystem preservation’ and ‘deny of human climate change’. The interpretation and systematization of qualitative data also depends on the researcher. Thus, the coding process was repeated independently by three trained social scientists to create a complete set of codes. Subsequently, the researchers united their different code systems in iterative steps into a coherent one. The objective was to generate an intercoder-reliability to minimize individual differences in the interpretations. As a last step, the codes were revisited and tailored to our research question in terms of what participants associate the social sustainability of future energy systems.
Discrete choice experiments
Discrete choice experiment (DCE) has emerged as a popular quantitative research method to study individuals’ preferences for a variety of sustainability- and energy-related technologies, services and policy measures [40,41,42]. The basic idea of the method is that instead of revealing preferences through empirical observations, researchers have individuals’ explicitly state their preferences regarding a set of predefined options. Through an experimental setup, researchers predefine options with varying attributes and levels so as to analyze what relative value the different attributes . This way, the method takes into account that in complex decision situations, preferences are not one-dimensional but involve trade-offs between underlying, or ‘latent’ preferences . The methods have, thus, proven to be more reliable than direct questions regarding the importance of specific attributes for individual choices  and demonstrate a high external validity . DCE and conjoint analysis have often been used synonymously in social science applications.Footnote 6 While we acknowledge the different traditions and theoretical foundations of both methods, the following review includes applications of CA and DCE in the context of energy and sustainability. As the purpose is to situate our study among the existing approaches to a better understanding of citizens’ preferences for energy technologies and sustainability measures, we emphasize the common features of CA and DCE: the setup of a hypothetical decision situation in which individuals have to choose among a discrete number of options with different attribute levels, the use of attributes as explanatory variables using regression models [59, 60] as well as similar procedures on data collection. Table 2 presents a non-exhaustive overview of the different perspectives researchers in the areas of energy and sustainability studies have adopted in using stated preference elicitation methods.
As illustrated in the table, individual energy technologies are used as a basis for the experiments. To our knowledge, no previous study has been underpinned by different energy systems or combinations of energy technologies. Among these reviewed studies, costs and citizens’ willingness to pay for environmental protection measures are the dominant attributes tested in combination with other environmental factors. In the study by Alvarez-Farizo and Hanley , three environmental-related attributes are highly significant, with the impact of wind farms on flora and fauna being the most important factor for citizens. The cost attribute thereby showed comparatively weak effects. This can also be observed in a study by Bergmann et al.  that uses a similar experimental setup for different energy technologies. Effects on landscape and wildlife are valued the highest by the respondents. The study by Klain et al.  looks at offshore wind farms and demonstrates that impacts on reef habitat—among the other indicators capital costs, ownership structure and visual impacts—are the most salient factor in citizens’ decisions. Like many other studies, e.g., , they assessed citizens’ willingness to pay (WTP) for measures that improve environmental conservation and found particularly high rates for measures on biodiversity. Another set of attributes that resonate with our research design is the role of transparent information for citizens’ assessments. Assefa and Frostell  found that citizens lack knowledge to discriminately assess different energy technologies while other studies  have argued for more transparent and complete life-cycle information of technologies for lay people. The study by Krütli et al.  investigates the role of perceived fairness in policy decisions on siting nuclear waste. Testing the attributes procedural justice, distributive justice and outcome valence, the authors find that procedural justice, i.e., the involvement of citizens and the transparency of the decision-making process is highly valued by respondents.
In sum, while the combination of tested attributes in various studies reflect environmental, economic and social dimensions, none of the reviewed studies have explicitly utilized DCE or CA for understanding social sustainability aspects nor for multi-criteria assessments in which the empirical results are utilized as weighted inputs for further, quantitative modeling. Similarly, focus groups that empirically complement, validate and contextualize DCE/CA findings have not been found in the literature. Louviere et al.  merely suggest that qualitative research, including focus groups, could be used ex ante to identify possible attributes.
As a basis for the discrete choices, we decided upon the technological systems, i.e., the different options participants needed to choose between. Model-based energy scenarios are complex ‘if…then’ statements derived from multiple assumptions and parameters  and are difficult for non-modelers to interpret . Therefore, it was not a suitable option to present participants with such complex scenarios. Likewise, presenting individual technologies would have given the impression that decisions about future energy systems are a matter of single solutions and would have deflected attention from the fact that individual energy technologies are in complex interaction with the overall energy system. To highlight the necessary complementarity of technologies for electricity and heat consumption, conversion and storage, we used reduced scenarios containing two technologies each (e.g., photovoltaics + battery storage). For the composition of the scenarios, seven energy technologies were used (the same that were used in the information sheets for the focus groups; see Fig. 1)Footnote 7 and combined into 12 meaningful and consistent scenarios (6 focusing on power generation, 6 on power and heat generation). Subsequently, the sustainability indicators, i.e., the attributes and the levels presented for each scenario were selected based on a desk research on sustainability criteria, conducted as part of the research project .Footnote 8 Data for all indicators included effects regarding the technologies’ full life-cycle (installation, operation, disposal).Footnote 9 Traditionally, discrete choice experiments fully randomize the levels of attributes across choices. In our case, however, LCA datasets prescribed exactly how each scenario scored with regard to the different sustainability indicators (see  for previous applications of non-randomized, predefined vignettes).
Participants were presented with two scenarios at a time and asked to choose the most preferred (paired comparison design). As a basis, the 12 scenarios were paired forming 30 different choices for ‘electricity’ and ‘electricity and heat’, while for each scenario all eight sustainability indicators were shown. Given this large number of choices and their complexity, a full factorial design (each participant receives all choices) was not adopted as we sought to minimize fatigue effects; therefore, we confronted each participant with 12 choices.Footnote 10 Figure 2 presents an overview of how the choices were constructed based on the seven technologies. It also shows how the choices were presented to participants in a pseudo-random pattern. Given the complexity of the scenarios we paid special attention to the presentation and visualization of the data. The scenarios entailed verbal descriptions along with small icons of the involved technologies to facilitate quick recognition during the choice situations. Every sustainability indicator was displayed as a colored percentage: the percentages state how much the scenario’s performance deviated from average performance of all considered scenarios. For the example shown in Fig. 3, security of supply for the scenario wind + photovoltaics is 19% below the average performance, whereas for gas + geothermics the security of supply is 40% above average. The colors indicate the scenarios’ contributions to sustainability (green—more sustainability, red—less sustainability).Footnote 11 A pre-test showed that a display without any visualization and color results in a lack of understandability for participants.
To aid understandability, descriptions and a glossary of the energy technologies used in the scenarios and the sustainability indicators were handed out to participants prior to the experiment. Participants had the opportunity to view the information again via a ‘mouse over feature’ during the experiment. To explain the data visualization and to reduce the risk of misinterpretations, an example was shown to participants at the beginning. Participants completed the experiment online through the survey platform Qualtrics. They were sent a personalized link so that they were able to complete the survey in their own time within a period of four weeks.
Responses were analyzed by determining participants’ preferences as the part-worth for each level of the attribute . The classic approach to analyzing discrete choice data—published by McFadden —is fitting a conditional logit regression model (also referred to as multi-nominal logit model (MNL) ) on the data. This approach has two drawbacks: (1) the underlying assumption of independence-of-irrelevant-alternatives (IIA) which is at least questionable in most settings, (2) the inability of accounting for unobserved heterogeneity . Several advancements to the MNL are able to overcome this: Latent-Class MNL, Random Parameter/Mixed MNL and Hierarchical Bayesian MLN . We applied a Random Parameter/Mixed MNL because it allowed to model the nested structure of our data (each participant made several pairwise choices) better than a Latent-Class MLN, and because we were not focused on obtaining individual-level-coefficients (an advantage of Hierarchical Bayes MLN). In contrast to MNL, Mixed MNL estimates a mean effect and a standard deviation of that effect over the sample, as well as testing if the variation in effect size is normally distributed in the sample. If the latter is not the case, it can be assumed that factors not included in the model have a significant impact on effect size (unobserved heterogeneity) .
Scenario attributes were not presented by absolute values, but by percentages depicting their performance relative to all scenarios in the sample. Since all attributes thus had the same range, their coefficients can be interpreted as attribute weights in the choice of a scenario . The analysis was implemented in the statistical program stata using mixlogit .
During the group discussions, participants were asked what they understood to be a social sustainable energy transition in order to measure the broadness of the opinions. Participants’ perceptions centered around three clusters, marked in different colors in Fig. 3. Connected with the cluster ‘lifestyle preservation’, arguments highlighted conservative and liberal positions on the future of energy systems: the prioritization of personal freedom over restrictions in energy use, the rejection of technology-related noise and the fear of a destruction of landscape esthetics as well as concerns about the security of supply were typical narratives presented for this type of argument. Our analysis also revealed an opposed cluster around ‘lifestyle change’: here, participants focused on the perceived injustice in resource and energy use and pointed to discrepancies between national and international conditions and between present and future generations. Although concerns about a failing security of supply of renewable energy technologies also prevailed in this cluster, the argumentation structures led to a different conclusion as opposed to the first cluster, which is the necessity to reconsider present lifestyles and to reduce personal impacts on the environment through own conscious sacrifices in consumption patterns. For a selection of quotes on these topics, see Table 3. Such an inner negotiation process that seeks to balance one’s own habits and a more sustainable lifestyle constitutes the core of this type of argument: participants accepted that major changes will be necessary and that these changes will affect all individuals—including themselves. Along with surfacing this inner conflict, participants also proposed different societal guidelines and new approaches towards the use of energy and natural resources (Fig. 4).
While these two clusters seem to be opposing in nature, it is important to note that they present different types of arguments that we observed not only across but also within participants: some participants used both kinds of arguments (lifestyle changes and lifestyle preservation) which underlines the inner conflicts and trade-offs citizens are exposed to when dealing with the concept of sustainability . The third and biggest cluster consisted of arguments pertaining to the balance between individualism over collectivism. Similar to the second cluster, statements about the need for conscious, individual sacrifices were present. However, the cluster also revealed the broadest variety of arguments when negotiating the conflicting positions on sustainability. The arguments circled around different options to maximize energy efficiency, the dangers to human health and ecosystems and the distribution and allocation of risks and burdens among society. The discussions were directly connected with an urgent request to policy-makers to balance the effects of energy transitions in a way the participants deemed just.
During the focus groups, aspects of distributional justice were intensively debated and emerged as one of the topics that showed the most variety in answers and had major potential for dispute. Our analysis also showed that most of the other arguments presented above and beyond were mental link to distributive justice (Fig. 5). Participants’ responses in relation to distributional justice circled around who suffers what consequences of future energy production and who gains what benefits of it, with a major emphasis on negotiating different needs among societal groups.
As over twelve hours of conversation transcripts in German and their translation in English would overwhelm the appendix of this article, we decided to present selected ones in both versions in a short overview to leave more space to the results’ discussion.
The participants did not limit their considerations to national conditions but also covered global facets of energy justice. Hence, they do not follow political measures to combat climate change and achieve social balance that limit themselves on their home country. They demand more extra-national measurements from politics, as they understand the interconnectedness of the underlying matter.
The arguments on ubiquity of climate change demonstrate that participants are aware of the interconnectedness of international commodity flows and its social outcomes. For example, among several of the focus groups, lithium mining processes in South America were criticized by participants as a particularly unjust side-effect of Germany’s investment in battery technologies. Such mining processes were not only discussed with respect to ecological damages but also in terms of the potential social exploitations and the moral (ir)responsibility of importing countries. Participants also reported a perceived distributive injustice between private companies and civil society. Participants were disapproving of benefits being accumulated by or granted towards private investors while damages or losses being transferred to the public domain or leading to price increases for end users.
Overall, the argumentations clustered around the need for lifestyle changes appeared to be more interconnected: here, arguments strongly built on each other (green). The argumentations that tended to lifestyle preservation were presented mostly without connections to each other (orange). Although the topics of employment and energy affordability were also addressed in all focus groups, they had a different status in the groups in Osnabrück compared to in Stuttgart: citizens from Osnabrück placed more emphasis on employment whereas in Stuttgart citizens focused on energy affordability. However, both strands of arguments were clearly subordinate to the debates on distributive and intergenerational justice and appeared to be given as “But what about…”- responses.
Finally, aspects of intergenerational justice emerged as part of the discussion in the focus groups. Participants shared their expectations and—above all—their fears regarding the living conditions of future generations. In this context, arguments on the disposal of residual and waste materials and their avoidance through resource conservation and recycling played a dominant role. Likewise, cross-references to adverse health effects of energy production were drawn and integrated into the discussion.
A deeper analysis is provided in Fig. 5. Here all found arguments are presented in a (original three-dimensional) graph that shows the proximity within the discussion. Meaning the closer arguments are printed, the more immediate they are spoken off or referred to in the respondents’ speech acts. This way it is possible not only to identify the large clusters, but also to compare the connectedness of the clusters. As we excluded all below three direct connections it is clear to see that the green cluster, lifestyle change, shows more interconnections than the preserving counterpart.
The blue cluster represents the actual debate on distributive justice and its main dimensions on a rational, fact-oriented manner. Here the arguments circle around knowledge: what are the costs of a given technical energy technology and consequences and costs currently allocated.
The green cluster represents the individuals using arguments on how to change their (and general) lifestyle to adapt to the perceived new reality surrounding the climate change. These “changers” use similar arguments while reasoning. They agree on a common notion that change is necessary and start debating how where and who should take what political steps. The lifestyle preservers, or conservatives, mostly agree on demanding more (sure, or irrefutable) information before meeting a decision or that they as private people are not the first address to make change but nations and industry. This bypasses the question on social sustainability by a tendency to shift the discussion to responsibility and blaming of other societal actors.
Discrete choice experiment Footnote 12
The model chosen for the analysis of the DCE is significant on a very high level and has a McFadden Pseudo-R2 of 0.49, meaning that almost half of the variance in choices can be explained by the sustainability indicators included in the regression. Most of the indicators selected for the DCE showed a significant effect (p > 95%) on scenario choice, with the exception of the indicator regarding temporary employment effects. Since this indicator was also highly correlated with permanent employment effects, and the latter had a higher significance as well as a higher effect on scenario choice, the temporary employment effects were excluded from the model.
Of the remaining indicators, four showed significant preference heterogeneity and were, thus, modeled as random effects: climatic effects, health effects, land usage, and resource depletion. Among these, the importance of health effects is influenced the most by unobserved heterogeneity: the standard deviation is even higher than the estimated mean of the coefficient. The importance of health effects seems to vary more than the importance of all the other indicators between citizens; a plausible reason for this variation could be that their impact on an individual’s personal health also varies very strongly depending on their personal health status, which is not captured by the model. The importance of climatic effects is least influenced by unobserved heterogeneity: in relation to its mean value, it has the smallest standard deviation of these regressors; see Table 4.
Since all the regressors have been normalized before the estimation, coefficients can be compared directly and represent the importance of a regressor for the choice between different scenarios, or preference weights. Overall, the climatic effects of the scenarios presented in the DCE had the strongest effect on whether a scenario was preferred over another. Climatic effects are seen as almost twice as important as the second most important regressor—resource depletion. Surprisingly, both economic-related regressors in the DCE (total system costs and employment effects) were regarded as the most non-relevant indicators by participants when assessing the social sustainability of the scenarios. Considering the importance of system costs and economic effects of energy transition pathways in media, politics and science , their relative unimportance in our DCE was rather surprising to us.
Group differences cannot be modeled directly in mixed-logit models , so we looked for them by analyzing interaction terms. Along with the DCE, information about age, gender, occupation and knowledge about the energy system of the participants were collected. For each of these variables, interaction terms with any of the regressors have been tested, but none of them could significantly enhance our model. This result implies that age, gender, occupation, and knowledge about the energy system do not significantly influence preference weights, as well as that the importance of climate effects, health effects, land use and resource depletion when classifying a scenario as more or less socially sustainable is affected by other attributes than these.
Our empirical research provides insights into what citizens value most when assessing future energy systems—with respect to available, scientific sustainability indicators and beyond.
When assessing the results of our discrete choice experiment, it should be noted that we could not realize a true random sampling of participants that meets the requirements for representativeness. It cannot be ruled out that participants in our sample cared differently about the future energy system than the overall German population. As a result, these findings have to be interpreted with caution.Footnote 13 Nevertheless, to our knowledge, this has been the first DCE on citizens’ preferences with regard to national energy scenarios, as opposed to single energy technologies, and thus, provides valuable insights: all but one of the sustainability indicators that we derived from current sustainability assessment models showed a significant contribution to participants’ choices; only temporary employment effects did not contribute significantly to the model. One of the somewhat counter-intuitive results of preference weights is the relative unimportance of production and total system costs which ranked last but one regarding preference weights. Even if the exact values of preference weights may differ in a representative sample, this result raises the question if costs that emerge from the transition towards renewables have the same importance for citizens as implied by their omnipresence in science, media and politics . In this regard, two previous DCEs on preferences regarding local energy projects present comparable settings. Like in our study, Alvarez-Farizo and Hanley  found that environmental attributes were highly significant while the importance of costs of local wind farms ranked significantly lower in citizens’ perceptions. On the contrary, in a study of 2006 , costs had the highest level of significance and—in contradiction to our results—employment effects did not significantly influence vignette choice. One reason for this discrepancy might be the declining prices for renewables in the last decades; another reason could be that the environmental and social implications of climate change have been getting ever clearer in the meantime.Footnote 14 One central implication of our findings is that it underlines increasing concerns of social scientists  whether economic incentives have the potential to increase the acceptance and social sustainability of technologies and transition processes in the long-term. In contrast, it suggests that particularly environmental externalities (including those beyond citizens’ immediate environment, e.g., resource depletion) will need to be taken up by policy measures.
Another central issue highlighted by the results of the DCE and the focus groups is that citizens balance many different sustainability aspects when choosing their preferred scenarios on the future of energy systems (see Table 5). Diverse contradictions and dilemmas inherent in the concept of sustainability have been taken up from a scholarly perspective and with respect to its policy implications, for instance the weighting of the three sustainability pillars  or the possibility of ‘green growth’ . From the perspective of citizens, however, their inner conflicts and the process of considering diverse trade-offs between sustainability objectives when assessing future energy systems has not been acknowledged or discussed. So far, inner conflicts of individuals with respect to sustainability have mostly been tackled through the lens of ‘rebound effects’ . The relevance of these aspects is further amplified by the results of the focus groups. The analysis reveals a contradiction between two different kinds of arguments. On one side, citizens expressed their intention to adjust their personal lifestyles towards a more climate stabilizing and sustainable manner. On the other side, citizens also seemed to be more reluctant in changing their everyday life and use of resources. The latter cluster of arguments demonstrated a less coherent set of arguments pointing to the co-responsibility of private sector enterprises as well as a fair balance of burdens between Germany and other actors on the international stage. Here, citizens raised questions about employment and affordability of electricity and heat more often. The lesser interconnectedness of the arguments illustrate that this fraction does not underlie a unifying, clear ideology like the one of the more environmentalist-driven arguments.
A central finding of the focus groups has been the dominance of aspects on distributional justice citizens mentioned in connection to social sustainability. To the participants of the focus groups, it presented more or less a given that the transition of the energy system will be costly; they worried not about having to pay for the transition but expressed their concerns about whether everyone will have to pay a fair share. Especially the balance between private and public sector as well as private sector and citizens were perceived as problematic. To many, burdens connected with the energy systems change were perceived to be externalized towards civil society. Energy justice within processes of energy transitions has received growing scholarly attention in recent years. From a conceptual perspective, previous studies have raised aspects such as possible negative effects for fossil-intensive employment or an outsourcing of emissions from one focal country to another . Particularly, the latter point has been underscored by our empirical research as a key theme in the eyes of German citizens. Here, our findings are in line with insights from other industrialized countries that argue for the importance of distributional and procedural justice [65, 82]. Following newer frameworks that account for distributional and procedural inequalities , our research suggests that policies need to move beyond tackling inequalities in transition processes in a selective manner (e.g., by focusing only on effects of single technologies or job effects resulting from the decline of an industry). As our research shows, citizens are concerned about the systemic effects and multiple externalities of transition processes which need to be reflected and tackled on a system’s perspective in the development and implementation of transition pathways.
Conclusions and outlook
Our research has been conducted with the purpose to close the gap of social sustainability insights on energy transition pathways and to inform sustainability assessments and multi-criteria decision analyses (MCDA). Our focus groups allowed for an explorative perspective on what citizens value in terms of the social sustainability of energy systems and thereby moved beyond (often entrenched) conceptual and indicator-based understandings of the concept in the literature. The discrete choice experiment—as a stated preference method—has proven to be viable option for quantifying and parametrizing citizens’ preferences regarding environmental, social and economic implications of future energy systems.
Overall, the combined empirical methods provided two main insights with strong implications for future energy research: (1) While environmental and climate-related effects of future energy systems significantly influenced citizens’ preferences for or against certain energy scenarios, total systems and production costs were of far less importance to citizens than the public discourse suggests. (2) The role of fairness and distributional justice and, thus, the sharing of burdens among members of society in transition processes featured as a dominant theme in all six focus groups.
When coordinating the results of the DCE and the focus groups with energy system models and macroeconomic models as part of an integrative assessment of energy scenarios (the overall objective of the research project), it became clear that current energy system models cannot quantify aspects of distributive justice of the calculated scenarios. The only indicator related to distributive justice that the applied models could calculate was the economic regional disparity . However, participants in our focus groups were not only discussing regional inequalities; for them, intergenerational distributive justice, burden sharing between state, firms, and citizens, as well as between different income and lifestyle groups was far more important. In order to tackle the energy transition on the policy level, facing these observed cleavages within society must be addressed to negotiate durable solutions. This field should not be overlooked by future research on citizens’ preferences and social sustainability indicators. Future energy scenarios, therefore, face the challenge to adapt to this demand and include statements about the burdens a respective scenario is placing on different actors and societal groups. This claim is far-reaching since many of the models are by design unable to provide this information and would need substantial modifications in order to calculate indicators of social sustainability as sophisticated as they calculate emissions or economic costs. Furthermore, our results not only advocate the enhancement of the scope of such models (1), but also call for a finer resolution in order to understand what implications different energy scenarios hold for different groups in society (2).
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
For more information on the project, please consult https://www.innosys-projekt.de/en (last accessed 06/09/2022).
The scenarios were remodeled to harmonize underlying assumptions. The harmonization was done using the models MESAP and flexABLE (for more details, see ) and included, among other, assumptions on energy demand, energy prices, technology prices, population and GDP.
Data from the Framework for the Assessment of Environmental Impacts of Transformation Scenarios (FRITS) 4 and PANTA RHEI 23 was used to determine the values of indicators for each scenario.
North Germany is heavily affected by the expansion of wind power generation and regularly produces more renewable energy than it needs while the industrialized centers in the south still lack renewable capacities. The emerging need for powerlines creates diverging patterns of acceptance in the German regions . The cities Osnabrück (in Lower Saxony, northern GER) and Stuttgart (in Baden-Württemberg, southern GER) represent these dynamics.
The recruitment of participants was guided using the following selection criteria: i) participants needed to live in either Stuttgart or Osnabrück, ii) an equal distribution of gender, iii) an even number of participants that represent three age groups (seniors/ working/ students), and iv) a good mixture of educational background and professions. While the first criterion stems from the consortium institutes’ background, the other three were introduced to gather a stratified random sample.
Both methods have their origins in psychology and have been typically used in marketing to detect consumer preferences. In line with Green and Srinivasan , we acknowledge conjoint analysis as an umbrella term that includes a broad spectrum of approaches that “(…) estimate(s) the structure of a consumer’s preferences (e.g. part worth's, importance weights, ideal points) given his/her overall evaluations of a set of alternatives that are pre-specified in terms of levels of different attributes." While some authors suggest that discrete choice experiments present a subcategory of conjoint analysis , Louviere et al. , however, argue that subsuming DCEs under the header of CA does not do justice to the theoretical underpinnings of DCE: Whereas CA is founded on mathematical principles of ‘conjoint measurements’, DCE is based on random utility theory that offers (better) insights into the choice behavior of individuals. It assumes that the latent utilities can be summarized by two components, a systematic (explainable) component and a random (unexplainable) component. Systematic components comprise attributes explaining differences in choice alternatives and covariates explaining differences in individuals’ choices. Random components comprise all unidentified factors that impact choices.” Due to the involvement of a random component, with DCE, researchers can only determine the probability that an individual will prefer one alternative over the other.
The decision was based on a meta-analysis of existing energy scenarios  and the assumed future relevance of different technologies for the overall energy mix as described in these scenarios. For instance, we refrained from integrating coal or nuclear power plants into the design since all major scenario studies assume their phase out by 2050 (the most common reference point of the scenario studies).
For the multi-criteria assessment of the project, a total number of 22 indicators were used. This large number, however, would have not been manageable for a DCE. Therefore, we limited the analysis to the seven indicators that were most commonly used in existing assessment studies, see section “Sustainability assessments of energy systems: Literature review”.
The first four indicators were derived from the life cycle impact assessment method (ILCD midpoint 2.0), which is integrated in the life cycle inventory database ecoinvent v3.3  while the employment indicators were derived from research studies on job creation  and electricity production costs (based on [1, 70,71,72,73]) and formed expert-based assessments (security of supply).
A review of conjoint analyses on environmental issues  shows considerable differences among studies regarding the number situations per participant, ranging from 12 to 120.
While we acknowledge the normative nature of the concept of sustainability, the ‘sustainability triangle’ nevertheless is publicly discussed, widely accepted and points to a clear direction of what is more and what is less sustainable. For the present case, higher sustainability means higher job effects, lower energy costs for households, higher security of supply, and lower effects on human health, emissions, land and resource usage. From our perspective, these methodological choices are legitimate since the research objective was not to identify what constitutes sustainability per se, but which indicators contribute most to citizens’ preferences for future energy systems.
Some of the results presented in this sub-chapter have been published in a previous paper as part of the multi-criteria assessment approach developed in .
This is also one of the reasons for us to not compare respective preference weights for subgroups of the sample or calculate the willingness to pay for the other indicators.
Furthermore, Bergmann et. al showed a significant effect of higher education and age, which proved insignificant in our case. This might be an effect of their higher sample number. Similar to our results, Bergmann et al. did not find many sociodemographic variables with significant influence, although they tested the influence of employment in the energy sector, being a parent, membership in a conservation group, and the amount of last electric bill. However, they found a significant difference regarding preference weights between urban and rural populations. Since our sample consisted mainly of urban citizens, we could not test for these differences. Since we included more vignette attributes than the two studies, it comes as no surprise that our pseudo-R2 is higher.
Discrete choice experiment
Multi-criteria decision analysis
Bundesministerium für Wirtschaft und Energie (2018) Zeitreihen zur Entwicklung der erneuerbaren Energien in Deutschland unter Verwendung von Daten der Arbeitsgruppe Erneuerbare Energien-Statistik (AGEE-Stat), Berlin
European Commission (2020) An EU-wide assessment of National Energy and Climate Plans: Driving forward the green transition and promoting economic recovery through integrated energy and climate planning, Brussels
Witt T, Dumeier M, Geldermann J (2020) Combining scenario planning, energy system analysis, and multi-criteria analysis to develop and evaluate energy scenarios. J Clean Prod 242:118414. https://doi.org/10.1016/j.jclepro.2019.118414
Junne T, Simon S, Buchgeister J et al (2020) Environmental sustainability assessment of multi-sectoral energy transformation pathways: methodological approach and case study for Germany. Sustainability 12:8225. https://doi.org/10.3390/su12198225
Kopfmüller J, Weimer-Jehle W, Naegler T et al (2021) Integrative scenario assessment as a tool to support decisions in energy transition. Energies 14:1580. https://doi.org/10.3390/en14061580
Fauré E, Arushanyan Y, Ekener E et al (2017) Methods for assessing future scenarios from a sustainability perspective. Eur J Futures Res. https://doi.org/10.1007/s40309-017-0121-9
Grunwald A, Rösch C (2011) Sustainability assessment of energy technologies: towards an integrative framework. Energy Sustain Soc 1:1–10
Rösch C, Bräutigam K-R, Kopfmüller J et al (2018) Sustainability assessment of the German energy transition. Energ Sustain Soc. https://doi.org/10.1186/s13705-018-0153-4
Santoyo-Castelazo E, Azapagic A (2014) Sustainability assessment of energy systems: integrating environmental, economic and social aspects. J Clean Prod 80:119–138. https://doi.org/10.1016/j.jclepro.2014.05.061
Troldborg M, Heslop S, Hough RL (2014) Assessing the sustainability of renewable energy technologies using multi-criteria analysis: suitability of approach for national-scale assessments and associated uncertainties. Renew Sust Energ Rev 39:1173–1184. https://doi.org/10.1016/j.rser.2014.07.160
Wang J-J, Jing Y-Y, Zhang C-F et al (2009) Review on multi-criteria decision analysis aid in sustainable energy decision-making. Renew Sust Energ Rev 13:2263–2278. https://doi.org/10.1016/j.rser.2009.06.021
Li C, Wang N, Zhang H et al (2019) Environmental impact evaluation of distributed renewable energy system based on life cycle assessment and fuzzy rough sets. Energies 12:4214. https://doi.org/10.3390/en12214214
Maxim A (2014) Sustainability assessment of electricity generation technologies using weighted multi-criteria decision analysis. Energy Policy 65:284–297. https://doi.org/10.1016/j.enpol.2013.09.059
Evans A, Strezov V, Evans TJ (2009) Assessment of sustainability indicators for renewable energy technologies. Renew Sust Energ Rev 13:1082–1088. https://doi.org/10.1016/j.rser.2008.03.008
Hottenroth H, Sutardhio C, Weidlich A et al (2022) Beyond climate change. Multi-attribute decision making for a sustainability assessment of energy system transformation pathways. Renew Sust Energ Rev 156:111996. https://doi.org/10.1016/j.rser.2021.111996
Naegler T, Becker L, Buchgeister J et al (2021) Integrated multidimensional sustainability assessment of energy system transformation pathways. Sustainability 13:5217. https://doi.org/10.3390/su13095217
Assefa G, Frostell B (2007) Social sustainability and social acceptance in technology assessment: a case study of energy technologies. Technol Soc 29:63–78. https://doi.org/10.1016/j.techsoc.2006.10.007
Liu G (2014) Development of a general sustainability indicator for renewable energy systems: a review. Renew Sust Energ Rev 31:611–621. https://doi.org/10.1016/j.rser.2013.12.038
Quitzow R, Bangert A, Düber D et al (2018) Multikriterieller Bewertungsansatz für eine nachhaltige Energiewende: Von der Analyse zur Entscheidungsfindung mit ENavi, Potsdam
Parris TM, Kates RW (2003) Characterizing and measuring sustainable development. Annu Rev Environ Resour 28:559–586
Renn O, Deuschle J, Jäger A et al (2007) Leitbild Nachhaltigkeit-Eine normativ-funktionale Konzeption und ihre Umsetzung. Springer Verlag, Wiesbaden
Kluge J, Offermann-van Heek J, Ziefle M (2021) How will I know about local energy projects? A conjoint-analysis of communication preferences in Germany. Energy Res & Soc Sci 75:102016. https://doi.org/10.1016/j.erss.2021.102016
Rösch C, Bräutigam K-R, Kopfmüller J et al (2017) Indicator system for the sustainability assessment of the German energy system and its transition. Energ Sustain Soc. https://doi.org/10.1186/s13705-016-0103-y
Gallego Carrera D, Mack A (2010) Sustainability assessment of energy technologies via social indicators: results of a survey among European energy experts. Energy Policy 38:1030–1039. https://doi.org/10.1016/j.enpol.2009.10.055
Renn O, Kastenholz G (1996) Ein regionales Konzept nachhaltiger Entwicklung 5:86–101
Brundtland G (1987) Our common future: the world commission on environment and development. Oxford University Press, Oxford
Voß A, Rath-Nagel S, Ellersdorfer I (2005) A conceptual framework for sustainable electricity supply, Stuttgart
United Nations (2016) UN Sustainable Development Goals: 17 goals to transform our world. https://www.un.org/sustainabledevelopment/. Accessed 08 Apr 2021
Kopfmüller J (2001) Nachhaltige Entwicklung integrativ betrachtet: Konstitutive Elemente, Regeln, Indikatoren. Global zukunftsfähige Entwicklung—Perspektiven für Deutschland, vol 1. Ed. Sigma, Berlin
Ringkjøb H-K, Haugan PM, Solbrekke IM (2018) A review of modelling tools for energy and electricity systems with large shares of variable renewables. Renew Sust Energ Rev 96:440–459. https://doi.org/10.1016/j.rser.2018.08.002
Carramolino R-B, Careri F, Kavvadias K et al (2017) Systematic mapping of power system models: expert survey, Luxembourg
Sala S, Vasta A, Mancini L et al (2015) Social life cycle assessment—state of the art and challenges for supporting product policies, Luxembourg
Zanni S, Awere E, Bonoli A (2020) Life cycle sustainability assessment: an ongoing journey. In: Ren J, Toniolo S (eds) Life cycle sustainability assessment for decision-making. Elsevier, Amsterdam, pp 59–93
Yang S, Ma K, Liu Z et al (2020) Development and applicability of life cycle impact assessment methodologies. In: Ren J, Toniolo S (eds) Life cycle sustainability assessment for decision-making. Elsevier, Amsterdam, pp 95–124
European Commission (2019) Special Eurobarometer 490 Climate Change
Venghaus S, Henseleit M, Belka M (2022) The impact of climate change awareness on behavioral changes in Germany: changing minds or changing behavior? Energy Sustain Soc. https://doi.org/10.1186/s13705-022-00334-8
Steentjes K, Arnold A, Corner A et al (2017) European Perceptions of Climate Change (EPCC): Topline findings of a survey conducted in four European countries in 2016, Cardiff
Wolf I (2020) Soziales Nachhaltigkeitsbarometer der Energiewende 2019. Kernaussagen und Zusammenfassung der wesentlichen Ergebnisse. Institut für transformative Nachhaltigkeitsforschung (IASS)
Boyon N (2019) United Nations Sustainable Development Goals—Global attitudes towards its use and regulation. Survey for the World Economic Forum, Paris
Danne M, Meier-Sauthoff S, Musshoff O (2021) Analyzing German consumers’ willingness to pay for green electricity tariff attributes: a discrete choice experiment. Energ Sustain Soc. https://doi.org/10.1186/s13705-021-00291-8
Mbaka CK, Gikonyo J, Kisaka OM (2019) Households’ energy preference and consumption intensity in Kenya. Energ Sustain Soc. https://doi.org/10.1186/s13705-019-0201-8
Amoah A, Larbi DA, Offei D et al (2017) In gov we trust: the less we pay for improved electricity supply in Ghana. Energ Sustain Soc. https://doi.org/10.1186/s13705-017-0133-0
Komendantova N, Battaglini A (2016) Beyond Decide-Announce-Defend (DAD) and Not-in-My-Backyard (NIMBY) models? Addressing the social and public acceptance of electric transmission lines in Germany. Energy Res Soc Sci 22:224–231. https://doi.org/10.1016/j.erss.2016.10.001
Burgess J (1996) Focusing on fear: the use of focus groups in a project for the community forest unit, countryside commission. Area 28:130–135
Bloor M, Frankland J, Thomas M et al (2001) Focus groups in social research. SAGE, London
Habermas J (1972) Wahrheitstheorien. In: Habermas J (ed) Vorstudien und Ergänzungen zur Theorie des kommunikativen Handelns. Suhrkamp, Frankfurt am Main, pp 127–186
Carey MA (2015) Focus Groups. In: Smelser N, Baltes P (eds) IESBS, vol 9. Elsevier, pp 274–279
Sonnenberger M, Deuschle J, Peters A (2012) Eine kritische Auseinandersetzung mit der Durchführung lebensstilbezogener Fokusgruppen Das Beispiel eines Projekts zum Thema Rebound-Effekte. In: Schulz M, Mack B, Renn O (eds) Fokusgruppen in der empirischen Sozialwissenschaft. VS Verlag für Sozialwissenschaften, Wiesbaden, pp 49–65
Henseling C, Hahn T, Nolting K (2006) Die Fokusgruppen-Methode als Instrument in der Umwelt- und Nachhaltigkeitsforschung, Berlin
Ogalleh S, Vogl C, Eitzinger J et al (2012) Local perceptions and responses to climate change and variability: the case of Laikipia District, Kenya. Sustainability 4:3302–3325. https://doi.org/10.3390/su4123302
Wibeck V (2014) Social representations of climate change in Swedish lay focus groups: local or distant, gradual or catastrophic? Public Underst Sci 23:204–219. https://doi.org/10.1177/0963662512462787
Wibeck V, Hansson A, Anshelm J et al (2017) Making sense of climate engineering: a focus group study of lay publics in four countries. Clim Change 145:1–14. https://doi.org/10.1007/s10584-017-2067-0
Gailing L, Naumann M (2018) Using focus groups to study energy transitions: researching or producing new social realities? Energy Res Soc Sci 45:355–362. https://doi.org/10.1016/j.erss.2018.07.004
Kühne O, Weber F (2018) Bausteine der Energiewende. Springer Fachmedien Wiesbaden, Wiesbaden
Alriksson S, Oberg T (2008) Conjoint analysis for environmental evaluation–a review of methods and applications. Environ Sci Pollut Res Int 15:244–257. https://doi.org/10.1065/espr2008.02.479
Louviere JJ, Flynn TN, Carson RT (2010) Discrete choice experiments are not conjoint Analysis. J Choice Model 3:57–72. https://doi.org/10.1016/S1755-5345(13)70014-9
Hainmueller J, Hangartner D, Yamamoto T (2015) Validating vignette and conjoint survey experiments against real-world behavior. Proc Natl Acad Sci U S A 112:2395–2400. https://doi.org/10.1073/pnas.1416587112
Green PE, Srinivasan V (1990) Conjoint analysis in marketing: new developments with implications for research and practice. J Mark 54:3–20
Hauber AB, González JM, Groothuis-Oudshoorn CGM et al (2016) Statistical methods for the analysis of discrete choice experiments: a report of the ISPOR conjoint analysis good research practices task force. Value Health 19:300–315. https://doi.org/10.1016/j.jval.2016.04.004
Hole AR (2007) Fitting mixed logit models by using maximum simulated likelihood. Stand Genomic Sci 7:388–401. https://doi.org/10.1177/1536867X0700700306
Álvarez-Farizo B, Hanley N (2002) Using conjoint analysis to quantify public preferences over the environmental impacts of wind farms. An example from Spain. Energy Policy 30:107–116. https://doi.org/10.1016/S0301-4215(01)00063-5
Bergmann A, Hanley N, Wright R (2006) Valuing the attributes of renewable energy investments. Energy Policy 34:1004–1014. https://doi.org/10.1016/j.enpol.2004.08.035
Klain S, Satterfield T, Chan KM et al (2020) Octopus’s garden under the blade: boosting biodiversity increases willingness to pay for offshore wind in the United States. Energy Res & Soc Sci 69:101744. https://doi.org/10.1016/j.erss.2020.101744
Lamy J, Bruine de Bruin W, Azevedo IM et al (2020) Keep wind projects close? A case study of distance, culture, and cost in offshore and onshore wind energy siting. Energy Res & Soc Sci 63:101377. https://doi.org/10.1016/j.erss.2019.101377
Krütli P, Stauffacher M, Pedolin D et al (2012) The process matters: fairness in repository siting for nuclear waste. Soc Just Res 25:79–101. https://doi.org/10.1007/s11211-012-0147-x
Kramer GJ (2018) Energy scenarios—exploring disruption and innovation. Energy Res & Soc Sci 37:247–250. https://doi.org/10.1016/j.erss.2017.10.047
Schmidt-Scheele R (2020) ‘Plausible’ energy scenarios?! How users of scenarios assess uncertain futures. Energy Strategy Rev 32:100571. https://doi.org/10.1016/j.esr.2020.100571
Wernet G, Bauer C, Steubing B et al (2016) The ecoinvent database version 3 (part I): overview and methodology. Int J Life Cycle Assess 21:1218–1230. https://doi.org/10.1007/s11367-016-1087-8
O’Sullivan M, Edler D, Lehr U (2018) Ökonomische Indikatoren des Energiesystems—Methode, Abgrenzung und Ergebnisse für den Zeitraum 2000–2016. GWS Research Report, Osnabrück
Nitsch J, Pregger T, Naegler T et al (2012) Langfristszenarien und Strategien für den Ausbau der erneuerbaren Energien in Deutschland bei Berücksichtigung der Entwicklung in Europa und global, Stuttgart/ Kassel/ Teltow
Noack C, Burggraf F, Schwan Hosseiny S et al (2015) Studie über die Planung einer Demonstrationsanlage zur Wasserstoff-Kraftstoffgewinnung durch Elektrolyse mit Zwischenspeicherung in Salzkavernen unter Druck, Stuttgart
Cebulla F, Naegler T, Pohl M (2017) Electrical energy storage in highly renewable European energy systems: capacity requirements, spatial distribution, and storage dispatch. J Energy Storage 14:211–223. https://doi.org/10.1016/j.est.2017.10.004
Kost C, Shammugam S, Jülich V et al. (2018) Stromgestehungskosten Erneuerbare Energien, Freiburg
McFadden D (1974) Conditional logit analysis of qualitative choice behaviour. In: Zambreka P (ed) Frontiers in econometrics. Academic Press, New York and London, pp 105–142
Elshiewy O, Guhl D, Boztug Y (2017) Multinomial logit models in marketing—from fundamentals to state-of-the-art. MAR 39:32–49. https://doi.org/10.15358/0344-1369-2017-3-32
Albert M (2015) Gegensätze der Nachhaltigkeit. Working Papers of the Chair for Innovation Research and Technology Management
Auspurg K, Liebe U (2011) Choice-Experimente und die Messung von Handlungsentscheidungen in der Soziologie. Köln Z Soziol 63:301–314. https://doi.org/10.1007/s11577-011-0136-3
Simora M, Frondel M, Vance C (2020) Do financial incentives increase the acceptance of power lines? Evidence from Germany. Reg Sci Urban Econ 85:103575. https://doi.org/10.1016/j.regsciurbeco.2020.103575
Xu Q, Dhaundiyal S, Guan C (2020) Structural conflict under the new green dilemma: inequalities in development of renewable energy for emerging economies. J Environ Manage 273:111117. https://doi.org/10.1016/j.jenvman.2020.111117
Thomas S (2012) Energieeffizienz spart wirklich Energie—Erkenntnisse zum Thema Rebound-Effekte. Energiewirts Tagesfr 62:8–11
Sovacool BK (2017) Contestation, contingency, and justice in the Nordic low-carbon energy transition. Energy Policy 102:569–582. https://doi.org/10.1016/j.enpol.2016.12.045
Evensen D, Demski C, Becker S et al (2018) The relationship between justice and acceptance of energy transition costs in the UK. Appl Energy 222:451–459
McCauley D, Ramasar V, Heffron RJ et al (2019) Energy justice in the transition to low carbon energy systems: exploring key themes in interdisciplinary research. Appl Energy 233–234:916–921. https://doi.org/10.1016/j.apenergy.2018.10.005
Alberini A, Bigano A, Ščasný M et al (2018) Preferences for energy efficiency vs. renewables: what is the willingness to pay to reduce CO2 emissions? Ecol Econ 144:171–185. https://doi.org/10.1016/j.ecolecon.2017.08.009
Aguilar FX, Cai Z (2010) Conjoint effect of environmental labeling, disclosure of forest of origin and price on consumer preferences for wood products in the US and UK. Ecol Econ 70:308–316. https://doi.org/10.1016/j.ecolecon.2010.09.002
Siegrist M, Stampfli N, Kastenholz H (2009) Acceptance of nanotechnology foods: a conjoint study examining consumers’ willingness to buy. BFJ 111:660–668. https://doi.org/10.1108/00070700910972350
Gamel J, Menrad K, Decker T (2016) Is it really all about the return on investment? Exploring private wind energy investors’ preferences. Energy Res & Soc Sci 14:22–32. https://doi.org/10.1016/j.erss.2016.01.004
Curtin J, McInerney C, Gallachóir BÓ et al (2019) Energizing local communities—what motivates Irish citizens to invest in distributed renewables? Energy Res & Soc Sci 48:177–188. https://doi.org/10.1016/j.erss.2018.08.020
Bauer A, Menrad K (2020) Beyond risk and return: what motivates environmentally friendly or harmful student fund investments in Germany? Energy Res & Soc Sci 67:101509. https://doi.org/10.1016/j.erss.2020.101509
Lüthi S, Prässler T (2011) Analyzing policy support instruments and regulatory risk factors for wind energy deployment—a developers’ perspective. Energy Policy 39:4876–4892. https://doi.org/10.1016/j.enpol.2011.06.029
Bai S, Zhao X, Wang D et al (2018) Engaging multiple weighting approaches and Conjoint Analysis to extend results acceptance of life cycle assessment in biological wastewater treatment technologies. Bioresour Technol 265:349–356. https://doi.org/10.1016/j.biortech.2018.06.032
Knoblauch TA, Trutnevyte E, Stauffacher M (2019) Siting deep geothermal energy: acceptance of various risk and benefit scenarios in a Swiss-German cross-national study. Energy Policy 128:807–816. https://doi.org/10.1016/j.enpol.2019.01.019
Kastner I, Matthies E (2016) Investments in renewable energies by German households: a matter of economics, social influences and ecological concern? Energy Res & Soc Sci 17:1–9. https://doi.org/10.1016/j.erss.2016.03.006
Bengart P, Vogt B (2021) Fuel mix disclosure in Germany—the effect of more transparent information on consumer preferences for renewable energy. Energy Policy 150:112120. https://doi.org/10.1016/j.enpol.2020.112120
Curtis J, Grilli G, Brazil W et al (2020) Why do preferences for electricity services differ? Domestic appliance curtailment contracts in Ireland. Energy Res & Soc Sci 69:101705. https://doi.org/10.1016/j.erss.2020.101705
Fettermann DC, Cavalcante CGS, Ayala NF et al (2020) Configuration of a smart meter for Brazilian customers. Energy Policy 139:111309. https://doi.org/10.1016/j.enpol.2020.111309
Hille S, Weber S, Brosch T (2019) Consumers’ preferences for electricity-saving programs: evidence from a choice-based conjoint study. J Clean Prod 220:800–815. https://doi.org/10.1016/j.jclepro.2019.02.142
Dütschke E, Paetz A-G (2013) Dynamic electricity pricing—which programs do consumers prefer? Energy Policy 59:226–234. https://doi.org/10.1016/j.enpol.2013.03.025
Offermann-van Heek J, Arning K, Sternberg A et al (2020) Assessing public acceptance of the life cycle of CO2-based fuels: does information make the difference? Energy Policy 143:111586. https://doi.org/10.1016/j.enpol.2020.111586
Jia J-J, Xu J-H, Fan Y (2018) Public acceptance of household energy-saving measures in Beijing: heterogeneous preferences and policy implications. Energy Policy 113:487–499. https://doi.org/10.1016/j.enpol.2017.11.024
Franke M, Nadler C (2019) Energy efficiency in the German residential housing market: its influence on tenants and owners. Energy Policy 128:879–890. https://doi.org/10.1016/j.enpol.2019.01.052
The authors would like to thank all participants of the focus groups and discrete choice experiment for their participation. The authors also thank the two anonymous reviewers whose comments helped improve and clarify this paper.
Open Access funding enabled and organized by Projekt DEAL. The research was conducted as part of the project InNoSys (“Integrated Sustainability Assessment and Optimization of Energy Systems”) funded by the German Federal Ministry for Economic Affairs and Energy (project number 03ET4058). The funding institution did not intervene in the research process or in writing this paper.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix A: Raw data used for calculating performances of the discrete choices
DCE electric-only combinations (balanced to 1 kWh each partner)
Wind and PV (roof)
Wind and PV (ground)
Wind and Li-battery
Wind and Geothermics
PV (roof) and Li-battery
PV (ground) and Li-battery
PV (roof) and Geothermics
PV (ground) and Geothermics
Gas (elec.) and Geothermics
Climate change, GWP 100a
Freshwater and terrestrial acidification
Ozone layer depletion
Photochemical ozone creation
Respiratory effects, inorganics
Resources, land use
Resources, mineral, fossils and renewables
DCE electric and heat combinations (balanced to 1kWh each partner)
Wind and gas (heat)
Wind and heat pump
Wind and power-to-gas
PV (roof) and gas (heat)
PV (ground) and gas (heat)
PV (roof) and heat pump
PV (ground) and heat pump
PV (roof) and power-to-gas
PV (ground) and power-to-gas
Climate change, GWP 100a
Freshwater and terrestrial acidification
Ozone layer depletion
Photochemical ozone creation
Respiratory effects, inorganics
Resources, land use
Resources, mineral, fossils and renewables
Appendix B: Available choices for discrete choice experiment with respective data
Note: All numbers represent the deviation from the arithmetic mean of all pairs of the respective variable in percent.
About this article
Cite this article
Schmidt-Scheele, R., Hauser, W., Scheel, O. et al. Sustainability assessments of energy scenarios: citizens’ preferences for and assessments of sustainability indicators. Energ Sustain Soc 12, 41 (2022). https://doi.org/10.1186/s13705-022-00366-0
- Sustainability assessment
- Sustainability indicators
- Sustainability trade-offs
- Social sustainability
- Transition pathways
- Energy systems
- Multi-criteria assessments
- Discrete choice experiment
- Focus groups
- Distributional justice
- Costs of energy transitions