- Original article
- Open Access
The Integrated Policy Package Assessment approach: elaborating ex ante knowledge in the field of urban mobility
Energy, Sustainability and Society volume 12, Article number: 36 (2022)
In response to climate change challenges, a main policy emphasis is on transitioning the energy system from high- to low-carbon energy supply. The German energy transition is first and foremost based on political decisions and interventions. These decisions need to be assessed ex ante to ensure a good governance approach to energy policies, for which this paper introduces the Integrated Policy Package Assessment approach (IPPA). IPPA consists of four steps: design, assessment, evaluation and discourse.
The results section illustrates the IPPA framework by applying it to urban passenger transport as an example case. First, the design phase was used to elaborate two complementary policy packages each consisting of several policy measures in the transformation pathways of “multi- and inter-modality”, and “alternative drive”. Second, the individual measures of the packages were impact-analysed by a large number of individual impact studies from various disciplines. Synthesizing the individual study results, we developed an impact assessment matrix for impact evaluation. The matrix covers the impact categories: technology development, sector integration, environment, social resonance, and institutional factors. In a further step, the key findings of the impact assessment were reflected and reviewed from the perspectives of various stakeholders and practice experts through a practice–science dialogue on transforming the urban passenger transport system.
The discussion and conclusion sections outline the main findings relating to content and process aspects, when applying the IPPA framework to a policy package in urban transport.
The transformation of the energy system towards climate compatibility and sustainability—commonly referred to in Germany as ‘the energy turnaround’—is a fundamental process of socio-technical change, which must be actively and purposefully shaped as a “joint effort” . The socio-technical transformation process is characterized by complexity, uncertainty and ambiguity [2,3,4,5]. The high degree of complexity results from the systemic intertwining of infrastructure, technology, behaviour, market design and politics. There is great uncertainty with regard to technical development, the decisions of actors and their interactions, or overall future developments both within and outside the energy system. Ambiguity refers to the variety of preferences of citizens, stakeholders, entrepreneurs and decision-makers as to the path to be taken for energy system transformation.
The energy system is widely understood as a highly interconnected socio-technical system with both sector-specific and cross-sectoral system characteristics and rationalities [6,7,8]. Throughout the supply, distribution and use of energy in the electricity, heat and mobility sectors, technical components are closely linked to social and institutional actors and their individual and collective decisions. In such an understanding, technical, institutional, economic and social parameters come together and interact closely. The energy system as it is today or is desired to be in the future is thus a manifestation of this interplay and is characterized by a high degree of complexity . Regarding knowledge of energy supplies, it is a challenge to determine the exact initial configuration (boundary conditions) and the interactions between the influencing factors (interdependencies) intersubjectively .
The transport sector is an excellent example of such complexity, uncertainty and ambiguity [11, 12]. The sector is much more complex than other energy sectors. Despite all the political objectives, it has not yet been possible to reduce greenhouse gas emissions from transport in Germany decisively below the 1990 level. On the contrary, emissions are rising continuously—even if a slight decrease can be observed in 2018 . Economic interdependencies in highly specialized value chains with a demand for highly qualified, mobile workers with mobility seen as an expression of freedom, individuality and independence, create tension in discussions on the “mobility transition” . Several objectives are linked to the transformation of mobility systems, covering a much broader range of issues than just climate protection through greenhouse gas reduction . The aim is to improve quality of life by reducing air and noise pollution and by making streets, neighbourhoods and cities more human-oriented than car-focused, but also to save time by relieving the burdens on infrastructure and avoiding traffic jams. At the same time, it should be possible to satisfy the mobility needs of individuals. Further, today’s degree of mobility achieved should be maintained, if not even further increased. This is important, as mobility is equated with individual degrees of freedom which should not be curtailed.
Thus, an integrated approach is required. Our research has addressed the question of how to link sustainability target achievement with transition pathways through the ex ante assessment of policy impact, reflecting pros and cons with decision-makers and stakeholders. The Integrated Policy Package Assessment (IPPA) approach is a suggested way to meet these requirements. This paper elaborates its use to assess ex ante knowledge in the field of urban passenger transport.
The paper is organized as follows: “Methods” section sets out the aim and leading research question, and links the work with a literature review. In “Results” section, we present the main results, outlining the IPPA conceptual framework and the IPPA case study focusing on example of the “alternative drives”. Finally, “Discussion” section discusses the results, summarizes the focal points, and draws some conclusions.
Leading research question
A substantial social–technical process such as the energy and mobility transition raises fundamental questions. What are promising pathways towards the transition? Which policy interventions and packages are suitable and functionally equivalent? How can the effects and side-effects of interventions in complex policy areas be assessed? What consequences are to be expected from policies, for example, for the environment, taxpayers, companies or individual quality of life? And what are stakeholders’ opinions on proposed transition pathways, policies and their corresponding impacts?
The energy transition is first and foremost based on political decisions, since promising transformation paths towards a climate-compatible future can only be realized through political intervention and adequate policy action. In short: no decision—no transition. However, a key question for political decision-makers is which decisions should be taken to reach sustainability goals, considering both the intended and unintended effects against the background of alternative decisions which may reach the same transition target, but show different impact consequences. This is no easy task, since the assessment of future-oriented pathways is based on an array of hypothetical ex ante assumptions and uncertainties in the area of anticipating future knowledge for socio-technical systems.
What is needed to meet these requirements? The leading research question calls for an integrated approach that closely links the design of adequate transition policies and assessment of their impact profiles as ex ante knowledge provision for decision-makers. The IPPA approach is our contribution, and we illustrate it by applying it to an example case. The twofold task as presented in the “Results” section combines conceptual framework development with case study-oriented implementation work. In this paper, we thus present the IPPA approach, which aims to elaborate ex ante knowledge for experts and decision-makers based on inter- and trans-disciplinary research methods. As decision-makers are well aware of what positive and/or negative impacts policy measures will yield, the idea is to provide ex ante knowledge of future impacts on a multidimensional scope with regard to specific policies or policy packages. The overarching objective is to elaborate a framework that integrates heterogeneous research from different disciplines, synthesizes the results in a coherent evaluation matrix, which reflects the expectations and assessments of practitioners and stakeholders.Footnote 1
Literature review and methods
The IPPA approach as conceptualized and illustrated in this paper draws on several research topics in the field of social science-based sustainability research, technology assessment, and system analysis. The conceptual steps of IPPA comprise the four phases of design, assessment, evaluation, and discourse. Design means combining several policy measures and interventions into a coherent policy package [20,21,22,23]. Analysis means an interdisciplinary impact assessment in which the various effects of policy packages are assessed ex ante from different disciplinary perspectives [24, 25]. Evaluation means a synthesis of assessment outputs [26, 27]. Finally, discourse comprises a dialogue-based exchange and review by practitioners and stakeholders [28,29,30]. To sum up, the methodological process specified the overarching objective of integrating and synthesizing heterogeneous impact assessment of policy measures, including the reflections of practice actors and stakeholders as joint application-oriented research. It thus draws on the areas of literature concerning policy packages, impact assessment, and research involving societal actors.
Research into policy packages relates to research regarding policymaking. Standard practice in policymaking is often called “policy patching” [31,32,33]. Thus, empirical research on the design and content of national and/or international energy and climate policies often shows an ad hoc policy patching pattern. This pattern implies uncontrolled growth of local, regional, and federal state policies and interventions that are rarely consistent with one other [34, 35]. The policy package approach tries to tackle this problem “by considering the interaction of the instruments in a bundle” , considering one or more core policy measure(s) in combination with ancillary measures. The ancillary measures need to have one of three rationales. They should either increase the effectiveness of the primary measure, strengthen the acceptance of the primary measure, or facilitate political support for the primary measure [37,38,39]. The result is a policy package that is, ideally, as effective, efficient, and accepted as possible in order to cope with a given problem . The package mitigates possible unintended effects, increases legitimacy and acceptance of the measures, and/or facilitates their implementation . The approach is usually applied to the design of theory-based policy packages in scientific and teaching environments outside the real-world policy arena . Within this paper, we combined the policy package approach with sustainable pathway identification and policy impact assessment and evaluation.
Sustainability has become the keyword for future orientation to safeguarding societies worldwide in harmony with one another and the biosphere . It is first and foremost a social construct that seeks to improve the quality of life for the world’s peoples . A key issue of sustainability is to integrate the three dimensions of economic, environmental and social (including socio-political) wellbeing targets. Sustainability research serves these efforts in many ways across the three dimensions. Among others, sustainability research documents the status quo, extrapolates and forecasts future developments, develops coherent sustainability transformation pathways, provides problem-solving metrics, indicators and tool assessments, addresses ethics, conflicting goals and deliberation processes, and helps to develop branch and sector-oriented sustainability specifications [45,46,47,48,49,50]. A special focus within sustainability research is on integrated impact assessment and evaluation, and sustainability target orientation. There is, for instance, a vast body of literature on sustainability impact assessment for the field energy transition and/or energy technologies [51,52,53,54]. Within the IPPA framework, we tackle several relevant issues of sustainability research, namely the field of sustainable pathway identification and interdisciplinary ex ante impact assessment. The concept of policy packaging should not focus only on the expected direct impact of the suggested measures, but has to foresee unexpected side-effects and unintended interrelationships with other sustainability goals. Interdisciplinary impact assessment from a variety of science disciplines therefore provides a multidimensional assessment picture in the areas of economic, environmental, and social dimensions.
The field of Responsible Innovation (RI) and Responsible Research and Innovation (RRI) [55,56,57,58] address the question of the responsible design and governance of research and innovation processes. The underlying idea is to steer the research and innovation process towards societally beneficial objectives. Science and research on RI/RRI were initially focused on technologies and processes with great societal transformation potential  as well as considerable scientific and ethical uncertainties . A distinctive feature of RRI as understood in large parts of the literature [61, 62] is that steering innovation processes according to societal values and needs is interpreted as a collective responsibility. In this view, there is not only an obligation (for example for technology developers or policymakers) to organize inclusive and participatory processes. There is also an obligation for societal actors to engage in a collective debate that shapes the context for collective decision-making. It is in this regard that IPPA can be described as overlapping with RI/RRI approaches. The overlap is mainly in the dimensions of ‘anticipation’ and ‘inclusion’. The ‘evaluation’ component of the IPPA approach includes the different policy measures (or innovations in terms of new technology, infrastructure, policy, regulation) which compose the policy packages, and their interactions, in an ex ante impact analysis informed by the results of a preceding interdisciplinary analysis. This corresponds with RI/RRI’s dimension of ‘anticipation’ . As participative approaches, we used different methods such as stocktaking workshops, a Group Delphi workshop, and a Practice-Science Dialogue.
The IPPA framework concept
The main intention of the IPPA approach was to develop an assessment procedure that integrated evidence and knowledge on functionally equivalent policy packages which aim to implement sustainable pathways towards climate-friendliness, whilst taking inter- and trans-disciplinary principles into account. As a result, we developed an IPPA framework concept consisting of a four-step phase-model with design, assessment, evaluation and discourse as its constituent elements (cf. Fig. 1).
At the heart of the approach is the design of policy packages that are capable of triggering the two transformation paths of “multi- and inter-modality” and “alternative drive systems”, here within the case study of urban passenger transport. The policy packages were developed using a mixed-method design consisting of a literature review, a participatory Group Delphi workshop, and a practice actors’ feedback workshop. In this paper, we will illustrate IPPA implementation according to the “alternative drive” case. The assessment of the policy packages comprised individual impact studies elaborated by contributions from ENavi project research groups. These were equally important, since each study’s method is characterized by specific strengths and weaknesses, and only their combination leads to robust results. The evaluation integrated and synthesized the individual impact studies into a coherent evaluation matrix. The integration aimed to deliver key insights on progress towards the mobility transition (intended impacts), and unintended side-effects and negative consequences. Finally, in the discourse phase, we applied several participatory methods linking discourse with the other framework phases. The policy package design, for instance, processed a Group Delphi workshop evaluating promising pathways and policy interventions, while the impact profiles of the policy packages were subjected to discussion and review by members of “competence teams” and further practice actors. The competence teams were a structural element of the ENavi project which included individuals from the economic and service sector, civil society, and administration concerned with issues around electricity, heat and/or mobility.
The IPPACase study implementation for urban passenger transport
The design phase: developing the “alternative drive” policy package
The policy package design started with an extensive literature review in order to frame and specify promising transition pathways towards a sustainable urban mobility transition in 2050. As a result, two sustainable, complementary pathways seen as an integrated push- and pull approach were identified:
the multi- and inter-modality pathway, and
the alternative drive pathway.
For each pathway, we developed a pathway target definition and compiled adequate policies for pathway implementation via policy packages. The complementary relation of both pathways envisages first, a modal shift towards sustainable effective and efficient transport systems, and second a substitution towards alternative drives in the remaining vehicles. In this paper, we limit the presentation to the “alternative drive” pathways due to a lack of space. The results of the “multi- and inter-modality pathway” will be published separately. For the “alternative drive” pathway, the target formulation reads as follows:
The transformation path “alternative drives” contributes substantially to a climate-friendly and sustainable transport system in the remaining motorized private transport (MPT) in 2050. With the focus on changes on the supply side due to technology development, the penetration of the vehicle fleet with highly efficient alternative drive technologies supplemented by the provision of a climate-neutral fuel mix is centre stage. Alternative drive refers to the diffusion of purely battery electric vehicles, hybrid vehicles and fuel cell vehicles as well as further efficiency improvements in conventional drives powered by climate-neutral liquid and gaseous fuels (first- and second-generation biofuels, biomass to liquids, power to liquids, power to gas), which also contributes to a climate-neutral MPT. The technology mix of the vehicle fleet and the fuel consumption in 2050 will differ considerably from the year 2021.
The target formulation has been underpinned by desk research analysing several features of a future sustainable urban mobility. The background analysis identified cause–impact chains, indicators, scope, and target states of a sustainable urban mobility “vision”. The policy package of alternative drives resulted in two core measures accompanied by four ancillary measurements. Table 1 gives an overview of the measures and details the policies. In the following, we summarize the single measures.
The core measure “CO2 fleet limit value of 60 g/km by 2030” is a lead instrument from the field of the regulatory toolbox. The CO2 limit for new cars is considered to have the most far-reaching effect as it addresses the entire new car fleet and almost all manufacturers (with the exception of very small fleets). This measure is a typical technology push measure, as it forces manufacturers to push forward technological developments and offer them on the market, with a focus on CO2 emission reduction during the car usage phase.
In contrast, the core measure “introduction of a CO2 component for fossil fuels” is a clear pull measure from the field of economic instruments, which primarily aims to increase the user costs for the MPT based on conventional propulsion and fossil fuels. By privileging alternative drive systems, the measure is intended to create incentives for users to decide to purchase vehicles with alternative drive systems. This will be directly supported by the accompanying measures “reform of the motor vehicle tax” in favour of climate-friendly, fuel-efficient and light vehicles, and “guidelines on parking fees”.
Both measures are intended to further increase the attractiveness of alternative drive systems with additional economic advantages, and thus to encourage users to buy them. Both core measures are flanked by ancillary measures in the field of infrastructure and communication. By promoting “intelligent charging points and tariff systems”, the aim is to prepare for the widespread integration of electric vehicles into the electricity grid so that no new barriers to the diffusion of electric vehicles arise. In addition, a target group-specific “information campaign on electric mobility” aims to fill information gaps and provide neutral information on the entire spectrum of electric mobility. In addition, measures in place, such as the privileged treatment of electric vehicles under the German Electromobility Act (EmoG) or tax advantages for company cars need to be continued.
The assessment phase: processing interdisciplinary impact studies
The assessment phase was based on sub-projects carried out within the ENavi. These were partly initiated independently from the IPPA approach. In a screening phase, we identified and evaluated on-going ENavi research via written surveys among the project staff . We identified 19 individual impact studies contributing to the alternative drive policy package assessment. Table 2 gives an overview of the impact study’s main objective, the method used and the scientific discipline assigned to the corresponding policy measures. The impact assessment involved various scientific disciplines (political science, institutional economics, industrial economics, innovation economics, macroeconomics, microeconomics, resource economics and environmental psychology). In addition, law, engineering sciences and simulation sciences with different model approaches were involved. Methodologically, the research included a variety of methods, including desk research, document analysis, legal analysis, expert interviews, surveys, conjoint analyses, and computer models. In Table 2, we indicate the availability of data and results.
Several studies dealt with impact assessment of the CO2 emission performance standard. Study no. 1 analysed the impact of CO2 limit values on the development over time of the fleet composition consisting of new vehicle registration and the remaining existing fleet. The work focused on re-assessing the current state of the art as described in . As a result, the passenger car limits of 60 g/km in 2030 and 10 g/km in 2050 ensure both a significant increase in the efficiency of conventional passenger cars and an increasing proportion of electric vehicles. From a macroeconomic perspective, study no. 2 used a general equilibrium model to examine various scenarios, each of which used different policy measures, such as CO2 performance standard. The results indicate that new car purchases change the most over time in the “standard” scenario. In order to comply with the CO2 limits, there are both substitution effects between the demand classes and drive types, and budget effects in relation to the absolute level of new vehicle purchases. Further research (no. 3) comparatively analysed several instruments towards impact parameters, i.e. effectiveness, uncertainty (for vehicle suppliers), need for knowledge for different agents, need for commitment, revenue generation, and protection of specific investments. Finally, a value chain upstream analysis has been carried out (no. 4), assessing the risks of supply disruptions associated with vanadium-based redox flow batteries for the German market, using the Holistic Risk Analysis and Modelling (HoRAM) method.
The consequences of a CO2 price component were analysed by four studies. From a microeconomic perspective, one piece of research (no. 5) used the total cost of ownership approach (TCO) to examine the specific effectiveness of the level of CO2 pricing proposed in the policy package. A law study no. 6 focussed on legal framework settings, and the potential and constraints for CO2 pricing implementation in Germany. A macroeconomic simulation study (no. 7) used the energy system model REMod in order to show the total avoidance costs arising in comparison with a business-as-usual scenario. As a target setting, the simulation was based on a total reduction of CO2 emissions of 55% by 2030 and deduced an adequate level of CO2 price to meet the reduction goal. In an agent-based model approach, study no. 8 depicted possible changes in mobility behaviour and mobility demand due to the increase in the cost of motorized private transport (MPT) via a CO2 price component.
The accompanying policy measure reform of the motor vehicle tax was covered by just one study. Research no. 9 dealt with the explicit design of the measurement and concluded that the three measures of CO2 price component, motor vehicle tax reform, and guidelines on parking space management altogether should lead to reduced motorized private transport patterns.
Intelligent charging points and tariff systems were the focus of four assessment studies. From an institutional economics perspective, analyses were carried out for researching capacity allocation options for integrating electro mobility into the electricity system (no. 10), and for researching various management models for implementing fast-charging electric vehicle infrastructure (no. 11). In addition, law analysis assessed the legal framework and problems for charging infrastructure (no. 12). From a techno-economic optimization approach, using the REMod simulation tool (no. 13), the effectiveness of intelligent charging stations use was analysed, and whether grid-supported charging and discharging of battery electric cars has an impact on their use in the vehicle fleet.
Two studies dealt with guidelines on parking fees. One study analysed various options for public parking space (no. 14), while study no. 15 carried out two representative surveys in big cities in order to assess the impact of a parking fee increase on mobility behaviour patterns.
Finally, the measure target group-oriented information campaign on electric mobility was assessed by four contributions. Study no. 16 used an agent-based model from innovation and diffusion research to investigate how a target-oriented information campaign would affect the diffusion of electric vehicles. Environmental psychology contributed two studies analysing the main information deficits that would have to be addressed by an information campaign (no. 17), and dealt with designing an information campaign pro electric mobility for private households (no. 18). Based on data available from the two city surveys, an analysis of the willingness to switch towards alternative drive cars, was carried out (no. 19).
The evaluation phase: synthesizing multicriteria impact profiles
The interdisciplinary impact assessment shown above provided a great variety of single results within the complex field of urban passenger transport in socio-technical systems. We developed a three-step approach for the evaluation of the impact assessment. First, we set up evaluation criteria according to different aspects of socio-technical systems and adapted them to the case of urban passenger transport. Second, we identified results from the impact studies assigning them to the criteria. Third, we evaluated qualitatively the single policy package measures according to the evaluation criteria.
Evaluation of impacts needs to rely on multidimensional criteria that cover the heterogeneity of socio-technical systems of humankind. We relied on a set of criteria proposed for the transformation of energy systems , which distinguishes five principal categories that address several dimensions of socio-technical systems and are equipped with corresponding criteria towards urban transport systems:
Technology development. This includes criteria such as innovative mobility services, alternative drives for MPT, alternative drives for public transport, and intelligent charging infrastructure.
Sector integration and coupling. This comprises the criteria of development of intelligent charging infrastructures, and coupling of renewable electricity generation with the energy demand in transport.
Environmental impact. This includes traditional emissions (air, water, soil, noise), and greenhouse gases.
Social resonance. This covers issues such as empirically measured willingness-to-accept (technologies, policy measures), and empirically measured consumption and investment behaviour (households, companies).
Institutional factors. This includes legal barriers (contradictions, inefficiencies, etc.), political barriers (e.g. overlapping competencies, mismatches between vertical governance levels, lobbying, time delays, etc.), spatial barriers, and economic barriers.
We then identified relevant results from the individual impact studies according to categories and criteria. The aim was to specify relevant indications for the case study on urban transport across the multidimensional socio-technical systems categories from the individual impact studies. While relevant impact results were identified by hands of a survey among project groups, the assignment to categories and criteria was done by document analysis and bilateral conversations with the research teams. Table 3 gives an overview of the variables identified.
In the field of technology development, electric vehicles should not only be used in MPT, but also for innovative mobility service provision, and for public transport. Increased diffusion of alternative drive vehicles needs to be pushed and incentivized by policy measures. In parallel, development and installation of intelligent charging infrastructure needs to be encouraged in order to avoid energy system instability. In the area of sector integration, there is a need to avoid negative effects of the diffusion of electric vehicles on the electricity system at large. Thus, expansion of renewable energy sources is pre-requisite for the extended use of alternative drives. For better coupling between electricity generation and use, storage capacities can be used either with battery electric vehicle storage, or with hydrogen production. In the area of environmental impact, the production and use phases are likewise important. While raw material production for batteries is a crucial issue with considerable environmental impacts and uncertainties, alternative drives in the use phase assure improvements for both traditional emissions into air, water and soil, and reduced greenhouse gases.
Social resonance in the sense of social acceptance and social behaviour are of major importance as an evaluation category. As for alternative drives, there is an increase in the cost of private transport. Thus, willingness to switch may be high, but there is a risk of social imbalance. To compensate, alternatives like public transport must be available and affordable. In addition, there is a lack of neutral information and education about the technical characteristics and possibilities of alternative drives, causing a great deal of scepticism about the new technologies. Finally, in the field of institutional factors, several issues remain. Due to legal issues, not everyone can participate equally in using alternative drive vehicles (e.g. tenants cannot instal private charging infrastructure). As a political issue, there are windows of opportunity currently open for transitioning the transport system with problem pressure via EU specifications, and society’s climate protection claim (Fridays for Future). However, the current Covid-19 pandemic also favours private car driving in the existing (compulsion engine) vehicle fleet. In addition, there is a lack of coordination between activities of the car industry, the energy sector and the state to establish charging infrastructures. Regarding spatial issues, there are contextual dependencies with the use of alternative drives between urban and rural areas. Lastly, economic barriers exist towards investment costs. Vehicles with alternative drive systems are significantly more expensive than conventional vehicles. However, state subsidies for electric car purchase have been considerably extended.
The discourse phase: iterative feedback loops with discursive dialogue
The discourse phase applied several participatory approaches to discuss IPPA development and implementation with internal project staff and external stakeholders along several phases of the cycle. Figure 2 displays the participatory methods used at different stages of the IPPA implementation.
In the design phase, we applied a Group Delphi Workshop. A Group Delphi is a variant developed in the 1990s as a modification of the traditional Delphi method [72,73,74,75,76]. The Group Delphi Workshop discussed and assessed predefined target orientation, sustainable pathways identification and corresponding policy interventions and designed policy packages. It resulted in assessing levels of effectiveness, efficiencies and acceptance among adequate policy interventions, and corresponding trade-offs. In the case of the policy package for the “alternative drive systems” pathway, the expert assessments were very similar: firstly, infrastructure expansion has a major influence on all alternative drives discussed; secondly, there was ambivalence with regard to taxation and quantity limits; and thirdly, the accompanying measures were assessed as being very differentiable. The ambivalence regarding taxation and quantity limits was based on the following arguments. In favour of the CO2 tax is the fact that both existing users and those who want to purchase a new passenger car are affected. In addition, high effectiveness and low side-effects can be expected. The fact that taxes in the high price segment are a marginal aspect for buyers and accordingly have no steering effect on certain groups of buyers speaks against it. One argument in favour of quantity limits is that they are relatively easy to implement through regulation and sanctions, which manufacturers can use to adjust their internal price structure and ensure that the vehicles are purchased. However, there may be a consistency problem, as the quota must be combined with a corresponding infrastructure.
Focussed on the interdisciplinary impact assessment phase, we used the participative methods of written surveys and stocktaking workshops. The two-step survey approach gathered knowledge on impact studies carried out in the ENavi project and delivered specific details on background, leading research questions and methods used, summary and discussion of major results, and assignment to the corresponding measurements within the policy package. The Stocktaking Workshops introduced and discussed both the IPPA implementation procedure and the synthesis of impact assessments.
In the evaluation phase, we carried out a Practice-Science Dialogue. The policy package “alternative drives” (together with the policy package on “multi- and inter-modality”) was subject to critical examination from various perspectives. At this event, representatives from business, politics and civil society together with project staff discussed the preliminary IPPA results . The workshop event aimed at the following objectives: to present the current research results from the IPPA approach, provide in-depth knowledge on selected individual impact study results, and discuss the overall approach of the IPPA. In presenting both pathway cases, we also stressed complementarity with firstly, encouraging shifts towards more efficient modes of passenger transportation, and secondly substitution towards alternative drives within the remaining fleet of vehicles. The recommendations derived from practitioners and stakeholders are depicted in Table 4. What became clear from the recommendations is that IPPA results were contextualized to a broader picture of mobility transition within a socio-technical system perspective.
In this paper, we presented an integrated approach for policy package assessment and illustrated the concept focusing on a case study in the area of urban passenger transport. Since many “grand challenges” are characterized by complexity, uncertainty, and ambiguity within socio-technical systems, integrated inter- and trans-disciplinary approaches seem promising—but they are much more difficult to apply. The IPPA approach consists of a four-phase framework model with design, assessment, evaluation and discourse policy packages. In the following, we discuss the main findings according to results on the levels of content and process perspective.
First, the scope and depth of content results from both the overall IPPA approach, and the individual impact assessment studies is promising. To begin with, the IPPA approach opens up the view of several crucial issues of today’s major challenges in problem-oriented science and policy: firstly, it shows interacting and embedded policies bundled in a package. Second, it considers a heterogeneity of impact perspectives yielding to very different but similarly important results. Thirdly, it provides an overall view on consistently evaluating the different results. And finally, it provides opportunities to discuss the integrated scientific results from real-world perspectives of practice experts from administration/policy, civil society, and business. Thus, the overall IPPA approach may serve as a materialized blueprint approach for analysing policy packaging as policy advice.
Second, the process of implementing the IPPA approach remains a major challenge. The conceptual framework of IPPA is an ideal-type approach which is difficult to fulfil in real-world science practice. The continuous need to compromise leaves room for inadequate results and thus for frustration. Challenges that arise during process implementation include: first, harmonizing timelines and time periods between those responsible in the process across the four process stages. Second, the definition and consideration of comparable policy measurement details within the impact studies are very challenging. These efforts are important in order to ensure all single studies have more-or-less the same research subject and yield comparable results. Finally, a discussion on how the core and ancillary policies relate directly and indirectly to specific impacts and what policy revisions are needed to increase effectiveness, efficiency and acceptance is essential.
One may conclude that the IPPA approach is ambitious with considerable added-value for integrated science, but still has also some shortcomings from a content perspective. The accuracy match between policy package measurement details and consideration of exactly these specifications within the impact studies is difficult to reach. Thus, it was not always clear whether the impact studies adequately relied on the specific measurement configuration when carrying out their impact assessment. The inadequacy may be a result of insufficient consideration when designing the impact studies or a result of difficulties in translating the measurement details into the methods used (survey, simulation, etc.). Another shortcoming is the (non-)comparability or (in)commensurability of the single results. The heterogeneity of single results provision is an added-value for providing insights into real-world impact complexities, but simultaneously these are difficult to put into a coherent synthesis. Which results are more explanatory? Which are less relevant? This is difficult to assess. However, what still remains is the fact that integrated science approaches for policy advice seem to be the road to follow. Even if this road is a challenging one, the added-value of integrated approaches is early consideration of real-world complexities, uncertainties, and ambiguities. It will be worthwhile to spend future effort in trying to achieve solid and feasible concepts and practices.
Availability of data and materials
The authors confirm that the data supporting the findings of this study are available within the article and the data that support the findings of this study are available from the corresponding author, upon reasonable request.
The research was conducted within the collaborative research project ENavi (“Kopernikus Navigation System for the Energy Transition” 2016–2019) [16,17,18,19]. The consortium gathered a wide range of technical, economic and social science expertise, with 59 associated partners and 26 associated experts who contributed their experience to the topics of infrastructure, heating and mobility. The project aim was to develop and implement an inter- and trans-disciplinary approach to integrate political interventions and measures, and work across the energy sectors of electricity, heat and mobility.
Ethics committee for a secure energy supply (2011) Germany’s energy transition: a collective project for the future, final report, Berlin. https://archiv.bundesregierung.de/resource/blob/656922/457334/784356871e5375b8bd74ba2a0bde22bf/2011-05-30-abschlussbericht-ethikkommission-en-data.pdf?download=1. Accessed 3 Dec 2021
Araújo K (2014) The emerging field of energy transitions: progress, challenges, and opportunities. Energy Res Soc Sci 1:112–121
Scheer D, Konrad W, Renn O, Scheel O (2014) Energiepolitik unter Strom: Alternativen der Stromerzeugung im Akzeptanztest. Oekom, München
Renn O (Hrsg) (2015) Aspekte der Energiewende aus sozialwissenschaftlicher Perspektive, Analyse aus der Schriftenreihe Energiesysteme der Zukunft, München (Nationale Akademie der Wissenschaften Leopoldina, Acatech - Deutsche Akademie der Technikwissenschaften und Union der deutschen Akademien der Wissenschaften)
Smil V (2020) Energy transitions: history, requirements, prospects. Praeger Publishers, Westport
Elzen B, Geels F, Green K (eds) (2004) System innovation and the transition to sustainability. Theory, evidence and policy. Edward Elgar, Cheltenham
Büscher C, Schippl J, Sumpf P (eds) (2018) Energy as a sociotechnical problem: an interdisciplinary perspective on control, change, and action in energy transitions. Routledge, Oxfordshire
Chilvers J, Pallett H, Hargreaves T (2018) Ecologies of participation in socio-technical change: the case of energy system transitions. Energy Res Soc Sci 42:199–210
Cherp A, Jewell J, Goldthau A (2011) Governing global energy: systems, transitions, complexity. Glob Pol 2(1):75–88
Bale CS, Varga L, Foxon TJ (2015) Energy and complexity: new ways forward. Appl Energy 138:150–159
Scheer D, Nabitz L (2019) Klimaverträgliche Energiezukünfte (nicht) wissen: Möglichkeiten und Grenzen von Zukunftswissen für die Energiewende. In: TATuP Zeitschrift für Technikfolgenabschätzung in Theorie und Praxis 29(3):14–19
Scheer D (2021) Wie wandelt die Wende? Wissenschaftsperspektiven auf Transformationsmechanismen der Energiewende. In: SONA – Netzwerk Soziologie der Nachhaltigkeit (ed) Soziologie der Nachhaltigkeit. Bielefeld, Transcript, pp 305–316
Bundesministerium für Umwelt, Naturschutz und nukleare Sicherheit (BMU) (2019) Klimaschutz in Zahlen. Fakten, Trends und Impulse deutscher Klimapolitik. https://www.bmu.de/fileadmin/Daten_BMU/Pools/Broschueren/klimaschutz_zahlen_2019_broschuere_bf.pdf. Accessed 3 Dec 2021.
Hesse M (2018) Ein Rückblick auf die Zukunft. 25 Jahre Verkehrswende. In: Ökologisches Wirtschaften 33(2):16–18
Kemp R, Rotmans J (2004) Managing the transition to sustainable mobility. In: Elzen B, Geels FW, Green K (eds) System innovation and the transition to sustainability: theory, evidence and policy. Edward Elgar, Cheltenham, pp 137–167
Renn O (2017) Ein Kompass für die Energiewende. Das Kopernikus-Projekt Energiewende-Navigationssystem (ENavi) ist gestartet. Gaia 26(1):68–69
Scheer D, Grunwald A (2017) Orientierungswissen für die Energiewende: Der Roadsmap-und-Navigation-Ansatz. Gaia 26(2):155
Dreyer M, Edenhofer O, Fischedick M, Grunwald A, Henning H-M, Hoffmann C, Hufendiek K, Jaeger C, Knodt M, Kost C, Luderer G, Mack B, Matthies E, Ober S, Pahle M, Renn O, Rodi M, Scheer D Staiß F (2018) Energiewende braucht den Dialog mit der Gesellschaft. Statusbericht 2018. Potsdam: Geschäftsstelle des Kopernikus-Projekts Energiewende-Navigationssystem|ENavi, Institute for Advanced Sustainability Studies (IASS). https://www.dialogik-expert.de/sites/default/files/downloads/de/enavi-statusbericht-2018.pdf. Accessed 3 Dec 2021
Renn O (2019) Navigationshilfen für den gesellschaftlichen Dialog zur Energiewende. Impulse des Kopernikus-Projekts ENavi. Gaia 28(4):394–395
Kelly C, May AD, Jopson A (2008) The development of an option generation tool to identify potential transport policy packages. Transp Policy 15(6):361–371
Givoni M (2014) Addressing transport policy challenges through Policy-Packaging. Transp Res Part A 60:1–8
Sovacool BK, Saunders H (2014) Competing policy packages and the complexity of energy security. Energy 67:641–651
Thaller A, Posch A, Dugan A, Steininger K (2021) How to design policy packages for sustainable transport: balancing disruptiveness and implementability. Transp Res Part D: Transp Environ 91:102714
Jaroszweski D, Chapman L, Petts J (2010) Assessing the potential impact of climate change on transportation: the need for an interdisciplinary approach. J Transp Geogr 18(2):331–335
König B, Diehl K, Tscherning K, Helming K (2013) A framework for structuring interdisciplinary research management. Res Policy 42(1):261–272
Munda G (2003) Multicriteria assessment. International Society for Ecological Economics
Radej B (2011) Synthesis in policy impact assessment. Evaluation 17(2):133–150
Bracken LJ, Bulkeley HA, Whitman G (2015) Transdisciplinary research: understanding the stakeholder perspective. J Environ Plan Manage 58(7):1291–1308
Thompson MA, Owen S, Lindsay JM, Leonard GS, Cronin SJ (2017) Scientist and stakeholder perspectives of transdisciplinary research: early attitudes, expectations, and tensions. Environ Sci Policy 74:30–39
Lang DJ, Wiek A, Bergmann M, Stauffacher M, Martens P, Moll P, Swilling M, Thomas CJ (2012) Transdisciplinary research in sustainability science: practice, principles, and challenges. Sustain Sci 7(1):25–43
Howlett M, Ramesh M (2003) Studying public policy: policy cycles and policy subsystems, 2nd edn. Oxford University Press, Oxford
Rosenow J, Kern F, Rogge K (2007) The need for comprehensive and well targeted instrument mixes to stimulate energy transitions: the case of energy efficiency policy. Energy Res Soc Sci 33:95–104
Kern F, Kivimaa P, Martiskainen M (2017) Policy packaging or policy patching? The development of complex energy efficiency policy mixes. Energy Res Soc Sci 23:11–25
OECD (2007) Instrument Mixes for Environmental Policy. http://www.oecd-ilibrary.org/environment/instrument-mixes-for-environmental-policy_9789264018419-en. Accessed 3 Dec 2021.
Hansjürgens B (2012) Instrumentenmix in der Klima- und Energiepolitik: Welche Herausforderungen stellen sich? Wirtschaftsdienst 92:5–11
Givoni M, Macmillen J, Banister D (2010) From individual policies to policy packaging. Submission to European Transport. Conference 2010. https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.683.1293&rep=rep1&type=pdf. Accessed 3 Dec 2021
Givoni M, Macmillen J, Banister D, Feitelson E (2013) From policy measures to policy packages. Transp Rev 33:1–20
Justen A, Schippl J, Lenz B, Fleischer T (2014) Assessment of policies and detection of unintended effects: guiding principles for the consideration of methods and tools in policy-packaging. Transp Res Part A Policy Pract 60:19–30
Taeihagh A, Bañares-Alcántara R, Givoni M (2014) A virtual environment for the formulation of policy packages. Transp Res Part A 60:53–68
Justen A, Fearnley N, Givoni M, Macmillen J (2014) A process for designing policy packaging: ideals and realities. Transp Res Part A 60:9–18
Kessler F, Vesela J, Vencl V, Strnadova D, Sørensen CH, Schippl J, Longva F, Ramjerdi F, Osland O, Givoni M et al (2010) Best practice in policy package design. In: OPTIC, optimal policies for transport in combination: 7th Framework Programme: Theme 7 Transport (Chapter Deliverable 4). https://optic.toi.no/getfile.php/1316951-1301426656/Optic/Bilder%20og%20dokumenter%20internett/OPTIC%20D4%20Final.pdf. Accessed 3 Dec 2021
Wicki M, Fesenfeld L, Bernauer T (2019) In search of politically feasible policy-packages for sustainable passenger transport: Insights from choice experiments in China, Germany, and the USA. Environ Res Lett 14:084048
Heinrichs H, Martens P, Wiek A (2016) Sustainability science. Springer, Dordrecht
Theis T, Tomkin J (eds) (2012) Sustainability: a comprehensive foundation. Urbana-Champaign: Univ.Ill. Open Source Textb. Initiat. https://cnx.org/contents/F0Hv_Zza@45.1:HdWd2hN5@2/Foreword. Accessed 3 Dec 2021.
Kates RW, Clark WC, Corell R, Hall JM, Jaeger CC, Lowe I, McCarthy JJ, Schellnhuber HJ, Bolin B, Dickson ND, Faucheux S, Gallopin GC, Grübler A, Huntley B, Jäger J, Jodha NS, Kasperson RE, Mabogunje A, Matson P, Mooney H, Moore B III, O’Riordan T, Svedin U (2001) Sustainability science. Science 292(5517):641–642
Kasemir B, Jäger J, Jaeger CC, Gardner MT (eds) (2003) Public participation in sustainability science—a handbook. University Press, Cambridge
Swart RJ, Raskin P, Robinson J (2004) The problem of the future: sustainability science and scenario analysis. Glob Environ Chang 14(2):137–146
Scheer D, Rubik F (eds) (2006) Governance of integrated product policy—in search of sustainable production and consumption. Greenleaf Publishing Ltd., Sheffield
Spangenberg JH (2011) Sustainability science: a review, an analysis and some empirical lessons. Environ Conserv 38(3):275–287
De Vries BJ (2012) Sustainability science. Cambridge University Press, Cambridge
Weaver PM, Rotmans J (2006) Integrated sustainability assessment: what is it, why do it and how? Int J Innov Sustain Dev 1(4):284–303
Ness B, Urbel-Piirsalu E, Anderberg S, Olsson L (2007) Categorising tools for sustainability assessment. Ecol Econ 60(3):498–508
Grunwald A, Rösch C (2011) Sustainability assessment of energy technologies: towards an integrative framework. Energy Sustainability Soc 1(1):1–10
Santoyo-Castelazo E, Azapagic A (2014) Sustainability assessment of energy systems: integrating environmental, economic and social aspects. J Clean Prod 80:119–138
Owen R, Bessant JR, Heintz M (eds) (2013) Responsible innovation: managing the responsible emergence of science and innovation in society. Wiley, Hoboken
Fisher E, Rip A (2013) Responsible innovation: multi‐level dynamics and soft intervention practices. Responsible innovation: managing the responsible emergence of science and innovation in society, pp 165–183
Wickson F, Carew AL (2014) Quality criteria and indicators for responsible research and innovation: learning from transdisciplinarity. J Responsible Innov 1(3):254–273
Owen R, Pansera M (2019) Responsible innovation and responsible research and innovation. In: Simon D, Kuhlmann S, Stamm J, Canzler W (eds) Handbook on science and public policy. Edward Elgar Publishing, Cheltenham, pp 26–48
Lindner R, Goos K, Güth S, Som O, Schröder T (2016) “Responsible Research and Innovation” als Ansatz für die Forschungs-, Technologie- und Innovationspolitik - Hintergründe und Entwicklungen. TA-Vorstudie. Berlin: Büro für Technikfolgen-Abschätzung beim Deutschen Bundestag (TAB). https://www.tab-beim-bundestag.de/de/pdf/publikationen/berichte/TAB-Hintergrundpapier-hp022.pdf. Accessed 3 Dec 2021
Forsberg EM (2019) Responsible research and innovation in the broader innovation system: reflections on responsibility in standardisation, assessment and patenting practices. In: von Schomberg R, Hankins J (eds) International handbook on responsible innovation. A global resource. Edward Elgar Publishing, Cheltenham, pp 150–166
Von Schomberg R (2013) A vision of responsible research and innovation. In: Owen R, Bessant J, Heintz M (eds) Responsible innovation. Managing the responsible emergence of science and innovation in society. Wiley, Hoboken, pp 50–74
Arnaldi S, Gorgoni G, Pariotti E (2016) RRI as a governance paradigm: what is new? In: Lindner R et al (eds) Navigating towards shared responsibility in research and innovation. Approach, process and results of the Res-AGorA Project, pp 22–29. https://indd.adobe.com/view/eaeb695e-a212-4a34-aeba-b3d8a7a58acc. Accessed 3 Dec 2021
Stilgoe J, Owen R, Macnaghten P (2013) Developing a framework for responsible innovation. Res Policy 42:1568–1580
Renn O (2018) Überlegungen zur Kopplung von systemanalytisch (technisch-ökonomischen) und sozialwissenschaftlich erfassten Zusammenhängen, Potsdam (unpublished manuscript)
Fahl U, Hauser W, Link H, Nabitz L, Naegler T, Prehofer S, Scheer D, Strunz S, Zabel C (2018) AP1 & AG Modellierung und Szenarien: Inventur der ENavi-Kompetenzen –Modelle, Methoden und Interventionen –Download-Paket Modelle, Stuttgart
Beestermöller R (2017) Die Energienachfrage privater Haushalte und ihre Bedeutung für den Klimaschutz: volkswirtschaftliche Analysen zur deutschen und europäischen Klimapolitik mit einem technologiefundierten Allgemeinen Gleichgewichtsmodell. Disseration, Forschungsbericht / Institut für Energiewirtschaft und Rationelle Energieanwendung; 128. https://elib.uni-stuttgart.de/bitstream/11682/9140/1/Dissertation_Beestermoeller.pdf. Accessed 3 Dec 2021
Ciotola A, Fuss M, Colombo S, Poganietz W-R (2021) The potential supply risk of vanadium for the renewable energy transition in Germany. J Energy Storage 33:102094
Schäfer-Stradowsky S, Albert D, Lerm V, Wilms S, Hartwig M, Sterniczuk T, Timmermann D, Zeccola M, Schnittker D (2017) Die drängendsten Fragen der Energiewende aus juristischer Sicht Forschungsbericht. IKEM, Universität Stuttgart, Universität Münster: Arbeitspapier des Projekts Kopernikus ENavi. https://www.ikem.de/wp-content/uploads/2018/11/Die_dr%C3%A4ngendsten_Fragen_der_Energiewende_aus_juristischer_Sicht.pdf. Accessed 3 Dec 2021
Mielke J, Geiges A (2018) Model-stakeholder interactions for a sustainable mobility transition. Working Paper 02/2018. https://globalclimateforum.org/wp-content/uploads/2018/09/GCF_WorkingPaper2-2018.pdf. Accessed 3 Dec 2021
Buchmann T, Wolf P, Fidaschek S (2021) Stimulating E-mobility diffusion in Germany (EMOSIM): an agent-based simulation approach. Energies 14:656. https://doi.org/10.3390/en14030656
Zimmer W, Blanck R, Bergmann T, Mottschall M, von Waldenfels R, Cyganski R, Wolfermann A, Winkler C, Heinrichs M, Dünnebeil F, Fehrenbach H, Kämper C, Biemann K, Kräck J, Peter M, Zandonella R, Bertschmann D (2016) Endbericht RENEWBILITY III – Optionen einer Dekarbonisierung des Verkehrssektors. Project Report. https://www.oeko.de/fileadmin/oekodoc/RenewbilityIII_Endbericht.pdf. Accessed 3 Dec 2021
Webler T, Levine D, Rakel H, Renn O (1991) The group delphi: a novel attempt at reducing uncertainty. Technol Forecast Soc Chang 39:253–263
Renn O, Webler T (1998) Der kooperative Diskurs - Theoretische Grundlagen, Anforderungen, Möglichkeiten. In: Renn O, Kastenholz H, Schild P, Wilhelm U (eds) Abfallpolitik im kooperativen Diskurs Bürgerbeteiligung bei der Standortsuche für eine Deponie im Kanton Aargau. Hochschulverlag AG an der ETH Zürich, Zürich, pp 3–103
Scheer D, Renn O (2014) Public perception of geoengineering and its consequences for public debate. Clim Change 125(3–4):305–318
Scheer D, Konrad W, Kissinger A, Noack V, Knopf S, Class H (2017) Regional-scale brine migration along vertical pathways due to CO2 injection—part 1: the participatory modeling approach. Hydrol Earth Syst Sci 21:2739–2750
Niederberger M, Renn O (2018) Das Gruppendelphi-Verfahren. Vom Konzept bis zur Anwendung. Springer, Wiesbaden
Dreyer M, Dratsdrummer F, Sellke P, Ulmer F (2019) Herausforderung Maßnahmengestaltung. Wie verleihen wir der Verkehrswende die erforderliche Dynamik (Veranstaltungsbericht KT 02-2019; ENavi-Projekt; Förderkennzeichen 03SFK4J0), Stuttgart, DIALOGIK. https://www.kopernikus-projekte.de/lw_resource/datapool/systemfiles/elements/files/B0EE61F85E387788E0537E695E86833F/current/document/ENavi-Veranstaltungsbericht-KT02-2019.pdf. Accessed 3 Dec 2021.
We gratefully acknowledge the organizations mentioned in the “Funding” section. We also would like to thank Ortwin Renn as the spokesperson and lead project manager of ENavi, the project staff members and the competence teams of ENavi for supporting us with their ideas, critiques, and last but not least their research. Special thanks goes also to the ENavi core group of the special topic mobility transition which helped developed the idea and implementation of the presented research. Furthermore, we want to thank the two anonymous reviewers who commented on the paper with much care and contributed to improving the quality of the paper.
Open Access funding was enabled and organized by Project DEAL and implemented by Karlsruhe Institute of Technology (KIT). The research carried out for this article is a result of the Federal Ministry of Education and Research funded Kopernikus project Energy Transition Navigation System for the detection, analysis and simulation of systemic interconnections (ENavi), Subproject J0 (funding code 03SFK4J0).
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Scheer, D., Dreyer, M., Schmidt, M. et al. The Integrated Policy Package Assessment approach: elaborating ex ante knowledge in the field of urban mobility. Energ Sustain Soc 12, 36 (2022). https://doi.org/10.1186/s13705-022-00362-4
- Energy transition
- Policy packages
- Impact assessment