As part of the development of the new NISTO evaluation methodology, an online questionnaire was sent to stakeholders in five different Northwestern European (NWE) countries. The list of stakeholders was compiled by the respective regional partners. The survey had two main objectives. Firstly, information about the experience with and knowledge of different evaluation methodologies was collected to get a clearer picture of the advantages and disadvantages of them. In the second part, potential evaluation criteria of the NISTO evaluation framework were rated by the stakeholders in order to get to know their preferences.
The survey was carried out between 27th September and 21st October 2013. 214 respondents completed the online questionnaire and ensured a wide geographical coverage. It was also ensured that stakeholders come from a wide range of organisations. While the main focus was on local governments, which are expected to be the main users of the new evaluation methodology (46% of respondents), responses were also received from representatives of regional governments (14%), mobility organisations (12%), as well as researchers and specialists (7%). Other organisations had lower shares.
According to the results of the survey the social cost-benefit analysis (SCBA) and the multi-criteria analysis (MCA) are the best known and most commonly used evaluation methodologies among the respondents. The rest of the methodologies (Caltrans Smart Mobility Framework, EcoMobiilty SHIFT, Multi-Actor Multi-Criteria Analysis and DfT Guidance on the Appraisal of Walking and Cycling Schemes) are used by only 5-12% of the respondents. Stakeholders were also asked to rate statements about each methodology. The flexibility of MCA was highlighted as a major benefit, while the standardised methodology of the SCBA was also considered as an advantage. The SCBA was also found to be time-consuming and complicated.
In the second part of the survey, stakeholders were asked to choose five indicators that they think are the most important and applicable for the evaluation of mobility and transportation projects. Changing the modal split, accessibility, environmental quality, efficiency of transport and safety were mentioned by most of the stakeholders.
The findings of the analysis suggest that the new NISTO evaluation framework should integrate the benefits of the SCBA and a MCA and possibly avoid their disadvantages. It is also recommended to involve different stakeholder groups in the evaluation process as their preferences can be significantly different. Furthermore, the new evaluation framework should be disseminated and explained in a clear way so that the stakeholders will understand it and use it.
More information on the stakeholder survey report is available in the Download Center.
Download Center »