Evaluation and Impact Analyses

The Austrian Institute for SME Research conducts evaluations and impact analyses of measures, programmes and institutions in various policy areas at international, national and regional level. This involves the analysis and evaluation of the efficiency and effectiveness of the use of public subsidies and other measures in view of limited resources and increasing (inter)national competitive pressure. The relevant research work forms an essential component of a learning and strategically oriented national and European policy making. The evaluation activities of the Austrian Institute for SME Research focus on research, technology and innovation policy (RTI policy), economic policy as well as labour market and social policy. The Institute is a member of the board and the working group FTI of the German Society for Evaluation e.V. (DeGEval) and a member of the platform fteval. The evaluations of the Austrian Institute for SME Research are based on the (quality) standards developed by these institutions.

Asset 7

Selected Projects

Evaluation des Zentralen Innovationsprogramms Mittelstand (Evaluation of the Central Innovation Programme for SMEs)

The evaluation of the German Central Innovation Programme for SMEs (ZIM) with its three R&D programme pillars - individual projects, cooperation projects and innovation networks concerns one of the most important instruments of innovation policy in Germany.

The evaluation focused on the programme period 2015 to mid-2018 and integrated a theory-based approach with a strong empirical basis. Methodologically, the evaluation implemented a coordinated set of analytical-quantitative and qualitative approaches, such as a control group approach as well as a broad set of qualitative methods, including the analysis of spillover-effects of the different programme pillars.

Completed:

2019/07

Contact

Peter Kaufmann

German Report

Österreichischer Forschungs- und Technologiebericht 2019 – 2022 (Austrian Research and Technology Report 2019 – 2022)

The Austrian Institute for SME Research writes, in a consortium with five further partners, the yearly report of the Federal Government to the Parliament (National Council) under Section 8(2) of the Research Organisation Act, on the state and progress of federally subsidised research, technology and innovation in Austria. The report covers development trends and priority topics for the Austrian innovation system, and reflects on them in an international context. The report is written on a yearly basis until 2022.

On behalf of:

Federal Ministry for Digital and Economic Affairs
Austrian Ministry for Transport, Innovation and Technology

Expected Completion:

2022

Contact

Peter Kaufmann

Publications

Evaluierung des BRIDGE Programms (Evaluation of the BRIDGE Programme)

The BRIDGE programme funds basic science research projects at universities and other public research organisations that already demonstrate realistic application prospects. Thus, the BRIDGE funding will facilitate the transfer of basic science results into industrial applications.
Companies participate in these projects financially or non-financially by providing equipment and guidance to the research institutes. The evaluation focuses on the different facets of impacts of the programme and on the more recent modifications in the programme design during the period 2009 up to 2016.

On behalf of:

Austrian Ministry for Transport, Innovation and Technology

Completed:

2018/05

Contact

Peter Kaufmann

german report

Evaluierung der innovationsfördernden Beschaffung (Evaluation of the Public Procurement Promoting Innovation)

The evaluation analyses to what extent the concept for innovation promoting public procurement (IÖB) established in 2011 has been successfully implemented or whether the corresponding setting enables efficient implementation. The evaluation is based on a mixture of quantitative and qualitative methods and also develops recommendations for further implementation with the help of an international comparison.

Completed:

2018/05

Contact

Sascha Ruhland

german report

Evaluierung der Förderungsgesellschaften Austria Wirtschaftsservice GmbH (AWS) und Forschungsförderungsgesellschaft GmbH (FFG) (Evaluation of Austria Wirtschaftsservice Gesellschaft mbH (AWS) and Austrian Research Promotion Agency (FFG))

The evaluation of the AWS and FFG promotion agencies essentially addresses the question whether and to what extent ambitions and expectations of the predecessor organisations consolidations, which happened in the context of the structural reforms more than a decade ago, have been achieved. Applying a theory-based evaluation approach (TBE) the evaluation analyses organisational and content-related functionalities, inherent properties, functional logics and impacts of both institutions, in order to draw action-relevant conclusions.

On behalf of:

Austrian Ministry for Transport, Innovation and Technology
Austrian Ministry of Science, Research and Economy

Completed:

2017/11

Contact

Peter Kaufmann

german report

Interim Evaluation of the Participation of SMEs in FP7 (Cooperation Programme and the Research for the Benefit of SMEs Schemes)

The overall objective of this study was to evaluate the results and impacts of the participating SMEs within two initiatives of FP7: the cooperation programme and the research for the benefit of SMEs schemes under the capacities programme, including the impacts on economic performance, European added value, behavioural additionality and innovation. The evaluation study assessed the relevance, efficiency and effectiveness of the two initiatives.

On behalf of:

European Commission, DG Research and Innovation

Completed:

2014/05

Contact

Sascha Ruhland

publication

Ihre Ansprechpersonen

Sascha Ruhland

Senior Researcher
s.ruhland@kmuforschung.ac.at
+43 1 5059761-49

Peter Kaufmann

Deputy Director
p.kaufmann@kmuforschung.ac.at
+43 1 5059761-31
Asset 7

Evaluation of the German Space and Innovation Programme

The study focuses on the achievement of the objectives and the effects of the programme, as well as on the cost-effectiveness of programme implementation by the Space Management (RFM) of the German Aerospace Agency (DLR). The analysis focuses on questions of internal organization and governance of programme implementation, as well as the implementation of large-scale missions. Apart from the actual programme performance, we also develop a concept for an increased future evaluability of the programme.

Expected Completion
2020/10
Asset 7

Recommendations on data bases and methods for the evaluation of R&D tax incentives in Germany

In this project, possible data bases and methodological challenges for a future evaluation of R&D tax incentives in Germany will be examined and a coordinated evaluation plan drawn up.

Expected Completion
2020
Asset 7

Concept for the impact analysis of Innosuisse

The project supports Innosuisse in developing a concept for the agency's impact analysis.

Expected Completion
2019/12
Asset 7

Competitiveness of the EU Engineering Industries and the Impact of Digitalisation

The study explores the competitiveness of the engineering industries in the EU against its major competitors USA, Japan, South Korea and the BRICs countries. It compares regulatory frameworks of EU and major third country competitors in the field of engineering industries.

Expected Completion
2020/06
Asset 7

Evaluation des Zentralen Innovationsprogramms Mittelstand (Evaluation of the Central Innovation Programme for SMEs)

The evaluation of the Central Innovation Programme for SMEs (ZIM) with its three programme pillars R&D individual projects, R&D cooperation projects and networks concerns one of the most important instruments of innovation policy in Germany.

Completed
2019/07
Asset 7

Evaluation of the Austrian Space Strategy 2012-2020 (Evaluierung der Weltraumstrategie 2012-2020)

This evaluation commissioned by the Federal Ministry for Climate Protection, Environment, Energy, Mobility, Innovation, and Technology (BMK, formerly BMVIT) examined the Austrian space commitment in the period 2012 to 2018 and derived corresponding recommendations for further development. This includes not only the design of the future space strategy, the relevant commitment at ESA and at the level of the European Union, but also the Austrian Space Applications Programme (ASAP), Austria's national space programme.

Completed
2020/03
Asset 7

Societal Criteria in Upstream Space Infrastructure Procurement

The study on behalf of DG GROW assessed the feasibility of including societal criteria (environmental, innovation, employment-related) in upstream space procurement within the European Union Space Programmes, Copernicus, Galileo and EGNOS. 

Completed
2019/05
Asset 7

Evaluation und Wirkungsanalyse CTI-Entrepreneurship (Impact monitoring and evaluation of the CTI Entrepreneurship Programme)

Assessment of the conception, implementation and short- to medium-term effects of the CTI Entrepreneurship Programme.

Completed
2019/05
Asset 7

Begleitende Evaluierung IWB/EFRE AT 2014-20 (Accompanying Evaluation IWB/EFRE AT 2014-20)

This accompanying evaluation of the implementation of the European Regional Development Fund (ERDF) 2014-20 in Austria applies a broad evaluation design.

Expected Completion
2022
Asset 7

Wissenschaftliche Begleitung des Projekts: „Multifunktionale Nutzung thermisch aktivierter Bestandsfassaden“ (Accompanying research of the project “Multifunctional use of thermally activated existing facades”)

Accompanying research of a technical research project, which shows the economic and technical potential of the external component activation for the renovation of existing buildings.

Expected Completion
2020
Asset 7

Wirkungsmonitoring der FFG Förderungen 2017-2021 (Impact monitoring of programmes managed by the Austrian Research Promotion Agency (FFG) 2017-2021)

The impact monitoring of RTDI funding for Austrian companies and research organisations assesses direct impacts of the funded projects on RTDI inputs, behavioural changes, and outputs as well as their current needs.

Expected Completion
2022
Asset 7

Evaluierung des Programms Klima- und Energie-Modellregionen (Evaluation of the programme “Klima- und Energie-Modellregionen”)

Evaluation of the Climate and Energy Model Regions (KEM) - Programme of the Austrian Climate and Energy Fund, which supports regions in the development and implementation of climate protection related measures.

Expected Completion
2020
Asset 7

Zwischenevaluierung des FTI-Programms „Mobilität der Zukunft“ (Interim evaluation of the RTDI-programme “Mobilität der Zukunft”)

Analysis of the programme design and the programme processes as well as the observed short-term effects of the mission-oriented RTI programme.

Completed
2019/03
Asset 7

Evaluierung des Förderprogramms kit4market (Evaluation of the Funding Programme kit4market)

The subject of the project is the evaluation of the programme(s) for the promotion of studies for commercial, international technology transfer" (kit4market, kit4market 2.0).

Completed
2018/09
Asset 7

Evaluierung der Umsetzung von HORIZON 2020, EUREKA, COSME, EEN und ERA in Österreich (Evaluation of the implementation of HORIZON 2020, EUREKA, COSME, EEN and ERA in Austria)

The Austrian Institute for SME Research was part of the consortium (head of: AIT) for the evaluation of the implementation of HORIZON 2020 and ERA in Austria, supplemented by the three European initiatives EUREKA, COSME and EEN.

Completed
2018/06
Asset 7

Evaluierung der innovationsfördernden Beschaffung (Evaluation of the Public Procurement Promoting Innovation)

Evaluation of the implementation of the Action Plan on Public Procurement Promoting Innovation in Austria.

Completed
2018/05
Asset 7

Evaluierung des BRIDGE Programms (Evaluation of the BRIDGE Programme)

This evaluation focuses on the different facets of impacts of the BRIDGE programme and on the more recent modifications in the programme design during the period 2009 up to 2016.

Completed
2018/05
Asset 7

Portfolioanalyse der unternehmensbezogenen Wirtschafts- und Forschungsförderung des Landes Oberösterreich (Evaluation of Upper Austria’s Portfolio of Funding and Support to Companies)

This evaluation aims to analyse the portfolio of Upper Austria’s funding and support measures provided to companies.

Completed
2018/03
Asset 7

Evaluierung der Förderungsgesellschaften Austria Wirtschaftsservice GmbH (AWS) und Forschungsförderungsgesellschaft GmbH (FFG) (Evaluation of Austria Wirtschaftsservice Gesellschaft mbH (AWS) and Austrian Research Promotion Agency (FFG))

The evaluation of the AWS and FFG promotion agencies essentially addresses the question whether and to what extent ambitions and expectations of the predecessor organisations consolidations, which happened in the context of the structural reforms more than a decade ago, have been achieved.

Completed
2017/11
Asset 7

Interim Evaluation of the Participation of SMEs in FP7 (Cooperation Programme and the Research for the Benefit of SMEs Schemes)

The overall objective of this study was to evaluate the results and impacts of the participating SMEs within two initiatives of FP7.

Completed
2014/05
Member of