# Indicator needs - Which new measures[^1] - Landscape of measures - Diversity index of innovation support instruments in the region[^2] - Existing investments in measures - What other regions do differently - Balance of measure index - Profile comparison with other regions - Number of specific types of measures per capita - How to design & implement measures[^3] - Good practices - Diagnostics - Internal business innovation factors - Return on investment to innovation - Firm's turnover from (new to firm) product innovation (as a pecentage of total turnover) - Increase in the probability to innovate linked to ICT use (in product innovation, process innovation, organisational innovaton, marketing innovation) - Scientific articles by type of collaboration (per capita) (international co-authoriship, domestic co-authoriship, single author) - Increase in a share of expenditures on technological innovations in the total amount of regional firms’ expenditures, % - Increase in the number of innovative companies with in-house R&D - Increase in th number of innovative companies without in-house R&D - Increase in th number of firms with international/national collaboration on innovation - Highly cited scientific articles (as a percentage of highly cited scientific article in the whole Federation) - Patents filed by public research organisations (as a percentafe of patent application filed under PCT) - Number of international patents - Start-up activity (as a percentage of start-up activity in the whole Federation) - Number of innovative companies to the number of students - Number of innovative companies to the number of researchers - Volume of license agreements to the volume of R&D support from the regional budget - How much effort: where & how[^4] - The bottom-line[^5] - Wages - Dynamics of real wages - Average wage (compare to the Fed) - Productivity - Labor productivity - Labor productivity growth rate - Jobs - Share of high-productive jobs - Share of creative industries jobs - Uneployment rate of university graduates - Income - GRP per capita and its growth rate - Influencing factors - Economy - Economic structure - Volume of manufacturing production per capita - Manufacturing value added per capita (non-natural resource-based) - The enabling environment - Ease of doing business[^6] - Level of administrative barriers (number and cost of administrative procedures) - Competition index[^7] - Workforce - Quality of education[^8] - Inrease in the number of International students - Quantity of education - Participation in life-long learning[^9] - Increase in literarecy - Amount of university and colleague students per 10 thousands population - Share of employees with higher education in the total amount of population at the working age - Increase in University students - Government expenditure on General University Funding - Access to training, information, and consulting support - Science & engineering workforce - Availability of scientists and engineers[^10] - Amount of researches per 10 thousands population - Average wage of researches per average wage in the region - Share of researchers in the total number of employees in the region - Government - Total expenditure of general government as a percentage of GDP - Government expenditure on Economic Development - Access to finance - Deals - Venture capital investments for start-ups as a percentage of GDP - Amounts of business angel, pre-seed, seed and venture financing - Amount of public co-funding of business R&D - Number of startups received venture financing - Number of companies received equity investments - Available - Amount of matching grants available in the region for business R&D - Number of Business Angels - ICT - ICT use[^11] - Broadband penetration - Internet penetration - Computer literacy - Behavior of innovation actors - Access to markets - FDI - foreign JVs - Inflow of foreign direct investments in high-technology industries - Foreign direct investment jobs[^12] - FDI as a share of regional non natural resource-based GRP - Number of foreign subsidiaries operating in the region - Share of foreign controlled enterprises - Exports - Export intensity in manufacturing and services[^13] - Share of high-technology export in the total volume of production of goods, works and services - Share of innovation production/serivces that goes for export, by zones (EU, US, CIS, other countries - Share of high-technology products in government procurements - Entrepreneurship culture - Fear of failure rate[^14] - Entrepreneurship as desirable career choice[^15] - High Status Successful Entrepreneurship[^16] - Collaboration & partnerships - Number of business contracts with foreign partners for R&D collaboration - Share of R&D financed from foreign sources[^17] - Firms collaborating on innovation with organizations in other countries[^18] - Share of Innovative companies collaborating with research institutions on innovation - Number of joint projects conducted by the local comapnies and local consulting/intermediary agencies - science and industry links - Technology absorption - Local supplier quality[^19] - Share of expenditures on technological innovations in the amount of sales - Number of purchased new technologies - Investments in ICT by asset (IT equipment, communication equipment, software) - Machinery and equipment - Software and databases - Level of energy efficiency of the regional economy (can be measured by sectors and for the whole region) - Share of wastes in the total volume of production (by sector) - Innovation activities in firms - Share of innovative companies - Business R&D expenditures per GRP - Factors hampering innovation[^20] - Expenditure on innovation by firm size - R&D and other intellectl property products - Growth of the number of innovative companies - Outpus - Volume of new to Russian market production per GRP - Volume of new to world market production per total production - Growth of the volume of production of innovative companies - Volume of innovation production per capita - Entrepreneurial activities - New business density[^21] - Volume of newly registered corporations [^22] - Share of gazelle companies in the total number of businesses - R&D production - Outputs - Amount of domestically protected intellectual property per 1 mln. population - Amount of PCT-applications per 1 mln. population - Number of domestic patent applications per R&D expenditures - Number of intellectual property exploited by regional enterprises per 1 mln. population - Publication activity of regional scientists and researches - Inputs - Regional and local budget expenditures on R&D - Government R&D expenditure - Public sector innovation - Number of advanced ICT introduced in the budgetary organizations (regional power, municipal bodies, social and educational organizations) - E-government index - Number of management innovations introduced in the budgetary organizations (regional power, municipal bodies, social and educational organizations) - Supporting organizations - Research institutions - Collaboration - Number of interactions between universities and large companies by university size - Resources - R&D expenditures per 1 researcher - Average wage of researches per average wage in the region - High education expenditure on R&D - Scientific outputs - Publications - Impact of publications in the ISI database (h-index) - Number of publications in international journals per worker per year - Publications: Academic articles in international peer-reviewed journals per 1,000 researchers [articles/1,000 researchers]. - Number of foreign patents granted per staff - Supportive measures - Diversity index of university entrepreneurship support measures[^23] - Commercialization - Licensing - Academic licenses: Number of licenses per 1,000 researchers.[licenses/researcher] - Spin-offs - Number of spin-offs with external private financing as a share of the institution's R&D budget - Industry contracts - Industry revenue per staff - Foreign contracts: Number of contracts with foreign industria l companies at scientific and educational organizations per 1,000 researchers [contracts/researchers] - Share of industry income from foreign companies - Revenue raised from industry R&D as a fraction of total institutional budget (up to a cap) - Difficulties faced by research organization in collaborating with SMEs - Private market - Number of innovation & IP services organizations[^24] - Number of private innovation infrastructure organizations [^25] - Access to certification and licensing for specific activities - Access to suppliers of equipment, production and engineering services - Innovation infrastructure - Investments - Public investment in innovation infrastructure - Increase of government investment in innovation infrastructure - Number of Development institution projects performed in the region - Volume of seed investments by the regional budget - Volume of venture financing from the regional budget - Volume of state support per one company - What to do about existing measures[^26] - Demand for measure - Quality of beneficiaries - Growth rates of employment in supported innovative firms - Growth rates of employment in supported innovative firms - Role of IP for tenants/clients[^27] - Share of tenants with innovation activities - Gazelle tenant: Share of tenants with annual revenue growth of more than 20% for each of the past four years or since formation [%] - Globalization of tenants: Median share of tenant revenues obtained from exports [%] - Number of beneficiaries - Number of projects conducted by companies in cooperation with innovation infrastructure - Scope and intensity of use of services offered to firms - Number of companies supported by the infrastructure (training, information, consultations, etc.) - Increase in the number of business applying for public support programmes (regional, federal, international) - Degree of access - Level of awareness - Perception (opinion poll) of business managers regarding public support programmes - Transparency - Perception of business managers in terms of level of transparency of support measures in the region - Description by regional business managers of the way the select and apply for regional and federal support schemes - Number of applicants - Increase in the number of business applying for public support programmes - Number of companies that know about a particular program - Increase in the number of start-ups applying to receive VC investments - Increase in the number of start-ups applying for a place in the incubators - Inputs of measures - Qualified staff[^28] - Budget per beneficiary - Performance of measure - Implementation of measure - Target vs. actual KPIs - Intermediate outputs per budget - Qualification of staff - Output of measure - Opinion surveys - Opinions of beneficiaries - Hard metrics - Output per headcount (e.g. staff, researchers) - Productivity analysis - Impact of measure - Opinion surveys - Perception of support impact (opinion polls) - Perception of the activity of regional government by the regional companies - Hard metrics - Increase in number of small innovation enterprises - Growth of the total volume of salary in the supported companies (excluding inflation) - Growth of the volume of regional taxes paid by the supported companies - Growth of the volume of export at the supported companies - Number of new products/projects at the companies that received support - Impact assessment - Average leverage of 1rub (there would be several programs with different leverage) - Volume of attracted money per one ruble of regional budget expenditures on innovation projects - What investments in innovative projects[^29] - Competitive niches - Clusters behavior - Cluster EU star rating - Share of value added of cluster enterprises in GRP - Share of cluster products in the relevant world market segment - Share of export in cluster total volume of sales - Growth of the volume of production in the cluster companies - Growth of the volume of production in the cluster companies to the volume of state support for the cluster - Growth of the volume of innovation production in the cluster - Share of export in cluster total volume of sales (by zones: US, EU, CIS, other countries) - Internal behavior - Median wage in the cluster - Growth of the volume of R&D in the cluster - Cluster collaboration - R&D - Patent map - Publications map - Industry - FDI map - Gazelle map - Business R&D expenditures as a share of revenues by sector - Share of regional products in the world market - Expenditure on innovation by firm size, by sector - Entrepreneurship - Startup map - Venture investment map - Attractiveness to public competitive funding - Fed and regional seed fund investments - FASIE projects: Number of projects supported by the FASIE per 1,000 workers [awards/worker] - Competitiveness support factors - Private investment in innovation - How to improve image - Rankings - macro indicators - meso-indicators - Innovation investment climate [^1]: Identifying new measures or investments that should be implemented.[^2]: Number of different innovations policy instruments existing in the region as a share of a total number representing a full typology of instruments[^3]: Understanding how to design the details of a particular measure and how to implement them.[^4]: Understanding the level of effort the region needs to take to compete on innovation and where to put this effort[^5]: This is what policy makers care about in the end[^6]: WB[^7]: GCR[^8]: GCR[^9]: per 100 population aged 25-64[^10]: GCR[^11]: GCR[^12]: : the percentage of the workforce employed by foreign companies [%]. [^13]: : exports as a share of total output in manufacturing and services [%].[^14]: GEM[^15]: GEM[^16]: GEM[^17]: UNESCO[^18]: CIS[^19]: GCR[^20]: CIS, BEEPS[^21]: Number of new organizations per thousand working age population (WBI)[^22]: (as a percentage of all registered corporations)[^23]: Number of measures offered by the unversity within a preset range (NCET2 survey)[^24]: (design firms, IP consultants, etc.)[^25]: (e.g. accelerators, incubators)[^26]: Understanding which measures should be strengthened, dropped or improved, and how.[^27]: WIPO SURVEY OF INTELLECTUAL PROPERTY SERVICES OFEUROPEAN TECHNOLOGY INCUBATORS[^28]: JL: not sure how this would be measured[^29]: Understanding what investments should be made in innovative projects.