Research and development (R&D) (rd)

Reference Metadata in Euro SDMX Metadata Structure (ESMS)

Compiling agency: Eurostat, the statistical office of the European Union


Eurostat metadata
Reference metadata
1. Contact
2. Metadata update
3. Statistical presentation
4. Unit of measure
5. Reference Period
6. Institutional Mandate
7. Confidentiality
8. Release policy
9. Frequency of dissemination
10. Accessibility and clarity
11. Quality management
12. Relevance
13. Accuracy
14. Timeliness and punctuality
15. Coherence and comparability
16. Cost and Burden
17. Data revision
18. Statistical processing
19. Comment
Related Metadata
Annexes
Footnotes



For any question on data and metadata, please contact: Eurostat user support

Download


1. Contact Top
1.1. Contact organisation

Eurostat, the statistical office of the European Union

1.2. Contact organisation unit

G4: Innovation and digitalisation

1.5. Contact mail address

2920 Luxembourg LUXEMBOURG


2. Metadata update Top
2.1. Metadata last certified 07/06/2023
2.2. Metadata last posted 07/06/2023
2.3. Metadata last update 19/02/2024


3. Statistical presentation Top
3.1. Data description

This collection provides users with data about R&D expenditure and R&D personnel broken down by the following institutional sectors: business enterprise (BES); government (GOV); higher education (HES); private non-profit (PNP), total of all sectors.

The R&D expenditure is broken down by source of funds; sector of performance; type of costs; type of R&D; fields of research and development (FORD); socio-economic objectives (NABS 2007) and by regions (NUTS 2 level). The business enterprise sector is further broken down by economic activity (NACE Rev.2); size class; industry orientation.

R&D personnel data are broken down by professional position; sector of performance; educational attainment level; sex; field of research and development (FORD); regions (NUTS 2 level); for the business enterprise sector is further broken down in size class and economic activity (NACE Rev.2). Researchers are further broken down by age class and citizenship.

 The periodicity of R&D data are every two years, except for the key R&D indicators (R&D expenditure, R&D personnel (in Full Time Equivalent - FTE) and Researchers (in FTE) by sectors of performance) which are transmitted annually by the EU Member States (from 2003 onwards based on a legal obligation). Some other breakdowns of the data may appear on an annual basis based on voluntary data provisions.

The data are collected through sample or census surveys, from administrative registers or through a combination of sources.

R&D data are available for following countries and country groups:

- All EU Member States; Candidate Countries; EFTA Countries;  The Organisation for Economic Cooperation and Development (OECD) is data provider for the United States of America, Japan,  South Korea and China.

- Country groups: EU Member States, Euro Area States.

R&D data are compiled in accordance to the guidelines laid down in OECD (2015), Frascati Manual 2015: Guidelines for Collecting and Reporting Data on Research and Experimental Development, The Measurement of Scientific, Technological and Innovation Activities and the European Business Statistics Methodological Manual for R&D Statistics.

3.2. Classification system

R&D statistics are compiled in line with international statistical classifications such as: Statistical Classification of Economic Activities in the European Community (NACE Rev.2, 2008)Nomenclature for the analysis and comparison of scientific programmes and budgets (NABS 2007)International Standard Classification of Education (ISCED 2011); and Field of Research and Development classification (FORD 2015). The name of ‘Field of Research and Development’ has changed with the last version of the Frascati Manual (2015); before it was ‘Field of science and technology classification’ (FOS 2007).

In addition to the Frascati Manual (2015) recommendations, regional breakdowns for EU Member States, Candidate Countries and EFTA countries are compiled following the Nomenclature of Territorial Units for Statistics, NUTS, Eurostat.

3.3. Coverage - sector

R&D statistics are compiled for four institutional sectors of performance: business enterprise (BES); government (GOV); higher education (HES); private non-profit (PNP). These sectors are defined based on the System of National Account (SNA), with the difference that higher education has been established as a separate sector because of its policy relevance, and households have, by convention, been merged with the private non-profit (PNP) sector.

3.4. Statistical concepts and definitions

Main concepts and definitions used for the production of R&D statistics are given by the Frascati Manual (2015).

Research and experimental development (R&D) comprise creative and systematic work undertaken in order to increase the stock of knowledge - including knowledge of humankind, culture and society - and to devise new applications of available knowledge." (§ 2.5, Frascati Manual, 2015).

Intramural R&D expenditures are all current expenditures plus gross fixed expenditure for R&D performed within a statistical unit during a specific period, whatever the source of funds." (§ 4.10, Frascati Manual, 2015).

R&D personnel in a statistical unit include all persons engaged directly in R&D, whether employed by the statistical unit or external contributors fully integrated into the statistical unit`s R&D activities, as well as those providing direct services for the R&D activities (such as R&D managers, administrators, technicians and clerical staff). Persons providing indirect support and ancillary services, such as canteen, maintenance, administrative and security staff, should be excluded, even though their wages and salaries are included in “other current costs” when measuring R&D expenditure." (§ 5.6 – 5.7, Frascati Manual, 2015).

Researchers are professionals engaged in the conception or creation of new knowledge, products, processes, methods and systems and also in the management of the projects concerned." (§5.35, Frascati Manual, 2015).

R&D statistics vs. HRST statistics

The concept of ‘R&D personnel’ relates to the actual occupation of persons, namely whether they are directly engaged in R&D, i.e. in ‘creative and systematic work undertaken to increase the stock of knowledge or to devise new applications of existing knowledge’. In contrast, the concept of ‘Human Resources in Science and Technology’ (HRST) covers both the occupation and the educational background and it refers to ‘people who have successfully completed tertiary education or who are employed in science and technology occupations where such education level is normally required’

 (see Eurostat  metadata Human Resources in Science & Technology, https://ec.europa.eu/eurostat/cache/metadata/en/hrst_esms.htm).

Consequently, this means that the criteria for ‘R&D personnel’ are stricter than for HRST, therefore the numbers of HRST are significantly higher than those for R&D personnel.

3.5. Statistical unit

The statistical units used to compile R&D statistics are: (a) enterprises for the business enterprise sector statistics and (b) institutional units for the Government sector, the higher education sector and the private non-profit sector. The definitions of the statistical units are as set out in Council Regulation (EEC) No 1993/696 of 15 March 1993 on the statistical units for the observation and analysis of the production system in the Community. For the business enterprise sector the statistical unit is the enterprise. The Regulation defines the enterprise as the smallest combination of legal units that is an organisational unit producing goods or services, which benefits from a certain degree of autonomy in decision making, especially for the allocation of its current resources. It may carry out one or more activities at one or more locations, and it may be a combination of legal units, one single legal unit or part of a legal unit. For the other three sectors the statistical unit is the institutional unit. 

3.6. Statistical population

R&D statistics are compiled for the R&D activity performed in the whole economy. R&D data relate to the population of all R&D performing units classified in Sections A to U of the Statistical Classification of Economic Activities in the European Community (NACE Rev.2, 2008).

3.7. Reference area

R&D statistics are currently available for EU Member States; Candidate Countries; EFTA Countries; China; Japan; the United States; South Korea. Regional R&D statistics are available for EU Member States, Candidate countries, and EFTA countries. Apart from national and regional statistics, Eurostat calculates and disseminates aggregates at the EU- and Euro-area-levels.

3.8. Coverage - Time

Eurostat's R&D database contains national data from 1980 onwards. However, data availability differs according to the country.

European aggregates for R&D expenditure and for R&D personnel (in full-time equivalent) are available from 2000 onwards. 

3.9. Base period

The base year for the unit Purchasing Power Standard (PPS) and PPS per inhabitant at constant prices is currently 2005. All calculations of non-basic unit (national currencies) are done by Eurostat.


4. Unit of measure Top

R&D expenditure is available in the following units:  Euro (MIO_EUR) and Euro per inhabitant (EUR_HAB); data are available in the following units: basic unit National currency (MIO_NAC); Purchasing Power Standard (MIO_PPS); Purchasing Power Standard at 2005 prices (MIO_PPS_KP05); Purchasing Power Standard per inhabitant at constant 2005 prices (PPS_HAB_KP05); Percentage of gross domestic product (PC_GDP); and Percentage of total R&D expenditure (PC_TOT - for the breakdown by source of funds).

R&D personnel data are available in full-time equivalent (FTE), in head count (HC), as a percentage of total employment and as a percentage of active population.


5. Reference Period Top

The reference period is the calendar year.


6. Institutional Mandate Top
6.1. Institutional Mandate - legal acts and other agreements

Since the beginning of 2021, the collection of R&D statistics is based on the Commission Implementing Regulation (EU) No 2020/1197 of 30 July 2020  The Regulation sets the framework for the collection of R&D statistics and specifies the main variables of interest and their breakdowns at predefined level of detail. Statistics on science, technology and innovation were collected until the end of 2020 based on Commission Implementing Regulation (EU) Regulation (EU) No 2012/995 concerning the production and development of Community statistics on science and technology.  

6.2. Institutional Mandate - data sharing

From December 2005 onwards, R&D data are collected in co-operation with OECD.


7. Confidentiality Top
7.1. Confidentiality - policy

Regulation (EC) No 223/2009 on European statistics (recital 24 and Article 20(4)) of 11 March 2009 (OJ L 87, p. 164), stipulates the need to establish common principles and guidelines ensuring the confidentiality of data used for the production of European statistics and the access to those confidential data with due account for technical developments and the requirements of users in a democratic society.

7.2. Confidentiality - data treatment

Primary and secondary confidentiality of national R&D data are flagged by the countries and provided to Eurostat. Eurostat is not executing any additional measures, other than removing flagged data while publishing the results. Primary and secondary confidentiality is respected for any data publicly released.


8. Release policy Top
8.1. Release calendar

Eurostat aims to publish preliminary R&D data 11 months after the end of the reference year (in November).

Eurostat aims to publish final R&D data 20 months after the end of the reference year (in the following August).

8.2. Release calendar access

Eurostat’s release calendar is available on Eurostat’s website (Release calendar - Eurostat (europa.eu)). The R&D theme can be filtered out in Eurostat’s website as it is identified in orange (Overview - Science, technology and innovation - Eurostat (europa.eu)).

8.3. Release policy - user access

In line with the Community legal framework and the European Statistics Code of Practice Eurostat disseminates European statistics on Eurostat's website (see item 15 - 'Accessibility and clarity') respecting professional independence and in an objective, professional and transparent manner in which all users are treated equitably. The detailed arrangements are governed by the Eurostat protocol on impartial access to Eurostat data for users.


9. Frequency of dissemination Top

Annual (with revisions and updates).


10. Accessibility and clarity Top
10.1. Dissemination format - News release

News releases on-line can be accessed on Eurostat’s webpage (News - Eurostat). The R&D theme can be filtered out on Eurostat’s website as it is identified in orange.  

10.2. Dissemination format - Publications

Statistics Explained.  

10.3. Dissemination format - online database

Please consult free data on-line. (Statistics | Eurostat (europa.eu))

10.4. Dissemination format - microdata access

Not applicable.

10.5. Dissemination format - other

See also Eurostat's Science, technology and innovation (STI) section website.

(Overview - Science, technology and innovation - Eurostat (europa.eu)).

10.6. Documentation on methodology

Detailed information about the national survey methods applied (Metadata) as well as about the quality of the data (Quality Reports) is provided by the countries to Eurostat systematically once in two years at the minimum. The new format for metadata and quality reports is the Single Integrated Metadata Structure (SIMS reporting). 

10.7. Quality management - documentation

National quality reports of Member States, Norway and Switzerland and some candidate countries are available in the odd years since the reference year 2009. They are updated in the even years only if there are methodological changes.


11. Quality management Top
11.1. Quality assurance

Eurostat is ensuring that the statistical practices used to compile national R&D data are in compliance with Frascati Manual (2015) recommendations. Quality evaluation of R&D statistics is carried out based on the information provided in the national quality reports sent by the countries in addition to the regular metadata provision.

11.2. Quality management - assessment

According to the information available, the overall quality of R&D statistics is good. Some differences between countries in the implementation of some recommendation of Frascati

Manual (2015) could affect the comparability of the results.

The completeness of R&D data are very good for mandatory variables stipulated in Commission Implementing Regulation (EU) No 2020/1197 of 30 July 2020.  The coherence between preliminary and final results is good.


12. Relevance Top
12.1. Relevance - User Needs

R&D expenditure as a percentage of GDP (R&D intensity) is one of the five headline target indicators set by Europe 2020 strategy for EU Member States (renewed target for the period 2020- 2030 ).

The users who make the most use of R&D data are:

- European Commission policy departments: DG Research and Innovation; DG JRC

- International organisations: OECD, UNESCO

- National governments

- Scientific organisations and universities.

R&D data also feeds into :

- Eurostat’s Macroeconomic Imbalance Procedure

- Eurostat’s Sustainable Development Goals dashboard

12.2. Relevance - User Satisfaction

User satisfaction with the national statistics is reported as high. In most countries, this assessment is based not on specific user satisfaction survey but on ad-hoc feedback received from users. Eurostat conducts at EU level evaluations of the European statistical programmes and general User Satisfaction Surveys (Evaluation - Eurostat (europa.eu))

12.3. Completeness

Data completeness of both preliminary and final mandatory data are very good. Optional variables in the BES, GOV and HES are less complete, as a few countries do not collect part or all of these data in their national surveys.


13. Accuracy Top
13.1. Accuracy - overall

The overall accuracy of R&D statistics is very good. All countries report that they make great efforts to prevent the appearance of errors in the data and that they carry out rigorous data validation to detect errors.

13.2. Sampling error

Many Member States carry out census survey in BES. For BES some Member States use coefficients of variations (on two key variables, R&D expenditure and R&D personnel in FTE) which vary significantly between Member States.

13.3. Non-sampling error

Coverage errors are of different nature for BES and the rest of R&D sectors. For the BES, the quality of the frame used is of concern and under constant monitoring. For the other sectors the main contributor to the coverage error is the possibility to include, exclude or double count R&D activities. However, countries report that these types of errors are either negligible or very low.

While no quantitative information is available on measurement errors a substantial effort is reportedly taken by countries to minimize them in all sectors. 


14. Timeliness and punctuality Top
14.1. Timeliness

According to Commission Implementing Regulation No 995/2012, preliminary data on R&D expenditure, R&D personnel and researchers in FTE are provided to Eurostat 10 months after the end of the calendar year (October) and are targeted to be released in November.

Final R&D data are provided to Eurostat 18 months after the end of the calendar year (June) and are targeted to be released in August.

14.2. Punctuality

Most countries are very punctual in the delivery of R&D data to Eurostat. 


15. Coherence and comparability Top
15.1. Comparability - geographical

R&D data are compiled by the countries following the guidelines and definitions outlined in the Frascati Manual (2015) and the Regional Manual. However, the data comparability across countries can be affected by:

  • different methods of the survey;
  • different methods of the calculation of indicators, in particular for data on R&D personnel expressed in Head counts (HC). Some countries include into the HC figures only data on internal R&D personnel, and not data on external R&D personnel as well;
  • different method of collecting data, i.e. some countries collect data on demographic characteristics (i.e. age, citizenship) of researchers only for internal researchers.
15.2. Comparability - over time

Breaks in the time series are rare in the most recent years but more frequent in the years before 1997.

15.3. Coherence - cross domain

The relevant statistics from other domains   for the business enterprise sector refer to R&D statistics which are also collected through other national surveys. The Community Innovation Survey collects information on the number of enterprises with R&D activities and the R&D expenditure of the enterprises.  The Structural Business Statistics and the Foreign affiliates (FATS) of EU enterprises collect information at enterprise level. R&D and FATS have two common indicators: Intramural R&D expenditure (230101) and R&D personnel (230201). However, the coverage is diferent.

R&D personnel data are collected also in the Labour Force Survey and in the education statistics. The education statistics collect data on R&D expenditure in the higher education sector (see Annex).

The main methodological difference with these data collections comes from coverage. 

15.4. Coherence - internal

The coherence between preliminary and final R&D results is very good. The internal consistency of the data (links between variables, coherence between data series, …) is checked by Eurostat before dissemination.


16. Cost and Burden Top

Information is not available.


17. Data revision Top
17.1. Data revision - policy

The general Eurostat revision policy applies to this domain.

Data transmitted to Eurostat by the reporting countries undergo detailed verifications by applying automated validation procedures at the level of variables and breakdowns. The second step of data verification consists in the time series checks. Before dissemination, results for the main indicators are compared across countries. If after these verifications, acceptance and publication of data, inconsistencies are found, reporting countries are asked to verify and revise their results.

Countries are allowed to revise the data any time an update or correction is necessary. Any substantial revision is justified/explained.

The revision policy for R&D domain is available in the publicly available manual “European Business Statistics Methodological Manual for R&D statistics”.   

17.2. Data revision - practice

All reported errors (once validated) result in corrections of the disseminated data. Reported errors are corrected in the disseminated data as soon as the correct data have been validated.

Data may be published even if they are missing for certain countries and indicators or flagged as provisional or of low reliability for certain countries. A revision/update of the country data, for a justified reason, already disseminated is published once the data are validated and confirmed by the countries. 

In addition to the ad-hoc revisions, the reporting countries have the possibility to revise the R&D preliminary figures, either with final or with improved preliminary figures after their dissemination. They can revise one or several years at one time. The data are disseminated only after undergoing the verifications explained in sub-concept 17.1.

The European Union and Euro Area aggregates and components are revised at the same time with the revisions of the country data, to remain consistent with the national data.


18. Statistical processing Top
18.1. Source data

At national level R&D data are compiled mostly by the national statistical authorities: National Statistical Institutes, but also by Research Councils and Ministries, Agencies, Science Policy Offices, professional associations, National Documentation Centres, universities. The data are collected through sample or census surveys, from administrative registers or through a combination of sources.

National R&D surveys are carried out in accordance to the concepts, guidelines and definitions laid down in the Frascati Manual (2015). The data are gathered via national questionnaires in paper and/or electronic format. The statistical unit used is the enterprise.

Detailed information about the national survey methods applied (Metadata) as well as about the quality of the data (Quality Reports) is provided by the countries to Eurostat systematically once in two years at the minimum.

18.2. Frequency of data collection

There are two cycles of annual data collection which correspond to the legally established deadlines for R&D data transmission by the countries: in October (T+10) for preliminary R&D data and in June (T+18) for final R&D data. Between these regular cycles, Member States can also provide updates and/or revisions of R&D data.

18.3. Data collection

36 countries provide basic compilations of national R&D statistics directly to Eurostat: EU Member States; Candidate Countries; EFTA Countries; data for China, Japan, the United States, and South Korea are extracted from the OECD database.

National aggregated R&D data are collected by Eurostat only via eDAMIS and in the SDMX standard. The collection is made in co-operation with the OECD. Countries' data, including confidential data, are provided to Eurostat in basic unit national currency for R&D expenditure and in full-time equivalent (FTE) and in head count (HC) for R&D personnel. Derived indicators and aggregates are calculated by Eurostat on the basis of the collected data and other reference data from Eurostat's dissemination database (Database - Eurostat (europa.eu).

Values can be accompanied by flags. 

18.4. Data validation

At Eurostat level, R&D data provided by the national statistical authorities are checked for consistency and plausibility, and compared with previously provided data before being imported in the internal production database. Suspected errors are reported to the national statistical authorities for correction or explanation.

Major breaks in series or/and other deviations are flagged by the countries.

18.5. Data compilation

Production of R&D statistics relies on the data sent by the countries. The derived indicators are calculated based on relevant reference data from Eurostat's dissemination database. Geographical aggregates (e.g. EU Member States, Euro Area States) are calculated by Eurostat as the sum of the national data expressed in a common unit. Where single Member States' figures are lacking, Eurostat may use unpublished estimates to impute country data and hence calculate the European aggregates.

18.6. Adjustment

European aggregates should be seen as estimates. They can sometimes deviate from what is obtained when summing up the national data. This can be due to dissemination of single or several national data sets outside the normal data treatment cycles. It can also be due to possible inconsistencies in national data e.g. the totals have been revised with different cycle than their breakdowns. Within the European aggregates consistency is however always assured in a way that breakdowns sum up to the total.


19. Comment Top

Geographical consistency: while the European aggregates usually coincide with the sum of Member States figures, they are updated only at fixed intervals (normally twice a year), which means there may be a difference between the European aggregate and the appropriate sum of national data between the regular updates due to updates/revision of R&D data at country level.


Related metadata Top
inn_cis12_esms - Community innovation survey 2020 (CIS2020)
educ_uoe_enr_esms - Pupils and students - enrolments
gba_esms - Government budget allocations for R&D (GBARD)
sbs_esms - Structural business statistics
sdg_09_10_esmsip2 - Gross domestic expenditure on R&D by sector


Annexes Top
National_metadata_RD_GOVSI_Statistics on Government R&D (GOVERD)
National_metadata_RD_HESSI_Statistics on Higher Education R&D (HERD)
National_metadata_RD_PNPSI_Statistics on Private non-profit R&D (PNPRD)
National_metadata_RD_BESSI_Statistics on Business enterprise R&D (BERD)


Footnotes Top