This chapter reviews existing sources and metrics to measure digital platform employment, limited to online and location-based services mediated by digital labour platforms. The objectives of this chapter are to: i) review what measurement initiatives on digital platform employment have been undertaken so far; ii) identify the lessons learnt from these initiatives; iii) understand the pros and cons of the various statistical vehicles for answering to different policy issues. A key research question in this area has been to estimate the number of digital platform workers. Initial attempts made use of existing data sources, combined with strong assumptions. A number of surveys conducted by researchers and private agencies followed, with government agencies having sponsored some of the research. Since then, official statistical agencies of OECD Members have begun to introduce questions on digital platform workers into Labour Force Surveys (LFSs) and Internet Usage Surveys. Lastly, big data or administrative data, such as social security or tax data, have been used to estimate the number of digital platform workers.
Handbook on Measuring Digital Platform Employment and Work
4. A critical review of existing statistical sources on digital platform employment
Abstract
Introduction
This chapter is a review of existing sources and metrics to measure digital platform employment, limited to online and location-based services mediated by digital labour platforms. It therefore generally excludes digital platforms whose objective is selling or renting goods and assets, unless differently specified. The measurement of internal digital platforms employment (i.e. platform workers who are engaged by the digital platform as employees) is also generally outside the scope of this review.1
Due to the lack of internationally agreed definition of digital platform work and employment, the terminology used in the reviewed papers is not harmonised. When discussing the findings from the reviewed sources, the current chapter reports for completeness also the original terms used, either in the main text or in footnotes. Information in the tables is also based on the original terminology.
The objective of this chapter is to: i) review what measurement initiatives on digital platform employment have been undertaken so far2; ii) identify the lessons learnt from these initiatives; iii) understand the pros and cons of the various statistical vehicles for answering to different policy issues.
Since the emergence of digital platform employment, there have been several attempts to estimate the number of digital platform workers. Initial attempts made use of existing data sources, combined with strong assumptions. A number of surveys conducted by both researchers and private agencies followed, with government agencies having sponsored some of the research. Since then, official statistical agencies of OECD Members have begun to introduce questions on digital platform workers into Labour Force Surveys (LFSs) and Internet Usage Surveys. Lastly, big data or administrative data, such as social security or tax data, have been used to estimate the number of digital platform workers.
The chapter looks at the attempts to measure digital platform employment by private agencies and official statistical agencies through surveys; highlights innovative uses of data; and concludes by discussing advantages and disadvantages associated with the different measurement methods.
Estimating the number of digital platform workers through surveys
Researchers have commonly used surveys to estimate the number of digital platform workers, though with wide variation in estimates. Surveys carried out by non-official organisations are presented first (summarised in Table 4.1), as chronologically have preceded surveys carried out by national statistical agencies (summarised in Table 4.2).
Non-official surveys
In the United States, (Katz and Krueger, 2016[1]) aimed to meet the lack of official statistics by conducting a version of the Bureau of Labor Statistics’ (BLS) Contingent Workers Survey (CWS) and found that 0.5% of the workforce identified customers through an online intermediary3. In line with existing labour market statistics, the survey referred to work done in the past week, although they used a different sampling method. In contrast, the PEW Research Centre used a broader definition of digital platform worker (including those who engage in digital platform employment as a secondary job) and a longer reference period (looking at those who engaged in digital platform employment in previous 12 months) and found that 8% of US working age adults were digital platform workers (Pew Research Center, 2016[2]). Several attempts have also been made to estimate the number of digital platform workers in Europe.
For the United Kingdom, the CIPD (a representative body for British Human Resource professionals) used an online survey and concluded that 4% of British adults had engaged in digital platform employment in the past 12 months in 2016 (CIPD, 2017[3]). Despite using a broader definition (of gigs, including work found using a digital platform), a slightly lower prevalence was provided by the Royal Society for the Encouragement of Arts, Manufactures and Commerce, for the share of British adults who tried gig work of some form, 3.1% (Balaram, Warden and Wallace-Stephens, 2017[4]). Using a definition of “gig economy” limited to including digital labour platforms only, both as main and secondary source of income, an online survey in Great Britain (Lepanjuuri K., 2018[5]) found that 4.4% of the population had “worked in the gig economy” in the 12 months previous to the survey. To correct for potential selection bias due to carrying out the survey online, the panel also included members responding by telephone. Huws et al. (2019[6]) found that 5.2% of the population in the United Kingdom had worked at least once a week for digital platforms in 2016, and that this share doubled to 9.4% in 2019.
In Germany, Bonin and Rinne (2017[7]) used a telephone survey to estimate that 2.9% of adults at some point in the past had engaged in digital platform employment. Evidence from this survey showed that respondents often misunderstand the definition of digital platform employment, and tend to classify online activities, such as job search websites, as digital platform employment. As a high number of respondents could not name the digital platform they were working for, or named platforms not related to labour platforms, the researchers corrected the share of real digital platform workers (“crowd workers”) to 0.85% of adults.
In France, Le Ludec et al. (2019[8]) used a combination of three methods to estimate that about 320 000 workers (about 0.8% of the working population) are registered in digital platforms mediating offer and demand of “micro-work”. The latter is a specific subset of digital platform employment, where workers are engaged to carry out “micro-tasks”, i.e. small independent units of larger tasks which are to be carried out independently, often remunerated with small amounts of money (ILO, 2018[9]). The authors selected the main micro-work platforms operating in France and used the results of Digital Platform Labour (DipLab) survey to apply a specific “capture-recapture” method.4
Two Scandinavian surveys highlight the importance of choice of question (see Annex A2). In a telephone survey, Alsos et al., (2017[10]) found that 0.5% to 1% of Norwegian working age adults have used a digital platform (including also platforms for renting accommodation, such as AirBnB) to earn income in the past 12 months. They found that questions asked over the phone gave more accurate responses than online surveys, as does mentioning specific digital platforms. An earlier survey carried out in the country among 1,525 Norwegian adults had found higher estimates: 10% of respondents indicated they had done work for a platform at some point and 2% said they performed platform work on a weekly basis (Jesnes et al., 2016[11]). The importance of specifying whether an individual provided, or merely offered a service, is highlighted in a report for Government of Sweden, which found that although 4% of Swedish working age adults searched for work via a digital platform, only 2.5% were successful (SOU, 2017[12]).
There have been several cross-country studies of digital platform workers. McKinsey Global Institute conducted an online survey of 8 000 workers across six countries (the United States, the United Kingdom, Germany, Sweden, France, and Spain) and found approximately 1.5% of respondents have earned income via digital labour platforms in the pooled sample (Manyika et al., 2016[13]).
Huws et al. (2019[6]) estimated the share of digital platform workers based on online surveys carried out in 13 European countries5 between 2016 and 2019, either as an addition to an existing omnibus survey or as a standalone survey. Data collected through samples of about 2 000 respondents in each country led to estimates of the number of regular (at least weekly) digital platform workers ranging from 4.9% of the working population in Sweden and the Netherlands in 2016 to 28.5% in the Czech Republic in 2019. However, differences in the age ranges in the samples limit cross-country comparability of this study. Estimates of the prevalence of digital platform employment from this survey are higher than those found in other surveys. This may derive from selection bias and overrepresentation of online workers among the respondents, particularly those used to perform micro-task work, such as filling online surveys. In addition, the effect of paying the respondents to answer the survey may add a bias. To assess potential selection biases in online surveys, the authors carried out companion offline surveys in two countries: a face-to-face survey in the United Kingdom and a telephone survey in Switzerland. Although the two UK surveys returned similar results, those carried out in Switzerland by telephone yielded lower estimates of digital platform workers (1.6% of total population aged 15 to 89 years) than those measured through the online survey by the authors.
In Europe, cross-country surveys have been undertaken by Eurobarometer and the European Commission. A Eurobarometer poll estimates the number of adults who provided a service using a digital platform in 2016 (and updated in 2018), including digital labour platforms, car sharing and digital platforms to rent accommodation. This survey highlighted wide variation across countries in the number of workers having offered their services through a digital platform at least once, ranging from 16% in France to less than 1% in Malta in 2016.6 The study also highlighted the importance of choosing an appropriate reference time, as those who regularly supply a service are a small fraction of those who do so occasionally (Eurobarometer, 2016[14]; Eurobarometer, 2018[15]).
Findings from the European Commission’s Joint Research Centre Collaborative Economy and Employment (COLLEEM) pilot survey conducted in 2017 in 14 EU Member States and repeated in 2018 across 16 EU Member States7 (both fielded by the Public Policy and Management Institute) are described in Chapter 1 of this Handbook. According to COLLEEM, the share of adults who provided services via online platforms monthly (digital labour platforms only) was 11% in the 16 countries surveyed in 2018, slightly higher than in 2017 (9.5%). Estimates from COLLEEM are affected by some methodological limits. The survey was conducted online among frequent Internet users, thus leading to potential self-selection bias, particularly of those providing professional services online. Potential self-selection bias was corrected for by using weights for education, employment status, and frequency of Internet use (based on Eurostat’s LFS and ICT survey) when reporting results for the adult population as a whole. However, bias in this survey may remain (Pesole et al., 2018[16]); (Urzì Brancati, Pesole and Fernández-Macías, 2020[17]); (Piasna and Drahokoupil, 2019[18]).
To overcome potential biases of paid, opt-in online surveys, Piasna and Drahokoupil (2019[18]), collected data on digital platform workers in five central and eastern European countries (Bulgaria, Hungary, Latvia, Poland and Slovakia) through the ETUI Internet and Platform Work Survey, using stratified random sampling of the entire population and face-to-face interviews. The respondents were not remunerated for their participation in the survey. Based on more than 4 700 respondents, they found that a lower share of adults engaged in monthly digital platform employment8 than previous estimates, with proportion of 0.4% in Poland, 0.8% in Latvia,1.1% in Slovakia, 1.% in Bulgaria and 3% in Hungary. More regular digital platform employment (at least weekly) ranges from 0.4% in Poland and Slovakia and 0.5% in Latvia, to 0.8% in Bulgaria and 1.9% in Hungary.
The reviewed studies show the importance of choice of the survey mode and its impact on survey’s results (Box 4.1). These considerations are also applicable to surveys carried out by official organisations.
Box 4.1. Observations on survey mode
Evidence shows that even with very similar definitions, survey results can vary rather substantially when data are collected face-to-face, online or by telephone. This can be attributed to factors related to coverage (which may introduce sampling biases), and to respondents’ behaviour (which may introduce measurement biases).
Different survey modes vary in their capability of covering relevant target groups
Although it could be argued that an online survey is an appropriate tool to target platform workers, as they need to have Internet access due to the nature of this employment form, there is some indication that online platform workers are better represented in online surveys than on-location platform workers who realise their tasks in the physical sphere. Furthermore, these respondents are likely to be more familiar with digital platforms than those members of the target population that have no Internet. Results may therefore be not representative of the general population. Adjusting the sample distribution through quotas or (post-stratification) weighting cannot correct for this bias, unless Internet access is provided to respondents as part of the survey design (Eurofound, 2019[19]).
Telephone surveys are not only limited to people who have a phone, but this number also needs to be recorded in an official register. It is likely that some population groups tend to register less than others. This could for example result in a situation in which platform workers with migration background or highly specialised online platform workers are less well covered in a survey. Related to that, national registers of mobile phones might turn out to be problematic as nowadays there not necessarily is a direct link anymore between the phone suffix for a certain country and the respondents’ actual place of living and working. This, again, might result in biased results as regards, for example, migrants or higher-educated (cross-border) mobile workers who (also) engage in platform work.
While the previously raised concerns (Eurofound, 2019[19]) as regards certain population groups (such as the institutionalised) being excluded from face-to-face surveys might be less relevant for digital platform employment surveys, at the time of writing (mid-2021) it remains to be seen whether and how the ‘new normal’ after the COVID-19 pandemic affects face-to-face surveys. It can, for example, be expected that people affected by ill health remain cautious in the medium or even long run as regards allowing interviewers to their private home where physical distancing might be difficult to realise. This can result in sample bias as for some people their health situation is a motivation to engage in online platform work, and they might be structurally omitted.
Other groups of digital platform workers might be difficult to cover in face-to-face household surveys as they are difficult to reach at home. Examples are on-location digital platform workers who, for example, do food delivery or ride-hailing in the evening or on weekends to generate additional income to a full-time employment during core working hours on weekdays.
Measurement orientation and expected bias should be considered when deciding upon the survey mode
It is generally argued that self-administered survey modes (like online surveys) encourage respondents to provide more honest answers compared to interviewer-guided survey modes like face-to-face or phone. There is no reason to assume that this is different for digital platform employment surveys. However, the big advantage of interviewer-guided survey modes is that the interviewer can clarify questions and probe in case of inconsistent answer behaviour of the respondent. Given the challenge of demarcation of the concept of digital platform employment, this might result in better survey quality.
The survey mode also influences the length of the survey. In face-to-face surveys, more questions can be asked than in online surveys (which are widely recommended to be limited to a maximum of 15 minutes). Accordingly, if a more comprehensive or in-depth coverage of topics is the intention of the survey, face-to-face is the better option compared to an online survey.
Related to that, response behaviour might differ between online surveys filled on a PC or laptop compared to on a mobile phone. Attention spans on the latter might be shorter, open-ended questions even less answered and longer answer batteries or unfavourable designs might trigger higher non-response and break-up rates which influence the survey quality. This maybe even more so in the case of on-location digital platform workers who might use waiting times between assignments to fill questionnaires on the app, but then interrupt or even stop fully if they receive an order on short-notice.
Surveys also provide information on the working conditions of digital platform workers
Beyond estimating the prevalence of digital platform workers, (Urzì Brancati, Pesole and Fernández-Macías, 2020[17]) also included questions aimed at better understanding their working conditions. There is a growing body of literature focusing on specific aspects of digital platform employment, such as legal work arrangements. While these studies do not provide information on the size of digital platform employment, they could allow improving questions in surveys administered for measurement purposes.
ILO (2018[9]) provides one of the first comparative studies of working conditions of micro-task workers around the world. It is based on an ILO survey covering 3 500 workers in 75 countries and working on five major globally operating micro-task platforms. This was supplemented with in-depth, follow-up interviews with a random sample of workers. The report analyses the working conditions on these micro-task platforms, including pay rates, work availability and intensity, social protection coverage and work–life balance. Drawing on surveys and interviews with about 12 000 workers and representatives of 85 businesses, ILO (2021[20]) examines working conditions, patterns of work and income, access to social protection, association and collective bargaining rights of digital platform workers operating in online web-based and location-based platforms around the world.
In Belgium, the food delivery platform Deliveroo employed workers through an intermediary company in 2016-2018 (SMart). Based on the administrative data provided by SMart, Drahokoupil and Piasna (2019[21]) analysed data on riders active from September 2016 to April 2017 and administered a survey to these riders. They analysed workers’ characteristics, patterns of work and pay, motivation for engaging in digital platform employment, as well as their perceived benefits and disadvantages of cessation of the Deliveroo-SMart contractual agreement.
Table 4.1. Main features of non-official surveys measuring digital platform employment
Country |
Time when the survey was conducted |
Reference period |
Reference |
Type(s) of digital platform in scope |
Question wording |
Selection into sample |
Sample size |
Survey method |
Definition of digital platform employment provided? |
Examples of digital platform named? |
Reference to earned income? |
Estimate of the prevalence of digital platform employment (%) |
Norway |
Sept. 2016 to Oct. 2017 |
In the past 12 months |
Digital labour platforms and digital platforms for assets rental (AirBnb) |
Done any assignments or paid employment through companies that use apps and websites to convey work and services |
Working age population |
Survey of work providers: 1 000 respondents |
Pilot surveys were online, actual survey was via telephone |
|
Yes |
|
0.5% of working age population |
|
Great Britain |
11 Nov. 2016 to 10 Jan. 2017 |
Ever |
Digital labour platforms |
Personally carried out paid work using a website or mobile phone application |
Residents aged 15 and up |
7 656 respondents |
Face-to-face |
Yes |
Yes |
3.2% of respondents have previously carried out gig work, 2.2% currently do |
||
Italy, the United States, and the United Kingdom |
ITA: 8-15 May 2018 GBR: 5 Feb. and 2 Mar. 2018 USA: 24-27 Apr. 2017 |
Last year? (Unknown) |
“Gig economy” (Digital labour platforms and digital platforms for assets rental, i.e. AirBnB) |
Jobs organised via online platforms |
Working age population (the US survey sampled using online ads and social media) |
15 000 for Italy and 20 000 for the United Kingdom, and 10 368 for the United States |
Online |
2.6% in Italy, 3.0% for the United Kingdom. No estimate for the US |
||||
Germany |
Ever |
Digital labour platforms |
Performing paid work assignments obtained via platforms or apps |
10 000 interviews |
Telephone |
No |
No |
Yes |
3.1% currently, an additional 2.9% had previously |
|||
United Kingdom |
2 to 15 Dec. 2016 |
In the last 12 months |
Digital labour platforms, digital platforms for selling goods and digital platform for renting assets |
Individuals who have used an online platform at least once to: 1) provide transport, 2) rent their own vehicle, 3) deliver food or goods, 4) perform short-term jobs, or 5) do other work |
A nationally representative sample of UK adults aged 18 to 70. |
5 019 respondents |
Online |
No |
Yes |
Yes |
4% of employed adults |
|
14 EU countries: GBR, ESP, DEU, NLD, PRT, ITA, LTU, ROM, FRA, SWE, HUN, HRV, SVK, FIN |
Second half of June 2017 |
Ever |
COLLEEM (Pesole et al., 2018[16]) |
Digital labour platforms |
Individuals providing services via online platforms where either 1) both work and payment is digital, or 2) payment is digital but the work is performed on-location. |
Internet users aged 16 to 74 |
32 389 observations (approximately 2 300 per country) |
Online |
Yes |
Yes |
Yes |
On average 9.7% of the adult population ever provided labour to an online platform |
16 EU countries: CZE, GBR, ESP, DEU, NLD, PRT, IRL, ITA, LTU, ROM, FRA, SWE,HUN, HRV, SVK, FIN |
Sept. and Nov. 2018 |
Ever |
COLLEEM II |
Digital labour platforms |
See COLLEEM |
|
38 878 observations |
Online |
Yes |
Yes |
Yes |
On average 11% of the adult population ever provided labour to an online platform |
EU-28 countries |
March 2016 |
Ever |
“Collaborative platform” (Digital labour platforms and other digital services platforms) |
Provided services on collaborative platforms. A collaborative platform is an internet based tool that enables transactions between people providing and using a service |
Residents aged 15 years and over |
Around 500 interviews per country |
Telephone interview |
Yes |
No |
No |
32% of respondents have visited collaborative platforms, of which another 32% have offered services |
|
United Kingdom, Sweden, Germany, Austria, and the Netherlands |
GBR (Jan. 2016) SWE (Mar. 2016) AUS DEU NLD (Apr. 2016) |
Unknown |
Digital labour platforms |
Engaged in paid work organised via an online platform |
Respondents to Ipsos-MORI iOmnibus online survey Working age population (age ranges between 16-65 and 16-75) |
GBR-2 238 SWE-2 146 AUS-1 969 DEU-2 180 NLD-2 126 |
Online |
No |
Between 9 and 19% of respondents engaged in crowd work |
|||
13 EU countries: GBR, SWE, NLD, DEU, AUT, CHE, ITA, EST, FIN, ESP, SVN, CZE, FRA |
2016 to 2019 |
At least weekly / monthly |
Digital labour platforms |
Engaged in paid work organised via an online platform |
Respondents to Ipsos-MORI iOmnibus online survey Working age population (age ranges between 18-55 and 16-75) |
GBR-2 235 SWE-2 146 AUT-1 969 DEU-2 180 NLD-2 125 CHE-2 001 ITA-2 199 EST-2 000 FIN-2 000 ESP-2 182 SVN-2 001 CZE-2 000 FRA-2 159 |
Online |
No |
No |
Yes |
Between 9% (NLD, 2016) and 44% (CZE, 2019) of respondents engaged in crowd work |
|
United States, Germany, France, Sweden, Spain |
June and July 2016 |
In the past 12 months |
Digital labour platforms, digital platforms for selling goods and digital platform for renting assets |
Classified independent workers according to a decision tree. |
Working age respondents |
8 131 responses (minimum 1 200 responses per country) |
Administered electronically |
1.5% |
||||
United Kingdom |
6 July to 6 August 2017 |
In the past 12 months |
Digital labour platforms |
Gig economy (involves exchange of labour for money between individuals or companies via digital platforms that actively facilitate matching between providers and customers, on a short-term and payment by task basis) |
All GB adults (aged 18+) |
NatCen Panel (2 184 interviews) + YouGov Omnibus non-probability online panel (11 354 people surveyed) |
Online |
Yes |
Yes |
Yes |
4.4% of the surveyed population (including Amazon Mechanical Turk, CrowdFlower, Clickworker, Microworkers and Prolific) worked via platforms during the previous 12 months |
|
France |
Website of the platforms visited in Sept. 2018 |
Unknown |
Digital labour platforms |
Estimates of the individuals micro-working in France, based on the results of the survey "Digital Platform Labour" (DiPLab). |
Estimates are based on a selection of seven micro-working platforms operating in France. The authors use a combination of 3 methods (declaration, capture-recapture, panel), adjusted by taking into account the multi-homing (multi-activity of micro-workers on multiple platforms) to estimate the number of micro-workers in France. This is also combined with a distributed questionnaire in the form of a paid task (997 responses obtained). |
Yes |
Yes |
No |
The estimated number of French people registered for micro-work platforms on the seven platforms is nearing 320 000. Among them, 4.7% are micro-working at least once a week, and 16.4% less than once a month. |
|||
United States |
12 July to 8 August 2016 |
In the past year |
Digital labour platforms |
Earned money by taking jobs (including filling surveys) through a website that required a user profile |
Respondents of the American Trends Panel who self-identify as internet users. |
4 579 respondents (4 165 online, 414 via mail) |
Online and via mail |
Yes |
Yes |
Yes |
8% of all adults engaged in gig work |
|
Sweden |
Autumn 2016 |
In the past 12 months |
Digital labour platforms |
Attempted to get a job through an online platform |
Aged 16-64 |
7 069 respondents |
Web panel, recruited by telephone |
Yes |
Yes |
Yes |
Around 4% have been trying, while around 2.5% of working age population has been successful |
Source: Adapted from OECD (2019[24]), Measuring platform mediated workers, OECD Digital Economy Papers No.282, OECD Publishing, https://doi.org/10.1787/170a14d9-en.
Surveys of national statistical offices
Labour force surveys
Existing labour statistics, such as those produced by LFSs, have difficulties in tracking digital platform workers. Such surveys focus on a worker’s primary job and can be unreliable in their coverage of secondary jobs and self-employment, and do not capture the diversity of employment contracts (Bernhardt and Thomason, 2017[25]); (Abraham et al., 2018[26]). This causes difficulties if digital platform workers already have a stable job and use digital platform employment to complement their income. Therefore, it is necessary to develop new questions for surveys. Recently, questions have been included in LFSs in Canada, Denmark, Finland, Singapore, Switzerland and the United States (Table 4.2). Italy also included a specific module on “gig workers” in its LFS in 2021 (ISTAT, 2021[27]).
In the United States, the Bureau of Labor Statistics (BLS) reinstated in 2017 the Contingent Work Survey (CWS) – a supplement to the nation’s monthly LFS -, which had been discontinued in 2005. In 2017, the BLS introduced two new questions on “electronically-mediated work”, with a view of measuring participation in the platform economy. The interviews were conducted by telephone and used a ‘last week’ reference period. While 3.3% of respondents (out of 46 000 people interviewed) answered positively to the situations described as electronically mediated work, a number of false positive answers were detected and in the recoded data; overall, only 1% the workforce was classified as working through an online intermediary.
Finland introduced in 2017 a question in the LFS to estimate the number of people aged 15 to 74 who had earned an income through digital platforms in the previous year (Finland, 2017[28]). Results from about 43 000 respondents showed that 0.3% of adults had earned more than 25% of their income from digital platforms. The question refers to a limited number of specific digital platforms, including some non-labour digital platforms, such as AirBnb and national digital platforms for selling second-hand goods. Pilot tests before the running of the survey had shown that respondents lacked understanding of what should be considered within the scope of digital platform employment and income (Sutela, 2018[29]).
Denmark also included specific examples of digital labour platforms and digital platforms for renting accommodation in three questions on digital platforms added to the 2017 LFS. The large-scale survey involved 18 000 randomly selected Danish citizens aged 15–74 years, interviewed using a combination of web survey and phone interviews. The survey concluded that only 1% of the workforce had earned income from platform mediated work in the last 12 months (Ilsøe and Larsen, 2020[30]).
The specific module on “Internet-mediated platform work” added to the 2019 LFS in Switzerland (Swiss Federal Statistical Office (SFSO), 2020[31]) also showed the importance of addressing cognitive biases when formulating the questions. Implementation of this module showed that plausibility checks are very important; these checks were based on hours worked, income, named platforms and interviewer’s additional comments, in order to control for false positive. Results from about 11 500 respondents showed that 1.6% of the population aged 15 to 89 provide platform services in Switzerland including renting out accommodation and sale of goods (without these two, digital platform employment amounts to 0.4% of total population).
As an annual supplement to its LFS, Singapore also included questions to capture the prevalence of own account workers who engaged in digital platform employment. This referred to digital platforms that serve as intermediaries to connect buyers with workers who take up piecemeal or assignment-based work. Results showed that in 2020, 3.6% of the workforce were regular own account workers who took up work via online matching platforms, either as their main job or on the side, over a one-year reference period. With the growth of ride-hailing and item delivery apps, most of the workers who utilised such digital platforms were providing services related to the transportation of goods and passengers.
ICT Surveys
Several national statistical offices of OECD Member States have conducted pilot surveys to measure the number of consumers and workers using digital labour platforms (Table 4.2). Initial attempts focused on use of digital platforms by consumers and were included in ICT usage surveys (such as those of Eurostat). More recently, questions asking whether participants have engaged in digital platform employment have been included in Internet use surveys in Canada, the United States, and in an EU-wide survey ran in 2018 and 2019. While the available estimates are not comparable across countries, they show a variety of approaches to dealing with the issues of providing definitions to questionnaire respondents, and setting appropriate reference periods. In addition to cross country differences, there are also substantial differences with surveys done by private organisations (see above). Some of the differences in estimates of platform use are due to differences in methodologies and definitions between countries and over time.
The Canada Internet Use Survey included a detailed module on Online Work in 2018 and in 2020. The 2018 results show that, among Internet users, 8% use Internet to earn income. Among them, 14.1% earned income using online freelancing, and 6.1% through platform-based peer-to-peer services.
The US Computer and Internet Use Supplement (CIUS), which is compiled as a supplement to the CPS, includes a question on online work, asking about own services offered for sale via the Internet. Estimates referring to November 2019 show a prevalence of 7.6% among Internet users, up from 6% in November 2017.
Eurostat inserted two questions in the Community Survey on ICT Usage in Households and by Individuals in 2018 and 2019. At the European level, results were not published as considered not reliable due to the small sample size and to limited respondents’ understanding of the concept of digital platform employment. However, Slovenia and Switzerland published some results, which confirm that only a tiny share of the population obtained paid work by using an intermediary website or apps. For example, in 2019, the share was 2.1% in Switzerland (among individuals aged 15 and more) and 0.5% in Slovenia 2019 (among individuals aged 16 to 74). An accurate measurement of digital platform employment through the ICT Survey would require a small ad-hoc module with several questions, so that respondents can have an appropriate understanding. The Eurostat ICT survey currently does not have this space, as it is aimed of surveying a number of other topics. Furthermore, estimates show that a small number of digital platform workers are likely to be included in each sample, making it difficult to gain high quality statistics of digital platform workers via this type of official survey.
Other surveys
In Australia, (McDonald et al., 2019[32]) carried out for the Victorian government an online survey of more than 14 000 adults to enquire about the extent and nature of digital platform employment9 across the country. The survey found that 7.1% of survey respondents worked through a digital platform or had done so in the previous year.10 Based on the findings from the survey, the Victorian government released a report on the “on-demand workforce” – of which platform work is considered a subset – (The State of Victoria, 2020[33]) highlighting digital platform workers’ conditions and offering recommendations for improvement.
In France, the National Institute for Statistics INSEE (Richet Damien, 2020[34]) surveyed individual entrepreneurs who had newly registered as “micro-entrepreneurs” in 2018. The Information system on new enterprises-survey of micro-entrepreneurs (Système d’information sur les nouvelles entreprises (Sine) – enquête Micro-entrepreneurs) allows to survey at regular intervals 56 000 new micro-entrepreneurs in France, to follow the developments for a new generation of enterprises. The survey found that one in six (16%) of them worked via a digital platform, with this percentage as high as two thirds for micro-entrepreneurs in the transport sector. About one third of new micro-entrepreneurs working through a digital platform – more than half of those in the transport sector – declared having created the enterprise specifically to this end. The Information system on new enterprises-survey (Sine) still asks this question in the following surveys (2019, 2021, 2022) and extended the scope, not only aiming at “micro-entrepreneurs” but also all newly created enterprises.
In Italy, the National Institute of Public Policy Analysis Innovation (INAPP), added a module on the gig economy to its 2018 survey (Participation, Labour, Unemployment, Survey, INAPP-PLUS). The survey, covering 45 000 adults and administered by telephone, found that 0.45% of Italians (about 213 000 people) offered services through labour-mediating digital platforms in the year before the survey (Cirillo, Guarascio and Scicchitano, 2019[35]). An earlier web-based survey, based on a sample of 15 000 respondents, estimated that a higher share of the population engaged in digital platform employment11 (2.6% of the working population) (Boeri et al., 2018[22]), although it used a different reference period (the week before the survey).
Other official agencies have considered digital platform workers as a subset of the broader category of “informal workers”. In the United States, the Federal Reserve's 2019 Survey of Household Economics and Decision-making (SHED), included a section on Gig Economy, including childcare, house cleaning and ride sharing. The survey – which counted on over 12 200 responses from a representative sample of the adult population – found that overall 17% of adults engaged in some form of gig work in the previous month, although only 13% of them found customers and received payments through an app or digital platform (Board, 2020[36]). In Canada, a study based on the Bank of Canada’s Canadian Survey of Consumer Expectations (Kostyshyna and Luu, 2019[37]) estimated that 18% of respondents had carried out informal work, with about 35% of them using websites and/or mobile platforms in the course of doing this work. However, the small sample limited the representativeness of this study (Sung-Hee, Liu and Ostrovsky, 2019[38]).
Lessons learnt from official surveys
Different approaches used to help respondents understand digital platform employment
When asking whether a person is a digital platform worker it is necessary that respondents have the same understanding of digital platform employment, and that the definition captures the wide variety of activities that can be done through digital platforms, while setting the boundaries with those that should not be considered within it. The United Kingdom’s ONS explicitly referred to finding work on a ‘digital platform’ in its pilot survey, but many respondents poorly understood the term. Other statistical agencies have taken the approach of providing a definition of digital platform employment, giving examples of digital platforms, or restricting their questions to a narrow range of digital platforms, such as ride-hailing (Annex 4.A). In addition, both the ordering of questions and use of probing questions can affect results (Abraham and Amaya, 2018[39]).
Both the US Bureau of Labor Statistics (in the 2017 CWS) and McDonald et al. (2019[32]) (in the survey carried out in Australia) included a detailed description of digital platform employment. While such detailed description is appropriate for an occasional survey focusing specifically on contingent workers, it is likely to be cumbersome if included in a regular survey, such as monthly or quarterly LFSs.
Although the CWS does not explicitly mention digital platforms, its question refers to finding work (performed in-person) “through companies that connect [workers] directly with customers using a website or mobile app”. Therefore, the description is robust to whether or not respondents consider themselves to be self-employed or an employee of the platform. In addition, the description states that the app or website coordinates payment for the service. The description aims to reduce the possibility that respondents, when answering this question, could include capital intensive services (such as providing accommodation) by referring to “short tasks or jobs”, although respondents may differ in their understanding of what is considered a short duration of time, and may exclude freelancing. Finally, the CWS description gives the example of providing transport, household chores or online work, but does not refer to specific digital platforms. However, many respondents poorly understood the definition, answering “yes” even if they merely made use of a computer or mobile app in their job. After recoding the data (e.g. by removing obviously incorrect responses, including hairstylists that said they worked entirely online), the estimated number of digital platform workers was reduced from 3.3% to 1% (Bureau of Labor Statistics, 2018[40]).
Far shorter questions have been included in other surveys, such as the LFS of Denmark, though it is questionable whether they convey to respondents a clear understanding of digital platform employment. The Danish survey asks whether respondents earned money by “performing work done through websites or apps” (Ilsøe and Madsen, 2017[41]). In the 2018 Eurostat ICT Usage in Households and by Individuals Survey, Eurostat referred to “intermediary” websites or apps. However, it is questionable whether all respondents would have the same understanding of the term intermediary. Although Eurostat does not say the work must be performed through the app or website, the survey explicitly excludes employment agencies. However, robustness checks (such as asking participants to name the digital platform which they work with) have shown that respondents poorly understood the question, which led Eurostat to decide not to publish the results.
Several surveys offer greater clarity by asking separate questions for digital platforms offering goods and services and for those mediating labour. The Canadian Internet Use Survey mentions six categories of digital platforms from which respondents can choose. The US Federal Reserve’s Survey of Households Economics and Decision-making (SHED) similarly offers six categories of activities. While the category “driving or ride-sharing” also mentions examples of digital platforms mediating this job, for the category “other paid personal tasks, such as deliveries” it is ambiguous whether a respondent would include services mediated by a digital platform. Likewise, a respondent may not include physically delivered services, such as handiwork, within the category “paid tasks online”. The Swiss LFS in 2019 had four filter questions for respondents to choose between renting out accommodation, providing taxi services, selling goods, or providing other services. The Danish LFS asks a separate question to those who earned money ‘performing work’ and those who rented property, while the Canadian LFS refers specifically to ride services and private accommodation services (to the exclusion of all other digital platforms). Both the United States CIUS Supplement and Statistics Finland do not distinguish between digital platforms renting accommodation and those mediating labour.
As discussed in Chapter 2, a number of different policy objectives and user needs might call for measurement of digital platform work and employment. In order to meet the range of different objectives, flexibility is needed to adjust the conceptual boundaries depending on the specific area of interest.
Most official surveys name specific examples of digital platforms to aid respondents understand what digital platforms are. The most common example of a digital platform mentioned by LFS is Uber, which is mentioned by the Canadian, Danish, Finnish and Swiss surveys. Among the surveys that do not offer an example, the French LFS combines both platforms and businesses that direct customers to the worker (“intermediary”, including digital platforms) (Insee, 2018[42]) while the US Bureau of Labor Statistics offers a detailed description.
Cross-country comparability requires consistent question wording, concepts and reference-periods
There are also several minor differences in question wording between surveys; experience from Sweden’s State Public Reports (SOU) suggests that this can have a large effect on the estimated number of digital platform workers (SOU, 2017[12]). These include asking if the respondent offered, or provided, a service; whether the question is broad enough to include those who engage in occasional digital platform employment for secondary income; and the chosen reference period.
Almost all surveys ask whether the worker provided a service, implying the worker completed a commercial transaction. However, the US CIUS asks whether a service was offered for sale (rather than provided), without specifying whether a transaction was completed or not. Similarly, the Canadian LFS asks whether the respondent ‘offered’ a service (and not necessarily ‘provided’ it) and does not mention the earning of income, meaning the survey could include those who offered a service for charitable reasons, and did not complete a commercial transaction.
Labour force statistics have traditionally focused on a worker’s main job. However, digital platform employment offers workers the flexibility to earn additional income, without becoming the respondent’s ‘main job’. Only the French LFS excludes those who engage in digital platform employment as a secondary job (by means of a series of filter questions). In contrast the US Fed only include secondary income, while the US Bureau of Labour Statistics, the 2018 Canadian Internet Use Survey, and the 2018 Eurostat ICT Usage Survey asks the respondent to specify whether the work done was as a workers main job, or to gain additional income. Likewise, the Swiss LFS ad-hoc module asks to specify whether the service provided was as part of the main, second or an additional job.
A related problem in comparing estimates of the number of digital platform workers with other categories of employment is the reference period used. LFSs typically ask for a respondent employment status in the past reference week. However, only the Bureau of Labor Statistics (CWS) asks whether the respondent performed digital platform employment in the last week. In contrast, surveys such as the Canadian, Danish, and Finnish LFSs refer to the past 12 months. The use of a longer reference period can greatly increase the estimated number of digital platform workers. Using a longer reference period also increases the share of occasional digital platform workers among all digital platform workers. Therefore, asking whether a respondent engaged in digital platform employment in the past 12 months as filter question, and then whether they engaged in digital platform employment in the past week can ensure comparability with the LFS employment count, and capture the larger number of irregular digital platform workers. This approach is taken in the Swiss LFS ad-hoc module. However, it can also be argued that the number of hours is more relevant than the frequency someone works on a digital platform (Pesole et al., 2018[16]).
Table 4.2. Main features of official surveys measuring digital platform employment
Country |
Time when the survey was conducted |
Reference period |
Name of the survey |
Type(s) of digital platform in scope |
Question wording |
Sample size |
Definition of digital platform employment provided? |
Examples of digital platforms named? |
Reference to earned income? |
Estimates of the prevalence of digital platform employment (%) |
Australia |
21 Mar. to 21 Apr. 2019 |
In the past 12 months / ever (before the 12 past months) |
Digital Platform Work in Australia - Prevalence, Nature and Impact |
Digital labour platforms, digital platforms for selling goods and digital platform for renting assets |
Earning income through digital platforms; renting, leasing, selling or licensing through platforms |
Approximately 15 000 individuals |
Yes |
Yes |
Yes |
7.1% currently or in the last 12 months have earned an income working or offering services through a platform, and 6% previous the last 12 months |
Canada |
Nov. 2015 to Oct. 2016 |
In the past 12 months |
LFS Fast Track Module –October 2016 collection |
Digital labour platforms (location-based) |
Offered ride services |
Approximately 100 000 individuals |
No |
Yes |
No |
0.2% (P2P Ride services only) |
Canada |
2018 |
In the past 12 months |
Canada Internet Use survey |
Digital labour platforms, digital platforms for selling goods and digital platform for renting assets |
Provided platform-based peer-to-peer services or online freelancing |
Approximately 26 000 individuals |
No |
Yes |
Yes |
8% of prevalence of Internet use to earn income Among income earners using Internet: 6.1% via platform-based peer-to-peer services and 14.1% via online freelancing |
Canada |
2018 (Regular CSCE questions and special questions included in the CSCE from 2018 Q2 to 2018 Q4) |
Unknown |
The Size and Characteristics Informal (“Gig”) Work in Canada |
Digital labour platforms |
The question refers to "informal work", not to "platform work", and provides a list of activities |
2 000 individuals Canadian Survey of Consumer Expectations (CSCE), from the Bank of Canada |
No |
Yes |
Yes |
Informal work as a share of the labour force is 3.5% (measured in full-time equivalents, average 2018Q3–2018Q4). About 35% of respondents engaging in informal activities used websites and/or mobile platforms in the course of doing this work |
Denmark |
Jan. 2017 to Mar. 2017 |
In the past 12 months |
Denmark's Labour Force Survey |
Digital labour platforms |
Performed work through websites or apps (e.g. Uber) |
Representative sample of 18 000 Danes |
No |
Yes |
Yes |
1.0% (have earned money by performing work found through websites or apps). |
EU Member states |
2018 and 2019 |
In the last 12 month |
Eurostat Community Survey on ICT Usage and e-commerce in Households and by Individuals |
Digital labour platforms |
Obtained paid work by using an intermediary website or apps |
No |
Yes |
Yes |
Results have not been published due to lack of reliability |
|
Finland |
During the year 2017 |
In the past 12 months |
Finland's Labour Force Survey 2017 |
Digital labour platforms, digital platforms for selling goods and digital platform for renting assets |
Earned income through capital or labour platforms |
12 000 persons every month. Sub-sample for platform jobs was 43 000 persons |
No |
Yes |
Yes |
7% (have earned income through capital or labour platforms) |
France |
During the year 2017 |
In the reference week |
Ad Hoc module of the European LFS (6th wave sample) |
“Intermediaries” (it includes digital platforms without specifications) |
Self-employed in main job that contact clients through a platform or a third party business |
3 700 independents (sample of the 6th wave of the LFS “Enquête Emploi”) |
No |
No |
Yes |
about 7% of independents and 0.8% of the “actifs occupés” (employed people) are using - either exclusively or not - a platform |
France |
Nov. 2018 and Nov. 2021 |
Unknown |
(Richet Damien, 2020[34]), based on Survey SINE Novembre 2018 and beyond |
Digital labour platforms |
Worked via a digital platform |
Micro-entrepreneurs registered during the first semester 2018 (56 000) |
No |
No |
No |
16% of micro-entrepreneurs are working via a digital platform. For 12% this is the main source of income, for 4% this is the annex source of income |
Italy |
2018 |
In the last 12 months |
INAPP-PLUS |
Digital labour platforms |
Provision of works and services through platforms that intermediate work |
45 000 persons (residents aged between 18 and 74 years) |
Yes |
Yes |
Yes |
213 000 individuals (0.49% of the population) are labour platform workers |
Singapore |
2020 |
In the last 12 months |
Labour Force Supplementary Survey on Own Account Workers |
Digital labour platforms |
Used online matching platforms to obtain work |
Approximately 4 200 persons aged 15 years and over |
No |
Yes |
Yes |
3.6% of the workforce were regular own account workers who took up work via online matching platforms |
Switzerland |
2019 |
In the last 12 months and last week |
Internet-mediated platform work (Swiss LFS) |
Digital labour platforms, digital platforms for selling goods and digital platform for renting assets |
Four filter questions on:Renting out accommodation / Taxi services / Sale of goods / Provision of other services. |
11 500 persons aged between 15 and 89 years |
Yes |
Yes |
Yes |
The platform work refers to “taxi” and “other”, which gives 0.4% of total population. When adding sale of goods and renting out accommodation, the total of platform services, the total of platform services amounts 1.6% of total population |
United Kingdom |
In the past 12 months |
UK ONS (cognitive/ qualitative pilot of questions for digital platform) |
Digital labour platforms |
Used an online platform to find work |
n/a |
No |
No |
Yes |
n/a |
|
United States |
May 2017 |
In the reference week |
Bureau of Labour Statistics Contingent Worker Supplement |
Digital labour platforms |
Use a platform for digitally or physically delivered tasks |
60 000 households |
Yes |
No |
Yes |
1% following recoding (3.3% based on survey responses) |
United States |
Nov. 2017 and 2019 |
In the past 6 months |
US CPS Computer and Internet Use Supplement |
Digital labour platforms and digital platforms for renting assets |
Offered services via the Internet |
Approximately 106 000 persons 15 years old and over |
No |
Yes |
No |
6% (offering capital or labour services for sale via Internet) in 2017, 7.6% in 2019 |
United States |
Nov. and Dec. 2017 |
In the past month |
FED Report on the Economic Well-Being of U.S. Households in 2017. Survey of Households Economics and Decision-making (SHED) |
Digital labour platforms, digital platforms for selling goods and digital platform for renting goods and assets |
Secondary income from online tasks or ride sharing |
12 246 panel members |
No |
Yes |
Yes |
4% (paid for completing online tasks) / 2% (driving using a ride-sharing app) |
United States |
Oct. 2019 |
In the past month |
Well-Being of U.S. Households in 2018. Survey of Households Economics and Decision-making (SHED) |
Digital labour platforms |
Secondary income from online tasks or ride sharing |
11 316 panel members |
No |
Yes |
Yes |
3% (paid for completing online tasks) / 2% (driving using a ride-sharing app) |
United States |
May 2020 |
In the past month |
Well-Being of U.S. Households in 2019. Survey of Households Economics and Decision-making (SHED) |
Digital labour platforms |
Secondary income from online tasks or ride sharing |
12 173 panel members |
No |
Yes |
Yes |
2% (paid for completing online tasks) / 3% (driving using a ride-sharing app) |
Source: Adapted from (OECD, 2019[24]), Measuring platform mediated workers, OECD Digital Economy Papers No.282, OECD Publishing, https://doi.org/10.1787/170a14d9-en.
Use of alternative data sources
Although official surveys are likely to be the best tool to estimate the total number of digital platform workers and their characteristics, the relatively small overall number of digital platform workers means that sample sizes are too small to provide quality information and to allow analysis at a more detailed level (e.g. by socio-demographic variables). In addition, such surveys cannot provide information on past trends in digital platform employment. Alternative sources, such as administrative data or data provided by digital platforms may usefully complement the information gained from official surveys.
Administrative data
Administrative data can overcome the problem of small sample size, reduce the burden on data providers and the cost of data collection. However, as administrative data are not collected for statistical purposes, they may have problems of timeliness, relevance, and accuracy (Office for National Statistics (UK), 2016[43]). In addition, due to a lack of definition and to ambiguities in the regulation of digital labour platforms, they may be omitted from some datasets. For example, ride hailing apps blur the lines between street hailing of a cab and pre-booking a chauffeur, and many apps take advantage of loopholes in existing labour market regulation (Broecke, 2018[44]). The tendency of digital platforms to locate in such blurred regulatory boundaries creates obstacles to the use of administrative data. For example, in Italy digital platform workers often lack formal contractual agreements (Cirillo, Guarascio and Scicchitano, 2019[35]) and almost half of the digital platforms are not formally registered at the National Institute for Social Security (INPS, 2018[45]). In addition, the source of income may not be identifiable (if for instance is reported from self-employed activity without further breakdown), or workers may not provide information on this type of activity, if they engage in digital platform employment as a secondary job or as a hobby. The cross-border nature of digital platforms further increases challenges to capture this type of employment, as workers may not report work done for a digital platform located in another country. Lastly, as systems of administration differ across countries, comparability is limited.
Administrative data have offered insights into contingent workers (such as employees who occasionally perform secondary work to earn additional income), though only a few studies distinguish digital platform workers from the broader group of non-standard workers.
In the United States, Collins et al. (2019[46]) used micro administrative tax data from the Internal Revenue Service (IRS) to explore the role of gig work mediated by digital platforms. In particular, they looked at tax data filed by self-employed individuals working for firms or performing independent contract work intermediated by firms. They refer to these arrangements - a subset of the broader gig economy - as the "online platform economy" for labour (labour OPE). They found that the share of workers with OPE income was approximately 1% of the workforce in 2016. Consistently with other sources, the results show that digital platform employment is mainly a secondary job to provide for a complementary income. Collins et al. (2019[46]) also included data on the number of digital platform workers by State in 2016. Moe, Parrott and Rochford (2020[47]) updated the data for New York State, by relating the annual growth in the number of these workers to the growth in the average number of for-hire vehicle trips in New York City, mainly supplied by drivers working for Uber and Lyft. The study estimated that there are about 150 000 digital platform workers in New York, representing about 1.6% of the State’s workforce.
In Canada, Sung-Hee, Liu and Ostrovsky (2019[38]) introduced a definition of gig work specific to the way work arrangements are reported in the Canadian tax system and estimated the size of the gig economy using various Canadian administrative sources. They also examined the characteristics of gig workers by linking administrative data to 2016 Census of Population microdata. The study found that, from 2005 to 2016, the percentage of gig workers in Canada rose from 5.5% to 8.2%. However, their definition of gig workers is not limited to individuals working through digital platforms.
Partnerships with digital platforms have the potential to improve administrative data sources. For example, the Estonian Tax and Customs Board (ETCB) has reached an agreement with two ride-sharing platforms to share their data with the ETCB. However, drivers must first give consent to share their data, which can lead to selection bias. Denmark is developing a digital solution for declaring income arising from the sharing economy. The Mexican Tax Administration (SAT) has reached an agreement whereby drivers must be officially certified before registering with a platform (OECD, 2018[48]). In France, since 2019 digital platforms are obliged to report the annual gross income an individual earns on the platform to the tax authorities, while in Belgium platforms are obliged to both withhold taxes and report information to the tax authorities (HM Revenue and Customs, 2018[49]; European Commission, 2017[50]). As countries are developing reporting systems to obtain income data from platforms, there may be benefits to harmonise reporting systems at EU level, so to reduce the reporting burden for platforms that operate cross-jurisdictionally and increase compliance (Ogembo and Lehdonvirta, 2020[51]). An additional aspect that should be considered is that legislation may apply only to digital platforms formally registered in the country. While digital platform providing in-person services most of the times are registered in the local business register, the same doesn’t apply for those mediating fully digital services.
Big data and web-scraping
The use of some alternative large datasets can also provide useful insights into the characteristics of platform workers. Harris and Krueger (2015[52]) estimated the number of US platform workers to be 0.4% of total employment by using data on the number of Uber drivers, and scaling this by the total number of Google searches for a list of 26 labour platforms (relative to the number of Google searches for Uber). The same method was used to estimate that as few as 0.05% of EU employees were active platform workers at the end of 2015 (Groen and Maselli, 2016[53]).
Using data from the bank accounts of those who received payments from digital platforms, economists at JP Morgan Chase investigated the characteristics of digital platform workers using data on 39 million Chase checking accounts (Farrell and Greig, 2016[54]; Farrell, Greig and Hamoudi, 2018[55]). In line with other studies, they found that approximately 1% of workers (twice the level of early 2016) used a digital platform, earning an average of under USD 800 per month, with the earnings of those using transportation apps having fallen by half since 2013. There is also a high rate of workers entering and leaving the sector. Such high churn highlights the need for an appropriate reference period when comparing the numbers of digital platform workers with other employment sectors. Koustas (2019[56]) used a transaction-level dataset from a large financial aggregator and bill-paying application to analyse how household balance sheets evolve when starting a “gig economy job”. Based on data for about 25 000 workers from 10 popular digital platforms, the study found that entry into gig work is generally preceded by a decline in non-gig income.
The use of web-scraping can also be used to assess trends in parts of the digital platform labour market. The Online Labour Index (OLI) measures the utilisation of digital platforms mediating online labour over time across countries and occupations; although it does not give an estimate of the absolute number of digital platform workers, it does capture trends. The index is based on tracking all projects and tasks posted on a sample of platforms, using an application-programming interface (API) and web-scrapping. The index is limited to platforms through which buyers and sellers of labour or services transact fully digitally: the worker and employer are matched digitally, the payment is conducted digitally via the platform, and the result of the work is delivered digitally. The samples include the top five platforms for which it was possible to collect data over time and which accounted for at least 70% of all traffic to online labour platforms (according to Alexa’s figures) (Kässi and Lehdonvirta, 2018[57]). The current sample is limited to English-language platforms.
However, data provided by platforms can have similar problems to administrative data (as the number of registered users could be higher than the number of actual users) (Office for National Statistics (UK), 2016[43]). Additionally, methods like web scrapping raise some concerns regarding data protection and statistical/research ethics. Therefore, such data can only complement rather than replace surveys.
Data from platforms can give insights into general labour market problems
The rich data on earnings and hours worked by digital platforms can also serve as a resource to look at general labour market issues, beyond estimating the size of digital platform employment. This is highlighted by the study of (Cook et al., 2018[58]) who used data on over a million drivers to examine the gender wage-gap and decomposed it into its main components, such as women being less willing to work anti-social hours (perhaps due to home duties or a lack of safety in picking up passengers late at night).
Wrapping up: consistencies and differences
To date several methods have been used to measure the number and characteristics of digital platform workers, although differences in definitions and methodologies limit their comparability. These methods serve different purposes and each of them has its own strengths and weaknesses (see Table 4.3 for a summary). The choice of method depends on the research objectives, the resources available, and the trade-offs faced by statistical agencies or researchers.
A first overarching observation is that measuring the same concept of digital platform employment across national and international surveys is key for internal and international comparisons. As shown in this review, the terminology and the definitions are not harmonised across countries.
For surveys, a key problem is how to ensure that respondents understand the meaning of digital platform employment. To gain consistent statistics over time it is necessary that respondents to questionnaires have a similar understanding of the question in each period. Although giving named examples of digital platforms to respondents is an easy way to convey the meaning of digital platform employment, this can be problematic as different digital platforms enter or exit the market. Providing a clear definition of digital platform along with examples is important to ensure that respondents understand the question. However, this should not lead to overly long introductory text, as this would increase the propensity of respondent to ignore this text (Montagnier, P.; Ek, I., 2021[59]).
The overall importance of the topic of digital platform workers to a survey affects the appropriate amount of space devoted to formulating an easily understandable question. However, rather than give a detailed definition of digital platform workers, consideration should be given to asking a series of short questions concerning different elements of digital platform employment, with the interviewer or subsequent analysis then determining whether the respondent should be considered as a digital platform worker or not. Filter questions can also be used to determine the nature of the work conducted, such as whether the service was provided online or delivered physically. This approach has the advantage of ensuring the survey is robust to changes in traditional employment, such as firms using apps to roster workers’ hours.
Next to the definition and clarification of the survey object, attention should also be devoted to the survey mode, as it can affect results by introducing coverage and measurement biases (see Box 4.1). While online surveys may be suitable to measure digital platform workers, they may not be representative of the overall population. Telephone or face-to-face surveys, however, may not be able to reach out to those digital platform workers who are not in national phone registers, or who are not available at the times that surveys are carried out. While evidence suggests that respondents are more honest when answering self-administered questionnaires, interviewer-administered surveys may yield higher quality results, as interviewers can correct inconsistencies in respondents’ answers. Cost and time are also relevant factors to consider. Face-to-face surveys tend to be more costly and take a longer time horizon to be realised than online surveys. Accordingly, if budgets are limited or results are required quickly, the online mode might be the preferred one.
Overall, it can be concluded that there is no perfect or ideal survey mode for digital platform employment surveys. All currently existing modes have specific advantages and disadvantages, and it needs to be decided on a case-by-case basis which mode is likely to result in the best outcome, that is which short-comings are acceptable against the specific information needs.
The choice of reference period will affect the type of workers captured by the survey. For researchers mainly interested in those who regularly engage in digital platform employment, asking whether someone performed such work in the reference week is appropriate. However, for those also wishing to capture occasional platform employment a longer time horizon is needed. Therefore, asking an additional question as to whether someone engaged in digital platform employment in the last 12 months may be appropriate, and would allow greater consistency with previous surveys.
When the objective is to ensure consistency with existing labour statistics, it is necessary to include questions on digital platform employment in the LFSs of national statistical offices, which ensures identical sampling frames and the same reference week (rather than a longer time horizon). This is likely, however, to give a lower quality estimate, as those who only perform this type of work occasionally are less likely to be captured.
The heterogeneity of labour services provided is a distinctive characteristic of digital platform employment, not normally found in traditional forms of labour provision. Therefore, careful consideration should also be given to the ordering and filtering of questions to ensure that it is clear about which episode of digital platform employment respondents are referring to when answering subsequent questions about the nature of the work or tasks they performed.
For researchers who are only interested in the use of a digital platform by a specific category of worker (such as the self-employed) it can be possible to use filter questions to identify the target group, and then phrase the question specific to that group (such as by asking the self-employed how they interact with customers). However, this approach comes at the cost of limiting data comparability with other surveys.
For researchers wishing to ensure cross-country comparability, the use of named digital platforms in survey questions may be problematic, as not all digital platforms may operate (or be equally known) in each country. The use of some existing big-data sources, such as used by Farrell et al. (2018[55]), can allow researchers to refine their research question as new digital platforms enter the market. Methodologies which rely on web-scraping may have problems of consistency over-time as digital platforms are added, or dropped, from the list of the ones that are monitored. These methods also raise some ethical issues. In addition, the potential use of administrative data is likely to be limited due to differences in administrative systems across countries. Therefore, the use of surveys is likely to be the best approach to gaining cross-country statistics.
Although LFSs may be the best option for those wishing to learn about the overall prevalence of digital platform employment, ICT Usage Surveys can be a better option for assessing technology usage and online behaviours. However, attempts to date have shown that this tool may not be the best vehicle to gain descriptive statistics, due to the small number of workers included in the sample. Time Use Surveys (TUSs) have the advantage of being able to capture platform work done for short period and as a secondary occupation, but to date they have not included questions to investigate this topic, and they also have the disadvantage of being conducted very unfrequently. Finally, income surveys are appropriate to examine whether individuals have earned a significant portion of their income from digital platform employment. Both types of surveys would require inclusion of additional questions in order to capture this phenomenon.
In conclusion, while the use of official surveys such as LFSs may give more accurate estimates on the overall prevalence of digital platform employment, problems of sample size reduce their suitability for gaining insights into the characteristics of digital platform workers. Even though the sample sizes of LFSs are typically very large, they will nevertheless lack statistical precision about characteristics of potentially small groups in the population such as digital platform workers. This is all the more true for ICT Usage Surveys, which have a smaller sample size than LFSs. Also, the nature of digital platform employment (task approach) is not that well compatible with the concepts underlying LFS. Therefore, other sources (such as ad hoc surveys, administrative datasets or big data) provide a useful complement. At present, the possibilities of using administrative data are limited, but these may increase as tax authorities develop data-sharing agreements with digital platforms. In addition, the use of online surveys can reduce costs (though possibly at the expense of reduced accuracy and sampling bias), allowing researchers to reach out to a larger number of respondents. Such approaches can complement official surveys, which can be used to test the overall accuracy of other approaches and to calibrate their results.
Based on this review, potential next steps should include the formulation of questions to be included in a range of official surveys (e.g. regular LFSs and ad-hoc modules within LFSs). It is also necessary to decide upon the most appropriate tool (and frequency) for addressing different facets of the phenomenon: for example, a short list of questions in core (monthly or quarterly) LFS questionnaires may be appropriate to monitor the evolution of digital platform employment over time. A longer list of questions in less frequent survey supplements (e.g. ad hoc modules in LFS, or TUSs or income survey supplements) on the other hand may be more appropriate to illustrate the variety and regularity of tasks performed by workers in digital platform employment and their characteristics and sources of income. Finally, more experimentation in terms of ordering of questions and use of prompting questions may be necessary before such questions are included in surveys. These points and additional methodological recommendations are further developed and discussed in Chapter 5.
The nature of work and its use of digital platforms are evolving rapidly. The frontiers between the various working arrangements and their legal status are blurring, and so are the workers’ perceptions of their occupations. This makes it difficult to accurately measure the evolution of digital platform employment. Although no optimal approach currently exists, this chapter suggests that a mixed approach, combining several measurement instruments (general population surveys, ad hoc surveys, administrative data, web scraping, etc.), is needed.
Table 4.3. Overview of sources and methods to estimate size and characteristics of digital platform employment
Method/ source |
Purpose/ Best suited for |
Example of indicators* |
Advantages |
Disadvantages |
Further comments |
||
Official surveys |
|||||||
Labour Force Survey |
Estimate the share of the workforce engaged in digital platform employment and monitor evolution over time |
Share of workforce engaged in electronically mediated work Share of workforce that earned income from platform mediated work Share of own account workers engaged in digital platform employment |
Same sampling frame as general statistics on labour market, which may ensure comparability with overall data on labour market and may provide accurate estimates on the overall prevalence of digital platform employment |
Difficulties in tracking digital platform workers as the focus is on a worker’s primary job. Could be unreliable in coverage of secondary jobs and self-employment and not capture the diversity of employment contracts The nature of digital platform employment (task-based) may not be fully compatible with concepts underlining the labour force surveys (job/occupation comprising several tasks) The small absolute number of digital platform workers may hinder further analysis of workers’ characteristics Using the past week as reference period is not suitable to capture occasional digital platform workers Difficulties and divergences in understanding the question may lead to unreliable results or overestimates Small differences in question wording may have a large effect on the estimated number of digital platform workers |
Need to harmonise definition and scope to ensure comparability Respondents need to have the same understanding of digital platform employment Naming specific digital platforms helps but may limit comparability across time and countries, and result in conservative estimates Providing a detailed description of digital platform employment helps but may be cumbersome for a regular survey Filtering questions could be used to determine whether it is a digital platform worker or not Question wording should be consistent (to offer for sale/provide a service), and broad so to capture also secondary job |
||
ICT Usage Survey |
Estimate the share of Internet users engaged in digital platform employment Technology use and online behaviours |
Share of Internet users using Internet to offer own services/obtain paid work/earn income |
Same sampling frame as for statistics on ICT, which may ensure comparability with other aspects of online activities and the digital economy |
Small sample size, which associated with the small absolute number of platform workers reduces reliability of findings Difficulties and divergences in understanding the question may lead to unreliable results or overestimates |
|||
Income Survey |
Share of income earned through digital platform employment |
A specific module on income earned through digital platforms should be developed |
|||||
Time Use Survey |
Identify share of time spent in activities related to digital platform work and employment (as secondary activity) |
|
|
Not very frequent |
A specific module on time devoted to relevant online activities should be developed |
||
Surveys by non-official organisations |
|||||||
Ad-hoc Survey |
Provide information on workers’ characteristics and employment/working conditions Estimate the share of the population engaging in digital platform employment |
Share and characteristics of adult population providing services via digital platforms |
Higher flexibility compared to official surveys, it could include a higher number of questions to explore a wider spectrum of issues on digital platform employment (both quantitative and qualitative) Lower cost of online surveys |
Potential selection and sampling biases (overrepresentation of online workers among respondents) Potential measurement bias linked to survey method used (face-to-face/CATI/online/paper form) Monetary incentives given to respondents may bias the results The above biases reduce comparability |
High heterogeneity of methodologies, little comparability among studies |
||
Alternative data sources |
|||||||
Administrative data (tax data) |
Estimate the number of digital platform workers and income from digital platform employment Examine specific aspects related to digital platform employment (e.g. gender pay differential) |
Share of workers with income from digital platform employment |
No issues related to sample size and techniques Lower burden on data providers Lower cost of data collection |
Data originally collected for different purposes, they may have problems of timeliness, relevance and accuracy There is often no distinction of digital platform employment from the broader non-standard work (i.e. may include gig work performed outside digital platforms) Differences in administrative systems across countries Potential underestimation due to blurred regulatory boundaries, cross-border nature of digital platforms, underreporting by workers and if the source of income is not identifiable |
|
||
Big data |
Infer number of digital platform workers through e.g. bank account data |
Share of workers using a digital platform and related earnings |
Reliable results |
Results are not representative No access to underlining (privately-owned) data |
|||
Web-scraping |
Specific purposes, e.g.: Monitor trends in supply and demand of online freelance labour |
Number of open, completed and new vacancies posted across (selected) digital platforms |
Real-time updates Comparability across time |
May be difficult to extend (e.g. from English platforms to platforms in other languages) May provide trends but not absolute numbers Ethical issues (as data is used for other purposes than those consent was given to) |
|
Note: *It includes illustrative examples based on the reviewed studies.
Source: OECD STI elaboration.
Annex 4.A. Questions posed in surveys
Annex Table 4.A.1. Questions posed in surveys of private agencies
Survey and countries covered |
Questions (or selection method) |
---|---|
Alsos et al. (2017) Norway |
Pilot Question: Recently, there has been a lot of attention around companies that use apps and websites to convey work and services. This is usually called the sharing economy. Below are a list of such companies. Have you done any assignments or paid employment through one or more of the following companies in the last 12 months? 1. Uber 2. Foodora 3. weClean 4. Upwork 5. Konsus 6. Haxi 7. FINN småjobber 8. Other ______ 9. No Round 3 Question: Recently, there has been a lot of attention around companies that use apps and websites to convey work and services. This is usually called the sharing economy. During the last 12 months, you have done some of the following ... 1. Did you work as a bicycle courier for Foodora? 2. Worked as a cleaner for WeClean? 3. Worked for Upwork or Konsus? 4. Worked as a driver for Haxi? 5. Did a job you found on FINN småjobber? 6. Did you do a job on Mitt anbud.no? 7. Rented a home on Airbnb? 8. Done assignments you have found on other apps or websites _______ 9. None of the aforementioned |
Bonin & Rinne (2017) Germany |
Even if you are not doing it now, have you ever done work in exchange for money, for orders that you received over the Internet or an app? |
CIPD (2017) United Kingdom |
Thinking about the LAST 12 MONTHS, which, if any, of the following have you done via an online platform (i.e. website) or app (i.e. mobile device application) to earn money? (Please tick all that apply) Provided transport using my vehicle (e.g. Uber, BlaBlaCar etc) Rented out my vehicle (e.g. EasyCar, Zipcar etc) Rented/shared my accommodation (e.g. AirBnB, tripping, HomeAway etc) Delivered food or goods (e.g. Deliveroo, City Sprint) Performed short-term jobs via online platforms that connect people looking for services (e.g. TaskRabbit, Upwork, PeoplePerHour etc) Sold things I have created via online platforms (e.g. Etsy) Other work arranged through an online platform (open) Still thinking about the LAST 12 MONTHS, what contribution did the following type of work make towards the total income you received from paid work over the past year? Provided transport using my vehicle (e.g. Uber, BlaBlaCar etc) Rented out my vehicle (e.g. EasyCar, Zipcar etc) Delivered food or goods (e.g. Deliveroo, City Sprint) Performed short-term jobs via online platforms that connect people looking for services (e.g. TaskRabbit, Upwork, PeoplePerHour etc) Other work arranged through an online platform |
Eurobarometer (2016) European (Eurostat related) countries |
A collaborative platform is an internet based tool that enables transactions between people providing and using a service. They can be used for a wide range of services, from renting accommodation and car sharing to small household jobs. Have you ever provided services on these platforms? No, you haven’t. 1 You have offered a service on one or more of these platforms once 2 You offer services via these platforms occasionally (once every few months) 3 You offer services via these platforms regularly (every month) 4 Other 5 None 6 DK/NA 7 |
Farrell, D. and F. Greig (2016), Paychecks, Paydays, and the Online Platform Economy - Big Data on Income Volatility. |
No questions. Based directly on income flows originating from a selection of platforms. In 2016, 42 platforms were selected. |
Farrell, D. and F. Greig (2018), The Online Platform Economy in 2018, Drivers, Workers, Sellers, and Lessons. United States |
128 platforms were selected, based on 3 key criteria: platforms i/ connect independent suppliers directly with demanders, ii/ mediate payment, and iii/ empower participants to enter and leave the market whenever they want. |
Huws, U., N. Spencer and S. Joyce (2016), Crowd Work in Europe: Preliminary results from a survey in the UK, Sweden, Germany, Austria and the Netherlands. |
No questionnaire in the report published. |
13 European countries |
No questionnaire in the report published. |
Katz L. and Krueger A. (2016), The Rise and Nature of Alternative Work Arrangements in the United States, 1995-2015 |
Do you do direct selling to customers on your main job or a secondary job, or both? Does your direct selling involve goods or services? Do you work with an intermediary, such as Avon or Uber, in your direct selling activity? Do you work with an online intermediary to find customers, such as Uber or TaskRabbit? |
(Le Ludec, Tubaro and Casilli, 2019[8]) France |
No questionnaire in the report published. |
United Kingdom |
Detailed questionnaire not provided. |
Manyika, J. et al. (2016), Independent work: Choice, necessity, and the gig economy United States and EU-15 countries |
Detailed questionnaire not provided. |
Pesole, A. et al. (2018), Platform Workers in Europe, Publications Office of the European Union |
Has the respondent ever gained income from: providing services via online platforms, where you and the client are matched digitally, payment is conducted digitally via the platform and the work is location-independent, web-based; or providing services via online platforms, where you and the client are matched digitally, and the payment is conducted digitally via the platform, but work is performed on-location |
Pew Research Center (2016), Gig Work, Online Selling and Home Sharing. United States |
Some people find paid jobs or tasks by connecting directly with people who want to hire them using a particular type of website or mobile app. These sites require workers to create a user profile in order to find and accept assignments, and they also coordinate payment once the work is complete. In the last year, have you earned money by taking on jobs through this type of website or mobile app (for example, by driving someone from one place to another, cleaning someone’s home, or doing online tasks)? (Y/N) What sorts of jobs or tasks have you performed in the last year using these services? Driving for a ride-hailing app (such as Uber or Lyft)6 Shopping for or delivering household items Performing tasks online (like completing surveys or doing data entry) Cleaning someone’s home or doing laundry Something else |
SOU (2017) Sweden |
In which, if any, of the following ways have you ever personally carried out paid work using a website or mobile phone application? 1. Providing a driving or taxi service, for a fee, by finding passengers through a website or app such as Uber or BlaBlaCar 2. Providing professional work, such as consultancy, legal advice, accounting services, through a website or app such as UpWork, PeoplePerHour or Freelancer 3. Providing creative or IT work, such as writing, graphic design, or web development, through a website or app such as UpWork, Freelancer, PeoplePerHour, Fiverr or Toptal 4. Providing administrative work, such as data entry or ‘click work’, through a website or app such as Clickworker, PeoplePerHour or Freelancer 5. Providing skilled manual work, such as plumbing, building, electrical maintenance and carpentry, through a website or app such as Rated People, MyBuilder or TaskRabbit 6. Providing personal services, such as cleaning, moving, or DIY tasks, through a website or app such as TaskRabbit, Hassle or Handy 7. Providing delivery or courier services, through a website or app such as Deliveroo, UberEATS or Just Eat |
Source: OECD STI elaboration.
Annex Table 4.A.2. Questions posed in official surveys
Survey |
Questions |
---|---|
Australians and the Gig Economy Survey, Prevalence and characteristics of digital platform work in Australia (2019) |
Questions relate to earning income through digital platforms; Renting, Leasing, Selling or Licensing through Platforms; experience with platform work (e.g. period, frequency, hours per week, perceived importance of the income, reasons to work or offer services through digital platforms); details related to the main digital platform used (name, type of work or service offered, methods of payment, amount paid per hour, hours spend per week and share of time spent on unpaid tasks, etc.); details on functions and regulation characteristics of the platform (e.g. subscription fees, insurance, rating by clients, dispute settlement process, etc.). Detailed questionnaire provided pp.85 to 97 of the publication. |
Canada LFS (LFS Fast Track Module –October 2016 collection) |
In the past 12 months, did you offer ride services such as Uber, Lyft, etc.? In the past 12 months, did you offer private accommodation services such as Airbnb, Flipkey, etc.? |
Canada Internet Use Survey (2018 survey) |
Online work During the past 12 months have you used the Internet to earn income? (Y/N) Include money made through online bulletin boards If Yes: What type of income was this? Was it a: Main source of income / Additional source of income Through what method did you earn this income during the past 12 months? Select all that apply. Was it through: Online bulletin board for physical goods (e.g., Etsy, Kijiji, Ebay) / Online bulletin board for services (e.g., Kijiji, Craigslist) / Platform-based peer-to-peer services (e.g., Uber, Airbnb, AskforTask) / Online freelancing (e.g., Upwork, Freelancer, Catalant, Proz, Fiverr) / Crowd-based microwork (e.g., Amazon Mechanical Turk, Cloudflower) / Advertisement-based income (e.g., income earned through YouTube or personal blogs) / Other What is your best estimate of the total income you earned through the Internet during the past 12 months? Would you say: Less than USD 200 / USD 200 to less than USD 1 000/ USD 1 000 to less than USD 10 000 /USD 10 000 to less than USD 20 000 / USD 20 000 to less than USD 50 000 / USD 50 000 or more |
Canada Internet Use Survey (2020 survey, forthcoming) |
Online work The next questions ask about the job or business you usually worked the most hours, if you had more than one job. Which of the following best describes your usual place of work at your main job or business? Do you: 1: Work at a fixed location outside the home 2: Work outside the home with no fixed location (e.g., driving, making sales calls) 3: Work at home (Include work done at the same address as your home, but on a different part of your property.) Excluding overtime, do you work any of your scheduled hours at home? (Y/N) During the past 12 months, have you done any telework from any of the following locations? Was it from: Home (Y/N) Co-working spaces (Y/N) Other locations (Y/N) Did not do any teleworking in past 12 months (Y/N) During the past 12 months, have you used an Internet-connected device at home that was provided by your employer? (Y/N) During the past 12 months, was there an expectation from your employer that you use the Internet to stay connected outside of your regular work hours? (Y/N) The following question is about money that you personally earned online in the past 12 months. Please remember that your answers will be kept strictly confidential. During the past 12 months, how much did you personally earn by doing the following activities online? (Min = 0; Max = 99999999) Selling physical goods online that you built or created Selling services via online bulletin boards Providing platform-based peer-to-peer accommodation services Providing platform-based peer-to-peer ride and delivery services Providing other platform-based peer-to-peer services Online freelancing Crowd-based microwork Earning income through online advertisements and sponsored content Other activities |
Denmark LFS |
Have you earned money in the past 12 months by performing work done through websites or apps - for example, via Uber? (Y / N) In the past 12 months, have you earned money by renting your property or your property through websites or apps for example via Airbnb? (Y/N) |
Eurostat, Community Survey on ICT Usage and e-commerce in Households and by Individuals, 2018 |
B8. Have you obtained paid work by using an intermediary website or apps (e.g. Upwork, TaskRabbit, Freelancer, Amazon Mechanical Turk) in the last 12 months? Websites of employment agency are excluded If YES to B8 go to B8.1, otherwise C1 B8.1. If Yes to B8: Could you please specify if the income of this work is: a) the main source of your income b) an additional source of income |
Finland LFS |
Have you during the past 12 months worked or otherwise earned income through the following platforms: 1. Airbnb, 2. Uber, 3. Tori.fi/Huuto.net, 4. Solved, 5. Some other, 6. None of the above. |
France LFS (Ad Hoc Module 2017) |
How do you mainly get in touch with your clients? Many answers possible (if the respondent can't choose) Don't read item 5. 1. Clients come into the shop or contact you directly (phone, mail, Internet etc.) 2. Clients go through a platform or through a third party business that redirect them to you. 3. You're directly looking for clients / contact yourself the clients. 4. Other 5. Not meaningful |
France Dispositif SINE, Interrogations 2018 et suivantes |
31. Travaillez-vous par l’intermédiaire d’une ou plusieurs plates-formes numériques de mise en relation (exemples : VTC, livraison à domicile, services à la personne, services ou conseil aux entreprises, …) ? UNE SEULE RÉPONSE Oui, c’est ma principale source de chiffre d’affaires........... 1 Oui, mais c’est une activité annexe.................................... 2 Non..................................................................................... 3 |
Italy (INAPP-PLUS 2018) |
1. In the last year, have you earned money by accepting jobs through this type of site or mobile app, e.g., driving someone from one place to another, delivering meals on wheels, cleaning someone's house, or performing tasks (Hit) online? (Yes/No/No answer) 2. What types of work or activities have you performed in the last year using these services? Driving for a travel application (such as Uber or Lyft) / Purchase or delivery of household items / Delivery meals/Performing online activities (such as completing surveys or entering data)/Cleaning someone's house or doing laundry/Something else (specify) /No answer 3. Can you tell us the net income you earned in 2017 from this job? 4. In relation to the income you earn from this work, which of the following statements best describes it? It is essential to meet my basic needs / It is an important component of my budget, but not essential / It's convenient for me to have it, but I could easily live without it. / No answer 5. How are you contractually framed when you provide these services? Coordinated and continuous collaboration (Co.Co.) / Occasional collaboration (withholding tax) / Business owner / Entrepreneur / Own business (VAT number) / Franchising / Ancillary work / Cooperative or company member / Familial Adjuvant / Informal agreements (No formalized contract) / I do not know or do not remember the contractual form. |
Singapore Labour Force Supplementary Survey on Own Account Workers |
Please indicate the online matching platform(s) used to take up work as an own account worker in the past 12 months (e.g. ride-hailing platforms, food delivery platforms etc) |
Switzerland – ad hoc LFS module (2019) on “Internet-mediated platform work” |
Finally, we would like to ask you a few questions on new forms of work. Internet platforms and apps make new income opportunities possible today. You are put in contact with the client and generally paid directly via the platform. Have you rented a room, apartment or a house to somebody via an internet platform or app such as Airbnb or Flipkey in the past 12 months? Have you provided taxi services via an internet platform or app such as for example Uber or Lyft in the past 12 months? Have you sold goods via an internet platform or app such as Ricardo or Ebay in the past 12 months? Please only answer “yes” if you previously collected, bought or produced the goods with the specific aim of reselling them. Have you provided other services via an internet platform or app such as cleaning, handiwork, delivery services or online programming in the past 12 months? In what activity area do you provide these paid services? Cleaning; Food delivery; Goods transport and delivery; Handiwork; Programming/online support; Translation; Data / text entry; Web / graphic design; Other activity area; Don't know; No answer Have you provided one of these paid services in the past week via an internet platform or app? How many hours have you spent working on this service or these services in the past week? number of hours/ don't know/No answer Did you provide these paid services via an internet platform or app as part of your main job or was this an additional job? (Interviewer: several answers possible): Main job/Additional job/don't know/No answer Did you provide these paid services via an internet platform or app as part of your main job or second job or was this an additional job? (Interviewer: several answers possible): Main job/Second job/Additional job/Don't know/No answer. Why did you choose this form of work? additional income opportunity/most suited to one's own qualifications/did not find a traditional job/ flexible working hours (day/night, at the weekend,...)/flexible workplace (home office, work on the go,...)/reconciliation with family life/ reconciliation with studies/other reason:…/don't know / no answer How long have you been providing paid services via an internet platform or app? - for less than 1 year/for 1 to less than 2 years/for 2 to less than 5 years/for 5 years and more/don't know/no answer How often do you provide these paid services via an internet platform or app? almost every week/almost every month/sporadically, i.e. several times a year/one-off activity /don't know /no answer On average, how many hours per week have you spent working in the past 12 months on these paid services? Number of hours /don't know /no answer On average, how many hours per month have you spent working in the past 12 months on these paid services? Number of hours /don't know /no answer Please estimate how many hours you have spent working in total in the past 12 months on these paid services: Number of hours /don't know /no answer What percentage of your income from your main job comes from the income from these paid services provided via an internet platform or app? Share as a %/don't know/no answer What percentage of your income from your second job comes from the income from these paid services provided via an internet platform or app? Share as a %/don't know/no answer Could you tell me your monthly gross income from these paid services provided via an internet platform or app? INCOME/don't know/no answer Could you estimate your monthly gross income from these paid services? Up to CHF 250 / CHF 251 – 500 / CHF 501 – 1000 / CHF 1001 – 2000 / CHF 2001 – 3000 / CHF 3001 - 4000 / CHF 4001 – 5000 / More than CHF 5000 / don't know / no answer Could you tell me your annual gross income from these paid services provided via an internet platform or app? INCOME/don't know/no answer Could you estimate your annual gross income from these paid services? Up to CHF 3000 / CHF 3001 - 6000 / CHF 6001 - 12000 / CHF 12000 - 24000 / CHF 24001 – 36000 / CHF 36001 – 48000 / CHF 48001 - 60000 / More than CHF 60000 / don't know / no answer What is the name of the internet platform or app that you use to provide the paid services? Airbnb/Flipkey/Uber/Lyft/Ebay/Ricardo/other internet platform/app:…/don't know/no answer. |
Switzerland, ICT usage survey 2017 and 2019, Enquêtes OMNIBUS TIC 2017 and 2019 |
In 2017: In the past 12 months, have you done paid work using any internet platform or application as an intermediary, e.g. TaskRabbit, Mechanical Turk, Freelance, etc. ? READ IF NECESSARY: Do not consider job posting sites but only sites where work is done and paid by task or mandate. 1) Yes, as main job 2) Yes, as a secondary or casual job 3) No 9) Don't know / No answer In 2019: The next question is about paid work obtained through a site or application. These may be physical tasks or services transmitted over the Internet, carried out for individuals or for companies. Any work that is paid by task or mandate should be considered, not just self-employment. 1) In the past 12 months, have you gotten paid work through any site or app, for example TaskRabbit, Mechanical Turk, Freelancer, Upwork, Batmaid, Uber, etc. ? Be careful, do not consider job posting sites and placement agencies. 2) Was the income from this work your main source of income? |
US CPS Computer and Internet Use Supplement (2017 and 2019) |
Have you offered own services for sale via the Internet (Examples include offering rentals on Airbnb and driving for Uber or Lyft. Do not include any goods or possessions sold online, such as clothing, shoes, or crafts.) |
US Federal Reserve (2018), Survey of Households Economics and Decision-making (SHED). |
In the past month, have you been paid for each of the following online occasional work activities or side jobs? Please do not include activities that you only do as part of your main job a. Completing paid online tasks, such as on Amazon Services, Mechanical Turk, Fiverr, Task Rabbit, or YouTube. (Y/N) b. Renting out property online, such as your car, your place of residence, etc. (Y/N) c. Selling goods on-line through eBay, Craigslist, or other websites (Y/N) d. Driving using a ride-sharing app such as Uber or Lyft. (Y/N) e. Other online paid activities (do not include taking GfK Surveys). (Y/N) |
US Federal Reserve (2019 and 2020), Survey of Households Economics and Decision-making (SHED) |
In the past month, have you been paid for each of the following activities? Childcare or eldercare services/Dog walking, feeding pets, or house sitting/House cleaning, yard work, or other property maintenance work/Driving or ride-sharing, such as with Uber or Lyft/Paid tasks online/Other paid personal tasks, such as deliveries, running errands, or helping people move Note: the Gig Economy section includes additional questions not reported here |
Bureau of Labor Statistics, May 2017 Contigent Worker Supplement |
Some people find short, IN-PERSON tasks or jobs through companies that connect them directly with customers using a website or mobile app. These companies also coordinate payment for the service through the app or website. For example, using your own car to drive people from one place to another, delivering something, or doing someone’s household tasks or errands. Does this describe ANY work you did LAST WEEK? Y/N Was that for your main job, your second job, or other additional work for pay? Main job Second job Additional work for pay Some people select short, ONLINE tasks or projects through companies that maintain lists that are accessed through an app or a website. These tasks are done entirely online and the companies coordinate payment for the work. For example, data entry, translating text, web or software development, or graphic design. Does this describe ANY work you did LAST WEEK? Y/N Was that for your main job, your second job, or other additional work for pay? Main job Second job Additional work for pay |
UK ONS (cognitive/qualitative pilot of questions for digital platform) |
In the last 12 months have you used a digital platform to find work on a short term, payment by task basis? Does the work you found on a digital platform provide your main source of earnings over the past three months? |
Source: OECD STI elaboration.
References
[30] A. StrømmenBakhtiar, &. (ed.) (2020), Digital platforms at work. Champagne or cocktail of risks?, Routledge, https://doi.org/10.4324/9780429293207.
[39] Abraham, K. and A. Amaya (2018), “Probing for Informal Work Activity”, NBER Working Paper 24880, https://www.nber.org/system/files/working_papers/w24880/w24880.pdf.
[26] Abraham, K. et al. (2018), “Measuring the Gig Economy: Current Knowledge and Open Issues”, NBER Working Paper 24950, https://www.nber.org/papers/w24950.
[10] Alsos, K. et al. (2017), “Når sjefen er en app”, Fafo-rapport, Vol. 2017/41, https://www.fafo.no/images/pub/2017/20649.pdf.
[4] Balaram, B., J. Warden and F. Wallace-Stephens (2017), Good Gigs: A fairer future for the UK’s gig economy, https://www.thersa.org/globalassets/pdfs/reports/rsa_good-gigs-fairer-gig-economy-report.pdf.
[25] Bernhardt, A. and S. Thomason (2017), What Do We Know About Gig Work in California? An Analysis of Independent Contracting, https://laborcenter.berkeley.edu/what-do-we-know-about-gig-work-in-california/.
[36] Board, F. (2020), Report on the Economic Well-Being of U.S. Households in 2019, Featuring Supplemental Data from April 2020, https://www.federalreserve.gov/publications/files/2019-report-economic-well-being-us-households-202005.pdf.
[22] Boeri et al. (2018), Social Protection for Independent Workers in the Digital Age, http://www.frdb.org/be/file/_scheda/files/01_Stephen_Machin.pdf.
[7] Bonin, H. and U. Rinne (2017), “Omnibusbefragung zur Verbesserung der Datenlage neuer Beschäftigungsformen”, IZA Research Report 80, http://ftp.iza.org/report_pdfs/iza_report_80.pdf.
[44] Broecke, S. (2018), Protecting workers from low pay in the future world of work: Are piece rate minimum wages part of the answer.
[40] Bureau of Labor Statistics (2018), “Electronically mediated work: new questions in the Contingent Worker Supplement”, Monthly Labor Review, https://www.bls.gov/opub/mlr/2018/article/electronically-mediated-work-new-questions-in-the-contingent-worker-supplement.htm (accessed on 2018).
[3] CIPD (2017), To gig or not to gig? Stories from the modern economy, https://www.cipd.co.uk/Images/to-gig-or-not-to-gig_2017-stories-from-the-modern-economy_tcm18-18955.pdf.
[35] Cirillo, V., D. Guarascio and S. Scicchitano (2019), Platform workers in Italy: an empirical exploration on worker-level data, http://oa.inapp.org/xmlui/handle/123456789/516?show=full.
[46] Collins et al. (2019), Is Gig Work Replacing Traditional Employment? Evidence from Two Decades of Tax Returns, https://www.irs.gov/pub/irs-soi/19rpgigworkreplacingtraditionalemployment.pdf.
[58] Cook, C. et al. (2018), The Gender Earnings Gap in the Gig Economy: Evidence from over a Million Rideshare Drivers, https://www.nber.org/system/files/working_papers/w24732/w24732.pdf.
[21] Drahokoupil, J. and A. Piasna (2019), Work in the Platform Economy: Deliveroo Riders in Belgium and the SMart Arrangement, https://www.etui.org/publications/working-papers/work-in-the-platform-economy-deliveroo-riders-in-belgium-and-the-smart-arrangement.
[15] Eurobarometer (2018), “The use of the collaborative economy”, Flash Eurobarometer 467.
[14] Eurobarometer (2016), “The use of Collaborative Platforms”, Flash Eurobarometer 438, http://ec.europa.eu/COMMFrontOffice/publicopinion/index.cfm/ResultDoc/download/DocumentKy/72885.
[19] Eurofound (2019), Mapping the contours of the platform economy, https://www.eurofound.europa.eu/data/platform-economy/records/mapping-the-contours-of-the-platform-economy.
[50] European Commission (2017), Europe’s Digital Progress Report (EDPR) 2017 Country Profile Belgium.
[54] Farrell, D. and F. Greig (2016), Paychecks, Paydays, and the Online Platform Economy - Big Data on Income Volatility, https://www.jpmorganchase.com/content/dam/jpmc/jpmorgan-chase-and-co/institute/pdf/jpmc-institute-volatility-2-report.pdf.
[55] Farrell, D., F. Greig and A. Hamoudi (2018), The Online Platform Economy in 2018: Drivers, Workers, Sellers, and Lessors, https://www.jpmorganchase.com/content/dam/jpmc/jpmorgan-chase-and-co/institute/pdf/institute-ope-2018.pdf.
[28] Finland, S. (2017), Labour force survey 2017: platform jobs, https://www.stat.fi/til/tyti/2017/14/tyti_2017_14_2018-04-17_en.pdf.
[53] Groen, W. and I. Maselli (2016), “The Impact of the Collaborative Economy on the Labour Market”, CEPS Special Report 138, https://www.ceps.eu/wp-content/uploads/2016/06/SR138CollaborativeEconomy_0.pdf.
[52] Harris, S. and A. Krueger (2015), “A Proposal for Modernizing Labor Laws for Twenty-First-Century Work: The “Independent Worker”, Hamilton Project Discussion Paper, Vol. 2015/10.
[49] HM Revenue and Customs (2018), The role of online platforms in ensuring tax compliance by their users, https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/754206/The_role_of_online_platforms_summary_of_responses.pdf.
[6] Huws, U. et al. (2019), The Platformisation of Work in Europe. Results from research in 13 European countries., Foundation for European Progressive Studies, UNI Global Union and University of Hertfordshire, https://www.feps-europe.eu/attachments/publications/the%20platformisation%20of%20work%20in%20europe%20-%20final%20corrected.pdf.
[23] Huws, U., N. Spencer and S. Joyce (2016), Crowd Work in Europe: Preliminary resultsfrom a survey in the UK, Sweden, Germany, Austria and the Netherlands, http://researchprofiles.herts.ac.uk/portal/files/10749125/crowd_work_in_europe_draft_report_last_version.pdf.
[20] ILO (2021), World Employment and Social Outlook 2021: The role of digital labour platforms in transforming the world of work, International Labour Organization, https://www.ilo.org/global/research/global-reports/weso/2021/WCMS_771749/lang--en/index.htm.
[9] ILO (2018), Digital labour platforms and the future of work: Towards decent work in the online world, International Labour Office, https://www.ilo.org/wcmsp5/groups/public/---dgreports/---dcomm/---publ/documents/publication/wcms_645337.pdf.
[41] Ilsøe, A. and L. Madsen (2017), “Digital af arbejdsmark: Danskernes erfaring med digital automatisering og digitale [Digitalization of the labour market - digital automation and digital platforms in Denmark]”, FAOS Forskningsnotat 157, https://faos.ku.dk/publikationer/forskningsnotater/fnotater-2017/Fnotat_157_-_Digitalisering_af_arbejdsmarkedet.pdf.
[45] INPS (2018), XVII Rapporto Annuale, https://www.inps.it/dati-ricerche-e-bilanci/rapporti-annuali/xvii-rapporto-annuale.
[42] Insee (2018), Emploi, chômage, revenus du travail, Insee, https://www.insee.fr/fr/statistiques/fichier/3573876/ecrt18.pdf.
[27] ISTAT (2021), Rilevazione sulle forze lavoro - Questionario 2021, ISTAT, https://www.istat.it/it/files//2021/02/Questionario_FdL_2021.pdf.
[11] Jesnes, K. et al. (2016), Aktører og arbeid I delingsøkonomien.
[57] Kässi, O. and V. Lehdonvirta (2018), “Online Labour Index: Measuring the Online Gig Economy for Policy and Research”, Technological Forecasting and Social Change, https://ilabour.oii.ox.ac.uk/new-publication-online-labour-index-measuring-the-online-gig-economy-for-policy-and-research/.
[60] Katz, L. and A. Krueger (2019), “The Rise and Nature of Alternative Work Arrangements in the United States, 1995-2015”, ILR Review, Vol. 72/2, pp. 382-416.
[1] Katz, L. and A. Krueger (2016), “The rise and nature of alternative work arrangements in the United States, 1995-2015”, Working paper, Vol. 226, https://scholar.harvard.edu/files/lkatz/files/katz_krueger_cws_resubmit_clean.pdf.
[37] Kostyshyna, O. and C. Luu (2019), The Size and Characteristics of Informal (“Gig”) Work in Canada, https://www.bankofcanada.ca/wp-content/uploads/2019/02/san2019-6.pdf.
[56] Koustas, D. (2019), “What do big data tell us about why people take gig economy jobs?”, https://www.aeaweb.org/articles?id=10.1257/pandp.20191041.
[8] Le Ludec, C., T. Tubaro and A. Casilli (2019), Combien de personnes microtravaillent en France ? Estimer l’ampleur d’une nouvelle forme de travail, http://diplab.eu/wp-content/uploads/2019/02/WPi3-19-SES-02-LeLudec-Tubaro-Casilli.pdf. (accessed on November 2020).
[5] Lepanjuuri K., W. (2018), The characteristics of those in the gig economy, United Kingdom Department for Business, Energy and Industrial Strategy, London., https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/687553/The_characteristics_of_those_in_the_gig_economy.pdf (accessed on November 2020).
[13] Manyika, J. et al. (2016), Independent work: Choice, necessity, and the gig economy, https://www.mckinsey.com/~/media/McKinsey/Featured%20Insights/Employment%20and%20Growth/Independent%20work%20Choice%20necessity%20and%20the%20gig%20economy/Independent-Work-Choice-necessity-and-the-gig-economy-Full-report.ashx.
[32] McDonald et al. (2019), Digital Platform Work in Australia: Prevalence, Nature and Impact, https://s3.ap-southeast-2.amazonaws.com/hdp.au.prod.app.vic-engage.files/7315/9254/1260/Digital_Platform_Work_in_Australia_-_Prevalence_Nature_and_Impact_-_November_2019.pdf.
[47] Moe, L., J. Parrott and J. Rochford (2020), The Magnitude of Low-Paid Gig and Independent Contract Work in New York State, https://static1.squarespace.com/static/53ee4f0be4b015b9c3690d84/t/5e424affd767af4f34c0d9a9/1581402883035/Feb112020_GigReport.pdf.
[59] Montagnier, P.; Ek, I. (2021), “AI measurement in ICT usage surveys: a review”, Digital Economy Papers No. 308, https://doi.org/10.1787/72cce754-en.
[24] OECD (2019), “Measuring platform mediated workers”, OECD Digital Economy Papers No. 282, https://doi.org/10.1787/170a14d9-en.
[48] OECD (2018), Tax Challenges Arising from Digitalisation – Interim Report 2018: Inclusive Framework on BEPS, OECD/G20 Base Erosion and Profit Shifting Project, OECD Publishing, Paris, https://doi.org/10.1787/9789264293083-en.
[43] Office for National Statistics (UK) (2016), The feasibility of measuring the sharing economy, https://www.ons.gov.uk/economy/economicoutputandproductivity/output/articles/thefeasibilityofmeasuringthesharingeconomy/2016-04-05.
[51] Ogembo, D. and V. Lehdonvirta (2020), “Taxing Earnings from the Platform Economy: An EU Digital Single Window for Income Data?”, British Tax Review, Vol. 1, pp. 82-101, https://eu2020-reader.bmas.de/en/new-work-human-centric-work/taxing-earnings-from-the-platform-economy-an-eu-digital-single-window-for-income-data%E2%80%8A1/.
[16] Pesole, A. et al. (2018), Platform Workers in Europe, Publications Office of the European Union, http://publications.jrc.ec.europa.eu/repository/bitstream/JRC112157/jrc112157_pubsy_platform_workers_in_europe_science_for_policy.pdf.
[2] Pew Research Center (2016), Gig Work, Online Selling and Home Sharing, http://www.pewinternet.org/2016/11/17/gig-work-online-selling-and-home-sharing/.
[18] Piasna, A. and J. Drahokoupil (2019), Digital labour in central and eastern Europe: evidence from the ETUI Internet and Platform Work Survey, European Trade Union Institute, https://www.etui.org/node/31491.
[34] Richet Damien, B. (2020), Micro-entrepreneurs immatriculés en 2018 : dans les transports, deux sur trois travaillent via une plateforme numérique, INSEE, https://www.insee.fr/fr/statistiques/fichier/version-html/4799082/IP1821.pdf.
[12] SOU (2017), Ett arbetsliv i förändring – hur påverkas ansvaret för arbetsmiljön?, https://www.regeringen.se/496173/contentassets/93df7ab18b704a8ab655080cb498dfd1/ett-arbetsliv-i-forandring--hur-paverkas-ansvaret-for-arbetsmiljon-sou-201724.
[38] Sung-Hee, J., H. Liu and Y. Ostrovsky (2019), Measuring the Gig Economy in Canada Using Administrative Data, Statistics Canada, https://www150.statcan.gc.ca/n1/pub/11f0019m/11f0019m2019025-eng.htm.
[29] Sutela, A. (2018), Platform jobs are here to stay – how to measure them?, http://www.stat.fi/tietotrendit/blogit/2018/platform-jobs-are-here-to-stay-how-to-measure-them/ (accessed on 11 December 2020).
[31] Swiss Federal Statistical Office (SFSO) (2020), Internet-mediated platform work is not very common in Switzerland, https://www.bfs.admin.ch/bfs/en/home/statistics/work-income/employment-working-hours/employed-persons/working-conditions/internet-platform-s.
[33] The State of Victoria (2020), Report of the Inquiry into the Victorian On-Demand Workforce, https://s3.ap-southeast-2.amazonaws.com/hdp.au.prod.app.vic-engage.files/4915/9469/1146/Report_of_the_Inquiry_into_the_Victorian_On-Demand_Workforce-reduced_size.pdf.
[17] Urzì Brancati, C., A. Pesole and E. Fernández-Macías (2020), New evidence on platform workers in Europe. Results from the second COLLEEM survey, Publications Office of the European Union, https://doi.org/10.2760/459278.
[61] Wikipedia (2020), Mark and recapture.
Notes
← 1. This chapter is mainly based on OECD (2019[24]).
← 2. The chapter includes studies whose aim is to estimate the size of digital platform employment drawing on quantitative methods, published by October 2020 in English (with the exception of a few studies in national languages). Although the chapter aimed at including as many available studies as possible, the evidence considered has to be intended as illustrative, rather than exhaustive.
← 3. This result was confirmed in (Katz and Krueger, 2019[60]), after the authors re-examined their results based on data from the CWS survey carried out in 2017, the RAND CWS 2015 survey and administrative tax data from the Internal Revenue Service (IRS) for 2000 to 2016. In line with (Farrell, Greig and Hamoudi, 2018[55]), they estimate that “only 0.5 percent to 1.5 percent of the workforce was engaged in online work for sample periods covering late 2015 to the end of 2017”.
← 4. Capture-recapture is a method commonly used in ecology to estimate an animal population's size where it is impractical to count every individual. A portion of the population is captured, marked, and released. Later, another portion will be captured and the number of marked individuals within the sample is counted. Since the number of marked individuals within the second sample should be proportional to the number of marked individuals in the whole population, an estimate of the total population size can be obtained by dividing the number of marked individuals by the proportion of marked individuals in the second sample (Wikipedia, 2020[61]).
← 5. Austria, Czech Republic, Estonia, Finland, France, Germany, Italy, the Netherlands, Slovenia, Spain, Sweden, Switzerland and the United Kingdom.
← 6. The French estimate fell to 11% in 2018, suggesting that understanding of the question by respondents changed over time.
← 7. Croatia, Czech Republic, Finland, France, Germany, Hungary, Ireland, Italy, Lithuania, the Netherlands, Portugal, Romania, Slovakia, Spain, Sweden and the United Kingdom.
← 8. “Platform work” in the original study.
← 9. “Platform mediated work” in the study.
← 10. The sample was constructed to be nationally representative according to gender, age and State/Territory and was administered by the Online Research Unit (ORU), an Australian-based online research panel provider.
← 11. “Gig-economy work” in the study.