Publications

Documents
Better Regulation
OECD (2019)
Closing the regulatory cycle: effective ex post evaluation for improved policy outcomes (forthcoming)
1. The stock of laws and regulations has grown rapidly in most countries. However not all regulations will have been rigorously assessed, and even where they have, not all effects can be known with certainty in advance. Moreover, many of the features of an economy or society of relevance to particular regulations will change over time. The OECD Recommendation on Regulatory Policy and Governance (2012) therefore calls on governments to “[c]onduct systematic programme reviews of the stock of significant regulation against clearly defined policy goals, including consideration of costs and benefits, to ensure that regulations remain up to date, cost justified, cost effective and consistent, and deliver the intended policy objectives.” 2. The OECD Regulatory Policy Outlook 2015 found that the use of evidence and analysis in the regulatory process has to date mostly involved ex ante assessments. Given that the stock of regulation is much larger than the incremental flow, there is large potential for improving the existing regulatory framework through more systematic ex post evaluations of regulations. 3. The 9th OECD Conference on Measuring Regulatory Performance was concerned with the appropriate institutions and processes to effectively implement ex post evaluation. Discussions focussed on institutionalising ex post evaluation as an integral part of the regulatory cycle, the results of which feed back into the regulatory process itself. 4. The following considerations emerged from the discussions as central to the effective implementation of ex post regulatory reviews:  Ex post reviews need to go beyond a “costing exercise” to focus on whether the regulation’s underlying policy objectives have been achieved. In addition, evaluations should take into account any side-effects of regulations and include a consideration of possibly better alternatives.  A mix of different approaches to evaluation will generally be required, depending on the context, including reviews of regulations triggered by “sunsetting” clauses and statutory requirements, and ad hoc reviews. Comprehensive in-depth reviews or programme reviews that look at the mix of regulations and policy instruments in certain policy areas or sectors can identify options for more broad-ranging reforms. Evaluations triggered by “sunsetting” clauses or automatic review requirements might also be usefully packaged if they address similar or overlapping issues. Finally, ongoing ‘management’ of regulations, e.g. through stock-flow linkage rules or red tape reduction targets, can achieve significant reductions in administrative burdens  Evaluations that are built into the regulatory regime from the outset create a coherent link between ex ante and ex post evaluation to support evidence-based policy making throughout the regulatory cycle. This approach can ensure the setting of clear objectives and enables the early identification of an appropriate methodology and data needs.  While there is no “one-size-fits-all” institutional setting for ex post evaluation, independent bodies can play a key role in conducting reviews and providing 4 │ Closing the regulatory cycle: effective ex post evaluation for improved policy outcomes oversight of evaluations. The more ‘sensitive’ the regulatory area, and the more significant its impacts, the stronger the case for an ‘arm’s length’ review process. Less critical evaluations will normally be conducted by line ministries and agencies themselves. These can also benefit from some form of independent quality control. Regulatory reviews should not be carried out in isolation but pay attention to previous evaluations prepared by other institutions, including parliament and independent bodies.  Consultation with stakeholders is crucial to make sure evaluations are targeted appropriately and can be informed by the real-world impact of regulations. Consultation with stakeholders also helps ensure recommendations for improvement are practical and user-centred. At the same time, those responsible for evaluation need to account for the diversity of knowledge, resources and level of organisation of different stakeholder groups.  Getting the timing of evaluations right can greatly increase the impact of resulting recommendations within the policy-making process. Depending on the political system, an evaluation conducted at a time when parliament plans a new legislative initiative in a related policy area may have more impact than one conducted during an election campaign when results face a greater risk of becoming politicised. Evaluations may also help inform party programmes or coalition agreements when published at the right time.  The existence of stock-flow linkage rules such as ‘one-in x-out’ can provide an incentive and discipline for keeping regulatory costs in check. To be effective, such regimes should motivate proper evaluation of existing regulations proposed for removal including assessments against their objectives and broader public policy objectives.  In order to ensure the quality of ex post evaluations, governments need to invest in the required skills and capacities within the public sector. A number of academic disciplines are potentially needed, depending on the area of regulation being reviewed, but the key skills in common relate to the identification and measurement of impacts, whether social, environmental or economic
Documents
Better Regulation
European Commission (2018)
Study supporting the interim evaluation of the innovation principle
The European Commission has recognised the importance of a more innovationoriented EU acquis, gradually exploring the ways in which EU rules can support innovation. The ‘innovation principle’ was introduced to ensure that whenever policy is developed, the impact on innovation is fully assessed. However, as further discussed in this Study, the exact contours of the innovation principle have been shaped very gradually within the context of the EU better regulation agenda: originally advocated by industry in the context of the precautionary principle, the innovation principle has gradually been given a more articulate and consistent role, which aims at complementing the precautionary principle by increasing the salience of impacts on innovation during all phases of the policy cycle. This Study presents an evaluation of the current implementation of the innovation principle, limited to two of its three components, i.e. the Research and Innovation Tool included in the Better Regulation Toolbox, and the innovation deals. As a preliminary caveat, it is important to recall that the implementation of the innovation principle is still in its infancy, and thus the Study only represents a very early assessment of the extent to which the innovation principle is being correctly implemented, and whether changes would be required to make the principle more effective and useful in the context of the EU better regulation agenda. The main finding is that the innovation principle has the potential to contribute to the quality and future-proof nature of EU policy, but that significant changes and effort will be needed for this potential to fully materialise. The most evident areas for improvement are related to the lack of a clear legal basis, the lack of a widely acknowledged definition, the lack of awareness among EU officials and stakeholders, and the lack of adequate skills among those that are called to implement the innovation principle. As a result of these problems, the impact of the innovation principle on the innovation-friendliness of the EU acquis has been limited so far. The Commission should clarify in official documents that the Innovation principle does not entail a deregulatory approach, and is not incompatible with the precautionary principle: this would also help to have the principle fully recognised and endorsed by all EU institutions, as well as by civil society, often concerned with the possible anti-regulatory narrative around the innovation principle in stakeholder discussions. Apart from clarifications, and further dissemination and training, major improvements are possible in the near future, especially if the innovation principle is brought fully in line with the evolving data-driven nature of digital innovation and provides more guidance to the Commission on how to design experimental regulation, including inter alia so-called ‘regulatory sandboxes’. Finally, the Commission should ensure that the innovation principle is given prominence with the transition to the Horizon Europe programme, in particular due to the anticipated launch of ‘missions’ in key domains.
Documents
Artificial Intelligence and new technologies regulation
ESMA (2018)
FinTech: Regulatory sandboxes and innovation hubs
In recent years competent authorities in the EU have adopted various initiatives to facilitate financial innovation. These initiatives include the establishment of ‘innovation facilitators’. Innovation facilitators typically take the form of ‘innovation hubs’ and ‘regulatory sandboxes’. Innovation hubs provide a dedicated point of contact for firms to raise enquiries with competent authorities on FinTech-related issues and to seek non-binding guidance on regulatory and supervisory expectations, including licensing requirements. Regulatory sandboxes, on the other hand, are schemes to enable firms to test, pursuant to a specific testing plan agreed and monitored by a dedicated function of the competent authority, innovative financial products, financial services or business models. In this report the European Supervisory Authorities (the ESAs) set out a comparative analysis of the innovation facilitators established to date in the EU, further to the mandate specified in the European Commission’s March 2018 FinTech Action Plan.The ESAs also set out ‘best practices’ regarding the design and operation of innovation facilitators, informed by the results of the comparative analysis and the experiences of the national competent authorities in running the facilitators. The best practices are intended to provide indicative support for competent authorities when considering the establishment of, or reviewing the operation of innovation facilitators. Accordingly, the best practices are intended to promote convergence in the design and operation of innovation facilitators and thereby protect the level playing field. The ESAs also set out options, to be considered in the context of future EU-level work on innovation facilitators, including in conjunction with the European Commission’s future work, to promote coordination and cooperation between innovation facilitators and support the scaling-up of FinTech across the EU. These options comprise: • the development of Joint ESA own-initiative guidance on cooperation and coordination between innovation facilitators; • the creation of an EU network to bridge innovation facilitators established at the Member State level. The ESAs will continue to monitor national developments regarding innovation facilitators and take such steps as are appropriate to promote an accommodative and common approach towards FinTech in the EU.
Literature
Impact assessment
Bruni S., Mazzantini G. (2018)
Gli indicatori del Bes quali strumenti di better regulation per la quantificazione degli impatti nelle Air e nelle Vir
Il presente articolo illustra le sinergie che potrebbero essere ottenute dall’utilizzo di alcuni indicatori del Benessere equo e sostenibile (Bes) all’interno dei processi di Analisi d’impatto della regolazione (Air) e di Valutazione d’impatto della regolazione (Vir). Uno dei limiti spesso attribuiti alle Air e alle poche Vir realizzate nel nostro paese, infatti, è quello di valutare (nella migliore delle ipotesi) le opzioni prendendo in considerazione soltanto stime qualitative dei loro impatti, tralasciando di effettuare stime quantitative. I motivi di tale limite sono diversi, non ultimo la scarsa dimestichezza della nostra classe dirigente con strumenti di analisi valutazione delle politiche pubbliche. La crisi economica e lo stato dei conti pubblici, che, soprattutto in tempi recenti, hanno ridotto le possibilità di scelta dei decisori pubblici, chiamandoli ad una maggiore responsabilità nella scelta di dove destinare le sempre più scarse risorse pubbliche, impongono tuttavia di far ricorso a strumenti di better regulation che consentono di aumentare la qualità delle politiche pubbliche. Il ricorso ad alcuni indicatori del Bes, nonché la possibilità di elaborarne alcuni nuovi e ad hoc, potrebbero permettere, almeno nel breve periodo, di effettuare Air e Vir basate sulla stima quantitativa degli effetti delle regolazioni e, perciò, più efficaci e precise.
Literature
Artificial Intelligence and new technologies regulation
Yeung K. (2018)
Algorithmic Regulation: A Critical Interrogation
Innovations in networked digital communications technologies, including the rise of ‘Big Data’, ubiquitous computing and cloud storage systems, may be giving rise to a new system of social ordering known as algorithmic regulation. Algorithmic regulation refers to decision-making systems that regulate a domain of activity in order to manage risk or alter behaviour through continual computational generation of knowledge by systematically collecting data (in real time on a continuous basis) emitted directly from numerous dynamic components pertaining to the regulated environment in order to identify and, if necessary, automatically refine (or prompt refinement of) the system’s operations to attain a pre-specified goal. It provides a descriptive analysis of algorithmic regulation, classifying these decision-making systems as either reactive or pre-emptive, and offers a taxonomy that identifies 8 different forms of algorithmic regulation based on their configuration at each of the three stages of the cybernetic process: notably, at the level of standard setting (adaptive vs. fixed behavioural standards); information-gathering and monitoring (historic data vs. predictions based on inferred data) and at the level of sanction and behavioural change (automatic execution vs. recommender systems). It maps the contours of several emerging debates surrounding algorithmic regulation, drawing upon insights from regulatory governance studies, legal critiques, surveillance studies and critical data studies to highlight various concerns about the legitimacy of algorithmic regulation.