Effects of economic and social incentives on bureaucratic quality

Experimental Evidence from Sierra Leone

Maarten Voors, Macartan Humphreys, Salif Jaiteh, Niccolo Meriggi, Carlo Prato, Peter van der Windt

Outline

  • Motivation
  • Model
  • Design
  • Results
  • Structural model

Motivation

Motivation

A challenge:

  • Quality of service provision is low in many developing countries

  • Recruiting and incentivizing service providers is difficult

A case: post Ebola epidemic in West Africa

  • Caught many by surprise, no early warning
  • Need for stronger decentralized bureaucracy
  • 7/10 emerging infectious diseases spill over from animals

Motivation

  • Local delivery models since 1990s: locally recruited actors, to deliver interventions or to do government tasks

  • Popular, …. but is little known when and how they work

  • Here: focus on agricultural extension workers

  • Largely unpaid, using entrepreneurial worker model

  • Agripreneur programs (World Bank, etc), but part of government system

Motivation

  • Most people live in rural areas and crucially depend on agriculture (crops and livestock)
  • Local animal welfare and disease risk go hand in hand
    • Sick animals are often eaten and cause health risk
    • Diseases are highly contagious
  • Need for surveillance: case-reporting, contact tracing, vaccine tracking, data management, response

Motivation

Promising work on improving service provision:

  1. Recruitment

  2. Community monitoring

  3. Financial incentives

We show:

  • evidence 2 and 3 matter
  • little movement on 1.
  • we use a structural model to explore why, and when these might be more effective.

Past Work on Recruitment

Theoretically:

Empirically:

Past Work on Recruitment

Past Work on Financial Incentives

By and large a success:

Past Work on Community Monitoring

Monitoring: involving communities

  • Original enthusiasm: “Power to the People” (Björkman and Svensson 2009)

    • How to improve service delivery and health outcomes in rural Uganda
  • Intensive treatment

    • Assess quality of services provided in clinic/community-specific report cards

    • Disseminate report cards to community and to clinic staff

    • Develop joint action plans

    • Interface meetings between clinic staff and community

Monitoring: involving communities

  • A small sample (n = 50)

  • And amazing results:

    • Infant weights significantly higher

    • Under-5 mortality 33% lower

    • Immunization rates higher

    • Staff absenteeism and waiting times at clinics lower

Raffler et al (2024) replication …

  • Same country, larger sample, teasing apart treatment components

Where does this leave us?

  • Candidate explanation: differences as baseline

Policy question

  1. Are performance-based payment schemes more or less effective than community monitoring mechanisms?
  2. Are there interaction effects between recruitment strategies and incentive mechanisms?
  • E.g. community monitoring may be less effective when service providers are selected by the state
  • They may be more effective if selected by communities, trusted, knowledgeable, present

Study design

We study these questions in the context of a randomized agricultural intervention in Sierra Leone.

Core design elements (more on context to come)

treatment label
T1 Agent is selected by community (T1 = 1) or by state (T1 = 0)
T2 Community can impose social sanctions on agent (T2 = 1) or not (T2 = 0)
T3 Agents receive pay for performance (T3 = 1) or not (T3 = 0)

Model

Model {.smaller} (base model)

After Francois (2000). A worker has type \(\theta = (\eta,\mu)\) where:

  • \(\eta \in \{ \underline{\eta} , 1 \}\) denotes embeddedness
  • \(\mu \in \{ 0 ,\overline{\mu} \}\) denotes intrinsic motivation

Drawn according to:

\({\mu}{\backslash}\eta\) \(\underline{\eta}\) 1
0 \(\frac{1+ \rho}{4}\) \(\frac{1- \rho}{4}\)
\(\overline{\mu}\) \(\frac{1- \rho}{4}\) \(\frac{1+ \rho}{4}\)

So \(\rho\) governs the correlation between embeddedness and motivation: embedded people are possibly more effective, but are they more likely to be highly motivated?

Selection (\(T_s\)) and type

  • Under state selection (\(T_s=0\)) the worker is a random draw from the candidate pool.
  • Under villager selection (\(T_s=1\)), the worker is drawn from the pool with high embeddedness.

So state is more likely to select workers with high intrinsic motivation if and only if \(\rho < 0\).

Performance

  • Workers choose effort \(e\)

  • Performance depends on effort and embeddedness: \(\pi = e \eta\)

  • Stochastic performance signal \(\sigma\), which is high (\(\sigma=1\)) with probability \(\pi\) or low (\(\sigma=0\)) with probability \(1-\pi\)

  • Cost of effort: \(c(e) = \frac{e^2}{2\kappa}\) (alternative use of time, with wage elasticity of effort \(\kappa\))

Villager (Monitoring, \(T_m\))

  • A representative villager selects a social sanctioning plan, which depends on the performance signal \(\sigma\):

\[s=(s(0),s(1)) \in [-T_m, T_m]^2.\]

  • Interpretable as commitments (additional) to reward (\(s(\pi)<0\)) or punish (\(s(\pi)>0\)) performance.

  • in line with Community Action Plan in experimental intervention (in CM)

Villager (Monitoring, \(T_m\))

  • Punishment may be psychologically costly, according to \(\gamma\).

Payoff to villager:

\[u(\pi, s) = \pi - \gamma s.\]

  • term \(\zeta\) captures village norms, impacts the probability that punishment is not costly for the villager

In crowding out version we have \(u(\pi, s) = \pi - s(\gamma - \xi T_p).\) (and replace \(s\) with \(-r\) to indicate rewards rather than sanctioning interpretation)

CAHW utility

Under pay-for-performance (\(T_p=1\)) and high performance signal (\(\sigma=1\)), the worker receives a payment normalized to 1

In addition:

  • \(\phi\): sensitivity to social sanctions
  • \(\mu\): intrinsic benefits from performing well
    • recall \(\pi = e \eta\)

Putting it all together:

\[w(e;s,\sigma;\theta) = \sigma T_p + \pi\mu - \phi s(\sigma) T_m - \frac{e^2}{2 \kappa},\]

Timeline

The sequence of events is as follows:

  1. Worker is selected by village (\(T_s=1\)) or state (\(T_s=0\)).
  2. Villagers and worker learn whether the latter is subject to community monitoring (\(T_m=1\)) and/or P4P (\(T_p=1\)).
  3. If \(T_m=1\), villager with guilt parameter \(\gamma\) commits to a conditional plan of social sanctioning \(\{s(\sigma)\}_{\sigma \in \{0,1\}}\).
  4. The worker chooses effort \(e\).
  5. The worker’s performance signal \(\sigma\) is realized.
  6. Payoffs are realized and the game ends.

Solution concept

An equilibrium is a pair of strategies \(\{ s,e(s;\theta) \}\) such that

  1. effort is individually rational for each type given the sanctioning strategy
  2. the sanctioning strategy maximizes the villager’s expected payoff given anticipated effect on the workers’ effort \(\hat{e}(s;\theta)\),
  3. expectations are correct (\(\hat{e}(s;\theta)=e(s;\theta)\) for each \(\theta\)) :

\[e(s;\theta) \in \arg \max_{e \in [0,1]} \mathbb{E}_{\pi } \Big\{ w(e;s,\sigma;\theta) \Big\}\] for \(T_m\)\[s \in \arg \max_{\{ (s(0),s(1)) \in [-T_m,T_m]^2 \}} \mathbb{E}_{\theta,\pi} \Big\{ u(\pi,s) \mid \hat{e}(s;\theta) \Big\}\]

Results

  • Sanctioning (\(T_m\)):
    • following a high signal: always praise the worker \(s(1)=-1\)
    • following a low signal: choose maximal shaming \(s(0)=1\) if guilt is low (\(\gamma=0\)) and minimal shaming \(s(0)=-1\) .
  • Effort:

\[e(s^*;\gamma,\theta) = \begin{cases} \kappa \eta (\mu + T_p + 2 \phi \zeta T_m) & \mbox{if} \quad \gamma =0 \\ \kappa \eta (\mu + T_p) \quad & \mbox{otherwise}. \end{cases}\]

Results: expected performance

Full closed form solution for all treatment conditions:

\((T_m,T_p) | T_s\)

State selection

(\(T_s=0\))

Community Selection

(\(T_s=1\))

Control \({\pi^*(T_s,0,0)}/{\kappa}\) \(\frac{\overline{\mu}}{2} \frac{1 + \rho + \underline{\eta}^2(1-\rho)}{2}\) \(\frac{\overline{\mu}}{2} (1 + \rho)\)
P4P \({\pi^*(T_s,0,1)}/{\kappa}\) \(\frac{\overline{\mu}}{2} \frac{1 + \rho + \underline{\eta}^2(1-\rho)}{2}+ \frac{1+ \underline{\eta}^2}{2}\) \(\frac{\overline{\mu}}{2} (1 + \rho)\) \(+1\)
CM \({\pi^*(T_s,1,0)}/{\kappa}\) \(\frac{\overline{\mu}}{2} \frac{1 + \rho + \underline{\eta}^2(1-\rho)}{2} +(1+ \underline{\eta}^2) \phi \zeta\) \(\frac{\overline{\mu}}{2} (1 + \rho) +2 \phi \zeta\)
P4P + CM \({\pi^*(T_s,1,1)}/{\kappa}\) \(\frac{\overline{\mu}}{2} \frac{1 + \rho + \underline{\eta}^2(1-\rho)}{2} +(1+ \underline{\eta}^2) \phi \zeta + \frac{1+ \underline{\eta}^2}{2}\) \(\frac{\overline{\mu}}{2} (1 + \rho) +2 \phi \zeta +1\)

Hypotheses derived from the model

H1: Village selection increases performance.

  • Explanation: Requires gains from embeddedness not crowded-out by any reductions in intrinsic motivation

H2: Community monitoring increases performance.

  • Explanation: Community monitoring (\(T_m\)=1) incentivizes worker performance through the associated probability of being publicly shamed for poor performance.

H3: Pay-for-performance increases performance.

  • Explanation: Pay for performance (\(T_p\)=1) increases performance due to the probability of receiving a monetary reward.

Hypotheses

H4: Positive interaction village selection and pay-for-performance.

  • Explanation: More productive workers are more responsive to extrinsic incentives (\(T_p\)=1).

H5: Positive interaction village selection and community monitoring.

  • Explanation: For more productive workers it is easier for villagers to commit to sanctioning

Community monitoring and pay-for-performance could be positive (if independent) or negative (if crowding out)

Design

Context: Sierra Leone

  • Poor service provision: mortality is 10% of live birthsqualk

  • Threat of zoonosis is high and expected to increase

  • Animals are essential for livelihoods (90% keep animals), comprising >50% of income

  • Low information and poor/risky animal husbandry practices

    • ~50% have frequent animal diseases, with high mortality
  • Animal diseases are highly contagious

  • Large impacts on households and largely preventable

Context: study site

  • In the wake of the Ebola epidemic, together with the GoSL, we implement a “One Health” intervention, addressing animal and human health

  • 363 villages across 7 chiefdoms in Kono district

Cross randomized treatments

One Health Program

  • Implemented from July 2017 to July 2019

  • Recruitment of Community Animal Health Worker: CAHW

    • 21-day training, implemented by veterinarians

    • Tool kit and drugs for treatment of basic animal diseases

    • Creation One Health platform

  • CAHW:

    • provides basic animal health services
    • demonstrates and provides information on best practices
    • reports suspected disease symptoms to MAF supervisors

One Health Program: 21-day training

Animal disease reporting form

Results

One Health Program results

  • Strong enthusiasm for the program: reporting throughout the period and beyond

  • No impact on human health, but impacts on intermediary outcomes

One Health Program: Results

  • From planner’s perspective it matters if we can improve CAHW performance:

    1. Recruitment

    2. Community monitoring

    3. Pay-for-performance

Recruitment

  • Community selection: MAF facilitators hold village meetings to nominate and select the CAHW candidate

  • “Business as usual”: CAHWs are recruited by state authorities in collaboration with Paramount Chiefs

  • Eligibility requirements, ability tests, language, residence

  • Training before assignment to incentives

Recruitment

  • Key design element: double listing

    • Obtain nominees from both Paramount Chief and community
    • Allows us to have the counter-factual

Incentives

Community Monitoring

  • CAHW and community develop joint action plans

  • Interface meetings between ministry staff and community:

    • Two times: after 6 months and 1.5 years
    • CAHW performance revealed (relative and overall)
    • Allows community members to reward or impose social sanctions

Incentives

Pay-for-Performance

  • CAHWs are paid based on their rank (across three groups)
  • Two times: after 6 months and 1.5 years

Note: rank ensure revenue neutrality but introduces small risk of non-independence / collusion

Treatment Implementation

  • Community monitoring and pay-for-performance implemented as designed

  • The recruitment treatment not so much

    • Only in 100 villages do we have true double-listing (in many other cases either same person listed twice or no one listed by one party)

    • Implication: smaller sample and non-experimental interactions

Cases: Assignments

Small amount of attrition

Does community selection affect CAHW type?