Empirical Project 3 Measuring the effect of a sugar tax

Learning objectives

In this project you will:

Key concepts

  • Concepts needed for this project: mean, frequency table, statistical significance, and p-value.
  • Concepts introduced in this project: natural experiment, differences-in-differences, and conditional mean.


CORE projects

This empirical project is related to material in:

  • Unit 3 of Economy, Society, and Public Policy
  • Unit 22 of The Economy.
natural experiment
An empirical study exploiting naturally occurring statistical controls in which researchers do not have the ability to assign participants to treatment and control groups, as is the case in conventional experiments. Instead, differences in law, policy, weather, or other events can offer the opportunity to analyse populations as if they had been part of an experiment. The validity of such studies depends on the premise that the assignment of subjects to the naturally occurring treatment and control groups can be plausibly argued to be random.

In Empirical Project 1, we mentioned that natural experiments can help us determine whether one variable causes another variable. A useful application of natural experiments is assessing the effects of a policy. To do so, we compare the outcomes of two groups both before and after the policy took effect:

If other factors that could affect the outcomes remain constant over the period considered, then we can reasonably conclude that any observed differences between the groups are due to the policy. Natural experiments therefore allow us to make causal statements about policies and outcomes.

A method that applies an experimental research design to outcomes observed in a natural experiment. It involves comparing the difference in the average outcomes of two groups, a treatment and control group, both before and after the treatment took place.

The method of comparing the treatment and control groups, both before and after the treatment took place, is known in economics as differences-in-differences. Unlike lab experiments, in natural experiments we cannot choose exactly who receives the treatment. The reason why we need to compare the two groups before the treatment took place is to take account of any pre-existing differences between the two groups, for example differences in age (for people) or characteristics (for products).

We will use the 2014 sugar tax in the US to learn how before-and-after comparisons are done in practice. Sugar-sweetened beverages (SSBs) are considered unhealthy because of their link to conditions such as diabetes and obesity. In November 2014, the city of Berkeley in California became the first US jurisdiction to implement a tax on SSB distributors, with the aim of discouraging SSB consumption. The tax of one cent per fluid ounce meant that if retailers raised their prices to exactly counter the effects of the tax, a $1 can of soda (12 oz) would now cost $1.12. But did sellers actually respond this way? And what effects did the tax have on shoppers’ expenditure on sugary beverages?

A group of researchers did a differences-in-differences study of the effects of this SSB tax, which you can read about in a Forbes article. Figure 3.1 summarizes the timeline of the tax, and the data that they collected and published in a 2017 PLoS Medicine journal paper. We will make before-and-after comparisons using the data they collected, in order to learn about the effects of the sugar tax.

Berkeley sugar-sweetened beverages tax implementation and evaluation timeline.

Figure 3.1 Berkeley sugar-sweetened beverages tax implementation and evaluation timeline.

Lynn D. Silver, Shu Wen Ng, Suzanne Ryan-Ibarra, Lindsey Smith Taillie, Marta Induni, Donna R. Miles Jennifer M. Poti, and Barry M. Popkin. 2017. Figure 1 in ‘Changes in prices, sales, consumer spending, and beverage consumption one year after a tax on sugar-sweetened beverages in Berkeley, California, US: A before-and-after study’. PLoS Med 14 (4): e1002283.

Working in Excel

Working in R