Multiple randomised field experiments confirm that door-to-door canvassing and live telephone calls are effective methods of moving voters to the polls, but they require significant investments of time and resources and are difficult to bring to scale. In contrast, methods such as email, text messaging, or messages posted on social media networks are less resource-intensive and are easily expanded to large numbers of target voters. In this paper, we test the effectiveness of short candidate videos sent to eligible voters using the popular smartphone application WhatsApp. Using a set of randomised field experiments conducted during the 2014 elections in Brazil, we make two contributions to the literature. First, we find that short videos delivered via WhatsApp are a powerful method of increasing turnout among teen voters, confirming our hypothesis about how today’s teens think about the networked publics in which they participate. Second, we add Brazil to the list of countries in which the traditional method of door-to-door canvassing has been proven a powerful method of mobilising voters.
This paper is part of
Democracies are sustained by active participation of the governed. The desire to win an election (or to be reelected) motivates, in theory, the behaviour of public officials, as election results provide guidance regarding public preferences and ongoing elections serve as renewals of the social contract, providing legitimacy to elected officials. While compulsory for many citizens in some democracies, voting is voluntary for most voters, and many eligible citizens in those countries regularly fail to participate in elections. In the United States, for example, turnout in presidential elections hovers at about 60%, and turnout in midterm and local elections is much lower. Turnout is also often quite low in Latin American countries (compared to Northern Europe, where it tends to be higher) without compulsory voting, including Chile (42% in the 2013 presidential election), Colombia (47.9% in the 2014 presidential election), and El Salvador (60.2% in the 2014 presidential election). Further, active voters are often unrepresentative of the broader public, raising concerns about political representation.
Political scientists have long been interested in ways to increase voter turnout. In the last 15 years, they have increasingly turned to randomised field experiments to determine best practices for getting out the vote (Druckman et al., 2011). Pioneered in the 1920s, but unpopular for many decades, interest in get-out-the-vote (GOTV) experiments was rekindled in 2000 with an experiment that employed door-to-door canvassing, live telephone calls, and direct mail to increase participation among voters in New Haven, Connecticut, USA (Gerber & Green, 2000).
Using field experiments, scholars have identified many of the mechanisms that move citizens to vote. Face-to-face and live telephone communication increases participation, while electronic, mass media, and mailed communications (messages delivered via robocalls, mailers, leaflets, email, text message, television, or radio), often referred to as indirect methods, tend to have weak to negligible effects (Green & Gerber, 2015; García Bedolla & Michelson, 2012). There are some important caveats to these general findings. For example, impersonal methods such as direct mail or robocalls that include a social pressure component have been found to effectively increase turnout (Green, Aronow, & McGrath, 2013). However, social pressure messages can generate voter backlash, making these kinds of messages less attractive to candidates and campaigns (Matland & Murray, 2013; Mann, 2010).
Most of this research has been conducted in the United States, but more recent scholarship has extended GOTV work to other parts of the world, including Benin, China, England, France, India, Japan and Sweden. In the largest such effort to date, Guillaume Liégey, Arthur Muller, and Vincent Pons (2013) worked with the 2012 François Holland campaign in France, finding that door-to-door canvassing effectively moved French voters to the polls. Bhatti et al. (2016) conducted a meta-analysis of door-to-door efforts in Europe between 2005 and 2014, including experiments conducted in England, France, Italy, Spain and Sweden along with their own efforts in Denmark. They calculated an average effect of just 0.78 percentage-points, far smaller than that found for efforts conducted in the US. Further testing in contexts other than the United States is needed to better understand which best practices are universal and which are dependent on local political cultures.
A related trend in GOTV research is that target populations are increasingly difficult to reach using traditional methods, leading practitioners and scholars to explore different communication methods (Green & Gerber, 2015; Issenberg, 2012). Door-to-door efforts, at times very powerful, are time consuming and expensive, in part because targeted voters are not always at home waiting to be contacted. Telephone canvassing is more cost-efficient, but targets are increasingly unwilling to answer calls from unknown or unidentified numbers, making strong contact rates, and thus treatment effects, elusive. Door-to-door and telephone canvassing effectiveness is also sensitive to call quality, adding challenges of supervision to GOTV campaigns (Nickerson, 2007a; Mann and Klofstad, 2015). In contrast, the content and quality of GOTV messages delivered via text messages, email, or social networking sites are more easily controlled, and researchers are increasingly exploring how to make these methods effective. Green and Gerber identify three advantages to the use of digital campaigns. First, cost. Not including the cost of content production, email, text, and video messages can, sometimes, be distributed at negligible expense. Second, recipients can forward these messages to their family and friends, providing additional (free) exposure and even the possibility of a message going viral. Finally, the flexibility of the platform allows for improved behaviour- and demographic-based targeting, two-way communication, and embedded links to websites where recipients can learn more about a candidate or get involved in a campaign. The pressing question is whether such campaigns are effective; experiments conducted to date, which we review below, provide limited evidence that these campaigns are able to move voters to the polls.
In this paper, we provide evidence that such a strategy can have dramatic results. In a set of GOTV experiments conducted in 2014 in Brazil, using the WhatsApp smartphone app and a series of messages developed by real candidates, we find large increases in voter turnout among younger voters randomly assigned to receive WhatsApp video messages. To our knowledge, these experiments are the first to test the power of WhatsApp video messages as a voter mobilisation tool.
These experiments are also the first to intentionally test GOTV messages in a regular election in Brazil. A 2008 field experiment during a mayoral runoff election in São Paulo that aimed to test the effects of information on vote choice also found that informing voters that a challenger had a record of corruption decreased turnout by 1.9 percentage points (de Figueiredo, Hidalgo, & Kasahara, 2014). Fujiwara (2015), exploiting the discontinuous introduction of electronic voting in various states in Brazil in the mid-1990s, finds that the introduction of the technology generates significant increases in voter participation among less educated citizens. Another earlier GOTV effort in Brazil focused on an online June 2014 participatory budgeting vote in Rio Grande do Sul in southern Brazil. Individuals assigned to the treatment condition were each sent three emails and a mobile phone text message, and were 4.7 percentage-points more likely to vote compared to those assigned to the control condition (Peixoto, Sjoberg, & Mellon, 2017).
The remainder of this paper proceeds as follows. First, we review the GOTV literature, focusing on distinctions drawn in previous scholarship between personal and impersonal methods of contact with targeted voters. We then briefly describe the breadth of the use of smartphones and messaging applications such as WhatsApp in Brazil and elsewhere, setting the stage for our hypotheses. Following a description of these hypotheses, we turn to the context of the Brazilian elections and the candidates with whom we partnered to conduct these experiments. We then describe and discuss our results.
The bulk of GOTV experimental field literature finds that the strongest effects on turnout are produced through personal interactions with voters. Gerber and Green (2000) argue, based on the US case, that low turnout during the second half of the 20th century is possibly due to the rise of impersonal campaign methods, such as direct mail and television advertisements, and the decline of personal contact in mass organisations (Rosenstone & Hansen, 1993; Putnam, 2000). While more expensive, hundreds of field experiments in a variety of electoral contexts and with different target populations have found that face-to-face contact with voters is the most powerful mobilisation method (Green & Gerber, 2015; García Bedolla & Michelson, 2012). Personal telephone calls are also a very effective, albeit expensive, method, particularly when callers are trained to be conversational and are well supervised (Nickerson, 2007b; Mann & Klofstad, 2015). When callers who have made a commitment to vote are re-contacted just before the election, telephone calls can generate increases in turnout equal to or surpassing those generated by single door-to-door contacts (Michelson, García Bedolla, & McConnell, 2009).
In contrast, most methods of impersonal GOTV have proven weak to ineffective in moving voters to the polls. Impersonal methods include messages sent directly to individual voters, such as direct mail (Green & Gerber, 2015), text messages (Dale & Strauss, 2009; Malhotra et al., 2011), email messages (Nickerson, 2006; Malhotra et al., 2012), and robocalls (Green & Gerber, 2015), and also mass media messages such as television and radio advertisements (Green & Vavreck, 2006; Panagopoulos & Green, 2011) and banner messages and general paid advertisements on Facebook (Bond et al., 2012; Collins, Kalla, & Keane, 2014). Moving beyond the US, scholars in Denmark found a small but statistically significant effect of text messages (Bhatti et al., 2017). A text message experiment in Norway (Bergh, Christensen, & Matland, 2016) generated similar results among Norwegian natives, and even stronger effects among immigrants. As noted above, an experiment in Brazil in 2014 using a combination of emails and text messages had a relatively large effect on turnout (Peixoto, Sjoberg, & Mellon, 2017).
Direct mail that includes a social pressure component, such as information about the voting recipient and her neighbours, generates larger increases in turnout (Gerber, Green, & Larimer, 2008; Panagopoulos, 2010; Rogers et al., 2017); however, as noted above, these tactics also generate significant negative backlash from recipients and the media (Matland & Murray, 2013; Mann, 2010). Pooling together 85 GOTV distinct studies conducted between 1998 and 2014, Green and Gerber (2015) find that sending a piece of mail increases turnout by about ¾ of a percentage point, although social pressure mailers have an average effect of 2.3 percentage points. Mail has also been found to be effective in experiments conducted in the UK and Ireland (Fieldhouse et al., 2013; Regan, 2013).
Other small, labour-intensive efforts have also generated sizeable increases in turnout using impersonal messages sent within personal networks, including the use of Facebook status updates (Teresi & Michelson, 2014; Haenschen, 2016) and friend-to-friend email messages (Davenport, 2008).
The bulk of the experimental field literature on voter mobilisation has emphasised the importance of social connectedness (Green & Gerber, 2015), which is challenged by Noticeable Reminder Theory (Dale & Strauss, 2009). Dale and Strauss posit that the strong effect of text messages proves that it is not the personal nature of other GOTV messaging methods that is key to their effectiveness, but rather that they are noticeable. This is consistent with the disparate findings of email and Facebook experiments noted above: emails sent by personal friends or trusted sources (Davenport, 2008; Malhotra et al., 2012) and Facebook status messages from friends (Teresi and Michelson, 2014; Haenschen, 2016) generate relatively large increases in turnout, while email sent from other sources (Nickerson, 2007b; Stollwerk, 2015) and Facebook banner advertisements (Bond et al., 2012; Collins, Kalla, and Keane, 2014) generate small or negligible increases in turnout.
In sum, previous experimental research finds that GOTV messages sent via impersonal delivery methods will be effective if they are interpreted as personal by recipients, or if they are more noticeable. Here, we explore a third possibility: that while door-to-door canvassing will be interpreted as personal by all recipients, messages delivered by text message will be interpreted as personal by younger recipients and as impersonal by older recipients. We further hypothesise that text message reminders to vote will be more effective among younger recipients because they are more likely than older voters to have mobile internet.
The use of online media is widespread among today’s youth. According to a survey of American 13- to 17-year-olds conducted in early 2012, teens are avid, daily users of social media: 75% have a profile on a social networking site and 68% text every day (Common Sense Media, 2012). Thompson (2014) reports that many younger smartphone users are more likely to use messaging applications (apps) than email, and they use these apps multiple times a day. Today’s youth use their mobile phones and the internet to establish community and connections (Agger, 2013). Teenagers are coming of age in an era of mediated communication, where lines between physical and digital interaction are increasingly entangled and blurry (boyd, 2014). According to boyd, participation in social media is an essential part of the lives of today’s teenagers. “[E]ngagement with social media is simply an everyday part of life, akin to watching television and using the phone” (boyd, 2014: 22). “When teens turn to networked publics, they do so to hang out with friends and be recognized by peers. They share in order to see and be seen” (boyd, 2014: 217).
In sum, for some American younger voters, particularly teenagers, interactions with their online publics may be just as personal and meaningful as face-to-face interactions. This suggests GOTV messages delivered via those communities may be just as powerful for teenagers as door-to-door canvassing and phone calls are for older voters. As described below, we test and find significant support for this hypothesis from our GOTV experiments in Brazil.
First introduced to consumers in the late 1990s, smartphones are mobile telephones that include an operating system, allowing access to the internet and the use of third party apps. Feature phones (traditional mobile phones) can send and receive text messages; smartphones allow users to send not just texts but also photos and videos using apps such as Facebook Messenger, Skype, Snapchat, and WhatsApp. Facebook Messenger dominates the market in the United States; globally, smartphone users prefer WhatsApp (Statista, 2017a; Statista, 2017b).
Smartphone use is widespread in Brazil, fueled by the recent development of 4G networks and tax-break prompted investment in the local market (partly in preparation for the 2014 FIFA World Cup and the 2016 Summer Olympics). As of January 2015, Brazil boasted the largest smartphone market in Latin America; nearly one in three Brazilians have internet access on their mobile phone, and WhatsApp has over 45 million users (over 20% of Brazilians). Businesses, political candidates, and even the country’s national soccer team have turned to WhatsApp as a means of communicating with the public. In early 2014, a Head & Shoulders shampoo campaign used short, sharable WhatsApp videos featuring Joel Santana, head coach for the Brazilian national team Vasco da Gama; in May 2014, Hellmann’s mayonnaise used WhatsApp to promote the product; June 2014 saw a WhatsApp campaign for Chivas Regal whiskey (Teixeira, 2014).
WhatsApp is also increasingly popular with politicians. In the 2014 presidential elections, candidates used WhatsApp to communicate with voters, while voters used it to share political preferences. One presidential candidate, Aécio Neves, was a robust user of the app; his party sent 33 WhatsApp messages during the campaign, one of which became the most popular piece of content circulated during the elections (Glickhouse, 2015). Young candidates in legislative races also used WhatsApp to interact with voters (Idoeta, 2014). On the last day of the 2014 elections, former President Dilma sent WhatsApp messages to 35 million voters.
We began our GOTV experiments by inviting various candidates for the federal and state legislatures in Brazil to cooperate with us. Of 28 invited candidates, four agreed to participate. These included candidates for the Federal Congress in Rio de Janeiro and Amazonas and candidates for the State Congress in Santa Catarina (Florianópolis) and São Paulo. The candidates included at least one member of all three major political parties in Brazil: the Workers’ Party (PT) in São Paulo, the Brazilian Social Democracy Party (PSDB) in Amazonas, and the Brazilian Democratic Movement Party (PMDB) in Rio de Janeiro and Santa Catarina. Two candidates were challengers and two were incumbents; three were successfully elected (the two incumbents and one challenger). In order to maintain their anonymity, and in conformity with Brazil’s research code (the Fundo de Amparo a Pesquisa do Estado de Sao Paulo, FAPESP), we refer throughout the remainder of this paper only to the names of the four municipalities in which the candidates were located.
In each geographic area, the candidate reached out to voters in the treatment group with information about themselves, their record, and their platform. Candidates controlled the content of the messages; our role was to randomise the treatment and control groups and instruct the campaigns about which voters to target with each type of message (a door-to-door visit, a robocall, an email, or a WhatsApp video message), similar to how Alan Gerber and his colleagues partnered with Rick Perry in Texas in 2006 (Gerber et al., 2011).
While voting is compulsory in Brazil, the law exempts those aged 16 and 17 and over age 70 (as well as illiterate voters). In 2014, these two segments represented 8.67% of eligible voters (Table 1). Our experiments targeted very small percentages of voters in each geographic area: 1,181 people in Rio de Janeiro, 833 in São Paulo, 487 in Santa Catarina, and 366 in Amazonas.
16-17 years old |
70+ years old |
All eligible voters |
|||
N |
% |
N |
% |
N |
|
Amazonas |
38,278 |
1.72 |
119,421 |
5.36 |
2,226,891 |
Rio de Janeiro |
75,487 |
0.62 |
1,186,728 |
9.77 |
12,141,145 |
Santa Catarina |
45,715 |
0.94 |
345,121 |
7.10 |
4,859,324 |
São Paulo |
231,076 |
0.72 |
2,519,149 |
7.87 |
31,998,432 |
Brazil |
1,719,404 |
1.20 |
10,670,989 |
7.47 |
142,825,280 |
Source: TSE 2014. Illiterate voters are also exempt from compulsory voting laws in Brazil. They are not included in these experiments.
Another important aspect of the context of these experiments is that the 2014 elections in Brazil were extremely competitive, with the second round re-election of Dilma Rousseff of the PT as president of Brazil by just 3 percentage points over her opponent, Aécio Neves of the PSDB, 51.64% to 48.36%, with over 105.5 million valid votes cast.
Varying levels of support for the PT and PDSB are relevant to the GOTV efforts examined here because we partnered with candidates to deliver the treatment messages. In other words, responses to these calls to vote may partially reflect support for or opposition to the particular candidates and parties making the GOTV requests. In São Paulo, for example, the candidate we partnered with was affiliated with the PT; the PT lost in São Paulo in the presidential, state governor, and state senate elections, and lost seats in the federal and state congresses. The PT candidate’s efforts to increase turnout among the target groups in that area may therefore have been less successful than otherwise because they were advocating turnout in favour of a candidate from a locally unpopular political party. In Amazonas, our partnering candidate was a PSDB federal congress candidate. Outreach was focused on eligible voters in the city of Manaus, whose mayor is a famous member of the party. Our partnering candidates in Rio de Janeiro and Santa Catarina were from the PMDB, one each for the federal and state legislatures. The PMDB has strong support in Rio de Janeiro, including the elected mayor and governor, but the party there is divided and many members supported PSDB’s Aécio Neves for the presidency.
Another aspect of the Brazilian context relevant to our experiments is the different socioeconomic status of targeted voters. For those targeted via WhatsApp in particular, levels of income and employment serve as proxies for smartphone ownership and thus the ability to receive and respond to the GOTV messages. These socioeconomic indicators may also serve as proxies for support for the two political parties, and thus openness to persuasion when receiving a blandishment to vote from a candidate. As shown in Table 2, Amazonas has the lowest levels of per capita income and education and the highest rate of unemployment; thus, it is possible that GOTV outreach in Amazonas that is dependent on personal ownership of a smartphone will be less successful compared to similar outreach in other areas. In other words, we expect the failure-to-treat effect to be larger.
Amazonas |
Rio de Janeiro |
Santa Catarina |
São Paulo |
Brazil |
|
Per capita average income |
R$ 461 |
R$ 1,193 |
R$ 1,245 |
R$ 1,432 |
RS 1,052 |
Unemployment rate |
9.7% |
7.5% |
3.1% |
6.6% |
6.5% |
Gini coefficient |
0.478 |
0.489 |
0.436 |
0.474 |
0.498 |
National GDP participation |
1.5% |
11.5% |
4% |
32.1% |
100% |
Unschooled and incomplete basic education |
53.6 |
41.5 |
45.5 |
41.9 |
50.2 |
Complete basic education and incomplete high school |
16.2 |
18.9 |
19.5 |
18.7 |
17.4 |
Complete high school and incomplete higher education |
24.1 |
28.1 |
24.8 |
26.8 |
23.5 |
Complete higher education |
5.3 |
10.9 |
9.7 |
11.7 |
8.3 |
Source: IBGE/Censo, 2010; IBGE, 2012; IBGE, 2015; PNAD, 2013. The Gini coefficient is a World Bank estimate of inequality; lower values indicate less inequality (see http://data.worldbank.org/indicator/SI.POV.GINI)
Our GOTV experiments in Brazil tested the effectiveness of door-to-door canvassing, email messages, robocalls, and WhatsApp video messages. As noted above, voting is compulsory in Brazil for adults aged 18 to 70; thus, we focused on those segments of the electorate not included in compulsory voting laws (those aged 16 to 17 or over 70). Given previous GOTV experimental results, we hypothesised that door-to-door canvassing would be the most effective method of increasing turnout, that WhatsApp would have a statistically significant effect in turnout among younger voters, and that email messages and robocalls would fail to mobilise voters. Details of the various methods used in the experiments are provided below. We also expected older voters to be easier to move across the cusp of deciding to vote due to an established voting habit from years of compulsory voting, and that older voters would be more easily contacted via door-to-door visits than teen voters.
Methods used in each municipality varied based on the preferences of the local candidate (see Table 3). Within each zone (determined by the candidates), treatment conditions were assigned randomly by residential section. One section was randomly assigned to each of the treatment groups and to the control group. Rio de Janeiro and São Paolo each have 20 sections, Santa Catarina has 16 sections, and Amazonas has 15 sections. Unfortunately, we cannot test for covariate balance using data from past elections because voter history information is unavailable. Instead, we test for balance in the covariates for which data is available: age and gender (see Appendix). Because treatment conditions were assigned randomly by residential section, the instrumental variable analyses below cluster by section to provide robust standard error estimates. There is only one section per zone assigned to each type of GOTV outreach.
Amazonas |
Rio de Janeiro |
Santa Catarina |
São Paulo |
|
Door-to-door |
X |
X |
||
|
X |
X |
X |
|
Robocalls |
X |
X |
X |
|
|
X |
X |
X |
After the election, as described in Table 3, we compared turnout in the treatment and control groups for each GOTV method and for each age group (older than 70 and younger than 18). Turnout data was collected at the individual level and is based on validated turnout information from the government. Contact for the door-to-door canvassing arms of the experiments is measured as the canvasser successfully speaking face-to-face with the targeted voter. Because not all individuals in the groups targeted for door-to-door canvassing were successfully contacted, we conduct 2SLS regression to take into consideration the failure to contact some voters by regressing contact on assignment to the treatment group. For the WhatsApp, email, and robocall treatment groups, we assume all targeted individuals were successfully treated. Note that the subject line in the email messages included language about participating in the election, which means that even those individuals who did not open the messages were likely exposed to some information about voting.
Looking first at the WhatsApp treatment, we see significant effects in several experiments (Table 4). Youth in Rio de Janeiro and Santa Catarina who were sent a WhatsApp message about the election were significantly more likely to vote, by 76.51 percentage points in Rio and by 44.05 percentage points in Santa Catarina; both of these differences are statistically significant at the
% voting, control group |
% voting, treatment group |
Intent-to-treat effect |
|
Amazonas >70 |
14.47 (11/76) |
11.76 (8/68) |
-2.71 (5.68) |
Amazonas <18 |
16.33 98/49) |
20.00 (9/45) |
3.67 (8.02) |
Rio de Janeiro >70 |
10.65 (18/169) |
14.92 (27/181) |
4.27 (3.58) |
Rio de Janeiro <18 |
12.38 (13/105) |
88.89 (96/108) |
76.51** (4.43) |
Santa Catarina >70 |
11.11 (9/81) |
12.5 (9/72) |
1.39 (5.25) |
Santa Catarina <18 |
14.29 (6/42) |
58.33 (28/48) |
44.05** (9.23) |
** =
As noted above (Table 2) Rio de Janeiro and Santa Catarina are states with higher than average per capita incomes, education and employment, compared to Amazonas. Thus, individuals in Amazonas are less likely to have smartphones on which they can access WhatsApp. For this experiment, candidates sent messages to mobile phone numbers. We neither have information about the type of mobile phone the individuals used nor are we able to determine if intended recipients successfully received the WhatsApp messages.
We next examine door-to-door treatment effects, controlling for contact (Table 5). Door-to-door canvassing was conducted in São Paulo and Rio de Janeiro. For all four groups, individuals randomly assigned to the treatment group were more likely to vote than were those randomly assigned to the control group.
% voting, control group |
% voting, treatment group |
Intent-to-treat effect (SE) |
Contact rate |
Treatment-on-treated effect (SE) |
|
Rio de Janeiro >70 |
10.65 (18/169) |
77.04 (151/196) |
66.39** (3.93) |
95.92 (188/196) |
69.22** (0.00) |
Rio de Janeiro <18 |
12.38 (13/105) |
75.00 (93/124) |
62.62** (5.18) |
97.58 (121/124) |
64.17** (0.00) |
São Paulo >70 |
20.31 (26/128) |
60.98 (75/123) |
40.66** (5.66) |
82.93 (102/123) |
49.03** (0.00) |
São Paulo <18 |
11.46 (11/96) |
30.36 (17/56) |
18.90** (6.38) |
87.50 (49/56) |
21.60** (0.00) |
** =
The effect of the door-to door visits persists in a 2SLS analysis, using assignment to the treatment group as an instrument for contact and clustering by section to provide robust standard errors. In Rio de Janeiro, instrumental variable regression generates a treatment-on-treated estimate of 69.22 percentage points (SE=0.00) for older voters and 64.17 percentage points (SE=0.00) for younger voters. The effects are weaker but still impressive in São Paulo, where the estimated treatment-on-treated effects are 49.03 percentage points (SE=0.00) for older voters and 21.60 percentage points (SE=0.00) for younger voters. These effects are much larger than those found in previous door-to-door GOTV field experiments, although they are on par with some results from California (García Bedolla & Michelson, 2012). We speculate below about reasons for the unusual magnitude of our findings.
We next examined the effect of email messages (Table 6) and robocalls (Table 7). As expected based on previous research, these methods have no measurable effects on turnout; differences in voter turnout between the control and treatment groups are small, with large standard errors.
% voting, control group |
% voting, treatment group |
Intent-to-treat effect (SE) |
|
Rio de Janeiro >70 |
10.65 (18/169) |
9.64 (16/166) |
-1.01 (3.31) |
Rio de Janeiro <18 |
12.38 (13/105) |
13.64 (18/132) |
1.26 (4.42) |
Santa Catarina >70 |
11.11 (9/81) |
10.29 (7/68) |
-0.82 (5.13) |
Santa Catarina <18 |
14.29 (6/42) |
17.02 (8/47) |
2.73 (7.81) |
São Paulo >70 |
20.31 (26/128) |
21.57 (22/102) |
1.26 (5.42) |
São Paulo <18 |
11.46 (11/96) |
9.33 (14/150) |
-2.13 (3.96) |
% voting, control group |
% voting, treatment group |
Intent-to-treat effect |
|
Amazonas >70 |
14.47 (11/76) |
10.98 (9/82) |
-3.50 (5.32) |
Amazonas <18 |
16.33 98/49) |
13.04 (6/46) |
-3.28 (7.34) |
Santa Catarina >70 |
11.11 (9/81) |
7.89 (6/76) |
-3.22 (4.72) |
Santa Catarina <18 |
14.29 (6/42) |
9.43 (5/53) |
-4.85 (6.66) |
São Paulo >70 |
20.31 (26/128) |
15.69 (16/102) |
-4.63 (5.14) |
São Paulo <18 |
11.46 (11/96) |
9.21 (7/76) |
-2.25 (4.72) |
Hundreds of field experiments conducted over the past two decades have led to significant advances in our understanding of how to increase voter turnout. Modeling the path-breaking work of Gerber and Green (2000), most of these experiments have used door-to-door canvassing or live telephone banks to contact voters. We now know the importance of particular variations in script and the use of trusted and well-trained canvassers, among other insights, but also have a better understanding of the cost of these campaigns. Simply stated, getting out the vote via personal door-to-door visits or phone calls in the US is extremely expensive, estimated at US$20 per vote or more (costs in Brazil are similar). The logistics of these campaigns bring additional challenges, such as how to contact voters who do not necessarily want to be contacted and are screening their phone calls. Thus, in the name of cost-efficiency and high contact rates, newer GOTV experiments have branched out into the use of internet- and mobile phone-based methods of contact including email, Facebook, and text messages. Here, we extend that research to Brazil, testing traditional methods of door-to-door canvassing, email, and robocalls, as well as WhatsApp video messages.
Our most interesting findings come from the WhatsApp experiments. In two of three experiments targeting young voters, these video messages were very effective at increasing turnout. The lower socioeconomic context of Amazonas likely means fewer targeted mobile phone numbers in that area were owned by smartphone users, possibly generating very low compliance levels. Experiments targeting older voters, whom we assume are less likely to be WhatsApp users, do not increase voter turnout.
The use of multimedia text messaging is widespread and growing in both the US and around the world. While not all registered or eligible voters are WhatsApp users, the expanding use of smartphone-based communication and lack of legislation that constrains WhatsApp use provides an opportunity to reach large numbers of voters at minimal expense. GOTV using these messages has the potential to have large effects on turnout among the increasingly wired populations of industrialised and developing countries. Additional experiments are needed to test if similar effects can be generated in different contexts and with different messages, and to determine the number of messages needed to maximise turnout.
Hundreds of GOTV experiments have been conducted over the last two decades. The overarching conclusion from this work, with few exceptions, is that moving large numbers of voters to the polls requires reminders to vote that use social pressure, are delivered via a personal socio-cultural interaction, or that constitute a noticeable reminder. We find that WhatsApp messaging is a powerful method of moving youth to vote in Brazil. This is a potentially powerful and cost-effective method of increasing turnout in a traditionally low-turnout group (young voters). As social networks and interpersonal interactions move online and onto smartphone-based apps, both for youth and older cohorts, GOTV methods should follow.
Consistent with prior research, we also find door-to-door canvassing to be an effective and powerful method of increasing voter turnout. Statistically significant and substantively large increases in turnout were generated in four experiments with older and younger voters in Rio de Janeiro and São Paulo. The results are weakest among younger voters in São Paulo; this may reflect the context of the election for that population. Recall that the candidate in São Paulo was affiliated with the PT, which, while successful in the presidential runoff election, was unpopular with local voters. This lack of popularity may have mitigated the effectiveness of the local candidate’s GOTV messages. This variation aside, the effect of the door-to-door campaigns was substantial, exceeding the usual expected effect sizes based on experiments in other countries and in other contexts. This may reflect the uniqueness of a robust, individualised door-to-door campaign in Brazil. While campaigns in the US often include individual-level outreach to voters, including door-to-door visits, campaigns in Brazil tend to instead rely almost exclusively on television and radio advertisements to reach the voting public. This reflects the structure of the voting system, including proportional representation (rather than a district system, which would encourage individual candidates to reach out to local voters using direct methods of communication) as well as compulsory voting laws that affect most citizens.
Results from the email and robocall campaigns are also consistent with prior research, (with the notable exception of the email and text message campaign conducted in Brazil by Peixoto, Sjoberg, & Mellon, 2017). Examining intent-to-treat effects, we find little evidence that email or robocalls move voters to the polls. Further experiments with larger target populations may be necessary to better understand if and when email messages from candidates effectively increase participation among Brazilian voters, or whether multiple “touches” are needed to make such tactics effective.
The observed effects in two of three WhatsApp experiments, and in the door-to-door experiments, are unusually large. It may be that further GOTV experiments in similar contexts will regress to a smaller mean, and that these results are outliers. Occasional door-to-door canvassing experiments have found effects of the magnitude observed here, including a campaign in Riverside County, California in 2006 that generated a treatment-on-treated effect of 43.1 percentage points (García Bedolla & Michelson, 2012), but most door-to-door efforts generate more modest results. On the other hand, the large size of these effects may reflect the specific context and nature of our experiments. It may be that voters in Brazil are particularly susceptible to messages about voting due to the presence of compulsory voting for most citizens in the country. In other words, voters in countries with compulsory voting who are exempt from those laws may have internalised local norms about voting, or they may be concerned that the messages inviting them to participate are an indication that they are required to do so. Further experiments in countries with partial or widespread compulsory voting laws will help better establish the effect of this context on the effect of GOTV messages aimed at voters in those countries who are not required to vote; post-experimental surveys of individuals moved to the polls in such instances may also be helpful. On the other hand, such effects may wear off if this particular targeting mechanism becomes more regularly applied, not only for political micro-targeting but also for general advertising. In other words, voters and consumers may develop immunity to widely-used communication methods. Again, future research is needed to determine whether these strong tactics become less noticeable as their frequency of use increases.
WhatsApp treatment group (W) |
Door-to- door treatment group (D) |
Email treatment group (E) |
Robocall treatment group (R) |
Control group (C) |
H0: W=C |
H0: D=C |
H0: E=C |
H0: R=C |
|
Amazonas <18 |
|||||||||
Proportion female |
0.39 |
- |
- |
0.39 |
0.38 |
0.86 |
- |
- |
0.92 |
Mean age |
16.64 |
- |
- |
17.01 |
16.40 |
0.56 |
- |
- |
0.54 |
Amazonas >70 |
|||||||||
Proportion female |
0.41 |
- |
- |
0.42 |
0.43 |
0.76 |
- |
- |
0.73 |
Mean age |
75.41 |
- |
- |
73.70 |
76.73 |
0.46 |
- |
- |
0.34 |
Rio de Janeiro <18 |
|||||||||
Proportion female |
0.34 |
0.34 |
0.35 |
- |
0.34 |
0.82 |
0.82 |
0.78 |
- |
Mean age |
16.49 |
16.51 |
16.58 |
- |
16.41 |
0.66 |
0.61 |
0.55 |
- |
Rio de Janeiro >70 |
|||||||||
Proportion female |
0.39 |
0.44 |
0.41 |
- |
0.40 |
0.82 |
0.82 |
0.78 |
- |
Mean age |
74.92 |
75.17 |
74.78 |
- |
75.01 |
0.66 |
0.61 |
0.55 |
- |
Santa Catarina <18 |
|||||||||
Proportion female |
0.42 |
- |
0.41 |
0.45 |
0.44 |
0.52 |
- |
0.35 |
0.48 |
Mean age |
16.54 |
- |
16.61 |
16.45 |
16.42 |
0.51 |
- |
0.63 |
0.69 |
Santa Catarina >70 |
|||||||||
Proportion female |
0.34 |
- |
0.38 |
0.39 |
0.39 |
0.72 |
- |
0.68 |
0.88 |
Mean age |
77.25 |
- |
75.08 |
76.71 |
74.02 |
0.43 |
- |
0.61 |
0.49 |
São Paulo <18 |
|||||||||
Proportion female |
- |
0.32 |
0.31 |
0.31 |
0.34 |
- |
0.52 |
0.48 |
0.48 |
Mean age |
- |
16.54 |
16.48 |
16.5 |
16.57 |
- |
0.81 |
0.64 |
0.79 |
São Paulo >70 |
|||||||||
Proportion female |
- |
0.44 |
0.41 |
0.42 |
0.44 |
- |
0.52 |
0.48 |
0.98 |
Mean age |
- |
76.01 |
78.7 |
76.0 |
79.36 |
- |
0.31 |
0.71 |
0.29 |