Not which ones, but how many?

Perspective on research from Guoer Liu, doctoral student in Political Science, and recipient of the 2019 Roy Pierce Award 

Guoer Liu

“Not which ones, but how many” is a phrase used in list experiments instruction, where researchers instruct participants, “After I read all four (five) statements, just tell me how many of them upset you. I don’t want to know which ones, just how many.” In retrospect, I was surprised to see that this phrase encapsulates not only the key research idea, but also my fieldwork adventure: not which plans could go awry, but how many. The fieldwork experience could be frustrating at times, but it has led me to uncharted terrain and brought insights into the research contexts. The valuable exposure would not have been possible without support from the Roy Pierce Award and guidance from Professor Yuki Shiraito

Research that I conducted with Yuki Shiraito explores the effect of behavior on political attitudes in authoritarian contexts to answer the question: does voting for autocracy reinforce individual regime support? To answer this question, two conditions need to be true. First, people need to honestly report their level of support before- and after- voting in authoritarian elections. Second, voting behavior needs to be random. Neither situation is probable in illiberal autocracies. Our project addresses these methodological challenges by conducting a field experiment that combines a list experiment and a randomized encouragement design in China.

In this study, list experiments are used instead of direct questions to measure the respondents’ attitudes towards the regime in the pre- and post-election surveys. The list experiment is a survey technique to mitigate preference falsification by respondents. Although the true preference of individual respondents will be hidden, the technique allows us to identify the average level of support for the regime within a group of respondents. In addition, we employ a randomized encouragement design where get-out-the-vote messages are randomly assigned, which help us estimate the average causal effect of a treatment. For effect moderated by prior support for the regime, we estimate the probability of the prior support using individual characteristics and then estimate the effect for the prior supporters via a latent variable model.

While the theoretical part of the project went smoothly and the simulation results were promising, the complication of fieldwork exceeded my expectation. For the list experiment survey, the usually reticent respondents started asking questions about the list questions immediately after the questionnaires were distributed. Their queries took the form of “I am upset by option 1, 2, and 4, so what number should I write down here?” This was not supposed to happen. List experiments are developed to conceal individual respondents’ answers from researchers. By replacing the questions of “which ones” with the question of “how many,” respondents’ true preference is not directly observable, which makes it easier for them to answer sensitive questions honestly. Respondents’ eagerness to tell me their options directly defeats the purpose of this design. Later I learned from other researchers that the problem I encountered was common in list experiment implementation regardless of research contexts and types of respondents. 

The rationale behind respondents’ desire to share their individual options despite being given a chance to hide them is thought-provoking. Is it because of the cognitive burden of answering a list question, which is not a familiar type of questions to respondents? Or is it because the sensitive items, despite careful construction, raise the alarm? Respondents are eager to specify their stance on each option and identify themselves as regime supporters: they do not leave any room for misinterpretation. To ease the potential cognitive burden, we will try a new way to implement the list experiment in a similar project on preference falsification in Japan. We are looking forward to seeing if it improves respondents’ comprehension of the list question setup. The second explanation is more concerning, however. It suggests the scope condition of list experiments as a valid tool to elicit truthful answers from respondents. Other more implicit tools, such as endorsement experiments, may be appropriate in those contexts to gauge respondent’s preference. 

Besides the intricacies of the list experiment, carrying out encouragement design on the ground is challenging. We had to modify the behavioral intervention to adapt needs from our local collaborators, and the realized sample size was only a fraction of the negotiated size initially. Despite the compromises, the implementation is imbued with uncertainty: meetings were postponed or rescheduled last minutes, instructions from local partners are sometimes inconsistent and conflictual. The frustration was certainly real. But the pain makes me cognizant of judgment calls researchers have to make in the backstage. The amount of effort required to produce reliable data is admirable. And as a consumer of data, I should always interpret data with great caution.

While the pilot study does not lead to a significant finding directly, the research experience and the methods we developed have informed the design of a larger project that we are currently doing in Japan.

I always thought of doing research as establishing a series of logical steps between a question and an answer. Before I departed for the pilot study, I made a detailed timeline for the project with color-coded tasks, flourish-shaped arrows pointing at milestones of the upcoming fieldwork. When I presented this plan to Professor Shiraito, he smiled and told me that “when doing research, it is generally helpful to think of the world in two ways: the ideal world and the real world. You should be prepared for both.” Wise words. Because of this, I am grateful for the Roy Pierce Award for offering the opportunity to catch a glimpse of the real world. And I am indebted to Professor Shiraito for helping me see the potential of attaining the ideal world with intelligence and appropriate tools.

Regime Threats and State Solutions

Post developed by Katherine Pearson and Mai Hassan. 

States can exert powerful social control over citizens. In her newly-published book, Regime Threats and State Solutions, Mai Hassan demonstrates how leaders use their authority to manage bureaucrats to advance their policy and political goals.

By controlling which bureaucrats are hired, where they’re posted, how long they stay in a post, and who gets fired or promoted, leaders can induce the bureaucratic behaviors that will help keep them in power. 

Focusing on Kenya since independence, Hassan uses qualitative and quantitative data gleaned from archival records and interviews to show how the country’s different leaders have strategically managed the public sector. The data show that the strategic management of bureaucrats existed under the one-party authoritarian regime beginning with Kenya’s independence in 1963, and continued after Kenya’s transition to an electoral regime in 1991. Under both regime types, leaders were able to co-opt societal groups that are needed for support and coerce the groups most likely to challenge the regime.

Haasan examines how leaders rely on bureaucrats to manage popular threats against the leader such as protests and strikes. First, she argues that leaders assign bureaucrats with deep social bonds to those areas where the leader needs to co-opt the local population. These deep social bonds compel bureaucrats to work on behalf of the area. But in areas that need more coercion, the leader tends to prevent the posting of bureaucrats with deep local roots because those who have deep roots will be unwilling to coerce locals. 

Second, she finds that the parts of the country that are most strategically important for the leader — and thus, the areas of the country where bureaucratic compliance is needed most — are staffed by the most loyal bureaucrats, those who are most willing to help keep the leader in office. Leaders can also neutralize the risks of disloyal bureaucrats by carefully managing where potentially disloyal officers are posted and how long they stay in their posts. 

Why would a leader hire or promote disloyal bureaucrats in the first place? Hassan addresses this question by showing that most state bureaucracies are not actually packed with the leader’s in-group members, who tend to be the most loyal. Elite threats, such as coups, tend to be more pressing than popular ones. Leaders can appease rival elites by hiring and promoting bureaucrats who are loyal to elites other than the leader. Strategically posting and shuffling bureaucrats allows the leader to recruit potentially disloyal bureaucrats in order to temper elite threats, while still relying on loyal bureaucrats to prevent popular threats where they are most likely to emerge.

Overall, Hassan’s analysis shows how even states categorized as weak have proven capable of helping their leader stay in power. Her work demonstrates how the strategic management of bureaucrats solves both elite and popular threats, and in doing so, highlights why bureaucrats must be taken seriously. States may assert power, but states do not act: bureaucrats do. 

Toward a Typology of Populists

Post developed by Pauline Jones, Anil Menon, and Katherine Pearson 

ICYMI (In Case You Missed It), the following work was presented at the 2019 Annual Meeting of the American Political Science Association (APSA).  The presentation, titled “Putin’s Pivot to Populism” was a part of the session “Russia and Populism” on Sunday, September 1, 2019. 

The rise in populism around the world has received much attention, but not all populists are the same. In a new paper, Pauline Jones and Anil Menon present an original typology of populists that goes beyond typical left-wing versus right-wing classifications. 

To better understand the different types of populists and how they operate, Jones and Menon examine two key dimensions: position within the political landscape (outsider versus insider), and level of ideological commitment (true believer versus opportunist). 

Populists tend to frame their criticism of political elites differently depending on whether they are political outsiders or government insiders. While outsiders are free to criticize those in power broadly, populists who hold political power are more likely to tailor their criticisms to their political opponents. Insiders are also more careful not to attack members of the elite with whom they will need to build political coalitions. 

Many populists evoke the past, but outsiders and insiders tend to do so differently. Whereas outsiders focus on the near past as a critique of a corrupt elite, political insiders instead focus on the distant past to evoke better days of shared national values. 

Jones and Menon also draw distinctions between true believers in populism and those who embrace populism for purely strategic reasons. True believers will remain strongly committed to enacting their populist agenda once in office; opportunists will use populist rhetoric to gain power, but won’t support their platform strongly if elected.  

The intersection of these two dimensions leads to the classification of populists into four types, illustrated in the table below: Oppositional, Classical, Strategic, and Pivot. 

Classification of populists

The most common variety of populist is the oppositional populist, who are outsiders and true believers. Oppositional populists put their agenda before all else and distance themselves from the mainstream elite. 

Classical populists sometimes start out as outsiders who become insiders once they are elected to office. Like oppositional populists, they are strongly committed to enacting their agenda; unlike oppositional populists, classical populists can enact their agenda from a position of power. Because they are insiders, classical populists are more selective about criticizing elites. 

Pivot populists are a rare group of political insiders who adopt populist rhetoric with little or no commitment to the populist ideology. Jones and Menon point to Russia’s Vladimir Putin as an example of a pivot populist who has adopted populism to bolster support for his regime while deflecting blame for the country’s problems. 

The final category is strategic populists. Like Donald Trump in the United States, strategic populists are outsiders with a weak commitment to the populist agenda. Strategic populists are broadly anti-elite, and also use their rhetoric to create divisions among the people. Once in power, they are unlikely to alienate elites by pursuing populist policy goals. 

Presidents and/or Prime Ministers  

Post developed by Allen Hicken and Katherine Pearson 

ICYMI (In Case You Missed It), the following work was presented at the 2019 Annual Meeting of the American Political Science Association (APSA).  The presentation, titled “Presidents and/or Prime Ministers: A Historical Dataset” was a part of the session “Legislatures and Leaders: New Perspectives on Political Institutions” on Thursday, August 29, 2019. 

Classifying systems of government is a challenge for political scientists comparing regimes over time and across countries. A new historical dataset developed by Fabricio Vasselai, Samuel Baltz, and Allen Hicken addresses this challenge with a simplified classification scheme that presents data on four broad variables: whether there is an elected prime minister, whether there is an elected president, whether there is a non-elected prime minister, and whether there is a non-elected president. The dataset includes a yearly assessment for almost all sovereign countries since 1789, which amounts to 16,910 country-years. 

The simplicity of this classification system allows researchers to examine other characteristics separately, including the level of democracy or the powers of elected leaders. While the majority of country-years fit a neat definition, this dataset allows a clearer analysis of complex cases. 

The authors present France as an interesting test case. In the years included in this dataset, France had (1) only an unelected prime minister, (2) no elected or unelected prime minister or president, (3) only an elected prime minister, (4) an elected prime minister and an elected president, or (5) an elected prime minister and unelected president, with several of these states repeating multiple times throughout France’s history. The dataset presents this complicated historical narrative in the simplified manner below. 

This classification system also allows researchers to explore the evolution of different systems of government over longer periods of time. The authors show that an explosion of elections took place in the 19th century. Beginning in the 20th century, the share of countries electing only a prime minister takes a slight lead; by 1945 almost twice as many countries elected only a prime minister compared to those electing only a president. The share of countries electing either leader climbs through the second half of the 20th century, with only about 10 percent of country-years lacking an elected leader by 2017. 

Evolution of types of system

By developing a simple, comprehensive dataset, Vasselai, Baltz, and Hicken have given researchers a resource that allows them to analyze regimes consistently and layer on additional information as needed. 

Winners and Losers:
 The Psychology of Attitudes Toward 
Foreign Trade

Post developed by Katherine Pearson and Diana Mutz

Foreign trade is a complex issue, but the public still has strong opinions about the issue. Diana Mutz demonstrated that social psychology can help to understand attitudes about trade when she delivered the 2019 Miller Converse lecture. A recording of her talk “Winners and Losers: The Psychology of Attitudes Toward Foreign Trade” is available below.

Most people rely on small-scale social experiences to understand large-scale interactions such as international trade. From this understanding, people tend to embrace beliefs about trade that are not necessarily accurate. For example, folk beliefs suggest that impersonal transactions are more dangerous than personal ones, that trade is zero-sum, and that trade “deficits” mean that a country is losing more jobs as a result of imports than it gains due to exports. These beliefs are inaccurate, yet understandable, generalizations from the world of face-to-face social exchange.

Contrary to popular wisdom, trade preferences do not reflect people’s economic self-interest. Mutz demonstrates that, surprisingly, these attitudes are not influenced by a person’s occupation, industry of employment, community job loss, geographic location, or individual job loss. Instead, perceptions of what is in the collective economic interest determine attitudes toward trade. Coverage of trade in the media has a large influence on these perceptions. Media coverage of foreign trade was mostly negative until 2016. As media coverage of trade has become more balanced since 2016, support for trade has also increased.

Politicians from all parties have been unwilling to champion trade when running for office because foreign trade is seen as a political liability in the United States. As the world economy changes, Mutz asserts that leaders will need to advocate for trade and for safeguards against its negative effects. She cautions that it’s unhelpful to leave the public out of that conversation altogether as has been common in the past.

For an additional perspective, Mutz compares attitudes about trade in the United States and Canada. She finds that attitudes about trade in the two countries are different due to differing attitudes toward competition. Americans value competition more, and believe in the fairness of unequal outcomes. In the U.S., nationalism reduces support for foreign trade, but in Canada the opposite is true. Canadians who hold the strongest beliefs about national superiority want to promote more trade and immigration.

Differing perspectives on trade in these countries can be explained by variation in two different types of ingroup favoritism. First, Americans in Mutz’s studies systematically preferred trade agreements in which their fellow Americans benefited more than trading partners. In fact, there was no level of job benefits to foreign countries that would justify the loss of even a single American job. This was not the case among Canadians. In addition, Americans demonstrated their competitive attitudes toward trade by demonstrating greater support for trade agreements that not only benefit their country but also disadvantage the trading partner. Canadians, in contrast, preferred the kind of “win-win” trade agreement that economists suggest benefits all countries involved.

Attitudes about race drive attitudes about trade and Mutz finds that the reverse may also be true. In a study that asked respondents to select which students should be admitted to college, participants who had just watched an ad against foreign trade were less supportive of admitting Asian-American students, as well as students from Asia.

Mutz concludes that, while many of these results are distressing, attitudes remain malleable. Efforts to change opinions toward trade that emphasize similarity and shared values are more effective than efforts emphasizing pocketbook gains. Since 2016, her data shows that there has been an increase in support for foreign trade and a realization that it comes with benefits as well as negative consequences.

New Book Examines Ghana’s Political Trap

Post developed by Katherine Pearson

As a country grows and develops economically, most experts expect political behavior to develop as well, becoming more policy-oriented and programmatic and moving away from clientelism that characterizes less developed countries. However, this has not been the case in Ghana. In his new book, Electoral Politics and Africa’s Urban Transition, Noah Nathan traces the unexpected political patterns that are emerging in urban Ghana. Despite a growing middle class and increasing ethnic diversity, clientelism and ethnic voting persist in many urban neighborhoods.

Nathan focuses his research on Accra, Ghana, a diverse and growing metropolis of four million people. Not only is the population of the city growing, but it is becoming wealthier and better educated: data show that the middle class in Accra has tripled in size since Ghana democratized in 1992. The trend toward urbanization has also led to more diversity and contact between members of different ethnic groups in the city. Experts usually expect that higher incomes and levels of education will shift voter preferences away from politicians offering patronage and toward more policy-oriented candidates.

Political practices in Ghana have not transitioned as rapidly as the demographics have. Instead, Nathan shows, Ghanaian politics have become stuck in a trap. The trap is a cycle wherein voters expect goods and favors, which politicians deliver in the form of patronage. As a result,  the government performs poorly and elected officials are seen as less credible. Policy-oriented citizens are left without programmatic candidates, and become more likely to decide to opt out of voting entirely. With those voters increasingly out of play, politicians face strong incentives to continue engaging in clientelism, sometimes creating ethnic competition.

political trap

Nathan, Noah L. Electoral Politics and Africa’s Urban Transition: Class and Ethnicity in Ghana. Cambridge University Press, 2019.

The key to understanding the political trap of clientelism is the neighborhood-level variations within cities. Voters with similar levels of wealth and education do not all vote alike across the city; voting behaviors differ greatly by neighborhood. Voters in poorer neighborhoods still expect favors from politicians, who respond accordingly. Taking this into account, many middle-class voters, those who are most likely to support a programmatic transition, opt out of voting because they view politicians engaging in patronage as lacking credibility.

Certain features of developing cities give further context to explain politicians’ and voters’ incentives. Developing countries have lower capacity to provide services and infrastructure to their citizens as a whole. The rapid pace of growth creates a scarcity of resources to go around. Without the credibility to promise broad improvements, politicians rely instead on promises to select groups. Cities tend to be comprised of neighborhoods that differ widely in their wealth and diversity, often within the same electoral district. Understanding these realities help explain why clientelism prevails, even as the electorate becomes wealthier, better-educated, and more diverse.

Nathan concludes his analysis of the political patterns in Ghana by drawing parallels with political systems seen in the United States in the late 19th and early 20th century, as well as in Latin American cities. In these cases the shift to more programmatic politics occurred politicians could no longer distribute government resources selectively. The rise of civil service reforms and broad social welfare programs supported the shift to policy-oriented systems. These parallels to similar transitions over time and in other developing countries may point the way to more policy-oriented political systems in the future.