For this pre-registered study, three narratives of around 400 words were created. A control text based on bread (seen as a neutral topic) was drafted by the large language model ChatGPT to avoid implicit researcher bias, then double-checked to ensure that the model had not imported bias of its own. As a point of comparison, an additional text was drafted that was designed to appeal to those low in authoritarianism, using arguments that are commonly used to describe the benefits of immigration, such as increased diversity. The third text was the authoritarianism-compatible text used in Study 2.
Each text contained a reference to the fictitious immigrant. In the control text, she was described as a consumer of bread, but in the treatment texts she was used to personify the values held by those low or high in authoritarianism. Both treatment texts were supplemented with the same factual material used in Study 2 and an emotional appeal.
Data were collected from 7 to 12 March 2023. The polling company YouGov recruited 3,067 participants. They responded to two political questions, and two short surveys testing for Authoritarianism and Social Dominance Orientation. Those in the control group read the neutral text on bread quality while those in the treatment groups read either the low authoritarianism text or the authoritarianism-compatible text. They were asked to respond to the four questions asked in Study 2. The first tested for shared values; the second asked whether the individual felt EU immigration was a good or a bad thing for the UK; the third was the immigration stock question and the fourth was the immigration flow question. Responses to the last two questions were used to create a composite immigration attitudes score as before.
The study was pre-registered on the Open Science Framework with the following hypotheses:
Hypothesis 1: Those exposed to the authoritarianism-compatible text will feel closer to the immigrant than those exposed to a control.
Hypothesis 2: Those exposed to the authoritarianism-compatible text will be more positive about EU immigration than those exposed to a control.
Hypothesis 3: Those exposed to the authoritarianism-compatible text will be more positive about immigration than those exposed to a control.
ResultsComparing the authoritarianism-compatible text and the control: T-tests were used to compare responses.
On the values question, there was a significant difference between those exposed to the control (“Cont”) text (M=4.07, SD=1.56) and those exposed to the authoritarianism compatible (“AC”) text (M=5.13, SD=1.56): (t=-15, df=2039, p<.001, conf. int. [-1.19, -.92],
d=-.68).
On the EU immigration question, there was a significant difference between the responses of those exposed to the two texts (“Cont” M=3.41, SD=1.83; “AC” M=2.61, SD=1.61; t=10.24; df=1901, p<.001, conf. int. [.65, .95], d=.46).
Expressed in percentage terms and including the “Don’t Knows”, there was a 20 percentage point difference between the responses of those who judged EU immigration to be “Slightly good”, “Moderately good” or a “Very good thing”(53% for the control v. 73% for the authoritarianism-compatible text).
Those exposed to the authoritarianism-compatible text were significantly more positive on both immigration stock (“Cont” M=3.79, SD=2.05; “AC” M= 4.13, SD= 1.98; t=-3.7, df=2030, p<.001, conf. int. [-.51, -.16], d=-.16) and immigration flow (“Cont” M=4.52, SD=1.78; “AC” M=4.21, SD=1.75; t=4.0, df=2035, p<.001, conf. int. [.16, .46], d=.18) than those exposed to the control text.
A composite immigration score was created from averaging the two responses above. This also showed a significant difference in the responses between those exposed to the authoritarianism-compatible and control texts (“Cont” M=3.64, SD=1.81; “AC” M=3.96, SD=1.77; t=-4.06, df=2033, p<.001, conf. int [-.47, -.17], d=-.18).
Comparing the low authoritarianism text and the control: The focus of this experiment was the authoritarianism-compatible text, hence no hypotheses were pre-registered for the low authoritarianism (“LA”) text. Nonetheless, when comparing this text with the control , there were significant differences on the values question (“Cont” M=4.07, SD=1.56; “LA” M=4.47, SD=1.71; t=-5.47, df=2010, p<.001, conf int[-.54, -.26], d=-.24); on the EU immigration question (“Cont” M= 3.41, SD=1.83; “LA” M= 2.93, SD=1.72; t=6.03, df=1930, p<.001, conf. int [.33, .64], d=.27); on the immigration stock question (“Cont” M=3.79, SD=2.05; “LA” M=4.05, SD=2.05; t=-2.84, df=2018; p=.004, conf int [-.44, -.08], d=-.13), on the immigration flow question (“Cont” M=4.52, SD=1.78; “LA” M=4.30, SD=1.82; t=2.80, df=2019, p=.005, conf int[.07, .38], d=.12), and on the composite immigration score (“Cont” M=3.64, SD=1.81; “LA” M=3.88, SD=1.84; t=-2.98, df=2019, p=.003, conf int [-.40, -.08], d=-.13).
This text did change attitudes but it was less effective than the authoritarianism-compatible text, as illustrated in Figs. 1-4.
Discussion: This study demonstrates with a large, nationally and politically representative sample that it is possible to make British attitudes towards immigration more positive. The three pre-registered hypotheses for Study 3 are therefore upheld. As compared to a control text, when British people are exposed to an authoritarianism-compatible text including factual material and an emotional appeal, they feel a greater sense of shared values with an immigrant, they are more positive about EU immigration and more positive about immigration overall.
In 2016, some politicians were wary about speaking up in favour of EU immigration. Here we show that an argument of 400 words can shift attitudes on EU immigration significantly. In the control condition, 53% said that EU immigration was a “Slightly good”, “Moderately good” or “Very good thing.” For those who read the treatment text, the equivalent percentage was 73% i.e. 20 percentage points higher than for those exposed to the control.
The study also suggests that some forms of argument are more effective than others. In Study 3, the authoritarianism-compatible text was more effective than the low authoritarianism text which deployed commonly used arguments about diversity. Both texts focused on an individual immigrant since research shows that it is easier to empathise with a single person than with many36. However in the authoritarianism-compatible text, the immigrant was described in reassuring terms as an unthreatening female engaged in a caring occupation who held traditional values and had integrated into the UK, speaking English well.
In this final experiment, both treatment texts included identical factual information. The results show that it was not these arguments alone that shifted attitudes. If this had been the case, there would be no difference between the results for the authoritarianism-compatible text and the low authoritarianism text. The evidence presented here suggests that the strongest effect came from combining this factual information with the authoritarianism-compatible elements and the emotional appeal.
A final point is that the authoritarianism-compatible text brought together elements that are sometimes tested in isolation, such as social norms messaging or messages framed in terms of particular personality traits (in this case, Conscientiousness). In this study, we constructed a persuasive text that is consistent with theorising that sees authoritarianism as an umbrella-type construct under which other psychological characteristics are grouped together in predictable ways. Further studies could explore in greater depth whether this combined approach to messaging is more effective than elements tested individually.
In summary, our results demonstrate that positive arguments can change British immigration attitudes in some contexts. On one level these results are not surprising, given that immigration attitudes have changed substantially in the UK in the last 10 years, which is often attributed to the salience of immigration in the media37. What our results show is that change can happen after exposure to a relatively short text, and that this is most effective when it combines shared values, evidence from trusted sources of information and an emotional appeal. This builds towards a body of evidence that people can persuaded by arguments incorporating reason when these are carefully constructed.
It was outside of the scope of this work to evaluate what level of immigration is appropriate for any given country at any given time, and for ethical reasons we did not test whether it was possible to make attitudes more negative. However, in a world where climate-driven migration is rising, we think this work offers important insights for policy-makers and politicians in understanding what drives attitudes towards immigration and what arguments might be effective in changing those attitudes.