Research Reports

Individual Differences in Anchoring Effect: Evidence for the Role of Insufficient Adjustment

Predrag Teovanović*a

Europe's Journal of Psychology, 2019, Vol. 15(1), 8–24, https://doi.org/10.5964/ejop.v15i1.1691

Received: 2018-06-30. Accepted: 2018-12-11. Published (VoR): 2019-02-28.

Handling Editors: Ljiljana Lazarevic, University of Belgrade, Belgrade, Serbia; Iris Zezelj, University of Belgrade, Belgrade, Serbia

*Corresponding author at: Visokog Stevana 2, 11000 Beograd, Serbia. E-mail: teovanovic@fasper.bg.ac.rs

This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Although the anchoring effect is one of the most reliable results of experimental psychology, researchers have only recently begun to examine the role of individual differences in susceptibility to this cognitive bias. Yet, first correlational studies yielded inconsistent results, failing to identify any predictors that have a systematic effect on anchored decisions. The present research seeks to remedy methodological shortcomings of foregoing research by employing modified within-subject anchoring procedure. Results confirmed the robustness of phenomenon in extended paradigm and replicated previous findings on anchor’s direction and distance as significant experimental factors of the anchoring effect size. Obtained measures of individual differences in susceptibility to anchoring were fairly reliable but shared only small portion of variability with intelligence, cognitive reflection, and basic personality traits. However, in a group of more reflective subjects, substantial negative correlation between intelligence and anchoring was detected. This finding indicates that, at least for some subjects, effortful cognitive process of adjustment plays role in the emergence of the anchoring effect, which is in line with expectations of dual-process theories of human reasoning.

Keywords: anchoring effect, individual differences, dual-process theories, intelligence, cognitive reflection

Anchoring effect refers to a systematic influence of initially presented numerical values on subsequent judgments of uncertain quantities, even when presented numbers are obviously arbitrary and therefore unambiguously irrelevant. A simple two-step procedure, usually referred to as a standard paradigm of anchoring, was initially introduced in the seminal work of Tversky and Kahneman (1974). First, people were instructed to make a judgment if some quantity, such as the percentage of African countries in the UN, is higher or lower than value randomly generated by spinning a wheel of fortune in their presence. Subjects were then asked to provide their own numerical estimates for the very same quantity. Results showed notable effect of arbitrary values on participants’ estimates (e.g. percentage of African countries in the UN was estimated on 25 and 45 for groups that were presented with anchors 10 and 65, respectively).

Exceptional easiness of experimental elicitation of the anchoring effect was demonstrated in various domains, in both laboratory and real-world settings, and for both novice and expert subjects (for reviews of literature, see Bokulić & Polšek, 2010; Furnham & Boo, 2011). Anchoring effect is so pervasive that even highly implausible anchors (e.g. “Did Gandhi lived to be 140?”) affect judgments. However, it seems that relation between anchor distance and the size of the anchoring effect is curvilinear - moderate anchors lead to stronger effect in comparison extreme ones (Mussweiler & Strack, 2001; Wegener, Petty, Detweiler-Bedell, & Jarvis, 2001). Besides, the larger effect was observed for anchors set above, in comparison to anchors set below correct answer (Hardt & Pohl, 2003; Jacowitz & Kahneman, 1995; Jasper & Christman, 2005).

According to Tversky and Kahneman (1974), anchoring effect is the product of anchoring and adjustment heuristic. Estimates are made starting from anchor value which is then adjusted in a deliberate fashion, step by step until the satisfactory answer is reached. A number of steps is often insufficient since people stop adjusting as soon as they reach the first answer that seems acceptable. Anchoring is seen as a consequence of this prematurely ended serial process.

An alternative explanation of anchoring assumes that anchor automatically cues positive test strategy, i.e. intuitive search for pieces of evidence that confirm anchor as a possible true answer for target quantity. Information that is consistent with the anchor is more easily accessible on successive estimation task, which in turn affects final estimates (Chapman & Johnson, 1999; Mussweiler & Strack, 1999; Strack & Mussweiler, 1997).

Recently, several attempts were made to integrate two competing accounts of anchoring (see e.g. Epley, 2004; Epley & Gilovich, 2005, 2006; Kahneman, 2011; Simmons, LeBoeuf, & Nelson, 2010). Endorsing dual-process theories of human reasoning, Kahneman (2011) noted that anchoring results from both automatic activations of anchor-consistent knowledge and re-adjustments from anchor as distinct cognitive processes – the first, fast and intuitive (Type 1), and the second, more demanding, slow and effortful (Type 2). Latter requires controlled attention, and relies on working memory capacities. It has been shown that adjustment decreases when cognitive resources are depleted either by concurrent cognitive task or alcohol consumption (Epley & Gilovich, 2006), and increases when instructions aimed to enhance mental efforts are introduced (Adame, 2016; Epley & Gilovich, 2005; Mussweiler, Strack, & Pfeiffer, 2000; Simmons et al., 2010).

Additional findings regarding the role of Type 2 processing in the emergence of the anchoring effect are needed. Since anchors may not affect all people equally, one of promising lines of research comes from the individual differences perspective. Starting from the assumptions of dual-process theories which state that people reliably vary in capacities to successfully perform Type 2 processes, and that these differences highly correspond to individual differences in intelligence (Evans & Stanovich, 2013; Stanovich & West, 2000, 2008), one could expect to observe negative correlation between anchoring and intelligence. However, recent studies failed to reveal such association (Furnham, Boo, & McClelland, 2012; Jasper & Ortner, 2014; Stanovich & West, 2008; Welsh, Delfabbro, Burns, & Begg, 2014; for minor exceptions, see Bergman, Ellingsen, Johannesson, & Svensson, 2010; Jasper & Christman, 2005).

Apart from the ability to successfully perform them, individuals also vary in mere readiness to undertake Type 2 processes at all (see e.g. Evans & Stanovich, 2013; Stanovich, 2009). Individual differences in this propensity are usually assessed by cognitive reflection test (CRT; Frederick, 2005), devised with the intention to differentiate between impulsive subjects who are prone to report response that first comes to mind (Type 1), and reflective subjects, who are able to resist to the first response and try to provide more thoughtful (Type 2) answer. No direct effect of cognitive reflection on anchored decision was observed in previous studies (Bergman et al., 2010; Jasper & Ortner, 2014; Oechssler, Roider, & Schmitz, 2009; Welsh et al., 2014). However, following the assumptions of dual process theories, it seems plausible to hypothesize that effects of intelligence and cognitive reflection on anchoring effects might be in interaction. More precisely, one could expect that individual differences in intelligence play role in the emergence of the anchoring effect only when Type 2 processes are initiated, i.e. when subjects’ reflectivity is high. On the other side, intelligence and anchoring should not be related if subjects are more impulsive, i.e. prone to rely on intuitive Type 1 processes.

Finally, it seemed practically worthwhile to empirically examine correlations that anchoring might have with personality traits. Previous studies on relation between anchoring effect and Big Five personality traits have brought mixed results. For example, McElroy and Dowd (2007) detected a modest positive correlation between susceptibility to anchoring and openness to experience, while Eroglu and Croxton (2010) failed to replicate this finding, but encountered on significant, although relatively small, associations with agreeableness, conscientiousness, and introversion. On the other side, Caputo (2014) reports that anchoring was negatively related to agreeableness and openness. Other studies reported on sporadic and practically negligible correlations between Big Five personality traits and susceptibility to anchoring (Furnham et al., 2012; Jasper & Ortner, 2014).

Research Aims and Hypotheses

From the experimental perspective, research was aimed to examine how both direction and relative distance of anchor contribute to the anchoring effect size. A non-linear relationship between anchor distance and the size of the anchoring effect (Mussweiler & Strack, 2001; Wegener et al., 2001), as well as a stronger effect of positively directed anchors (Hardt & Pohl, 2003; Jacowitz & Kahneman, 1995; Jasper & Christman, 2005), were expected. In order to ensure that relative distance of the anchor is closely the same for all participants, the standard paradigm was extended by introducing pretest session (see Method section). This procedural intervention also allowed to examine if reliable individual differences in susceptibility to the anchoring effect could be collected.

The main correlational aim of the research was to determine whether traditional psychometric constructs can predict anchoring effect, with an expectation that relation between anchoring and intelligence is moderated by cognitive reflection (Evans & Stanovich, 2013; Kahneman, 2011; Stanovich, 2009). On the other side, considering the inconsistent findings of previous studies, it was hard to come out with strong expectations regarding relation between anchoring effect and Big Five personality traits.

Method

Participants

A total of 236 special-education undergraduate students (214 females; age M = 19.83, SD = 1.31) participated in this study that was part of a wider research on cognitive biases (see Teovanović, 2013; Teovanović, Knežević, & Stankov, 2015) in return for partial course credit. Participants gave their informed consent before taking part in the study.

Anchoring Experiment

Material

A set of 24 general knowledge questions, all required numerical answers, was used in the anchoring experiment. Relatively difficult questions, covering various topics, were chosen with the intention to induce conditions of uncertainty. Participants were not expected to know the precise answers but to provide approximate estimates of target quantities.

Design

The anchoring experiment employed 2 x 4 within-subject design, with anchor direction and anchor distance as repeated factors. Anchor direction had two levels: positive, for anchors placed above, and negative, for anchors placed below the values of initial estimates. Four levels of relative anchor distance were set by adding or subtracting the particular portion (20%, 40%, 60%, or 80%) of the initial estimate’s value. Three different general knowledge questions were used in each of eight experimental conditions (see the first two rows in Table 1), resulting in a total of 24 questions.

Procedure

Two-session anchoring experiment was administered via a computer program which was used for presentation of instructions and questions, recording of answers, and calculation of individual anchor values. In the first session, questions were presented in a randomized order, one at a time and the participants were instructed to state the answers by using a numeric keypad. Answers were recorded as initial estimates (E1) and used in the subsequent session as the basis for the setting anchors (A) on various levels of distance and direction factors. As previously stated, for each participant (p) on each presented question (q), individual anchor values (Apq) were calculated by multiplying initial estimates (E1pq) with predetermined values (which ranged between 0.2 and 1.8 across questions) and rounding decimals. At the beginning of the second session, which followed immediately, an instruction was presented on the screen: “In the previous session, you answered a set of questions. In the following one, you will be asked to answer the same questions again. You are allowed, but not obliged, to change your mind and provide amended answers”. Same 24 questions were presented in a new random order, but the standard paradigm of anchoring was applied, i.e. for each question participants were administered a comparative task and a final estimation task. More precisely, the participant was first required to indicate if her/his final response was higher or lower than the value of the specific anchor (Apq). After that, a participant would state the final response (E2pq) by using the numeric keypad.

Measure

Measures of the anchoring effect (AE) were calculated for each participant on each question by using the following formula: AEpq = (E2pq - E1pq) / E1pq * 100.

As an index of relative amendment in estimation after introducing of anchor, AE tells about the difference between initial and final estimate in the units of percentage of initial estimate’s valuei. Since relative anchor distance was also expressed in terms of percentage of the initial estimate, this enabled their direct comparison. For all questions, zero value of AE indicated an absence of difference between the initial and final estimate, i.e. lack of anchoring effect. Maximum magnitude of anchoring effect was determined by the relative anchor distance on specific question (for negative anchors, it had negative values: -20%, -40%, -60%, -80%; for positive anchors, it had positive values: 20%, 40%, 60%, 80%).

Data Trimming

In order to control for the unwanted effect of outlying AE values, trimming procedure was applied. The absence of the anchoring effect and the maximum of the anchoring effect determined lower and upper bound of an acceptable range for AE measures. However, two type of data departures were both expected and observed. The first concerns under-anchoring, and it had been registered when AE was lower than zero for positive anchors, i.e. higher than zero for negative anchors. Similarly, over-anchoring was indicated when values of final estimates were smaller than values of negatively directed anchors, i.e. higher than values of positively directed anchors. Measures that had been outside of acceptable range were fenced to meet its boundaries. Corresponding second estimations (E2) were also amended such that applied formula results in trimmed AE measure. A described procedure was applied on 17.5% of all AE and E2 measures (see the last two rows of Table A1 in the Appendix)ii.

Individual Differences Measures

One week prior to the anchoring experiment, several cognitive ability tests and one personality questionnaire were computer administered to the same group of participants. Personal identification numbers were used for matching participants’ data.

Raven’s Matrices

Raven’s Matrices (RM; Raven, Court, & Raven, 1979). For each of 18 tasks, participants were asked to identify the missing symbol that logically completes the 3x3 matrix by choosing from among five options. Participants were allowed six minutes to complete the test. Previous studies that had used this instrument reported about its good metric properties (see, e.g., Pallier et al., 2002; Teovanović et al., 2015).

Vocabulary Test

Vocabulary Test (Knežević & Opačić, 2011) consists of 56 items of increasing difficulty. Subjects were required to define the words (e.g. “vignette”, “credo”, “isle”) by choosing the answer from among six options. No time limit for the completion of this test was imposed. On average, the participants completed this test in 13.11 minutes (SD = 2.09).

Cognitive Reflection Test

Cognitive Reflection Test (CRT) was devised as a measure of “the ability or disposition to resist reporting the response that first comes to mind” (Frederick, 2005, p. 36). It consists of only three questions, each triggering most participants to answer immediately and incorrectly. As previously noted, CRT was used to capture individual differences in propensity to engage Type 2 processing.

NEO-FFI

NEO-FFI (Costa & McCrae, 1992) was employed to quickly assess the Big Five personality traits - neuroticism (N), extraversion (E), openness (O), agreeableness (A), and conscientiousness (C). Each scale consists of 12 items, resulting in 60 items in total.

Results

Experimental Findings

Initial estimates were precisely correct responses only in 141 (2.5%) trials. When correctness was defined more loosely to encompass deviations up to five units (e.g. on „How many African countries there are in the UN?“, all values between 48 and 58 were counted as correct responses), number of correct responses rose only to 440 (7.8%) indicating that questions used in this study were relatively difficult, as intended.

Descriptive statistics for initial and final estimates on each question, as well as results of difference tests between them and associated indices of anchoring effect sizes are all presented in Table 1. Final estimates for each quantity markedly differed from the initial ones (ps < .05) and these differences were highly significant (ps < .001) on the vast majority of questions. Equally important, all of them were in predicted direction – final estimates were higher than initial estimates for positive anchors and lower for negative anchors. As much as 55.4% of initial estimates were amended toward anchors. Besides, over-anchoring was observed far more frequently than under-anchoring, χ2(1) = 102.56, p < .001. Such pattern of results confirms the experimental robustness of the anchoring effect.

Table 1

Descriptive Statistics and Results of Tests of Difference Between Initial (E1) and Final (E2) Estimates for Each Question Employed in the Anchoring Experiment

Distance Question (Correct Response) E1
E2
Difference tests
Effect size
AE
M SD M SD t(235) p d η2 M SD
-80% How many squares are there on a shogi playing board? (81) 54.45 67.27 34.43 27.95 -5.54 < .001 -0.36 .12 -33.43 33.45
How many castles are there in Vojvodina? (67) 5.84 11.04 3.71 7.61 -5.20 < .001 -0.34 .10 -24.14 29.49
How many gold medals did China win in 2008 Summer Olympics in Beijing? (51) 15.03 24.49 11.17 21.16 -6.17 < .001 -0.40 .14 -20.96 28.12
-60% How many chromosomes do penguins have? (80) 160.42 878.80 113.97 710.69 -2.08 .039 -0.14 .02 -24.45 26.48
How many civil airports are there in Germany? (65) 90.81 59.53 68.11 50.23 -14.17 < .001 -0.93 .46 -25.00 19.94
How many times was the NIN award for the best novel been awarded? (58) 21.49 46.07 13.95 23.06 -4.35 < .001 -0.28 .08 -24.67 24.55
-40% How many African countries are there in the United Nations? (53) 8.84 11.07 6.95 8.22 -7.45 < .001 -0.48 .19 -16.13 17.38
How long does Mercury revolution around the sun take? (88) 230.64 526.29 182.92 416.89 -5.75 < .001 -0.94 .12 -17.65 18.28
How tall is Saint Sava Temple in Belgrade (in meters)? (82) 117.42 238.92 97.30 213.47 -5.87 < .001 -0.38 .13 -17.06 16.03
-20% What is the length of an Olympic size swimming pool (in meters)? (50) 100.10 253.23 93.33 214.80 -2.27 .024 -0.15 .02 -4.45 8.08
What is the duration of hockey game in minutes? (60) 53.59 25.57 49.53 24.70 -8.77 < .001 -0.57 .25 -5.80 8.88
How long did Vuk Karadžić live? (76) 92.73 311.86 82.78 248.92 -2.42 .016 -0.16 .02 -7.33 7.93
+20% How old is Belgrade zoo? (75) 63.19 43.07 69.97 45.40 14.50 < .001 0.94 .47 11.49 9.58
How many keys are there on a concert grand piano? (88) 57.53 31.84 64.26 35.27 15.31 < .001 1.00 .45 12.59 9.28
What is the hottest temperature ever recorded in the world? (58) 111.46 298.69 121.45 312.95 5.12 < .001 0.33 .10 8.60 9.16
+40% What is the length of standard playing cards in millimeters? (88) 154.54 404.80 187.30 550.02 3.29 .001 0.21 .04 14.32 17.88
How many novels did Agatha Christie write? (82) 23.60 28.05 28.69 33.46 9.47 < .001 0.62 .28 23.85 18.66
How many Academy Awards for best picture was given to date? (84) 82.93 142.03 103.92 181.41 6.84 <.001 0.45 .17 25.87 18.05
+60% What is the latitude of Reykjavik? (64) 79.90 175.18 109.94 267.42 4.67 < .001 0.30 .09 35.03 27.89
What are 70 yards in meters? (64) 1141.50 2315.80 1227.90 2363.60 4.56 < .001 0.30 .08 25.21 28.01
What is the atomic number of mercury? (80) 32.54 45.93 41.99 55.23 8.72 < .001 0.57 .25 34.04 28.19
+80% How many days are there in each season of the Discordian Calendar? (73) 132.53 647.48 159.21 651.38 7.93 < .001 0.52 .21 34.62 36.66
What is the distance between Bratislava and Vienna in kilometers? (64) 342.04 623.12 457.51 717.57 8.44 < .001 0.55 .23 41.38 34.49
How many calories are there in a 100 grams of apple? (53) 80.84 172.01 99.70 243.37 3.09 .002 0.20 .04 24.70 33.54

Note. d = Cohen’s d. η2 = eta-square. AE = a measure of the anchoring effect.

Anchors accounted for between 2% and 50% of estimates’ variance across questions, as indicated by η2 values, while absolute values of Cohen’s d ranged from 0.14 to 1.00. On average, magnitude of anchoring effect was medium and somewhat higher for positive anchors (dANC+ = 0.50, ηANC+2 = .20) compared to negative ones (dANC- = -0.42, ηANC-2 = .14).

While standard indices of effect size are directly conditioned by the response variability across participants, AE measures relate initial to final estimates for each participant and hence are not dependent on differences between participants. As it is presented in penultimate column of Table 1, final estimates were on average from 9% to 41% higher than initial estimates for positive anchors, i.e. from 4.5% to 33.4% lower for negative anchors.

To enable their comparison and further aggregation, AE values were absolutized for negative anchors. For each of eight experimental conditions, anchoring effect measures were calculated as average AE score on three belonging questions (see Figure 1).

Click to enlarge
ejop.v15i1.1691-f1
Figure 1

Mean anchoring effect and 95% CI error bars for each experimental condition.

Overall, participants amended their final estimates by 21.4 percent, 95% CI [20.3, 22.5], of initial estimates’ value. Results of two-way analysis of variance for repeated measures revealed that degree of anchoring effect strongly depended on both anchor direction, F(1,235) = 76.53, p < .001, η2 = .25, and anchor distance, F(3,705) = 265.67, p < .001, η2 = .53. Main effects were not qualified by the higher order interaction, F(3,705) = 1.47, p = .22.

Negatively directed anchors had a significantly lower impact (MANC- = 18.44, 95% CI [17.36, 19.52]) in comparison to the positive anchors (MANC- = 24.46, 95% CI [23.01, 25.91]), and this was the case for each anchor distance (ps < .001). The large effect of anchor’s direction is probably due to the fact that lower boundary of possible values on each question was (near to) zero.

Anchoring effect measures were even more strongly influenced by relative anchor distance. There was general increase of anchoring effect for the first three anchor distance levels. An almost linear relationship was observed with AE measures on the approximately halfway between the initial estimates and the anchors. However, increase leveled off between 60% and 80% distances, for both positive and negative anchors. Differences between mean AEs for last two distances were not significant (ps > .10)iii. This pattern of results indicates that further increasing of anchor distance would probably not be followed by significant increase of anchoring effect size.

Susceptibility to Anchoring Effect

Considerable variability of AE measures was observed across participants on each question (see the last column of Table 1). Moreover, participants who were more susceptible to anchoring effect on one item were also more prone to amend their estimates toward anchors on other items. Internal consistency of individual differences was acceptable (α = .71). The average correlation between AE measures for 24 items was relatively small (r = .11), but it was notably higher after aggregation for eight experimental conditions (r = .27). The first principle component accounted for 36.7% of their total variance (λ = 2.94). It was highly loaded by each AE score (rs ranged from .46 to .73) and approximately normally distributed (KS Z = 0.54, p = .59).

Predictors of Susceptibility to Anchoring Effect

Cognitive and personality measures were collected with the aim to explore their capacity for predicting individual differences in anchoring effect. Results presented in Table 2 suggest fair levels of reliability for all of the measures (αs ≥ .70), except for CRT (α = .40). Latter is not surprising considering that CRT consisted only of three items. Also, performance on CRT was very poor. As much as 199 (84.3%) participants failed to give at least one correct answer. Hence, a high reflective group of subjects in this study consisted of only 37 participants who scored at minimum one point on CRT.

Table 2

Descriptive Statistics for Predictors and Results of Multiple Regression Analysis

Predictors Descriptive Statistics
Regression Analysis
M SD n α r β p
Cognitive Measures
Raven’s Matrices (RM) 12.54 3.14 18 .79 .03 .02 .81
Vocabulary 20.82 6.49 56 .73 -.04 -.09 .17
Cognitive Reflection Test (CRT) 0.20 0.50 3 .40 .00 -.04 .70
Personality Measures
Openness 3.26 0.53 12 .72 .24 .26 < .001
Conscientiousness 3.71 0.57 12 .84 .13 .13 .07
Extraversion 3.41 0.56 12 .78 -.01 -.08 .25
Agreeableness 3.41 0.51 12 .70 .08 .03 .67
Neuroticism 2.68 0.70 12 .84 .00 .06 .43

A measure of overall susceptibility to anchoring effect was regressed on the set of potential predictorsiv and the results are displayed in the last three columns of Table 2. Zero-order correlations were relatively small, and only the trait of openness correlated significantly with anchoring effect (r = .24, p < .001). Besides, openness was the only measure that significantly contributed to the prediction model (β = 0.27, p < .001). In total, relatively small portion of anchoring effect’s variance was accounted for by predictors (F(8,227) = 2.65, p = .008, R2 = 5.3%).

Cognitive measures showed no direct correlation with anchoring. However, it was hypothesized that processes captured by AE measures may differ with respect to the degree of subjects’ reflectivity, i.e. that cognitive reflection might moderate the relationship between cognitive abilities and anchoring effect. Results confirmed this expectation. Standardized interaction term, entered in multiple regression analysis along with standardized CRT and RM scores, was highly significant (β = -.24, p = .004). For the group of participants who performed poorly on CRT (NCRT- = 199), the correlation between RM scores and anchoring effect measures was not significant (r = .11, p = .13), while for the group of participants that had at least one correct CRT answer (NCRT+ = 37), RM performance significantly correlated with anchoring (r = -.51, p = .001)v. Furthermore, results of separate multiple regression analyses for the two groups, presented in Table 3, indicate stronger effect of predictor set in high reflective group (R2 = 32.0%) in comparison to low reflective group (R2 = 5.3%), even after controlling for difference between size of groups (Fischer’s z = 2.21, p = .027).

Table 3

Results of Regression Analyses for Two Cognitive Reflection Groups

Predictor Low CRTa
High CRTb
β p β p
Raven’s Matrices .08 .29 -.49 .003
Vocabulary -.05 .50 -.29 .049
Openness .26 .001 .19 .26
Conscientiousness .10 .23 .18 .28
Extraversion -.06 .44 -.19 .28
Agreeableness .01 .84 .18 .28
Neuroticism .08 .34 -.07 .72

aF(7,191) = 2.592, p = .014, R2 (adjusted) = 5.33%. bF(7,29) = 3.422, p = .009, R2 (adjusted) = 32.01%.

Discussion

Anchoring effect is a well-documented phenomenon. Yet, studies that examine covariates of susceptibility to this cognitive bias are relatively recent and with mixed findings (Bergman et al., 2010; Caputo, 2014; Eroglu & Croxton, 2010; Furnham et al., 2012; Jasper & Christman, 2005; Jasper & Ortner, 2014; McElroy & Dowd, 2007; Oechssler et al., 2009; Stanovich & West, 2008; Welsh et al., 2014). Relative inconsistency in reported results could be partly due to questionable psychometric properties of used instruments, but also due to the absence of the uniform procedure for reliable measurement of individual differences in susceptibility to anchoring effect. In respect to latter, at least two approaches can be distinguished. First, predictors of anchoring were examined by using interaction test in 2 x 2 ANOVA with anchor condition (high/low) and dichotomized psychometric construct of interest as between-subject factors. In such way, McElroy and Dowd (2007) showed that participants who were high on openness to experience provided higher estimates for high anchors and lower estimates for low anchors in comparison to participants who were low on openness. A similar procedure was used in several subsequent studies (Furnham et al., 2012; Oechssler et al., 2009; Stanovich & West, 2008). Drawbacks of this approach lie in the inevitable arbitrariness of dichotomization criteria and practical inability to simultaneously examine effects of several predictors. As an alternative solution, Welsh et al. (2014) proposed a multi-item measure of anchoring expressed as a correlation between experimentally provided anchors and participant’s numerical estimates across the number of trials on a specially constructed card game. In such way, several predictors could be simultaneously examined. However, authors missed to examine reliability of these measures, and the question of generalizability of findings beyond gambling setting can also be raised.

The present study was designed with an intention to overcome some shortcomings of the previous studies. Introduction of pretest session, in which participants stated their anchor-free estimates before appliance of standard paradigm, ensured that anchor direction and relative extremity were same for all participants. This also allowed direct comparability of the anchor distance and the anchoring effect measures. An additional benefit of applied within-subject procedure lies in the opportunity to collect measures of the anchoring effect for each participant on each question and to evaluate psychometric properties, which was mostly ignored in previous research (for the exception, see Jasper & Ortner, 2014). Finally, proposed procedure opens the possibility for multilevel analyses aimed to explore whether effects of experimental factors are moderated by individual characteristics of participantsvi.

The average size of the anchoring effect in the present study was medium. Participants amended an initial estimate of uncertain quantity toward anchor in more than half cases, on average for slightly more than one-fifth of its value. In that sense, an experimental reliability of the anchoring effect was yet again confirmed, this time by using within-subject design. It seems plausible to suppose that anchoring effect would be even stronger if participants were not previously asked to express their anchor-free estimates, i.e. that reported results can be seen as conservative indications of the anchoring effect size.

Anchors showed asymmetrical effect. Positively directed anchors produced larger effects in comparison to equally distanced negative anchors, which is in line with previous findings (Hardt & Pohl, 2003; Jacowitz & Kahneman, 1995; Jasper & Christman, 2005). This was probably due to fact that the degree of estimate change for negative anchors was both theoretically and psychologically limited by a fixed lower boundary of possible responses. Unlike that, effects of positive anchors were not limited in this way, since upper boundaries of reasonable values on the most of questions were not fixed. Besides, in both directions, more distanced anchors led to a larger anchoring effect, but only to some point. For the most extreme anchors, no significant difference in effect was observed in comparison to the nearest anchors. This indicates that maximum of the anchoring effect was registered and that more distant anchors would yield same (Mussweiler & Strack, 2001) if not weaker (Wegener et al., 2001) effect.

Considering the correlational aspects, results indicate fair internal consistency of the anchoring effect measures, thus preventing alternative interpretations of negligible correlations. Anchoring effect was directly associated only with the trait of openness. As suggested by McElroy and Dowd (2007), this can be viewed as a consequence of enhanced sensitivity to external information which is a common characteristic of two phenomena. In other words, participants prone to take into account alternative points of view in general also show increased readiness to amend their answers toward externally suggested solutions on estimation tasks. Other personality traits were not correlated with anchoring, although some previous studies suggested that possibility (e.g. Caputo, 2014; Eroglu & Croxton, 2010).

Findings on the relations between cognitive variables and AE measures are of particular theoretical importance since they could shed some light on the discussion about psychological mechanisms that underlie anchoring effects. Kahneman (2011) put previously emerged distinction between two competing theoretical accounts of the anchoring effect into the context of dual-process theories of human reasoning. An adjustment was explicitly described as deliberate Type 2 process which is typically carrying out in multiple steps. After estimating if the correct value is higher or lower than the presented anchor, people adjust from the anchor by generating an initial value. Afterwards, people evaluate if this value is a reasonable answer (in which case they terminate adjustment and provide an estimate), or it requires additional modification (in which case they readjust estimate further away from the anchor value). Anchoring effect is hypothesized to arise partially because the capability to perform processes of evaluating and adjusting is limited by capacities of working memory. Since individual differences in these capacities can be approximated by intelligence tests (e.g. Evans & Stanovich, 2013; Stanovich & West, 2008), one would expect to observe a negative correlation between measures of intelligence and anchoring. In that sense, finding that AE measures were not directly related to cognitive measures, which is in line with previously reported results (Bergman et al., 2010; Furnham et al., 2012; Jasper & Ortner, 2014; Oechssler et al., 2009; Stanovich & West, 2008; Welsh et al., 2014), could imply that adjustment, as effortful cognitive process is not involved in the emergence of the anchoring effect at all. Nevertheless, a relation between intelligence and anchoring depended on cognitive reflection. In other words, readiness to involve in more demanding Type 2 processes moderated the relation between cognitive capacities and susceptibility to anchoring effect. For the vast majority of participants, who were prone to mentally economize by hinging on intuitive Type 1 processes, differences in intelligence indeed were not related to anchoring. It can be hypothesized that final estimates of these subjects have not resulted from serial adjustments but were outcomes of Type 1 processing, i.e. relatively automatic activation of information consistent with the presented anchor. Observed variability among these subjects might be due to variations in the dispositional sensitivity to external information, or due to individual differences in distortions of scale on which answers are provided (e.g. Frederick & Mochon, 2012), but unlikely due to capacities to repeatedly reconsider readjusted anchor as a possible answer to given question. However, for more reflective subjects, negative correlation between intelligence and anchoring was observed – participants with higher capacities to carry out Type 2 processes adjusted further away from anchors. In other words, differences among more reflective subjects, who were prone to engage in processes of reevaluation and readjustment before stating their final estimates, were at least to some extent due to their capacities to perform these processes. This indicates that (insufficient) adjustment, at least for some subjects, plays role in the emergence of the anchoring effect.

This finding, though, should be taken with caution, considering the low reliability of three-item CRT and relatively small size of high reflective subsample. Future replications are neededvii. While more direct ones would seek to perform similarly designed study by using psychometrically improved instruments, such as seven-item CRT (Toplak, West, & Stanovich, 2014), others could examine whether comparable results would be obtained if cognitive reflection is measured in other ways, for example by using typical performance measures, such as need for cognition or actively open-minded thinkingviii, as suggested by Stanovich (2009). Finally, studies that combine experimental and differential perspective could be also applied with the same purpose. For example, study could be organized with aim to explore if subjects with larger cognitive capacities benefit more from interventions previously shown to reduce anchoring effect, such as consider-the-opposite strategy (Adame, 2016; Mussweiler, Strack, & Pfeiffer, 2000), forewarnings (Epley & Gilovich, 2005, Study 2), or accuracy motivation (Epley & Gilovich, 2005, Study 1; Simmons et al., 2010).

The present study explored some of the potential benefits of novel within-subject procedure which allows simultaneous manipulation of experimental factors of anchor’s distance and direction and reliable measurement of individual differences in susceptibility to anchoring effect. Although first results are promising, future studies are needed, especially those driven by theoretical expectations aimed to examine cognitive processes involved in anchoring effect.

Notes

i) AE measures could not be calculated when denominator, i.e. initial estimate had zero value, which was the case in 92 trials (1.63%). Distribution of missing AE data by questions is displayed in the third row of Table A1 in the Appendix.

ii) Although markedly smaller percent of measures was amended when more classical trimming procedures were applied (0.9% after following Tabachnick & Fidell, 2007; 2.1% after following procedure proposed by Tukey, 1977), the pattern of results presented in this paper have remained the exact same.

iii) Accordingly, results of polynomial contrast tests showed that linear and quadratic components were significant for both positive (linear F(1,235) = 312.54, p < .001; quadratic F(1,235) = 25.87, p < .001) and negative anchors (linear F(1,235) = 329.45, p < .001; quadratic F(1,235) = 43.74, p < .001).

iv) Correlations among predictors are presented in Table A2 in the Appendix.

v) Two reviewers expressed consideration regarding the poor performance on CRT and consequently the small size of the high reflective subsample. It should be noted here that poor CRT performance was not consequence of deficient instruction or indication of non-understanding of a task. Participants did understand the task, considering high rate of predictably irrational / intuitive responses (for example, to a question “If it takes 5 machines 5 minutes to make 5 widgets, how long it takes 100 machines to make 100 widgets?” as much as 78.1% of participants provided wrong intuitive answer “100 minutes”; similar pattern was observed for the other two questions). Poor performance was expected since it was one of the first reported findings on CRT (see e.g. Table 1 on page 29 in Frederick, 2005). Considering this, it seems reasonable to set cut-off score to one out of three. However, when analysis was performed on a very small subsample of subjects who had at least two correct answers (n = 9), a similar pattern of correlations was observed (for RM r = -.36; for Vocabulary r = -.57).

vi) Multilevel analysis was run on data gathered in this study, with aim to examine if different parameters of individual anchor distance functions - intercept, linear term and quadratic term (as indicators of general susceptibility to anchoring, sensitivity to changes in anchor distance, and resistance to anchor extremity, respectively) are related to personality traits and cognitive variables. While results regarding general susceptibility to anchoring effect were similar to results reported here, low reliability of individual differences in two other parameters prevented any firm conclusion on their covariates.

vii) Considering the limited size of high reflective group (NCRT+ = 37), estimated correlation between Raven’s matrices and anchoring (r = - .51) was not highly precise (95% CI [.22, .72]). In the light of previous findings that indicate low to a medium correlation between anchoring and cognitive measures, it is far more plausible to suppose that effect size in population would be closer to the lower boundary of 95% confidence interval. Correlational studies that seek to confirm that relationship between intelligence and anchoring do exist in a high reflective group (e.g. ρCRT+ = .30), but not in a low reflective group (ρCRT- = .00), would have a power of only 50.1% if subsamples remained same in size. However, under the same condition, if the effect size in population were a little bit higher (e.g. ρCRT+ = .40), power would be 73.4%. Anyhow, future studies are recommended to use larger samples, particularly subsample of high reflective participants. I would like to thank an anonymous reviewer for the encouragement to elaborate on this point.

viii) Previous studies on thinking styles as potential predictors of anchoring effect yielded inconsistent results (see e.g. Cheek & Norem, 2017; Epley & Gilovich, 2006; Jasper & Christman, 2005).

Funding

This research was supported by the Ministry of Education, Science and Technological Development of Serbia, Project No 179018.

Competing Interests

The author has declared that no competing interests exist.

Acknowledgments

The author has no support to report.

References

  • Adame, B. J. (2016). Training in the mitigation of anchoring bias: A test of the consider-the-opposite strategy. Learning and Motivation, 53, 36-48. https://doi.org/10.1016/j.lmot.2015.11.002

  • Bergman, O., Ellingsen, T., Johannesson, M., & Svensson, C. (2010). Anchoring and cognitive ability. Economics Letters, 107(1), 66-68. https://doi.org/10.1016/j.econlet.2009.12.028

  • Bokulić, M., & Polšek, D. (2010). Heuristika sidrenja. Prolegomena, 9(1), 71-95.

  • Caputo, A. (2014). Relevant information, personality traits and anchoring effect. International Journal of Management and Decision Making, 13(1), 62-76. https://doi.org/10.1504/IJMDM.2014.058470

  • Chapman, G. B., & Johnson, E. J. (1999). Anchoring, activation, and the construction of values. Organizational Behavior and Human Decision Processes, 79(2), 115-153. https://doi.org/10.1006/obhd.1999.2841

  • Cheek, N. N., & Norem, J. K. (2017). Holistic thinkers anchor less: Exploring the roles of self-construal and thinking styles in anchoring susceptibility. Personality and Individual Differences, 115, 174-176. https://doi.org/10.1016/j.paid.2016.01.034

  • Costa, P. T., & McCrae, R. R. (1992). Revised NEO Personality Inventory (NEO-PI-R) and NEO Five-Factor Inventory (NEO-FFI) professional manual. Odessa, FL, USA: Psychological Assessment Resources.

  • Epley, N. (2004). A tale of tuned decks? Anchoring as accessibility and anchoring as adjustment. In D. J. Koehler & N. Harvey (Eds.), The Blackwell handbook of judgment and decision making (pp. 240-256). Oxford, United Kingdom: Blackwell.

  • Epley, N., & Gilovich, T. (2005). When effortful thinking influences judgmental anchoring: Differential effects of forewarning and incentives on self‐generated and externally provided anchors. Journal of Behavioral Decision Making, 18(3), 199-212. https://doi.org/10.1002/bdm.495

  • Epley, N., & Gilovich, T. (2006). The anchoring-and-adjustment heuristic: Why the adjustments are insufficient. Psychological Science, 17(4), 311-318. https://doi.org/10.1111/j.1467-9280.2006.01704.x

  • Eroglu, C., & Croxton, K. L. (2010). Biases in judgmental adjustments of statistical forecasts: The role of individual differences. International Journal of Forecasting, 26(1), 116-133. https://doi.org/10.1016/j.ijforecast.2009.02.005

  • Evans, J. S. B., & Stanovich, K. E. (2013). Dual-process theories of higher cognition: Advancing the debate. Perspectives on Psychological Science, 8(3), 223-241. https://doi.org/10.1177/1745691612460685

  • Frederick, S. (2005). Cognitive reflection and decision making. The Journal of Economic Perspectives, 19(4), 25-42. https://doi.org/10.1257/089533005775196732

  • Frederick, S. W., & Mochon, D. (2012). A scale distortion theory of anchoring. Journal of Experimental Psychology: General, 141(1), 124-134. https://doi.org/10.1037/a0024006

  • Furnham, A., & Boo, H. C. (2011). A literature review of the anchoring effect. Journal of Socio-Economics, 40(1), 35-42. https://doi.org/10.1016/j.socec.2010.10.008

  • Furnham, A., Boo, H. C., & McClelland, A. (2012). Individual differences and the susceptibility to the influence of anchoring cues. Journal of Individual Differences, 33(2), 89-93. https://doi.org/10.1027/1614-0001/a000076

  • Hardt, O., & Pohl, R. (2003). Hindsight bias as a function of anchor distance and anchor plausibility. Memory, 11(4-5), 379-394. https://doi.org/10.1080/09658210244000504

  • Jacowitz, K. E., & Kahneman, D. (1995). Measures of anchoring in estimation tasks. Personality and Social Psychology Bulletin, 21(11), 1161-1166. https://doi.org/10.1177/01461672952111004

  • Jasper, F., & Ortner, T. M. (2014). The tendency to fall for distracting information while making judgments: Development and validation of the objective Heuristic Thinking Test. European Journal of Psychological Assessment, 30(3), 193-207. https://doi.org/10.1027/1015-5759/a000214

  • Jasper, J. D., & Christman, S. D. (2005). A neuropsychological dimension for anchoring effects. Journal of Behavioral Decision Making, 18(5), 343-369. https://doi.org/10.1002/bdm.511

  • Kahneman, D. (2011). Thinking, fast and slow. New York, NY, USA: Farrar, Straus and Giroux.

  • Knežević, G., & Opačić, G. (2011). Vocabulary Test. Unpublished Material.

  • McElroy, T., & Dowd, K. (2007). Susceptibility to anchoring effects: How openness-to-experience influences responses to anchoring cues. Judgment and Decision Making, 2(1), 48-53.

  • Mussweiler, T., & Strack, F. (1999). Hypothesis-consistent testing and semantic priming in the anchoring paradigm: A selective accessibility model. Journal of Experimental Social Psychology, 35(2), 136-164. https://doi.org/10.1006/jesp.1998.1364

  • Mussweiler, T., & Strack, F. (2001). Considering the impossible: Explaining the effects of implausible anchors. Social Cognition, 19(2), 145-160. https://doi.org/10.1521/soco.19.2.145.20705

  • Mussweiler, T., Strack, F., & Pfeiffer, T. (2000). Overcoming the inevitable anchoring effect: Considering the opposite compensates for selective accessibility. Personality and Social Psychology Bulletin, 26(9), 1142-1150. https://doi.org/10.1177/01461672002611010

  • Oechssler, J., Roider, A., & Schmitz, P. W. (2009). Cognitive abilities and behavioral biases. Journal of Economic Behavior & Organization, 72(1), 147-152. https://doi.org/10.1016/j.jebo.2009.04.018

  • Pallier, G., Wilkinson, R., Danthiir, V., Kleitman, S., Knezevic, G., Stankov, L., & Roberts, R. D. (2002). The role of individual differences in the accuracy of confidence judgments. The Journal of General Psychology, 129(3), 257-299. https://doi.org/10.1080/00221300209602099

  • Raven, J. C., Court, J. H., & Raven, J. (1979). Manual for Raven’s Progressive Matrices and Vocabulary Scales. London, United Kingdom: H. K. Lewis & Co.

  • Simmons, J. P., LeBoeuf, R. A., & Nelson, L. D. (2010). The effect of accuracy motivation on anchoring and adjustment: Do people adjust from provided anchors? Journal of Personality and Social Psychology, 99(6), 917-932. https://doi.org/10.1037/a0021540

  • Stanovich, K. E. (2009). Distinguishing the reflective, algorithmic, and autonomous minds: Is it time for a tri-process theory? In J. Evans & K. Frankish (Eds.), In two minds: Dual processes and beyond (pp. 55-88). Oxford, United Kingdom: Oxford University Press. https://doi.org/10.1093/acprof:oso/9780199230167.003.0003

  • Stanovich, K. E., & West, R. F. (2000). Individual differences in reasoning: Implications for the rationality debate? Behavioral and Brain Sciences, 23(5), 645-665. https://doi.org/10.1017/S0140525X00003435

  • Stanovich, K. E., & West, R. F. (2008). On the relative independence of thinking biases and cognitive ability. Journal of Personality and Social Psychology, 94(4), 672-695. https://doi.org/10.1037/0022-3514.94.4.672

  • Strack, F., & Mussweiler, T. (1997). Explaining the enigmatic anchoring effect: Mechanisms of selective accessibility. Journal of Personality and Social Psychology, 73(3), 437-446. https://doi.org/10.1037/0022-3514.73.3.437

  • Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics. Boston, MA, USA: Allyn & Bacon/Pearson Education.

  • Teovanović, P. (2013). Susceptibility to cognitive biases (Doctoral dissertation). Retrieved from National Repository of Dissertations in Serbia. (Accession No. 3303)

  • Teovanović, P., Knežević, G., & Stankov, L. (2015). Individual differences in cognitive biases: Evidence against one-factor theory of rationality. Intelligence, 50, 75-86. https://doi.org/10.1016/j.intell.2015.02.008

  • Toplak, M. E., West, R. F., & Stanovich, K. E. (2014). Assessing miserly information processing: An expansion of the Cognitive Reflection Test. Thinking & Reasoning, 20(2), 147-168. https://doi.org/10.1080/13546783.2013.844729

  • Tukey, J. W. (1977). Exploratory data analysis. Reading, MA, USA: Addison-Wesley.

  • Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185(4157), 1124-1131. https://doi.org/10.1126/science.185.4157.1124

  • Wegener, D. T., Petty, R. E., Detweiler-Bedell, B. T., & Jarvis, W. B. G. (2001). Implications of attitude change theories for numerical anchoring: Anchor plausibility and the limits of anchor effectiveness. Journal of Experimental Social Psychology, 37(1), 62-69. https://doi.org/10.1006/jesp.2000.1431

  • Welsh, M. B., Delfabbro, P. H., Burns, N. R., & Begg, S. H. (2014). Individual differences in anchoring: Traits and experience. Learning and Individual Differences, 29, 131-140. https://doi.org/10.1016/j.lindif.2013.01.002

Appendix

Table A1

Distribution of Missing and Trimmed Data in the Anchoring Experiment

Anchor Target quantity (correct response) Zero denominators Over-anchoring Under-anchoring
-80% Squares on a shogi playing board (81) 1 5 16
Castles in Vojvodina (67) 23 2 6
Gold medals won by China in 2008 Summer Olympics (51) 3 0 33
-60% Chromosomes in penguins (80) 5 6 9
Civil airports in Germany (65) 2 1 11
Awarded NIN prizes for best novel (58) 0 5 35
-40% African countries in the United Nations (53) 20 6 14
Mercury revolution around the sun in days (88) 3 13 22
Heights of Saint Sava Temple in meters (82) 0 6 7
-20% Length of an Olympic size swimming pool in meters (50) 0 15 15
Duration of the hockey game in minutes (60) 0 12 8
Years lived by Vuk Karadžić (76) 0 3 10
+20% Belgrade zoo in years (75) 0 36 16
Concert grand piano keys (88) 0 68 12
Hottest temperature recorded in the world (58) 0 36 13
+40% Length of standard playing cards in millimeters (88) 0 28 9
Novels that Agatha Christie wrote (82) 5 80 7
Academy Awards for best picture (84) 0 75 17
+60% Latitude of Reykjavik (64) 2 56 12
Seventy yards in meters (64) 5 34 18
Atomic number of mercury (80) 5 93 4
+80% Days in each season of the Discordian Calendar (73) 5 30 13
Distance between Bratislava and Vienna in kilometers (64) 1 25 8
Calories in a 100 g apple (53) 12 17 19
Total 92 (1.63%) 652 (11.56%) 334 (5.92%)
Table A2

Correlations Among Cognitive Variables and Personality Traits

Variable 1 2 3 4 5 6 7
Cognitive Measures
1. Raven’s Matrices (RM)
2. Vocabulary .30**
3. Cognitive Reflection Test (CRT) .23** .09
Personality Measures
4. Openness .23** .16* .18*
5. Conscientiousness -.11 -.06 -.05 .12
6. Extraversion -.09 -.20* .08 .20** .22**
7. Agreeableness .09 .08 .00 .17** .17** -.02
8. Neuroticism -.11 .03 -.03 -.12 -.40** -.37** -.19**

About the Author

Predrag Teovanović is an assistant professor of methodology and statistics at Faculty for Special Education and Rehabilitation, University of Belgrade, and member of the Laboratory for Research of Individual Differences at the same university.