discrimination in a low-wage labor market: a field...

23
D espite legal bans on discrimination and the liberalization of racial attitudes since the 1960s, racial differences in employment remain among the most enduring forms of economic inequality. Even in the tight labor market of the late 1990s, unemployment rates for black men remained twice that for whites. Racial inequal- ity in total joblessness—including those who exited the labor market—increased among young men during this period (Holzer and Offner 2001). Against this backdrop of persist- ent racial inequality, the question of employment discrimination has generated renewed interest. Although there is much research on racial dis- parities in employment, the contemporary rel- evance of discrimination remains widely contested. One line of research points to the persist- ence of prejudice and discrimination as a criti- cal factor shaping contemporary racial disparities (Darity and Mason 1998; Roscigno et al. 2007). A series of studies relying on sur- veys and in-depth interviews finds that firms are reluctant to hire young minority men—espe- cially blacks—because they are seen as unreli- able, dishonest, or lacking in social or cognitive skills (Holzer 1996; Kirschenman and Neckerman 1991; Moss and Tilly 2001; Waldinger and Lichter 2003; Wilson 1996: chap. 5). The strong negative attitudes expressed by employers suggest that race remains highly Discrimination in a Low-Wage Labor Market: A Field Experiment Devah Pager Bruce Western Princeton University Harvard University Bart Bonikowski Princeton University Decades of racial progress have led some researchers and policymakers to doubt that discrimination remains an important cause of economic inequality. To study contemporary discrimination, we conducted a field experiment in the low-wage labor market of New York City, recruiting white, black, and Latino job applicants who were matched on demographic characteristics and interpersonal skills. These applicants were given equivalent résumés and sent to apply in tandem for hundreds of entry-level jobs. Our results show that black applicants were half as likely as equally qualified whites to receive a callback or job offer. In fact, black and Latino applicants with clean backgrounds fared no better than white applicants just released from prison. Additional qualitative evidence from our applicants’experiences further illustrates the multiple points at which employment trajectories can be deflected by various forms of racial bias. These results point to the subtle yet systematic forms of discrimination that continue to shape employment opportunities for low-wage workers. AMERICAN SOCIOLOGICAL REVIEW, 2009, VOL. 74 (October:777–799) Direct all correspondence to Devah Pager, Department of Sociology, Princeton University, Princeton, NJ 08544 ([email protected]). This research has been supported by grants from the National Science Foundation, the National Institute of Justice, the JEHT Foundation, the Princeton Research Institute on the Region, and the Industrial Relations Section of Princeton University. The first author acknowledges generous support from NSF CAREER, NIH K01, and a W.T. Grant Scholars Award. We also gratefully acknowledge the support of the New York City Commission on Human Rights, and Commissioner Patricia Gatling. Thanks to Glenn Martin, Don Green, and the many workshop partic- ipants who provided generous feedback on earlier drafts of this article.

Upload: others

Post on 23-Mar-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

Despite legal bans on discrimination and theliberalization of racial attitudes since the

1960s, racial differences in employment remainamong the most enduring forms of economicinequality. Even in the tight labor market of thelate 1990s, unemployment rates for black menremained twice that for whites. Racial inequal-

ity in total joblessness—including those whoexited the labor market—increased amongyoung men during this period (Holzer andOffner 2001). Against this backdrop of persist-ent racial inequality, the question of employmentdiscrimination has generated renewed interest.Although there is much research on racial dis-parities in employment, the contemporary rel-evance of discrimination remains widelycontested.

One line of research points to the persist-ence of prejudice and discrimination as a criti-cal factor shaping contemporary racialdisparities (Darity and Mason 1998; Roscignoet al. 2007). A series of studies relying on sur-veys and in-depth interviews finds that firms arereluctant to hire young minority men—espe-cially blacks—because they are seen as unreli-able, dishonest, or lacking in social or cognitiveskills (Holzer 1996; Kirschenman andNeckerman 1991; Moss and Tilly 2001;Waldinger and Lichter 2003; Wilson 1996: chap.5). The strong negative attitudes expressed byemployers suggest that race remains highly

Discrimination in a Low-Wage LaborMarket: A Field Experiment

Devah Pager Bruce WesternPrinceton University Harvard University

Bart BonikowskiPrinceton University

Decades of racial progress have led some researchers and policymakers to doubt that

discrimination remains an important cause of economic inequality. To study

contemporary discrimination, we conducted a field experiment in the low-wage labor

market of New York City, recruiting white, black, and Latino job applicants who were

matched on demographic characteristics and interpersonal skills. These applicants were

given equivalent résumés and sent to apply in tandem for hundreds of entry-level jobs.

Our results show that black applicants were half as likely as equally qualified whites to

receive a callback or job offer. In fact, black and Latino applicants with clean

backgrounds fared no better than white applicants just released from prison. Additional

qualitative evidence from our applicants’ experiences further illustrates the multiple

points at which employment trajectories can be deflected by various forms of racial bias.

These results point to the subtle yet systematic forms of discrimination that continue to

shape employment opportunities for low-wage workers.

AMERICAN SOCIOLOGICAL REVIEW, 2009, VOL. 74 (October:777–799)

Direct all correspondence to Devah Pager,Department of Sociology, Princeton University,Princeton, NJ 08544 ([email protected]). Thisresearch has been supported by grants from theNational Science Foundation, the National Instituteof Justice, the JEHT Foundation, the PrincetonResearch Institute on the Region, and the IndustrialRelations Section of Princeton University. The firstauthor acknowledges generous support from NSFCAREER, NIH K01, and a W.T. Grant ScholarsAward. We also gratefully acknowledge the supportof the New York City Commission on Human Rights,and Commissioner Patricia Gatling. Thanks to GlennMartin, Don Green, and the many workshop partic-ipants who provided generous feedback on earlierdrafts of this article.

Page 2: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

salient in employers’ evaluations of workers.At the same time, research relying on inter-views with employers leaves uncertain thedegree to which self-reported attitudes are influ-ential in actual hiring decisions (Pager andQuillian 2005). Indeed, Moss and Tilly(2001:151) report the puzzling finding that“businesses where a plurality of managers com-plained about black motivation are more likelyto hire black men.” In fact, across a series ofanalyses controlling for firm size, starting wage,the percent black in the relevant portion of themetropolitan area, and a business’s average dis-tance from black residents in the area, Moss andTilly find that employers who overtly criticizethe hard skills or interaction skills of blackworkers are between two and four times morelikely to hire a black worker (pp.151–52). Hiringdecisions, of course, are influenced by a com-plex range of factors, racial attitudes being onlyone. Employers’ stated preferences do not pro-vide a clear picture of the degree to which neg-ative attitudes about blacks translate into activeforms of discrimination.

Research focusing on wages rather thanemployment offers even less evidence of con-temporary discrimination. Neal and Johnson(1996), for example, estimate wage differencesbetween white, black, and Latino young men.They find that two thirds of the black-whitegap in wages in 1990 to 1991 can be explainedby race differences in cognitive test scores meas-ured 11 years earlier, and test scores fullyexplain wage differences between whites andLatinos. This and similar studies trace theemployment problems of young minority menprimarily to skill or other individual deficien-cies, rather than any direct effect of discrimi-nation (Farkas and Vicknair 1996; Neal andJohnson 1996; O’Neill 1990). Heckman(1998:101–102) puts the point most clearly,writing that “most of the disparity in earningsbetween blacks and whites in the labor marketof the 1990s is due to differences in skills theybring to the market, and not to discriminationwithin the labor market.” He goes on to describelabor market discrimination as “the problem ofan earlier era.”

Does employer discrimination continue toaffect labor market outcomes for minority work-ers? Clear answers are elusive because dis-crimination is hard to measure. Withoutobserving actual hiring decisions, it is difficult

to assess exactly how and under what conditionsrace shapes employer behavior. We address thisissue with a field experiment that allows directobservation of employer decision making. Bypresenting equally qualified applicants who dif-fer only by race or ethnicity, we can observe thedegree to which racial considerations affect realhiring decisions. Furthermore, we move beyondexperimental estimates of discrimination toexplore the processes by which discriminationoccurs. Examining the interactions between jobseekers and employers, we gain new insightsinto how race influences employers’ percep-tions of job candidate quality and desirability.Studying the multifaceted character of dis-crimination highlights the range of decisions thatcollectively reduce opportunities for minoritycandidates.

CONCEPTUALIZINGDISCRIMINATION

Empirical studies often portray discriminationas a single decision. Research on employmentdisparities, for example, considers the role ofdiscrimination at the point of initial hire;research on pay disparities considers discrimi-nation at the point of wage-setting decisions. Inreality, discrimination may occur at multipledecision points across the employment rela-tionship. In this way, even relatively smallepisodes of discrimination—when experiencedat multiple intervals or across multiple con-texts—can have substantial effects on aggregateoutcomes.

Depictions of discriminators also often por-tray the labor market as divided neatly betweenemployers with a “taste for discrimination” andthose who are indifferent to race (Becker 1957).Consequently, it is suggested, job seekers canavoid discrimination by sorting themselves intosectors of the labor market where discriminationis less likely to occur (Heckman 1998:103).Fryer and Levitt (2003:5) characterize employ-ers according to a similar dichotomy, with appli-cants best advised to identify and avoidemployers prone to discrimination, rather thanwasting time pursuing job opportunities amongfirms unwilling to hire them: “In the face of dis-criminatory employers, it is actually in the inter-est of both employee and employers for Blacksto signal race, either via a name or other résuméinformation, rather than undertaking a costly

778—–AMERICAN SOCIOLOGICAL REVIEW

Page 3: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

interview with little hope of receiving a joboffer.” According to this conceptualization oflabor market discrimination, racial preferencesor biases are fixed and concentrated among aspecific subset of employers.

Other evidence challenges this tidy distinc-tion between employers who do and do not dis-criminate. Alternative formulations of labormarket discrimination encourage us to view theprocess as more interactive, contextual, andwidespread. Theories of both statistical dis-crimination and stereotypes view race as aheuristic employers use to evaluate job appli-cants about whom little is known. Here, group-based generalizations provide guidance aboutthe expected profile of individuals from a givengroup and facilitate decision making when infor-mation or time are scarce (Aigner and Cain1977; Fiske 1998). Heuristics of this kind arepervasive (and often unconscious). Their effectsmay vary depending on the availability of andattention to person-specific information (suchas that conveyed through application materialsor in an interview) that may interact with andpotentially override initial expectations.

A long line of social psychological researchinvestigates how stereotypes give way to indi-vidualizing information, as well as the condi-tions under which stereotypes demonstrate astubborn resistance to change (Bodenhausen1988; Fiske 1998; Trope and Thomson 1997).1

This research suggests that salient personaliz-ing information can quickly counteract stereo-typed expectations; however, in evaluatingdifficult-to-observe or ambiguously relevantcharacteristics, or when decision makers havecompeting demands on their attention, stereo-types often filter information in ways that pre-serve expectations (Darley and Gross 1983;Dovidio and Gaertner 2000; Gilbert and Hixon1991). In these cases of decision making underuncertainty, racial preferences or biases areunlikely to be expressed in any static or uniformway, but will vary in intensity and consequencedepending on other characteristics of the appli-cant, the employer, and the interaction betweenthe two.

In addition to noting the varying role of raceacross employment interactions, some researchshifts the focus from employer characteristics tothe characteristics of the job for which a givenworker is being considered. Previous researchpoints to the negative consequences of thechanging composition of low-wage jobs forblack men, with the shift from manufacturingto services skewing the distribution of skilldemands toward “soft skills,” for which blackmen are considered lacking (Moss and Tilly2001). Jobs involving customer service or con-tact with clients heighten the salience of racebecause of employers’concerns about the dressand demeanor of young black men (Moss andTilly 2001). Jobs at the “back of the house” orthose emphasizing manual skills are less like-ly to activate concerns of this kind. In this sce-nario, discrimination may obtain not at theemployer level but at the job level, with blackapplicants excluded from some job types andchanneled into others. In this case, we wouldlook to variation in discrimination not amongemployers but among the job openings for whichworkers are being considered.

Rather than viewing discrimination as a sin-gle decision, or as the result of a small group ofhighly prejudiced employers, a growing body ofresearch points to the variable contexts thatshape how information about applicants may befiltered and interpreted along racial lines.Decision making under uncertainty and therace-typing of jobs both make discriminationmore likely. To capture the contingent and cumu-lative effects of discrimination implied by thesetheories requires an examination of how expe-riences of discrimination may be distributedacross a wide range of decision points and mayvary depending on interactions among theemployer, the applicant, and the job in question.

THE CHANGING LANDSCAPE OFLOW-WAGE LABOR MARKETS

Economic theory predicts the decline of dis-crimination through market competition (Becker1957), but several features of contemporarylow-wage labor markets may sustain or renewracialized decision making. Shifts in the com-position of both low-wage jobs and workershave potentially created new incentives andopportunities for employers to enact racial pref-erences in hiring. First, low-wage job growth is

DISCRIMINATION IN A LOW-WAGE LABOR MARKET—–779

1 Theories of statistical discrimination also predictemployer responsiveness to individual characteristics(e.g., Altonji and Pierret 2001; Oettinger 1996; cf.Pager and Karafin 2009).

Page 4: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

concentrated in service industries, in positionsthat place a heavy emphasis on self-presentation,interaction with customers, and other person-ality-related attributes (Moss and Tilly 2001). Asdiscussed earlier, employers consistently expressconcerns over the “soft skills” of black men,implying a potential skills mismatch between theskill requirements of new job growth and theperceived skill profile of black male job seek-ers. Furthermore, because many of the qualitiesvalued by employers for contemporary low-wage jobs are difficult to evaluate from a writ-ten application or brief meeting, generalizednegative perceptions of minority workers maybe more difficult for individual minority appli-cants to disconfirm (Biernat and Kobrynowicz1997).

Second, low-wage labor markets today arecharacterized by increasing heterogeneity ofthe urban minority work force, with low-skillblack workers now more likely to compete withother minority groups—in particular, low-skillLatino workers. Interviews with employers inLos Angeles and Chicago suggest consistentpreferences for Latinos over blacks, with Latinoworkers viewed as more pliant, reliable, andhard-working (Kirschenman and Neckerman1991; Waldinger and Lichter 2003). Given theseracial preferences among employers, growingcompetition within the low-wage labor marketmay leave black men vulnerable to discrimina-tion relative not only to whites, but to Latinosas well.

Finally, low-wage labor markets are increas-ingly supplied by workers with criminal records.Nearly a third of black men without a collegedegree have prison records by their mid-30s,adding to employers’ reservations about blackmale job applicants (Pager 2007b; Pettit andWestern 2004). The high rate of incarcerationmakes a criminal record a newly importantsource of stigma that is worth studying in its ownright. Moreover, we can view a criminal recordas an extreme and authoritative signal of thekinds of problematic behaviors that employersascribe to young black men. In this context,separating the effects of criminal stigma fromrace provides a useful benchmark for measur-ing racial stigma. In the first effort in this direc-tion, Pager’s (2003) research in a Milwaukeefield experiment compared racial and criminalstigma among matched pairs of job seekers.Fielding a pair of black and a pair of white job

applicants (in which one member of each pairwas randomly assigned a criminal record), Pagerfound that a black applicant with no criminalbackground experiences job prospects similarto those of a white felon. That blackness con-fers the same disadvantage as a felony convic-tion helps calibrate the deeply skeptical view ofyoung black men in the eyes of Milwaukeeemployers.

The growing importance of soft skills, ethnicheterogeneity, and job seekers with criminalrecords suggest the persistence or increasingincidence of discrimination in contemporarylow-wage labor markets. Whether based on sta-tistical generalizations or inaccurate stereo-types, preconceived notions about thecharacteristics or desirability of black men rel-ative to other applicant types are likely to struc-ture the distribution of opportunity along raciallines.

METHODS FOR STUDYING LABORMARKET DISCRIMINATION

Racial discrimination in the labor market is typ-ically studied by comparing the wages of whitesand minorities, statistically controlling forhuman capital characteristics. Estimates from avariety of social surveys suggest that the black-white difference in hourly wages among menusually range between about 10 and 20 percent(Cancio, Evans, and Maume 1996; Darity andMeyers 1998; Neal and Johnson 1996).Although widely used, this residual method, inwhich discrimination is defined as the unex-plained race difference in wages, is sensitive tothe measurement of human capital. Where racedifferences in human capital are incompletelyobserved, the effect of discrimination may beoverestimated (Farkas and Vicknair 1996; Nealand Johnson 1996).

Residual estimates of discrimination inferemployer behavior from data on workers’wages.Field experiments, by contrast, offer a moredirect approach to the measurement of dis-crimination. This approach, also referred to asan audit methodology, involves the use ofmatched teams of job applicants—calledtesters—who apply to real job openings andrecord responses from employers. Testers areassigned equivalent résumés and are matched ona variety of characteristics like age, education,physical appearance, and interpersonal skills.

780—–AMERICAN SOCIOLOGICAL REVIEW

Page 5: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

Because black and white testers are sent to thesame firms, and testers are matched on a widevariety of characteristics, much of the unex-plained variation that confounds residual esti-mates of discrimination is experimentallycontrolled.

In part due to taxing logistical requirements,the use of in-person audit studies of employmentremains rare, with only a handful of such stud-ies conducted over the past 20 years (Bendick,Jackson, and Reinoso 1994; Bendick et al. 1991;Cross et al. 1990; Pager 2003; Turner, Fix, andStruyk 1991).2 Moreover, the typical emphasison a single comparison group leaves severalsignificant features of contemporary urban labormarkets unexplored.

By studying both race and criminal back-ground, the Milwaukee audit study represents animportant starting point for this project (Pager2003). The Milwaukee study examined the influ-ence of the criminal justice system on labormarket stratification by studying the effect of acriminal record for black and white job seekers.Although race emerged as a key theme in thestudy’s findings, the topic of racial discrimina-tion was not a central focus. Moreover, theresearch design yielded only indirect evidenceof racial discrimination because black and whitetesters did not apply to the same employers.Our ability to investigate when and how racialdiscrimination occurs is therefore limited inthis context.

The current study updates and extends ear-lier research in several ways. First, we focusdirectly on the question of racial discrimination,in both conceptualization and design. Thisemphasis allows us to situate our research with-in ongoing debates about discrimination and toprovide a rigorous design for detecting racialdiscrimination. Second, we move beyond stan-dard two-race models of discrimination byincluding matched black, white, and Latino jobseekers, reflecting the racial heterogeneity of

large urban labor markets. To our knowledge,this is the first study of its kind to simultane-ously examine the employment experiences ofthree racial/ethnic groups. Third, to help cali-brate the magnitude of racial preferences, wecompare applicants affected by varying formsof stigma; specifically, we compare minorityapplicants with white applicants just releasedfrom prison. Where the Milwaukee studyattempted this comparison across teams, thepresent analysis provides a direct test by com-paring the outcomes of minority and ex-offend-er applicants who visit the same employers.Finally, we extend our analysis from the quan-titative evidence of differential treatment to arich set of qualitative data that allow for anexploration of the process of discrimination.Drawing from the testers’ extensive field notesthat describe their interactions with employers,we provide a unique window into the range ofemployer responses that characterize discrimi-nation in contemporary low-wage labor markets.

RESEARCH DESIGN AND METHODS

The New York City Hiring Discrimination Studysent matched teams of testers to apply for 340real entry-level jobs throughout New York Cityover nine months in 2004. The testers werewell-spoken, clean-cut young men, ages 22 to26. Most were college-educated, between 5 feet10 inches and 6 feet in height, and recruited inand around New York City. They were matchedon the basis of their verbal skills, interactionalstyles (level of eye contact, demeanor, and ver-bosity), and physical attractiveness. Testers wereassigned fictitious résumés indicating identi-cal educational attainment and comparable qual-ities of high school, work experience (quantityand kind), and neighborhood of residence.Résumés were prepared in different fonts andformats and randomly varied across testers,with each résumé used by testers from eachrace group. Testers presented themselves ashigh school graduates with steady work expe-rience in entry-level jobs. Finally, the testerspassed a common training program to ensureuniform behavior in job interviews. While in thefield, the testers dressed similarly and commu-nicated with teammates by cell phone to antic-ipate unusual interview situations.

We fielded two teams that each included awhite, Latino, and black tester. To help ensure

DISCRIMINATION IN A LOW-WAGE LABOR MARKET—–781

2 For a summary of the results of earlier auditstudies of employment, see Heckman and Siegelman(1993) and Pager (2007a). Correspondence studies,which rely on résumés sent by mail rather than in-per-son applications (e.g., Bertrand and Mullainathan2004), are less costly but rely on application proce-dures less suited for low-wage labor markets (whichtypically require in-person applications).

Page 6: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

comparability, the Latino testers spoke in unac-cented English, were U.S. citizens of PuertoRican descent, and, like the other testers,claimed no Spanish language ability. The firstteam tests a standard racial hierarchy, with thewhite tester serving as a benchmark againstwhich to measure variation in racial and ethnicdiscrimination. To calibrate the magnitude ofracial stigma, the second team compares blackand Latino testers with a white tester with acriminal record. The criminal record was typi-cally disclosed in answer to the standard ques-tion on employment applications, “Have youever been convicted of a crime? If yes, pleaseexplain.” We instructed testers to reveal, whenasked, that they had recently been released fromprison after serving 18 months for a drug felony(possession with intent to distribute, cocaine).In addition, following Pager (2003), the whitetester’s criminal record was also signaled onthe résumé by listing work experience at a stateprison and by listing a parole officer as a ref-erence.3

For both teams, we sampled employers fromjob listings for entry-level positions, definedas jobs requiring little previous experience andno more than a high school degree. Job titlesincluded restaurant jobs, retail sales, warehouseworkers, couriers, telemarketers, customer ser-vice positions, clerical workers, stockers,movers, delivery drivers, and a wide range ofother low-wage positions. Each week, we ran-domly drew job listings from the classified sec-tions of the New York Times, Daily News, NewYork Post, Village Voice, and the online serviceCraigslist. The broad range of job listingsallowed for extensive coverage of the entry-level labor market in New York. From the avail-able population of job listings, we took a simplerandom sample of advertisements each week.Testers in each team applied to each job with-in a 24-hour period, randomly varying the orderof the applicants.

Our dependent variable records any positiveresponse in which a tester was either offered ajob or called back for a second interview. Werecorded callbacks using voicemail boxes set up

for each tester. For employer i (i = 1, . . . ,N ) andtester t (t = W, B, or L for white, black, or Latino),a positive response, yit, is a binary variable thatscores 1 for a job offer or callback, and 0 oth-erwise. We define the level of differential treat-ment as the ratio in positive response rates foreach comparison, rWB = y–W / y–B, where y–t is theproportion of positive responses for testers ofrace t. Under the null hypothesis of equal treat-ment, rWB = 1, the proportion of positiveresponses received by each racial group is equal.For data on matched pairs, several statisticaltests have been proposed that use within-paircomparisons to account for the correlation ofobservations from the same pair (e.g., Agresti1990; Heckman and Siegelman 1993). In ourcase, where three testers are sent to the sameemployer, we have a matched triplet and infor-mation from all three testers should ideally con-tribute to an inference about a contrast betweenany two. Ghosh and colleagues (2000) suggestthat matched pairs can be fit with a hierarchi-cal logistic regression with a random effect foreach pair. We generalize their approach to ourmatched triplets, fitting a random effect foreach employer. If the probability of a positiveresponse is given by E(yit) = pit, the hierarchi-cal model is written

pitlog (1 – pit) = �i + �Bit + �Lit,

where Bit is a dummy variable for blacks, Lit isa dummy variable for Latinos, and the randomeffects for employers, �i, is given a normal dis-tribution. The employer effects, �i, induce acorrelation among observations from the sameemployers and reduce standard errors, as in theusual matched-pair inference. We estimate themodels with Markov Chain Monte Carlo meth-ods. We construct intervals for the ratios (rWB,rWL, and rBL) by taking random draws from theposterior predictive distribution of yit.Alternative methods that adjust for clustering byemployer yield similar results to those report-ed below.

THE PROBLEMS OF MATCHING

The quality of audit results depends on the com-parability of the testers. Because race cannot beexperimentally assigned, researchers must relyon effective selection and matching to constructaudit teams in which all relevant characteristics

782—–AMERICAN SOCIOLOGICAL REVIEW

3 Results from Pager (2003) suggest that provid-ing information about a criminal record to employ-ers who do not request the information does little toaffect hiring decisions.

Page 7: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

of testers are similar—something that may leavesubstantial room for bias. Heckman andSiegelman (1993) argue that researchers knowlittle about the hard-to-observe characteristicshighly prized by employers. If testers are poor-ly matched, evidence of discrimination may bemerely an artifact of idiosyncratic tester char-acteristics.

Bertrand and Mullainathan (2004) removetester effects in a “correspondence test” thatsent résumés with common white and blacknames to employers in Boston and Chicago.Their design allows the random assignment ofrésumé characteristics to white- and black-sounding names, largely removing concernsabout unobserved characteristics. Résumés withwhite names were 50 percent more likely thanthose with black names to receive callbacksfrom employers (9.7 versus 6.5 percent). Studiesof this kind provide some reassurance thatresults from the body of audit research are notdriven by tester effects alone.

Because we rely on in-person audits for ourstudy of low-wage labor markets, the effectivematching of testers is a key concern.4 Wereviewed more than 300 applicants to identifyour final team of 10 testers.5 Successful appli-cants were subject to two lengthy screeninginterviews and a written test, a far more prob-ing job selection process than the testers encoun-tered in their fieldwork.6 Each tester passed a

standard training period, was required to dressuniformly, and was subject to periodic spotchecks for quality control.7

Despite these measures, uncontrolled testereffects remain a threat to inferences about dis-crimination. We assess the sensitivity of ourresults to testers in four ways. First, each testermay have a unique effect, but the average effectof the testers may be zero. In this case, theobservations from each tester will be correlat-ed and standard errors that ignore this cluster-ing will tend to be too small. We allow for thispossibility by fitting an additional random effectfor each tester in our hierarchical logistic regres-sion.8 Second, each tester may have a uniqueeffect, but these effects may not average to zero.To assess the sensitivity of our results to eachtester, we perform a type of cross-validation inwhich the treatment effect is recalculated for areduced data set, sequentially omitting thoseemployers associated with each individual tester.Confidence intervals below are based on mod-els that include employer and tester randomeffects. We compare these results with cross-val-idation treatment effects based on subsets ofthe data in which individual testers are sequen-tially omitted. Third, we recalculate our keyresults for each unique combination of testersmatched in teams over the course of the field-work (see Appendix, Table A2). These results,although sensitive to small sample sizes forsome combinations, tend to support the con-sistency of effects across a number of testercomparisons.

As a final investigation of tester effects, weconsider the possibility that the expectations orbehaviors of testers may influence the auditresults in nonrandom ways. For example, if ablack tester expects to be treated poorly by

DISCRIMINATION IN A LOW-WAGE LABOR MARKET—–783

4 In-person audits also allow for the inclusion ofa wide range of entry-level job types (which oftenrequire in-person applications); they provide a clearmethod for signaling race, without concerns overthe class-connotations of racially distinctive names(Fryer and Levitt 2004); and they allow us to gatherboth quantitative and qualitative data, with informa-tion on whether an applicant receives the job as wellas how he is treated during the interview process.

5 These 300 applicants were prescreened for appro-priate age, race, ethnicity, and gender.

6 Indeed, as an employer herself, the researchermust identify subtle cues about applicants that indi-cate their ability to perform. Whether or not these cuesare explicit, conscious, or measurable, they are pres-ent in a researcher’s evaluation of tester candidates,just as they are in employers’ evaluations of entry-level job applicants. Like employers, researchers areaffected by both objective and subjective/subcon-scious indicators of applicant quality in their selec-tion and matching of testers in ways that should

ultimately improve the nuanced calibration of testpartners.

7 In addition to on-site supervision at the start andfinish of each day of fieldwork, on several occa-sions, we “tested the testers.” For example, we hidvideo cameras in the offices of confederate employ-ers, which allowed us to monitor testers’compliancewith the audit protocol as well as to use the tapes asa training tool to better synchronize test partners’per-formance (not counted among results).

8 Additional models (not shown here) test for fixedeffects of individual testers; we find no significantdifferences across testers within each race group.

Page 8: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

employers, he may appear more withdrawn,nervous, or defensive in interactions. The natureof the interaction may create a self-fulfillingprophecy, in which the tester experiences pooroutcomes for reasons unrelated to his race(Steele and Aronsen 1995). We assess thesetester effects by analyzing the degree to whichpersonal contact between testers and employersis associated with widening racial disparities.Overall, we find no evidence that testers’ inter-personal styles or expectations are associatedwith increasing discrimination; if anything, per-sonal contact appears to weaken the effect ofrace, suggesting that testers’ performance min-imized, rather than exaggerated, our measuresof racial bias (see Appendix, Table A1).

The problem of imperfect matching amongtesters is a well-understood vulnerability ofaudit experiments, and one to which we devot-ed considerable attention. Ironically, however,achieving perfect matches can itself producedistortions in the hiring process. Because auditpartners are matched on all characteristics thatare most directly relevant to hiring decisions(e.g., education, work experience, and physicalattributes), employers may be forced to privilegerelatively minor characteristics simply out ofnecessity to break a tie (Heckman 1998:111). Ifemployers care only marginally about race, butare confronted with applicants equal on all otherdimensions, this single characteristic may takeon greater significance than it would under nor-mal circumstances when evaluating real appli-cants who differ according to multipledimensions.

The design of our study, which focuses on theearly stages of the hiring process, avoids situa-tions in which employers must choose only asingle applicant. By using “callbacks” as one ofour key dependent variables, we include casesthat represent an employer’s first pass at appli-cant screening.9 Indeed, recent surveys suggestthat employers interview an average of six to

eight applicants for each entry-level job open-ing (Pager 2007b). If race represents only aminor concern for employers, we would expectall members of our audit team to make it throughthe first cut. If race figures prominently in thefirst round of review, we can infer that this char-acteristic has been invoked as more than a meretie-breaker. In these cases, the evidence of race-based decision making is quite strong.

EXPERIMENTAL RESULTS

The primary results from the field experimentfocus on the proportion of applications sub-mitted by testers that elicited either a callbackor a job offer from employers, by race of theapplicant. Our first team assesses the effects ofrace discrimination by comparing the outcomesof equally qualified white, Latino, and blackapplicants. Figure 1a reports positive responserates for each racial/ethnic group. In applicationsto 171 employers, the white tester received acallback or job offer 31.0 percent of the time,compared with a positive response rate of 25.2percent for Latinos and 15.2 percent for blacks.These results show a clear racial hierarchy, withwhites in the lead, followed by Latinos, andblacks trailing behind.

Figure 1b shows the contrasts between thethree race groups. Once we adjust for employ-er and tester effects, the confidence interval forthe white-Latino ratio of 1.23 includes one.10 Bycontrast, the white-black ratio of 2.04 is sub-stantively large and statistically significant. Thepositive response rate for blacks is also signif-icantly lower than the rate for Latinos. Thepoints in the figure show the cross-validationresults obtained by sequentially dropping casesassociated with each individual tester. All ratiosremain consistently greater than one, indicatingthat employers treat blacks less positively

784—–AMERICAN SOCIOLOGICAL REVIEW

9 Positive responses recorded in this study werefairly evenly split between callbacks and job offers.Employers who made offers on-the-spot were typi-cally hiring more than one applicant, thus similarlyavoiding a situation in which a forced-choice becomesnecessary. In fact, rates of job offers were more even-ly distributed by race relative to callbacks (see TablesA1 and A2).

10 In a model pooling cases from the two teams,with main effects for team and criminal background,the white-Latino gap becomes statistically significant.The generality of this result certainly deserves morestudy. The Puerto Ricans of New York that our Latinotesters represent are a longstanding community ofU.S. citizens. In other local labor markets, wheremarkers of citizenship and accent are more prominentsources of difference, evidence of ethnic discrimi-nation may be stronger.

Page 9: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

regardless of which testers are applying forjobs. Overall, these results indicate that, rela-tive to equally qualified blacks, employers sig-nif icantly prefer white and Latino jobapplicants. The findings suggest that a blackapplicant has to search twice as long as anequally qualified white applicant before receiv-ing a callback or job offer from an employer.

The results from this first comparison indi-cate employers’ strong racial preferences, butthe magnitude of this preference remains some-what abstract. To calibrate the effects of raceagainst another stigmatized category, the ex-offender, we repeated the experiment, this timeassigning a criminal record to the white tester.Figure 2a shows the percentage of positiveresponses—job offers or callbacks—receivedby each tester. In this experiment, whites withcriminal records obtained positive responses in17.2 percent of 169 job applications, com-pared with 15.4 percent for Latinos and 13.0percent for blacks.11 The white testers’ racialadvantage narrows substantially in this com-

parison; yet the white applicant with a crimi-nal record still does just as well, if not better,than his minority counterparts with no crimi-nal background.

Figure 2b shows that the white-Latino ratiois close to one and the confidence intervaloverlaps one by a large margin. The white-black ratio is now a statistically insignificant1.32, compared with a significant ratio of 2.04when the white tester had a clean record. As inthe previous experiment, Latinos were pre-ferred to blacks, but here the difference is notsignificant. As before, the cross-validationtreatment effects, obtained by droppingemployers associated with one particular tester,are all close to one. These results indicate that,regardless of which testers were sent into thefield, employers differentiated little among thethree applicant groups.

The comparison of a white felon with blackand Latino applicants with clean backgroundsprovides a vivid calibration of the effects ofrace on hiring decisions. While ex-offendersare disadvantaged in the labor market relativeto applicants with no criminal background, thestigma of a felony conviction appears to be nogreater than that of minority status. Replicatingearlier results from Milwaukee (Pager 2003),these findings suggest that New York employ-

DISCRIMINATION IN A LOW-WAGE LABOR MARKET—–785

Figure 1. Positive Response Rates and Paired Comparisons by Race and Ethnicity

Notes: Positive responses refer to callbacks or job offers. Hollow circles in Figure 1b indicate point estimates of theratio. Solid circles indicate ratios obtained by sequentially dropping testers from the analysis. We estimated 95 per-cent confidence intervals from a hierarchical logistic regression with employer and tester random effects. Numberof employers = 171.

11 The overall rate of positive responses is lowerfor all testers relative to the results presented inFigure 1. This is likely due to the staggered fieldingof teams and resulting differences in the compositionof employers audited across the two time periods.

Page 10: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

ers view minority applicants as essentially

equivalent to whites just out of prison.

Theories of statistical discrimination point

to the very high incarceration rates among

young black men as a key explanation for

employers’ indifference between white felons

and blacks with potentially unobserved crimi-

nal histories. Current estimates suggest that

roughly 18 percent of young black men with

high school degrees will experience incarcera-

tion by their early 30s (Pettit and Western 2004),

and a larger fraction surely have lower level

convictions and arrests. Still, the fact that known

information about a white applicant’s serious

criminal conviction is viewed with no more

concern than the assumed characteristics of a

young black man points to the strength and

intensity of contemporary racial attitudes.

Overcoming these negative expectations, even

for a candidate with otherwise appealing char-

acteristics, requires the negotiation of a number

of significant hurdles not present for white job

seekers.

RACE AT WORK: AN EXAMINATION OF

INTERACTIONS BETWEEN APPLICANTS AND

EMPLOYERS

The strong evidence of hiring discriminationfrom the field experiment provides a clearmeasure of the continuing significance of racein employer decision making. These numbers,however, tell us little about the process by whichrace comes to matter. Fortunately, the in-persondesign of the experiment allows us to furthersupplement the experimental findings with qual-itative evidence from testers’ field notes thatreport their interactions in job interviews. Thesedetailed narratives describe employers’ delib-erations and suggest some of the ways racecomes into play during employment interac-tions.

Our analysis examines cases in which testershad sufficient interaction with employers forcontent coding. Consistent with the notion thatcontemporary forms of discrimination are large-ly subtle and covert, many cases contain littlethat would lead us to anticipate the differentialtreatment that followed. Of those that do, how-ever, we observe several consistent patterns inemployers’ responses. In particular, three cate-gories of behavior stand out, which we refer to

786—–AMERICAN SOCIOLOGICAL REVIEW

Figure 2. Positive Response Rates and Paired Comparisons by Race, Ethnicity, and CriminalBackground

Notes: Positive responses refer to callbacks or job offers. Hollow circles in Figure 2b indicate point estimates of theratio. Solid circles indicate ratios obtained by sequentially dropping testers from the analysis. We estimated 95 per-cent confidence intervals from a hierarchical logistic regression with employer and tester random effects. Numberof employers = 169.

(clean record) (clean record)

Page 11: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

here as: categorical exclusion, shifting stan-dards, and race-coded job channeling. The firsttype of behavior, categorical exclusion, is char-acterized by an immediate or automatic rejec-tion of the black (or minority) candidate in favorof a white applicant. Occurring early in theapplication process, these decisions involve lit-tle negotiated interaction but appear to reflecta fairly rigid application of employers’ racialpreferences or beliefs. A second category ofbehavior, shifting standards, reflects a moredynamic process of decision making. Here weobserve cases in which employers’ evaluationsof applicants appear actively shaped or con-structed through a racial lens, with similar qual-ifications or deficits taking on varying relevancedepending on an applicant’s race. Finally, a thirdcategory of behavior moves beyond the hiringdecision to a focus on job placement. Race-based job channeling represents a process bywhich minority applicants are steered towardparticular job types, often those characterizedby greater physical demands and reduced cus-tomer contact.

By observing the interactions that character-ize each of these behavior types, we gain a rareglimpse into the processes by which discrimi-nation takes place. At the same time, we empha-size that this discussion is intended as adescriptive exercise rather than a formal causalanalysis. Indeed, the categories we identify arenot mutually exclusive; some of the sameprocesses may be operating simultaneously,with employers’shifting evaluations of applicantskills leading to different patterns of job chan-neling, or assumptions about the appropriaterace of the incumbent of a particular positionleading to forms of categorical exclusion.Likewise, this typology cannot account for allof the differential treatment we observe—atleast half of the employer decisions were madeon the basis of little or no personal contactbetween applicant and employer, leaving thenature of the decision entirely unobserved. Withthese caveats in mind, we nevertheless view theanalysis as providing a unique contribution tothe study of racial discrimination, revealingmechanisms at work that observational researchcan rarely identify.

CATEGORICAL EXCLUSION

Few interactions between our testers andemployers revealed signs of racial animus orhostility toward minority applicants. At the sametime, a close comparison of test partners’expe-riences shows a number of cases in which raceappears to be the sole or primary criterion foran employer’s decision. With little negotiationor deliberation over the selection decision, theseemployers’ decisions seem to reflect a preex-isting judgment regarding the adequacy or desir-ability of a minority candidate. Theuncompromising nature of the employer’s deci-sion can be characterized as a form of categor-ical exclusion.

A clear-cut case of categorical exclusion wasprovided when all three testers applied for awarehouse worker position and received a per-functory decision. Zuri, one of our black testers,reported: “The original woman who had herd-ed us in told us that when we finished filling outthe application we could leave because ‘there’sno interview today, guys!’ .|.|. When I made itacross the street to the bus stop .|.|. the womanwho had collected our completed applicationspointed in the direction of Simon, Josue, andmyself [the three test partners] motioning for usto return. All three of us went over.|.|.|. Shelooked at me and told me she ‘needed to speakto these two’ and that I could go back.” Zurireturned to the bus stop, while his white andLatino test partners were both asked to comeback at 5 p.m. that day to start work. Simon, thewhite tester, reported, “She said she told theother people that we needed to sign something—that that’s why she called us over—so as not tolet them know she was hiring us. She seemedpretty concerned with not letting anyone elseknow.”

In this context, with no interview and virtu-ally no direct contact with the employer, weobserve a decision that appears to be based onlittle other than race. The job is a manual posi-tion for which Zuri is at least as able, yet he isreadily passed over in favor of his white andLatino counterparts.

This case is unusual in that three testers wererarely present at a given location at the sametime. More often, we found evidence of differ-ential treatment only after comparing the testers’reports side by side. Here again, we observedseveral hiring decisions in which race appearedto be the sole or primary source of differentia-

DISCRIMINATION IN A LOW-WAGE LABOR MARKET—–787

Page 12: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

tion. In one example, the three testers inquiredabout a sales position at a retail clothing store.Joe, one of our black testers, reported that, “[theemployer] said the position was just filled andthat she would be calling people in for an inter-view if the person doesn’t work out.” Josue, hisLatino test partner, was told something verysimilar: “She informed me that the position wasalready filled, but did not know if the hiredemployee would work out. She told me to leavemy résumé with her.” By contrast, Simon, theirwhite test partner, who applied last, had anotably different experience: “I asked what thehiring process was—if they’re taking applica-tions now, interviewing, etc. She looked at myapplication. ‘You can start immediately?’ Yes.‘Can you start tomorrow?’Yes. ‘10 a.m.’She wasvery friendly and introduced me to anotherwoman (white, 28) at the cash register who willbe training me.”

A similar case arose a few weeks later at anelectronics store. Joe, the black tester, wasallowed to complete an application but was toldthat his references would have to be checkedbefore he could be interviewed. Meanwhile,Simon and Josue, his white and Latino partners,applied shortly afterward and were interviewedon the spot. Joe’s references were never called,while Simon received a callback two days lateroffering him the job.

When evaluated individually, these interac-tions do not indicate racial prejudice or dis-crimination. Side by side, however, we see thatminority applicants encounter barriers not pres-ent for the white applicant, with employers cit-ing excuses for putting off the black or minoritycandidate (e.g., “the job has already been filled”or “we’d have to check your references beforewe can proceed”) that appear not to apply for thewhite applicant. To be sure, certain cases maycapture random error—perhaps a positionbecame available between the testers’ visits, oran employer was otherwise preoccupied whenone applicant arrived but not another, leading tothe employer’s differential response. Still, theconsistency of the pattern in these data sug-gests that random error is unlikely to be a dom-inant factor. Indeed, of the 171 tests conductedby the first team (no criminal background),white testers were singled out for callbacks orjob offers 15 times, whereas there was only asingle case in which a black tester received a

positive response when his white or Latino part-ner did not.12

These cases of categorical exclusion,although directly observed in only a small num-ber of audits (5 of the 47 cases of differentialtreatment across the two teams), reveal oneform of discrimination in which racial consid-erations appear relatively fixed and unyield-ing.13 Before black (or minority) candidateshave the chance to demonstrate their qualifica-tions, they are weeded out on the basis of a sin-gle categorical distinction.

Categorical exclusion represents one impor-tant form of discrimination. While these ratherabrupt interactions reveal little about the under-lying motivation that drives employers’ deci-sions, they do demonstrate the sometimes rigidbarriers facing minority job seekers. In thesecases, black (or minority) applicants are dis-couraged or dismissed at the outset of theemployment process, leaving little opportunityfor a more nuanced review.

SHIFTING STANDARDS

Making it past the initial point of contact wasnot the only hurdle facing minority applicants.Indeed, among those who recorded more exten-sive interaction with employers, we observe acomplex set of racial dynamics at work. On theone hand, personal contact with employers wasassociated with significantly improved out-comes for all testers and a narrowing of theracial gap (see Appendix, Table A1). The testers’interpersonal skills seemed to reduce the influ-

788—–AMERICAN SOCIOLOGICAL REVIEW

12 In an additional 13 cases, both white and Latinotesters received positive responses; in seven cases, theLatino tester alone was selected (see Appendix,Table A2).

13 The denominator of 47 represents the total num-ber of cases of black-white differential treatmentfrom the first (N = 28) and second (N = 19) teams.In calculating the numerator, we do not include anumber of additional cases of differential treatmentresulting from applications in which there was littleor no personal contact between testers and theemployer (rates of personal contact were similar byrace of tester). In such cases, differential treatmentmay reflect categorical exclusion (based on a visualassessment of the candidate), shifting standards(based on a review of the completed applications),random error, or something else.

Page 13: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

ence of racial bias, or at least did not exacerbateit. Yet, even in the context of this more person-alized review, we see evidence of subtle bias inthe evaluation of applicant qualifications. Inparticular, a number of cases reveal how testers’“objective” qualifications appear to be reinter-preted through the lens of race. Although testers’résumés were matched on education and workexperience, some employers seemed to weighqualifications differently depending on theapplicant’s race. In the following interactions,we see evidence that the same deficiencies ofskill or experience appear to be more disquali-fying for the minority job seekers (N = 11).

In one case, Joe, a black tester, was notallowed to apply for a sales position due to hislack of direct experience. He reported, “[Theemployer] handed me back my résumé and toldme they didn’t have any positions to offer me.|.|. that I needed a couple years of experience.”The employer voiced similar concerns withJosue and Kevin, Joe’s Latino and white part-ners. Josue wrote, “After a few minutes of wait-ing .|.|. I met with [the employer] who lookedover my résumé. He said that he was a little wor-ried that I would not be able to do the work.”Kevin reported an even stronger reaction: “[Theemployer] looked at my résumé and said, ‘Thereis absolutely nothing here that qualifies you forthis position.’” Yet, despite their evident lack ofqualifications, Kevin and Josue were offered thesales job and asked to come back the next morn-ing. In interactions with all three testers, theemployer clearly expressed his concern overthe applicants’ lack of relevant work experi-ence. This lack of experience was not groundsfor disqualification for the white and Latinocandidates, whereas the black applicant wasreadily dismissed.

When applying for a job as a line cook at amidlevel Manhattan restaurant, the three testersencountered similar concerns about their lackof relevant experience. Josue, the Latino tester,reported, “[The employer] then asked me if I hadany prior kitchen or cooking experience. I toldhim that I did not really have any, but that Iworked alongside cooks at [my prior job as aserver]. He then asked me if I had any ‘knife’experience and I told him no.|.|.|. He told me hewould give me a try and wanted to know if I wasavailable this coming Sunday at 2 p.m.” Simon,his white test partner, was also invited to comeback for a trial period. By contrast, Joe, the

black tester, found that “they are only lookingfor experienced line cooks.” Joe wrote, “I start-ed to try and convince him to give me a chancebut he cut me off and said I didn’t qualify.”None of the testers had direct experience withkitchen work, but the white and Latino appli-cants were viewed as viable prospects whilethe black applicant was rejected because helacked experience.

In other cases, employers perceived real skillor experience differences among applicantsdespite the fact that the testers’ résumés weredesigned to convey identical qualifications. Inone example, the testers applied for a job at amoving company. Joe, the black applicant, spokewith the employer about his prior experience asa stockperson at a moving truck company, but“[the employer] told me that he couldn’t use mebecause he is looking for someone with mov-ing experience.” Josue, his Latino partner, pre-sented his experience as a stocker at a deliverycompany and reported a similar reaction, “Hethen told me that since I have no experience .|.|.there is nothing he could do for me.” Simon,their white test partner, presented identical qual-ifications, but the employer responded morefavorably: “‘To be honest, we’re looking forsomeone with specific moving experience. Butbecause you’ve worked for [a storage company],that has a little to do with moving.’ He wantedme to come in tomorrow between 10 and 11.”The employer is consistent in his preferencefor workers with relevant prior experience, buthe is willing to apply a more flexible, inclusivestandard in evaluating the experience of thewhite candidate than in the case of the minori-ty applicants. Employers’ shifting standards,offering more latitude to marginally skilledwhite applicants than to similarly qualifiedminorities, suggest that even the evaluation of“objective” information can be affected byunderlying racial considerations.

Even in cases where the white tester pre-sented as a felon, we see some evidence that thisapplicant was afforded the benefit of the doubtin ways that his minority counterparts were not.In applying at an auto dealership, for example,the three testers met with very different reac-tions. Joe, the black tester, was informed at theoutset that the only available positions were forpeople with direct auto sales experience. WhenJosue, his Latino partner, applied, the lack ofdirect auto sales experience was less of a prob-

DISCRIMINATION IN A LOW-WAGE LABOR MARKET—–789

Page 14: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

lem. Josue reported, “He asked me if I had anycustomer service experience and I said not real-ly.|.|.|. He then told me that he wanted to get ridof a few bad apples who were not performingwell. He asked me when I could start.” Josue wastold to wait for a callback on Monday. When theemployer interviewed Keith, their white ex-felon test partner, he gave him a stern lectureregarding his criminal background. The employ-er warned, “I have no problem with your con-viction, it doesn’t bother me. But if I find outmoney is missing or you’re not clean or notshowing up on time I have no problem endingthe relationship.” Despite the employer’s con-cerns, Keith was offered the job on the spot. Thebenefit of the doubt conferred by whitenesspersists here, even in the context of a whiteapplicant just released from prison.

A pattern in these interactions, when com-pared side by side, is the use of double stan-dards—seeking higher qualifications fromblacks than non-blacks, or viewing whites asmore qualified than minorities who presentequivalent résumés. Recent research empha-sizes employers’ use of race as a proxy for dif-ficult-to-observe productivity characteristics(Moss and Tilly 2001; Waldinger and Lichter2003). Where we have detailed field notes onjob interviews, the interactions we observe sug-gest that employers also use race in interpretingand weighing observable skill characteristics.Standards appear to shift as employers evaluatevarious applicants’ qualifications differentlydepending on their race or ethnicity (see alsoBiernat and Kobrynowicz 1997; Yarkin, Town,and Wallston 1982).

RACE-CODED JOB CHANNELING

The first two categories of differential treat-ment focus on the decision to hire. Beyond thisbinary decision, employers also face decisionsabout where to place a worker within the organi-zational hierarchy. Here, at the point of jobplacement, we observe a third category of dif-ferential treatment. In our review of the testers’experiences, we noticed that applicants weresometimes encouraged to apply for differentjobs than the ones initially advertised or aboutwhich they had inquired. In many cases, theseinstances of channeling suggest a race-codingof job types, whereby employers prefer whitesfor certain positions and minorities for others.

In one case, Zuri, a black tester, applied for asales position at a lighting store that had a signin the front window stating “SalespersonWanted.” Zuri described the following interac-tion: “When she asked what position I was look-ing for I said I was open, but that since they werelooking for a salesperson I would be interestedin that. She smiled, put her head in her hand andher elbow on the table and said, ‘I need a stockboy. Can you do stock boy?’” Zuri’s white andLatino test partners, by contrast, were each ableto apply for the advertised sales position.

Another black tester, Joe, was similarly chan-neled out of a customer service position in hisapplication to a Japanese restaurant. Joe report-ed, “I told her I was there to apply for the wait-er position and she told me that there were noserver positions. I told her it was advertised inthe paper, and she said there must have been amistake. She said all she had available was abusboy position. I told her since there was nowaiter position, I would apply for the busboy.”Later that day, Kevin, his white test partner,was hired for the server position on the spot.

We also observed channeling of the Latinotesters. Josue’s fieldnotes of an audit at a cloth-ing retailer begin by describing the “youngwhite 20-something women running the place.”One of the women interviewed him, asked aboutpast work experience, and asked which job hewas applying for. “I told her ‘sales associate,’”Josue reported, and he presented a résumé onwhich the most recent job listed was as a salesassistant at a sporting goods store. “She then toldme that there was a stock position and asked ifI would be interested in that.” Josue was offeredthe stocker job and asked to start the next day.

In many cases, these instances of channelingare coded as “positive responses” in the initialanalyses. While our key concern is about accessto employment of any kind, this general focusmasks another form of racial bias at work. Acloser analysis of the testers’ experiences sug-gests that decisions about job placement, likehiring more generally, often follow a raciallogic. We coded all instances of job channelingacross both our teams and counted 53 cases(compared with 172 positive responses). Bycomparing the original job title to the suggest-ed job type, we then categorized these cases asdownward channeling, upward channeling, lat-eral channeling, or unknown. We define down-ward channeling as (1) a move from a job

790—–AMERICAN SOCIOLOGICAL REVIEW

Page 15: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

with the testers’ field notes, employers appearto apply more stringent hiring criteria to minor-ity workers, preferring whites for jobs thatrequire greater skill or responsibility. In addi-tion, minorities are disproportionately chan-neled out of customer service positions,consistent with other research in which employ-ers view minority applicants as lacking com-munication skills or as otherwise discomfitingfor customers. Although our testers presentedhighly effective styles of interpersonal com-munication, the cursory review process for thesejobs often leaves group membership moresalient than any individuating characteristics.

DISCRIMINATION IN A LOW-WAGE LABOR MARKET—–791

involving contact with customers to a job with-out (e.g., from server to busboy), (2) a movefrom a white-collar position to a manual posi-tion (e.g., from sales to stocker), or (3) a movein which hierarchy is clear (e.g., from supervi-sor to line worker). We define upward chan-neling as a move in the opposite direction. Wefocus on these two types of channeling for ourcurrent analysis. After eliminating cases inwhich all testers within a team were similarlychanneled, we have 23 additional cases of dif-ferential treatment that were not recorded by ourinitial measurement of job offers and callbacks.

Like hiring criteria, job placement is alsopatterned by race (see Table 1). Black applicantswere channeled into lower positions in ninecases, Latinos were channeled down in fivecases, and whites experienced downward chan-neling in only one case. Many of these caseswere restaurant jobs in which the tester appliedfor a position as a server but was steered to a jobas a busboy or dishwasher. In almost all cases,the original position required extensive cus-tomer contact while the suggested position didnot (e.g., salesperson to stocker). Testers weresometimes guided into lower positions becausetheir résumés indicated limited work experi-ence, but racial differences in channeling sug-gest that insufficient work experience was morepenalizing for minorities than for whites. Theone case of downward channeling among whiteapplicants involved a tester presenting with acriminal background.

In fact, whites were more often channeled upthan down. In at least six cases, white testerswere encouraged to apply for jobs that were ofa higher-level or required more customer con-tact than the initial position they inquired about.In one case, the white tester was even encour-aged to apply for a supervisory position, despitelimited work experience. Kevin reported: “[Theemployer] then asked me if I had any experiencein construction. I told him I did not. He askedif I would be okay working with people that havethick accents like his. I told him that was fine.He then told me that he wanted me to be his newcompany supervisor.”

Employers appear to have strong views aboutwhat kind of person is appropriate for whatkind of job, based either on their own assump-tions of worker competence or assumptionsabout what their clients expect or prefer in theappearance of those serving them. Consistent

Table 1. Job Channeling by Race

Original Job Title

Blacks Channeled Down—Server—Counter person—Server—Assistant manager—Server—Retail sales—Counter person—Sales—Sales

Latinos Channeled Down—Server—Sales—Steam cleaning—Counter person—Sales

Whites Channeled Down—Server

Latinos Channeled Up—Carwash attendant—Warehouse worker

Whites Channeled Up—Line cook—Mover—Dishwasher—Driver—Kitchen job—Receptionist

Note: This table includes all cases of upward anddownward channeling, except when all testers on ateam were channeled similarly.a Employer told tester that “sales might not be rightfor you.”

Suggested Job

XBusser Dishwasher/porter Busboy Entry fast-food position Busboy/runner Maintenance Delivery Stockboy Not specifieda

Runner Stock Exterminator Delivery Stock person

Busboy

Manager Computer/office

Waitstaff Office/telesales Waitstaff Auto detailing “Front of the house” job Company supervisor

Page 16: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

The three types of differential treatment weobserve illustrate how employers enact theirracial preferences in the hiring process. Ratherthan outward hostility or racial animus, we seemore subtle forms of discouragement or rejec-tion. At multiple points in the hiring process,black (or Latino) applicants face additional hur-dles or barriers that reduce their chances ofemployment and affect the quality of jobs forwhich they are considered. Figure 3 illustratesthe processes identified in the preceding dis-cussion. At each of the three decision points, wesee pathways deflected by various forms ofracial bias. Subtle differences in employers’responses—often imperceptible to the appli-cants themselves—produce a pattern of out-comes systematically affected by race.

Complementing the quantitative indicatorsof differential treatment, these qualitative obser-vations provide a rare window into the process-es by which discrimination occurs. The threecategories of differential treatment observed inthese data point to the range of experiences thatconstitute discrimination in the employmentprocess.14 In a small number of cases, minori-ty testers were disqualified early on in deci-sions that appear to reflect employers’ fairlyrigid preferences. These instances of categori-

cal exclusion represent one of the most extremeforms of discrimination, wherein minority appli-cants have little opportunity to overcomeemployers’ potential concerns. By contrast, alarger number of interactions suggest a morecomplicated set of negotiations at play. In eval-uating applicant qualifications, minority appli-cants, and black men in particular, appear to beheld to a higher standard than their white coun-terparts. Black men are disqualified more read-ily, or hired more reluctantly, than their whitepartners with identical skills and experience.Furthermore, racialized assessments of applicantquality and “fit” affect not only the decision tohire, but also decisions about job placement,with minority applicants more often channeledinto positions involving less skill or customercontact. Together, these experiences illustratehow racial disadvantage is dynamically con-structed and reinforced, with the assessment ofapplicant qualifications and suitability subjectto interpretation and bias. While not an exhaus-tive catalogue of discrimination experiences,the fact that these dynamics are observed innatural settings (with little prompting) attests totheir relative frequency and regularity. Ourtesters’ experiences suggest how race shapesemployers’ evaluations in subtle but systemat-ic ways, with important implications for struc-turing opportunity along racial lines.

DISCUSSION

Sending trained testers with equivalent résumésto apply for entry-level jobs reveals clear evi-dence of discrimination among low-wageemployers in New York City. Blacks were onlyhalf as likely to receive a callback or job offerrelative to equally qualified whites; moreover,black and Latino applicants with clean back-grounds fared no better than a white applicant

792—–AMERICAN SOCIOLOGICAL REVIEW

Figure 3. Discrimination at Three Decision Points

14 To be sure, our study captures only a few of themany pathways in the employment process that arepotentially affected by racial bias. Beyond our win-dow of observation, the pathways of this diagramwould presumably continue along later points in theemployment process, including wage-setting deci-sions, training opportunities, promotion, and termi-nation decisions. This research represents oneincremental contribution to understanding—and doc-umenting—the varied decision points that may beaffected by race.

Page 17: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

just released from prison. The magnitude ofthese racial disparities provides vivid evidenceof the continuing significance of race in con-temporary low-wage labor markets. There is aracial hierarchy among young men favoringwhites, then Latinos, and finally blacks as thecandidates of last resort.

The episodes of discrimination recorded inthis study were seldom characterized by overtracism or hostility. In fact, our testers rarelyperceived any signs of clear prejudice. It wasonly through side-by-side comparisons of ourtesters’ experiences that patterns of subtle butconsistent differential treatment were revealed.Minority applicants were disqualified morereadily and hired more reluctantly than theirwhite partners with identical skills and experi-ence. Additionally, black and Latino applicantswere routinely channeled into positions requir-ing less customer contact and more manualwork than their white counterparts. In interac-tions between applicants and employers, we seea small number of cases that reflect employers’seemingly rigid racial preferences. More often,differential treatment emerged in the socialinteraction of the job interview. Employersappeared to see more potential in the statedqualifications of white applicants, and theymore commonly viewed white applicants as abetter fit for more desirable jobs.

Our findings of discrimination are particu-larly striking because the testers in this studyrepresent a best-case scenario for low-wage jobseekers. The testers were college-educatedyoung men with effective styles of self-presen-tation. Although posing as high school gradu-ates with more limited skills, these young menstood well above the typical applicant for theselow-wage jobs. The effects of race among indi-viduals with fewer hard and soft skill advantagesmay well be larger than those estimated here.

At the same time, while we find robust evi-dence of racial discrimination, we should becareful not to interpret these results as showingthe level of discrimination actively experiencedby minority job seekers in the New York labormarket. Our sampling design, based on employ-ers, not workers, over-represents small firmsrelative to their share of employment. The sam-ple includes many restaurants and independentretailers for whom hiring is less bureaucratic,and who lack the human resource departmentsthat manage the equal employment opportuni-

ty obligations of large firms (Dobbin et al.1993). Nevertheless, our sampled employerswell represent the kinds of low-skill servicework that dominate low-wage urban labor mar-kets.

A second limitation on the generalizability ofour findings results from our sampling proce-dures based on classif ied advertisements.Surveys of job seekers suggest that 25 to 30 per-cent of low skill jobs are filled by classified ads;the remainder are filled through some combi-nation of network referrals, walk-in applica-tions, and employment agencies (Holzer 1987).These search strategies may generate a differ-ent distribution of employers from that report-ed here. Some argue that the focus on jobsadvertised through metropolitan newspapersunderstates the extent of discrimination. Firmsthat wish to discriminate, it is argued, are morelikely to advertise job openings through morerestrictive channels, such as networks of exist-ing employees, employment agencies, or moreselective publications (Elliott 2000; Fix andStruyk 1993; Petersen, Saporta, and Seidel2000). Others, by contrast, argue that any ran-dom sample of employers will overstate theextent of discrimination actually experienced byjob seekers. If minority applicants can identifyand avoid firms that discriminate, the actualincidence of labor market discrimination will becorrespondingly reduced (Becker 1957;Heckman 1998).

Of course, minority workers’ability to avoidthe effects of discrimination by self-selectinginto nondiscriminatory firms requires that asufficient number of nondiscriminatory employ-ers exist; that there are no differences in the qual-ity of jobs offered by employers who are moreand less likely to discriminate; and that thesearch costs necessary to locate nondiscrimi-natory employers are trivial. Future researchusing microdata to track the search patterns andoutcomes of black and white job seekers couldbetter address these issues. From our data, wecan safely conclude that job searches across awide range of employers represented by theclassified ads of five New York newspapersreveal substantial discrimination. Understandinghow job seekers adapt to this reality remains achallenge for future research.

Our findings for the New York City labormarket add to evidence of racial discrimina-tion in employment reported from recent field

DISCRIMINATION IN A LOW-WAGE LABOR MARKET—–793

Page 18: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

experiments in Milwaukee, Boston, and Chicago(Bertrand and Mullainathan 2004; Pager 2003).The significant evidence of discriminationfound in these studies contrasts sharply withrecent survey research showing small racial dif-ferences in wages (Farkas and Vicknair 1996;Neal and Johnson 1996). How might these dis-parate findings be reconciled? First, as notedabove, the presence of discrimination in thelabor market may lead workers to differential-ly sort across employers, such that minority jobseekers queue for jobs offered by employerswho are less likely to discriminate. Thesedynamics can lead to longer search or waittimes for minority job seekers, which might notbe reflected in ultimate wage offers. Indeed,data from the late 1990s show that the unem-ployment spells of black men (3.1 months) areabout twice as long as those for whites (1.6months) (Gottschalck 2003:2). This suggeststhat the primary effects of discrimination onlabor market outcomes may be reflected inemployment differentials rather than wages.15

Second, the experience of discrimination mayadd to the psychic costs of the job searchprocess, prompting some to opt out altogether.If discrimination discourages all but the mostmotivated and able black job seekers, blackwage earners would represent an increasinglyselect group. Since the 1990s, increasing num-bers of young black men have dropped out ofthe formal labor market, contributing to an arti-ficial convergence of black and white wages(Western and Pettit 2005). Without effectivelyaccounting for the processes that precede labor

force participation—including the discouragingeffects of discrimination—wage estimates canaccount for only one incomplete picture of thelarger employment process.

Our findings add to a large research programdemonstrating the continuing contribution ofdiscrimination to racial inequality in the post-civil rights era. Still, significant questionsremain unanswered. The audit experiment nec-essarily focuses on employers’ hiring behav-iors but does not examine the skills, preferences,and networks of job seekers. We do not know,and few research designs have been devised totest, the relative magnitude of the effects of dis-crimination compared with the effects of humanand social capital. Such an analysis would needto study both employers as they screen job appli-cants and workers as they search for jobs.

The effects of discrimination, relative tohuman and social capital, should also be definedbroadly. As evidence of discrimination in thepost-civil rights era accumulates, new researchshould go beyond determining whether dis-crimination is present to consider how the effectsof discrimination unfold over the life cycle andacross social space. Episodes of discriminationmay not only cause unemployment at one pointin time, but may have long-term effects thatweaken minority workers’ attachment to thelabor market and reduce labor force participa-tion. Discrimination may produce broad cul-tural effects in which work itself isde-legitimated as a fair source of opportunity.The effects of discrimination may also varyacross the population, concentrating perhapsamong the young men whose employment ratesare lowest. Tracing these larger and more var-ied effects of discrimination show both theadvantages and limits of the experimentalmethod used here. The experiment allows us toinfer discrimination with great certainty, butthe effects of discrimination are narrowlydefined. The broader effects of discrimination—on the cultural dimensions of economic life andover the life course—are harder to pinpoint butmay indicate more fundamental and intractableinequalities. A research agenda that includesthese wider consequences would be less skep-tical that discrimination exists and more curiousabout its continuing effects on not just employ-ment inequality, but on American race relationsmore broadly.

794—–AMERICAN SOCIOLOGICAL REVIEW

15 Johnson and Neal (1998), for example, findthat after controlling for cognitive ability and otherhuman capital characteristics, black-white differ-ences in employment among young men remain largeand statistically significant. The importance ofemployment over wages for racial inequality in eco-nomic status is likely to be especially great for youngnon-college-educated men, for whom the overalllevel of wage dispersion is low. Later in the lifecourse, as wage dispersion increases and labor forceexperience accumulates, the racial wage gap becomesmore pronounced (Tomaskovic-Devey, Thomas, andJohnson 2005). For a historical example, see Whatley(1990), who shows that despite the substantial racialbarriers to employment that existed among Northernfirms after World War I, blacks and whites experi-enced remarkably similar wage rates.

Page 19: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

Devah Pager is an Associate Professor of Sociologyand Faculty Associate of the Office of PopulationResearch at Princeton University. Her book, Marked:Race, Crime, and Finding Work in an Era of MassIncarceration, investigates the racial and economicconsequences of large scale imprisonment for con-temporary U.S. labor markets.

Bruce Western is Professor of Sociology and direc-tor of the Multidisciplinary Program in Inequality andSocial Policy at Harvard University.

Bart Bonikowski is a PhD candidate in sociology atPrinceton University. In addition to his work on strat-ification, he is completing a project that comparespopular conceptions of the nation among the popu-lations of 30 countries.

APPENDIX

ROBUSTNESS CHECKS

We examine the robustness of our primaryresults by looking at racial and ethnic contrastsfor different subsets of the data (Table A1).Although small numbers in certain cells lead tosome instability in estimates, these breakdownscan examine the consistency of effects across thefull range of the sample. To account for learn-ing or adaptation by the testers, we estimateeffects for the first and second halves of theexperimental period. In each period, whites andLatinos received significantly more positiveresponses than did blacks, and whites receivedslightly more positive responses than didLatinos. To examine whether our results dependstrongly on any particular area within New York,we separate the experimental effects by location.Over half the audited employers were located inManhattan. We found the pattern of black dis-advantage throughout Manhattan and in theouter boroughs. To examine whether the firsttester sent to an employer was more likely to besuccessful, we randomized the order in whichtesters were sent. Experimental effects are sim-ilar regardless of which tester interviewed first.Finally, we compare the outcomes of audits inwhich testers had little or no interaction with theemployer with those characterized by more sub-

stantial personal contact. Here we see some evi-dence that personal contact reduces racial dis-parities in employment, consistent with thenotion that individualizing information can helpoffset the effects of negative stereotypes.

The bottom half of Table A1 presents thesesame comparisons for the team in which thewhite applicants presented evidence of a felonyconviction. Across these comparisons, we findtreatment effects close to zero, supporting thefinding that employers did not distinguishstrongly between whites with criminal recordsand minority job seekers without. In short, theseresults indicate a large racial preference amongNew York employers for white job applicantsover black applicants, smaller preference forwhites over Latinos and Latinos over blacks, andlittle difference between white felons andminorities with clean backgrounds. All resultsare robust to tester effects and experimentaleffects and appear to be roughly uniform acrossNew York City.

RESULTS BY TESTER TEAMS

In the course of fielding two three-person teamsof testers, we used 10 different testers: twoLatinos, four blacks, and four whites. In eachthree-person team consisting of a white, a black,and a Latino, we combined the 10 testers intosix different unique combinations. Before pool-ing the data across combinations of testers,Heckman and Siegelman (1993) recommendtesting for the homogeneity of responses acrosscombinations. The columns in Table A2 repre-sent mutually exclusive outcomes; overallresponse rates by race can be calculated bysumming all columns in which a given racegroup is represented. A chi-square test withineach team fails to reject the null hypothesis ofhomogeneity across combinations. With thisevidence of homogeneity, we report treatmenteffects pooled across testers. Table A2 reportsthe detailed experimental results for each uniquecombination of testers.

DISCRIMINATION IN A LOW-WAGE LABOR MARKET—–795

Page 20: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

796—–AMERICAN SOCIOLOGICAL REVIEW

Table A1.—Percentage of Positive Responses and Race Differences, by Date, Employer Address,and Race of First Tester

White Latino Black Race Differencesa

Subsample (N) (W) (L) (B) W/L W/B L/B

Total (171) 31.0 25.1 15.2 1.2 (.02) 2.0 (.00) 1.7 (.00)Dateb

—Feb. 23 to April 7 (84) 29.8 23.8 9.5 1.3 (.08) 3.1 (.00) 2.5 (.00)—April 8 to July 16 (84) 33.3 27.4 21.4 1.2 (.04) 1.6 (.00) 1.3 (.05)Locationc

—Below 34th St. (56) 23.2 21.4 12.5 1.1 (.31) 1.9 (.00) 1.7 (.03)—34th St. to 72nd St. (46) 30.4 21.7 17.4 1.4 (.02) 1.8 (.00) 1.3 (.15)—Above 72nd St. (18) 33.3 22.2 5.6 1.5 (.00) 6.0 (.00) 4.0 (.00)—Other (50) 40.0 34.0 20.0 1.2 (.12) 2.0 (.00) 1.7 (.00)Race of First Tester—White (68) 27.9 23.5 10.3 1.2 (.11) 2.7 (.00) 2.3 (.00)—Black (45) 40.0 31.1 20.0 1.3 (.06) 2.0 (.00) 1.6 (.01)—Latino (53) 28.3 22.6 18.9 1.3 (.09) 1.5 (.00) 1.2 (.15)Type of Positive Responsed

—Callback (171) 12.9 9.9 2.9 1.3 (.10) 4.4 (.00) 3.4 (.00)—Job offer (171) 21.1 17.0 12.9 1.2 (.02) 1.6 (.00) 1.3 (.02)Personal Contacte

—No personal contact (46)f 10.9 6.5 0 1.7 (.09) >10.9 >6.5—Personal contact (65) 52.3 46.2 29.2 1.1 (.11) 1.8 (.00) 1.6 (.00)

White felon Latino Black Race Differencesa

Subsample (N) (Wf) (L) (B) Wf/L Wf/B L/B

Total (169) 17.2 15.4 13.0 1.1 (.25) 1.3 (.08) 1.2 (.17)Dateb

—March 2 to April 13 (83) 16.9 13.3 10.8 1.3 (.16) 1.6 (.06) 1.2 (.21)—April 14 to Aug. 6 (82) 17.1 17.1 15.9 1.0 (.43) 1.1 (.35) 1.1 (.34)Locationc

—Below 34th St. (51) 9.8 7.8 3.9 1.3 (.30) 2.5 (.05) 2.0 (.00)—34th St. to 72nd St. (46) 13.0 17.4 13.0 .8 (.74) 1.0 (.42) 1.3 (.14)—Above 72nd St. (7) 0 0 0—Other (62) 29.0 21.0 21.0 1.4 (.08) 1.4 (.09) 1.0 (.46)Race of First Tester—White (53) 20.8 18.9 13.2 1.1 (.34) 1.6 (.13) 1.4 (.15)—Black (59) 18.6 15.3 15.3 1.2 (.20) 1.2 (.15) 1.0 (.39)—Latino (52) 11.5 11.5 11.5 1.0 (.44) 1.0 (.42) 1.0 (.41)Type of Positive Responsed

—Callback (169) 11.2 9.5 5.3 1.2 (.23) 2.1 (.01) 1.8 (.02)—Job offer (169) 5.9 6.5 7.7 .9 (.58) .8 (.77) .8 (.65)Personal Contacte

—No personal contact (75) 8.0 8.0 4.0 1.0 (.45) 2.0 (.09) 2.0 (.04)—Personal contact (39) 35.9 28.2 30.8 1.3 (.12) 1.2 (.24) .9 (.58)a Numbers in parentheses are bootstrap p-values for a one-sided test of whether the ratio is less than or equal toone.b Changes over time capture several possible effects: learning or adaptation by testers, compositional changes inthe types of employers brought into the sample at different points, and changes in the business cycle.c Street addresses are for Manhattan.d Because some testers received both a job offer and a subsequent callback, the sum of these two columns may begreater than the total listed above (in which a positive response is calculated by the presence of a callback or a joboffer).e Analyses of “personal contact” include only those cases in which all tester partners experienced personal con-tact; the “no personal contact” analyses include cases in which none of the testers experienced personal contact.This exclusion avoids any confounding effect of employers’ racial preferences as reflected in the decision tointerview.f Because the response rate for blacks in this subsample is zero, ratios in which blacks are in the denominator areundefined. For the purposes of this analysis, we represent this ratio as greater than the value of the numeratorover one.

Page 21: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

REFERENCES

Agresti, Alan. 1990. Categorical Data Analysis. NewYork: Wiley.

Aigner, Dennis J. and Glen G. Cain. 1977. “StatisticalTheories of Discrimination in Labor Market.”Industrial and Labor Relations Review 30:749–76.

Altonji, Joseph G. and Charles R. Pierret. 2001.“Employer Learning and StatisticalDiscrimination.” Journal of Economics116:313–50.

Becker, Gary S. 1957. The Economics ofDiscrimination. Chicago, IL: University ofChicago Press.

Bendick, Marc, Jr., Charles Jackson, and VictorReinoso. 1994. “Measuring EmploymentDiscrimination through Controlled Experiments.”Review of Black Political Economy 23:25–48.

Bendick, Marc, Jr., Charles Jackson, Victor Reinoso,and Laura Hodges. 1991. “Discrimination againstLatino Job Applicants: A Controlled Experiment.”Human Resource Management 30:469–84.

Bertrand, Marianne and Sendhil Mullainathan. 2004.“Are Emily and Greg More Employable thanLakisha and Jamal? A Field Experiment on LaborMarket Discrimination.” American EconomicReview 94:991–1013.

Biernat, Monica and Diane D. Kobrynowicz. 1997.“Gender and Race-Based Standards ofCompetence: Lower Minimum Standards butHigher Ability Standards for Devalued Groups.”

Journal of Personality and Social Psychology72:544–57.

Bodenhausen, Galen. 1988. “Stereotypic Biases inSocial Decision Making and Memory: TestingProcess Models of Stereotype Use.” Journal ofPersonality and Social Psychology 55(5):726–37.

Cancio, A. Silvia, T. David Evans, and David J.Maume. 1996. “Reconsidering the DecliningSignificance of Race: Racial Differences in EarlyCareer Wages.” American Sociological Review61:541–56.

Cross, Harry, Genevieve Kenney, Jane Mell, andWendy Zimmerman. 1990. Employer HiringPractices: Differential Treatment of Hispanic andAnglo Job Seekers. Washington, DC: UrbanInstitute Press.

Darity, William, Jr. and Patrick A. Mason. 1998.“Evidence on Discrimination in Employment:Codes of Color, Codes of Gender.” The Journal ofEconomic Perspectives 12:63–90.

Darity, William, Jr. and Samuel L. Meyers. 1998.Persistent Disparity: Race and EconomicInequality in the United States since 1945.Cheltenham, UK: Edward Elgar.

Darley, John M. and Paget H. Gross. 1983. “AHypothesis-Confirming Bias in Labeling Effects.”Journal of Personality and Social Psychology44:20–33.

Dobbin, Frank, J. Sutton, J. Meyer, and W. R. Scott.1993. “Equal Opportunity Law and the

DISCRIMINATION IN A LOW-WAGE LABOR MARKET—–797

Table A2.—Detailed Experimental Results, by Unique Combination of Testers

Who Gets a Positive Response (percent)

Group All None W + L W + B L + B W L B N

White without criminal record (posterior predictive probability of �2 statistic: .054)a

1 11 69.2 4.4 3.3 0 7.7 4.4 0 912 7.5 67.9 11.3 0 0 9.4 3.8 0 533 36.4 18.2 0 0 0 18.2 18.2 9.1 114 33.3 33.3 33.3 0 0 0 0 0 65 28.6 57.1 14.3 0 0 0 0 0 76 0 66.7 0 0 0 33.3 0 0 3Total 12.9 63.7 7.6 1.8 0 8.8 4.7 .6 171White with criminal record (posterior predictive probability of �2 statistic: .588)1 3.7 75.3 2.5 2.5 1.2 7.4 4.9 2.5 812 4.9 56.1 2.4 2.4 7.3 14.6 7.3 4.9 413 2.8 77.8 8.3 2.8 2.8 2.8 0 2.8 364 0 60 0 0 20 0 20 0 55 0 75 0 0 0 0 0 25 46 0 100 0 0 0 0 0 0 2Total 3.6 71.0 3.6 2.4 3.6 7.7 4.7 3.6 169

Note: W = white; L = Latino; B = black. Columns of “Who Gets a Positive Response” represent mutually exclu-sive categories (i.e., rows sum to 100 percent). In the first experiment (no criminal record), there was only asingle case (group 3) in which a black tester received a callback when neither of his test partners received one.a The chi-square test is undefined with marginal counts of zero. We calculate a posterior predictive p-value bysimulating counts under independence for nonzero cells.

Page 22: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

Construction of Internal Labor Markets.” AmericanJournal of Sociology 99:396–427.

Dovidio, John F. and Samuel L. Gaertner. 2000.“Aversive Racism and Selection Decisions.”Psychological Science 11:315–19.

Elliott, James R. 2000. “Class, Race, and JobMatching in Contemporary Urban Labor Markets.”Social Science Quarterly 81:1036–52.

Farkas, George and Keven Vicknair. 1996.“Appropriate Tests of Racial Wage DiscriminationRequire Controls for Cognitive Skill: Comment onCancio, Evans, and Maume.” AmericanSociological Review 61:557–60.

Fiske, Susan. 1998. “Stereotyping, Prejudice, andDiscrimination.” Pp. 357–411 in The Handbook ofSocial Psychology, edited by D. Gilbert, S. Fiske,and G. Lindzey. Boston, MA: McGraw Hill.

Fix, Michael and Raymond J. Struyk, eds. 1993.Clear and Convincing Evidence: Measurement ofDiscrimination in America. Washington, DC:Urban Institute Press.

Fryer, Ronald G., Jr. and Steven D. Levitt. 2003.“The Causes and Consequences of DistinctivelyBlack Names.” NBER Working Paper 9938.

———. 2004. “The Causes and Consequences ofDistinctively Black Names.” The Quarterly Journalof Economics 119:767–805.

Ghosh, Malay, Ming-Hui Chen, Atalanta Ghosh, andAlan Agresti. 2000. “Hierarchical BayesianAnalysis of Binary Matched Pairs Data.” StatisticaSinica 10:647–57.

Gilbert, Daniel T. and J. Gregory Hixon. 1991. “TheTrouble of Thinking: Activation and Applicationof Stereotypical Beliefs.” Journal of Personalityand Social Psychology 60(4):509–17.

Gottschalck, Alfred O. 2003. “Dynamics of EconomicWell-Being: Spells of Unemployment,1996–1999.” Current Population Reports.Washington, DC: US Census Bureau.

Heckman, James J. 1998. “Detecting Discrimination.”The Journal of Economic Perspectives12:101–116.

Heckman, James and Peter Siegelman. 1993. “TheUrban Institute Audit Studies: Their Methods andFindings.” Pp. 187–258 in Clear and ConvincingEvidence: Measurement of Discrimination inAmerica, edited by M. Fix and R. Struyk. Lanham,MD: University Press of America.

Holzer, Harry J. 1987. “Informal Job Search andBlack Youth Unemployment.” American EconomicReview 77:446–52.

———. 1996. What Employers Want: JobProspects of Less-Educated Workers. New York:Russell Sage Foundation.

Holzer, Harry J. and Paul Offner. 2001. “Trends inEmployment Outcomes of Young Black Men.”Georgetown University, Washington, DC.Unpublished manuscript.

Johnson, William and Derek Neal. 1998. “Basic

Skills and the Black-White Earnings Gap.” Pp.480–500 in Black-White Test Score Differences,edited by C. Jencks and M. Phillips. Washington,DC: Brookings Institution.

Kirschenman, Joleen and Katherine Neckerman.1991. “‘We’d Love to Hire Them, but.|.|.’: TheMeaning of Race for Employers.” Pp. 203–234 inThe Urban Underclass, edited by C. Jencks and P.Peterson. Washington, DC: Brookings Institute.

Moss, Philip and Chris Tilly. 2001. Stories EmployersTell: Race, Skill, and Hiring in America. NewYork: Russell Sage.

Neal, Derek and William Johnson. 1996. “The Roleof Premarket Factors in Black-White WageDifferences.” Journal of Political Economy104:869–95.

Oettinger, Gerald S. 1996. “Statistical Discriminationand the Early Career Evolution of the Black-WhiteWage Gap.” Journal of Labor Economics14:52–78.

O’Neill, June. 1990. “The Role of Human Capital inEarnings Differences between White and BlackMen.” The Journal of Economic Perspectives4(4):25–45.

Pager, Devah. 2003. “The Mark of a CriminalRecord.” American Journal of Sociology108:937–75.

———. 2007a. “The Use of Field Experiments forStudies of Employment Discrimination:Contributions, Critiques, and Directions for theFuture.” Annals of the American Academy ofPolitical and Social Sciences 609:104–133.

———. 2007b. Marked: Race, Crime, and FindingWork in an Era of Mass Incarceration. Chicago, IL:University of Chicago Press.

Pager, Devah and Diana Karafin. 2009. “BayesianBigot? Statistical Discrimination, Stereotypes, andEmployer Decision-Making.” Annals of theAmerican Academy of Political and Social Science621(1):70–93.

Pager, Devah and Lincoln Quillian. 2005. “Walkingthe Talk: What Employers Say Versus What TheyDo.” American Sociological Review 70(3):355–80.

Petersen, Trond, Ishak Saporta, and Marc-David L.Seidel. 2000. “Offering a Job: Meritocracy andSocial Networks.” American Journal of Sociology106:763–816.

Pettit, Becky and Bruce Western. 2004. “MassImprisonment and the Life Course: Race and ClassInequality in U.S. Incarceration.” AmericanSociological Review 59:151–69.

Roscigno, Vincent J., Lisette Garcia, Sherry Mong,and Reginald Byron. 2007. “Racial Discriminationat Work: Its Occurrence, Dimensions, andConsequences.” The New Black: AlternativeParadigms and Strategies for the 21st CenturyResearch in Race and Ethnic Relations 14:131–55.

Steele, Claude M. and Joshua Aronson. 1995.“Stereotype Threat and the Intellectual Test

798—–AMERICAN SOCIOLOGICAL REVIEW

Page 23: Discrimination in a Low-Wage Labor Market: A Field Experimentscholar.harvard.edu/files/bonikowski/files/pager... · discrimination remains an important cause of economic inequality

Performance of African Americans.” Journal ofPersonality and Social Psychology 69(5):797–811.

Tomaskovic-Devey, Donald, Melvin Thomas, andKecia Johnson. 2005. “Race and the Accumulationof Human Capital across the Career: A TheoreticalModel and Fixed-Effects Application.” AmericanJournal of Sociology 111(1):58–89.

Trope, Yaacov and Erik P. Thomson. 1997. “Lookingfor Truth in All the Wrong Places? AsymmetricSearch of Individuating Information aboutStereotyped Group Members.” Journal ofPersonality and Social Psychology 73(2):229–41.

Turner, Margery, Michael Fix, and Raymond Struyk.1991. Opportunities Denied, OpportunitiesDiminished: Racial Discrimination in Hiring.Washington, DC: Urban Institute Press.

Waldinger, Roger and Michael I. Lichter. 2003. Howthe Other Half Works: Immigration and the Social

Organization of Labor. Berkeley, CA: Universityof California Press.

Western, Bruce and Becky Pettit. 2005. “Black-WhiteWage Inequality, Employment Rates, andIncarceration.” American Journal of Sociology111:553–78.

Whatley, Warren C. 1990. “Getting a Foot in theDoor: ‘Learning,’State Dependence, and the RacialIntegration of Firms.” The Journal of EconomicHistory 50(1):43–66.

Wilson, William Julius. 1996. When WorkDisappears: The World of the New Urban Poor.New York: Vintage Books.

Yarkin, K. L., J. P. Town, and B. S. Wallston. 1982.“Blacks and Women Must Try Harder: StimulusPerson’s Race and Sex Attributions of Causality.”Personality and Social Psychology Bulletin8:21–24.

DISCRIMINATION IN A LOW-WAGE LABOR MARKET—–799