NewYorkUniversity
LawReview

Topics

Empirical Legal Studies

Results

Devaluing Death: An Empirical Study of Implicit Racial Bias on Jury-Eligible Citizens in Six Death Penalty States

Justin D. Levinson, Robert J. Smith, Danielle M. Young

Stark racial disparities define America’s relationship with the death penalty. Though commentators have scrutinized a range of possible causes for this uneven racial distribution of death sentences, no convincing evidence suggests that any one of these factors consistently accounts for the unjustified racial disparities at play in the administration of capital punishment. We propose that a unifying current running through each of these partial plausible explanations is the notion that the human mind may unwittingly inject bias into the seemingly neutral concepts and processes of death penalty administration.

To test the effects of implicit bias on the death penalty, we conducted a study on 445 jury-eligible citizens in six leading death penalty states. We found that jury-eligible citizens harbored two different kinds of the implicit racial biases we tested: implicit racial stereotypes about Blacks and Whites generally, as well as implicit associations between race and the value of life. We also found that death-qualified jurors—those who expressed a willingness to consider imposing both a life sentence and a death sentence—harbored stronger implicit and self-reported (explicit) racial biases than excluded jurors. The results of the study underscore the potentially powerful role of implicit bias and suggest that racial disparities in the modern death penalty could be linked to the very concepts entrusted to maintain the continued constitutionality of capital punishment: its retributive core, its empowerment of juries to express the cultural consensus of local communities, and the modern regulatory measures that promised to eliminate arbitrary death sentencing.

Reconciling Rational-Basis Review

Raphael Holoszyc-Pimentel

When Does Rational Basis Bite?

Traditionally, rational-basis scrutiny is extremely deferential and rarely invalidates legislation under the Equal Protection Clause. However, a small number of Supreme Court cases, while purporting to apply rational-basis review, have held laws unconstitutional under a higher standard often termed “rational basis with bite.” This Note analyzes every rational-basis-with-bite case from the 1971 through 2014 Terms and nine factors that appear to recur throughout these cases. This Note argues that rational basis with bite is most strongly correlated with laws that classify on the basis of an immutable characteristic or burden a significant right. These two factors are particularly likely to be present in rational-basis-with-bite cases, which can be explained on both doctrinal and prudential grounds. This conclusion upends the conventional wisdom that animus is the critical factor in rational basis with bite and reveals that other routes to rational basis with bite exist. Finally, this Note observes that applying at least rational basis with bite to discrimination against gay, lesbian, bisexual, and transgender individuals is consistent with the pattern of cases implicating immutability and significant rights.

Political Powerlessness

Nicholas O. Stephanopoulos

There is a hole at the heart of equal protection law. According to long-established doctrine, one of the factors that determine whether a group is a suspect class is the group’s political powerlessness. But neither courts nor scholars have reached any kind of agreement as to the meaning of powerlessness. Instead, they have advanced an array of conflicting conceptions: numerical size, access to the franchise, financial resources, descriptive representation, and so on.

My primary goal in this Article, then, is to offer a definition of political powerlessness that makes theoretical sense. The definition I propose is this: A group is relatively powerless if its aggregate policy preferences are less likely to be enacted than those of similarly sized and classified groups. I arrive at this definition in three steps. First, the powerlessness doctrine stems from Carolene Products’s account of “those political processes ordinarily to be relied upon to protect minorities.” Second, “those political processes” refer to pluralism: the idea that society is divided into countless overlapping groups, from whose shifting coalitions public policy emerges. And third, pluralism implies a particular notion of group power— one that (1) is continuous rather than binary, (2) spans all issues, (3) focuses on policy enactment, and (4) controls for group size, and (5) type. These are precisely the elements of my suggested definition.

But I aim not just to theorize but also to operationalize in this Article. In the last few years, datasets have become available on groups’ policy preferences at the federal and state levels. Merging these datasets with information on policy outcomes, I am able to quantify my conception of group power. I find that blacks, women, and the poor are relatively powerless at both governmental levels; while whites, men, and the non-poor wield more influence. These results both support and subvert the current taxonomy of suspect classes.

A Comprehensive Theory of Civil Settlement

J.J. Prescott, Kathryn E. Spier

A settlement is an agreement between parties to a dispute. In everyday parlance and in academic scholarship, settlement is juxtaposed with trial or some other method of dispute resolution in which a third-party factfinder ultimately picks a winner and announces a score. The “trial versus settlement” trope, however, represents a false choice; viewing settlement solely as a dispute-ending alternative to a costly trial leads to a narrow understanding of how dispute resolution should and often does work. In this Article, we describe and defend a much richer concept of settlement, amounting in effect to a continuum of possible agreements between litigants along many dimensions. “Fully” settling a case, of course, appears to completely resolve a dispute, and if parties to a dispute rely entirely on background default rules, a “naked” trial occurs. But in reality virtually every dispute is “partially” settled. The same forces that often lead parties to fully settle—joint value maximization, cost minimization, and risk reduction—will under certain conditions lead them to enter into many other forms of Pareto-improving agreements while continuing to actively litigate against one another. We identify three primary categories of these partial settlements: award-modification agreements, issue-modification agreements, and procedure-modification agreements. We provide real-world examples of each and rigorously link them to the underlying incentives facing litigants. Along the way, we use our analysis to characterize unknown or rarely observed partial settlement agreements that nevertheless seem theoretically attractive, and we allude to potential reasons for their scarcity within the context of our framework. Finally, we study partial settlements and how they interact with each other in real-world adjudication using new and unique data from New York’s Summary Jury Trial Program. Patterns in the data are consistent with parties using partial settlement terms both as substitutes and as complements for other terms, depending on the context, and suggest that entering into a partial settlement can reduce the attractiveness of full settlement. We conclude by briefly discussing the distinctive welfare implications of partial settlements.

Post-Racial Hydraulics: The Hidden Dangers of the Universal Turn

Charlotte S. Alexander, Zev J. Eigen, Camille Gear Rich

In recent years, antidiscrimination scholars have focused on the productive possibilities of the “universal turn,” a strategy that calls on attorneys to convert particularist claims, like race discrimination claims, into broader universalist claims that secure basic dignity, liberty, and fairness rights for all. Scholars have urged litigators to employ universalist strategies in constitutional and voting rights cases, as well as in employment litigation. Thus far, however, arguments made in favor of universalism have largely been abstract and theoretical and therefore have failed to fully consider the second-order effects of universalist strategies on the ground. In this Article, we challenge the prevailing arguments in favor of universalism by exploring the market consequences as lawyers shift from particularist Title VII race discrimination claims to universalist Fair Labor Standards Act claims. Drawing on a review of case filing statistics and an inductive, purposeful sample of attorney interviews, we describe a phenomenon we call “post-racial hydraulics,” which are a set of non-ideological, economic, and pragmatism-based drivers produced by the trend toward universalism. Post-racial hydraulics must be understood as key but previously unexplored factors in racial formation. Left unchecked, these non-ideological drivers will have substantive ideological effects, as they threaten to fundamentally reshape the employment litigation market and alter our understanding of race discrimination.

Conditional Spending and the Need for Data on Lethal Use of Police Force

Grace E. Leeper

When it wants to be, the federal government is good at counting things. It tracks average daily caffeine intake (300 milligrams per adult older than twenty-two in 2008), weekly instances of the flu (875 reported by public health laboratories in the week ending January 14, 2017), monthly production of hens’ eggs (8.97 billion in December 2016), and annual bicycle thefts (204,984 in 2015). But it currently cannot provide a comprehensive count of how often police officers use lethal force against its citizens. The deaths of Michael Brown, Walter Scott, Tamir Rice, Laquan McDonald—all unarmed, black, and shot by police officers—and far too many others have forced the issue of lethal police use of force into the national consciousness. But while many recent reports have focused on the unreliability of current data, there has been relatively little consideration of how, exactly, the federal government might go about getting it. This Note seeks to fill this gap by laying out the contours within which the federal government can act to incentivize states to collect more and better data. After highlighting the need for robust data collected at the federal level and describing various issues with the current state of federal collection of law enforcement data, this Note outlines the legal landscape legislators considering such a policy must grapple with: the combination of federalism concerns that are particularly acute in the sphere of state and local law enforcement, and the Supreme Court’s somewhat ambiguous conditional spending jurisprudence. Finally, it explains how the federal government might incentivize data collection without running afoul of the law, proposing a legislative scheme for federal collection of law enforcement data that combines national guidelines, conditional spending requirements, and competitive grant funding.

Toward an Optimal Bail System

Crystal S. Yang

Few decisions in the criminal justice process are as consequential as the determination of bail. Indeed, recent empirical research finds that pre-trial detention imposes substantial long-term costs on defendants and society. Defendants who are detained before trial are more likely to plead guilty, less likely to be employed, and less likely to access social safety net programs for several years after arrest. Spurred in part by these concerns, critics of the bail system have urged numerous jurisdictions to adopt bail reforms, which have led to growing momentum for a large-scale transformation of the bail system. Yet supporters of the current system counter that pre-trial detention reduces flight and pre-trial crime—recognized benefits to society—by incapacitating defendants. Despite empirical evidence in support of both positions, however, advocates and critics of the current bail system have generally ignored the real trade-offs associated with detention.

This Article provides a broad conceptual framework for how policymakers can design a better bail system by weighing both the costs and benefits of pre-trial detention—trade-offs that are historically grounded in law, but often disregarded in practice. I begin by presenting a simple taxonomy of the major categories of costs and benefits that stem from pre-trial detention. Building from this taxonomy, I conduct a partial cost-benefit analysis that incorporates the existing evidence, finding that the current state of pre-trial detention is generating large social losses. Next, I formally present a framework that accounts for heterogeneity in both costs and benefits across defendants, illustrating that detention on the basis of “risk” alone can lead to socially suboptimal outcomes.

In the next part of the Article, I present new empirical evidence showing that a cost-benefit framework has the potential to improve accuracy and equity in bail decision-making, where currently bail judges are left to their own heuristics and biases. Using data on criminal defendants and bail judges in two urban jurisdictions, and exploiting variation from the random assignment of cases to judges, I find significant judge differences in pre-trial release rates, the assignment of money bail, and racial gaps in release rates. While there are any number of reasons why judges within the same jurisdiction may vary in their bail decisions, these results indicate that judges may not be all setting bail at the socially optimal level.

The conceptual framework developed in this Article also sheds light on the ability of recent bail reforms to increase social welfare. While the empirical evidence is scant, electronic monitoring holds promise as a welfare-enhancing alternative to pre-trial detention. In contrast, application of the conceptual framework cautions against the expanding use of risk-assessment instruments. These instruments, by recommending the detention of high-risk defendants, overlook the possibility that these high-risk defendants may also be “high-harm” such that they are most adversely affected by a stay in jail. Instead, I recommend that jurisdictions develop “net benefit” assessment instruments by predicting both risk and harm for each defendant in order to move closer toward a bail system that maximizes social welfare.

Looking over a Crowd—Do More Interpretive Sources Mean More Discretion

Adam M. Samaha

Observers have suggested that adding sources of interpretation tends to increase interpreter discretion. The idea is embedded in a quip, attributed to Judge Harold Leventhal, that citing legislative history is like “looking over a crowd and picking out your friends.” Participants in debates over interpretive method have applied the idea to the proliferation of other sources as well, including canons of construction and originalist history. But the logic of “more sources, more discretion” has escaped serious testing. And predicting the effect of source proliferation is not a matter of logic alone. The empirical study of how information loads affect behavior has grown dramatically in recent decades, though almost without notice in legal scholarship on interpretive method.

This Article tests the logic and evidence for “more sources, more discretion.” The idea turns out to be incorrect, without more, as a matter of logic. Adding sources tends to reduce the chance of discretion using a simple model of interpretation. This starter model depicts judges as aggregators of source implications, and it draws on basic probability theory and computer simulations to illustrate. The analysis does change if we allow judges to “spin” or “cherry pick” sources, but without much hope for limiting discretion by limiting sources. Of course, judges will not always behave like machines executing instructions or otherwise follow the logic of these models. Thus the Article goes on to spotlight provocative empirical studies of information-load effects, develop working theories of interpreter behavior, and present new evidence.

After emphasizing that interpreters might ignore additional information at some point, the Article tests three other theories. First, an extended dataset casts doubt on an earlier study that linked a growing stock of precedents to increased judicial discretion. Adding to the pile of precedents seems to have no simple pattern of effect on discretion. Second, existing studies indicate that increasing information loads might prompt judges to promote the status quo, and new data suggest that this effect depends on the type of information added. The number of sources cited in appellant briefs appears to have no effect on judges’ willingness to affirm—in contrast with the number of words and issues presented, which may have opposing effects. Third, an expanded dataset supports an earlier finding that judges who face a large number of doctrinal factors might weight those factors in a quasi-legal fashion. This time-saving prioritization does not seem to follow conventional ideological lines.

With simple intuitions in doubt, thoughtful work remains to be done on the effects of source proliferation. Observers interested in judicial discretion have good reason to look beyond source proliferation to find it. And observers interested in institutional design have good reason to rethink the range of consequences when information is added to our judicial systems.

Dynamic Rulemaking

Dynamic Rulemaking

In administrative law, it is generally assumed that once an agency promulgates a final rule, its work on that project—provided the rule is not litigated—has come to an end. In order to ensure that these static rules adjust to the times, therefore, both Congress and the White House have imposed a growing number of formal requirements on agencies to “look back” at their rules and revise or repeal ones that are ineffective.

Our empirical study of the rulemaking process in three agencies (N = 462 revised rules to 183 parent rules) reveals that—contrary to conventional wisdom—agencies face a variety of incentives to revise and update their rules outside of such formal requirements. Not the least of these is pressure from those groups that are affected by their regulations. There is in fact a vibrant world of informal rule revision that occurs voluntarily and through a variety of techniques. We label this phenomenon “dynamic rulemaking.” In this Article, we share our empirical findings, provide a conceptual map of this unexplored world of rule revisions, and offer some preliminary thoughts about the normative implications of dynamic rulemaking for regulatory reform.

Foreword

Lee Epstein, Barry Friedman, Geoffrey R. Stone

Testing the Constitution

We live in the age of empiricism, and in that age, constitutional law is a relative backwater. Although quantitative methods have transformed entire fields of scholarly inquiry, reshaping what we ask and what we know, those who write about the Constitution rarely resort to quantitative methodology to test their theories. That seems unfortunate, because empirical analysis can illuminate important questions of constitutional law. Or, at least, that is the question to be tested in this Symposium.

We brought together a terrific group of scholars with a unique assignment. We paired distinguished constitutional thinkers with equally accomplished empiricists. We asked the law scholars to identify a core question, assumption, or doctrine from constitutional law, and we asked the empiricist to take a cut at answering it, or at least at figuring out how one might try to answer it. We understood that their answers might be preliminary at best, that the questions might be resistant to easy answers. This is so, in part, because empiricism is as much a means of refining questions as it is a way of answering them.

The balance of this Foreword is, in a sense, an introduction to the idea that more serious empirical analysis can further both constitutional law scholarship and constitutional law decisionmaking. Hence our title: Testing the Constitution.