orgtheory.net

a belated, belengthy performance

Kieran

I have been extremely irresponsible about my contribution to our book seminar on Donald MacKenzie’s An Engine, Not a Camera. But for once this is because my thoughts on the book metastisized into an article-length something-or-other. I’m still working on it so I won’t inflict it upon you (but stay tuned: eventually I will). Instead, here is a long excerpt. At the risk of sounding like Saul Kripke, some disclaimers: I’ve dropped some of the throat-clearing sign-posting introductory stuff and also left out supporting material in the middle; there’s another whole bit to the paper which I’m not putting in here; and I’m still not sure what I think on some points. Also, any errors of fact or argument are completely not my responsibility. Neither shall I accept invoices for medical costs incurred by migraines brought on by reading such a long post.

Any comments or reactions are much appreciated, however.

From Science Studies to Finance Studies

MacKenzie’s background is in science studies. In the 1970s, David Bloor’s (1976) “strong program” argued for “epistemological symmetry” in explanations of the acceptance or rejection of scientific theories. Roughly speaking, the idea was that social explanations of the acceptance or rejection of scientific theories need not take a position on the truth or falsity of those theories. Sociological processes or social factors were not not to be invoked just to explain the acceptance or persistence of seemingly false beliefs, but seemingly true ones as well. The obvious contrast is with the simplest realist view that the truth or accuracy of a theory is enough to explain why scientists believe in it (with appropriate caveats about the current state of knowledge and the possibility of new research). Recalling the main tenets of the strong program makes it clear why the so many researchers trained in science studies have been attracted in recent years to economic sociology. The cri de cœur of the strong program was that sociology was not there just to explain the mistakes or irrational episodes in the history of science. Strong-programmers criticized their Mertonian precursors for being too willing to accept this lesser role in relation to the official theorists and historians of scientific progress. In exactly the same way, the new economic sociology began by rejecting Parsons’ (and before him, Pareto’s) division between economics as the science of rational action and sociology as the science of the irrational residuum. No wonder it caught the attention of people like MacKenzie.

The strong-programmers were followed (and challenged) by the actor-network theory (ANT) of Bruno Latour (1987) and Michel Callon (1986). This school takes the more radical view that there is no point in even making a distinction between the social and natural when it comes to explaining scientific practice. They speak instead in terms of networks of “actants,” a category including not just people but also things to which agency may be attributed, such as devices, technologies or bits of software. The focus is on the process by which a heterogenous collection of such actants can become organized into a more or less successful knowledge-producing network. The questions of most interest to ANT researchers are typically “what” and “how” questions: what are the actants in the network, how are they made to fit together, what are the results, how are they produced? This approach encourages very close study of the role of material devices, artifacts, algorithms and so on in the production and transformation of knowledge. Though not a convert to Latour’s project, this last feature is strongly evident in MacKenzie’s book.

The strong-programmers and the Latoureans disagree about a great deal. A recurrent criticism of both approaches from philosophers is that, although they may appear to have radical epistemological or ontological implications, on closer inspection their claims are either flatly indefensible or easily reconciled with a more straightforward philosophy of science or ontology. Work in science studies can indeed be unclear about the content of its claims about scientific truth or its correspondence to reality. At the same time, the caricature of strong-programmers (ridiculed as “postmodernist” or “irrationalist”) often seen in the work of some rock-kicking scientific realists does little to convey the importance of science studies and less to recommend the fair-mindedness of its critics.1

An Engine, Not a Camera does contain one or two bits of loose talk on the topic of truth and reality, and its vocabulary in this respect derives more from the Latourean strain of thought than the Strong Progammers. But in its substance the book does not directly concern itself with the philosophical questions. In fact, because the topic is finance and financial markets, some standard battle lines in the “science wars” are beside the point. Given the case at hand, any claims about the performative relationship between theory and reality will refer to a link between two different kinds of social practice rather than – as in the case of physics, say – to the relationship between a social practice and some bit of the non-human world. Both economics as a body of knowledge and economies themselves are socially constructed. They are produced by the joint action of human beings, so what else could they be? The Chicago Board of Exchange is not like Halley’s Comet, capable of going on as before in the absence of the social actions that bring it to life. In this sense, both economics and the economy are necessarily “performed” or “enacted” by people (together with other actants), just like any other social practice.2 This means that the bar for showing that theory is “performed” through practice is lower than in the case of the physical sciences.

The problem is in that case the bar might be too low. The kind of performativity that is necessarily true just in virtue of being a social practice is not very interesting. At the other end of the scale is what MacKenzie calls the “crude claim that any arbitrary formula for option prices, if proposed by sufficiently authoritative people, could have ‘made itself true’ by being adopted” (20). This much stronger version of performativity is obviously false. The question is whether there is any interesting middle ground which we don’t already understand, and which the concept of performativity helps elucidate.

Lead Us Not Into Temptation, Again

I want to be clear about the concept of performativity because it is tempting to misinterpret it. Specifically, the label will have a strong rhetorical appeal to many sociologists because it suggests some kind of a debunking about what is going on behind the curtain, the exposure of a trick, showing that the emperor has no clothes. The implication is that economic theories are successful because they can get themselves enacted, and not that they get enacted because they are successful. Although MacKenzie disavows this interpretation early on (20), the book leaves a fairly wide space for ambiguity. This is where we came in: an audience of sociologists will tend to hear the argument as a kind of debunking of economic practice, or as an example of how finance is better explained by a sociological approach than by its own theoretical resources. Meanwhile, if pushed by an audience of economists, MacKenzie can honestly say that he never explicitly makes these strong claims.

The self-image of economics as a discipline adds further enticement. Economics often pretends to the authority of the natural sciences, sometimes claiming the title of the physics of the social sciences.3 The organization of contemporary economics as a powerful quasi-profession (Fourcade 2006) helps its adherents talk as though its point of view was inexorable and even beyond question. We have all heard – or perhaps been the victim of – aggressive browbeatings about “basic principles of Econ 101” or the “fundamental facts of economics.” The implication of this kind of boundary-maintenance is that credible criticism of economic policy or theory can only come from those with a Ph.D in the field. But internally economics remains quite heterogeneous. When apostates arise within the fold, the temptation is to insist these lost sheep are not really economists after all, or that they have forgotten any economics they once knew.4

This is just the sort of attitude that the strong-program iconoclasts wanted to dismantle in the case of natural science. The dogma under attack was, as Stephen Shapin once put it, the idea that reality imprints itself on the content of science with “unmediated compulsory force” (Shapin 1982: 163). This project produced a vice of its own: a tendency in science studies to oversell its own findings. The subversive frisson experienced when insinuating that physical reality per se was in some strong sense dependent on our conceptions of it proved hard to resist. Distaste for one extreme sometimes led some – intentionally or otherwise – to write as though they denied reality any role in determining the content of our beliefs about the natural world.

We can leave aside the question of whether the “unmediated force” view was in fact widespread amongst philosophers of science at the time. In part because of the rise of the Latoureans, the differences between contemporary strong-programmers and philosophers with a moderately realist view of science are perhaps fewer and less significant than it might seem. The critical attack by strong-programmers on Popperian falsificationism and the Lakatosian program for “rational reconstruction” of the history of science was very effective, but its impact on succeeding versions of scientific realism was perhaps rather more constructive than is commonly acknowledged. Contemporary scientific realists are rather more careful than they once were about the relationship between science as a social practice and the truth of our beliefs about the natural world. But the same is also true of the strong-programmers themselves: they are much less inclined than before to gesture towards strongly relativist claims about truth.5

The science studies brigade has now arrived in force on the borders of economic sociology, and so much the better for both fields. But the last thing that we need is to rehash the same tired mistakes or polemics all over again regarding the content of claims about the constructed or performative quality of economic theory and practice.

Kinds and Cases of Performativity

MacKenzie distinguishes three kinds of performativity: “generic,” “effective” and “Barnesian” (together with the latter’s negative complement, “counterperformativity”). Generic performativity means the active use of some bit of theory not just by economists but also by economic agents, policy makers and the like. Effective performativity requires that the use of theory not just be window-dressing: it must “make a difference” (18) in practice. Finally “Barnesian” performativity (named for Barry Barnes) requires that the use of economics actively alter processes “in ways that bear on their conformity to the aspect of economics in question” (19). That is, the model or theory must bring participants into line with its picture of the world. In that case the model helps make itself true, in the sense that before the its public appearance the system did not behave in accordance with the model’s predictions, whereas subsequently it does. Naturally, it is also possible that a model might undermine the real-world viability of the process it describes. That would be a “counterperformative” effect.

MacKenzie argues that performativity can be thought of as part of “a more general phenomenon: the incorporation of economics into the infrastructures of markets” (19). He examines four cases from the field of finance theory where ideas developed (mostly) by academics might have had performative effects on the structure and practice of financial markets. These are the Modigligani-Miller “irrelevance” propositions for capital theory; portfolio selection theory and the closely related Capital Asset Pricing Model (CAPM); random walk models and the efficient market hypothesis (EMH); and the Black-Scholes-Merton (BSM) formula for option pricing. Taken together, these ideas form the core of modern finance theory, and they contributed to a revolution in financial markets that began in the late 1960s.

I will skip the first three cases and focus on the BSM equations for option pricing. This is one of finance theory’s crown jewels and also MacKenzie’s best case for performativity. If the EMH provided an overall vision of how the market should work, then Black, Scholes and Merton provided a technique that could be put to work within the market itself. MacKenzie documents the development of the theory behind option pricing and its subsequent application in practice. He argues that the appearance and application of the BSM formula had three main effects. First, the model’s power and elegance legitimated the business of options trading: “it undermined the long-standing cultural association between options and gambling” (158). The fact that the basic equations were published work rather than private methods eased their acceptance. Second, Fischer Black sold elegantly-constructed sheets containing Black-Scholes values for options (and associated information) that traders could use on the floor while doing their work. They simplified the process of making trades, though traders using them were occasionally mocked as not being man enough to work without them. Third, MacKenzie argues that the model was put to use in “spreading,” the identification of pairs of options on the same underlying stock where one member of the pair was underpriced with respect to the other. Here MacKenzie sees Barnesian performativity in action, because the method that traders used to identify the discrepancies in option prices was the same, in essence, as the one academic researchers used to assess the accuracy of the model itself:

The most thorough tests of fit were conducted by Mark Rubinstein (1985) … [In essence] Rubinstein checked whether the graph of implied volatility against strike price was a flat line, as it should be on the model. There was thus a homology between the econometric testing of the Black-Scholes-Merton model and the trading-floor use of the model in “spreading.” When spreaders used the model … it would be precisely deviations from that flat line that they would have identified and that their activities would have tended to “arbitrage away.” It seems, therefore, that the model may have been helped to pass its central econometric test … by the market activities of those who used it (165).

This is MacKenzie’s strongest example of Barnesian performativity, “a direct performative loop between ‘theory’ and ‘reality’” (166). The mechanism here is of great interest because it is not what we typically mean when we say that economic theory has the capacity to make itself true by successfully implanting itself in our minds. Critics such as Margaret Radin have worried, for example, that the spread of the rhetoric of commodification makes people forget that their motives and actions are not all that well-described by the self-interested vocabulary they use. And experiments in social-psychology and behavioral economics have found that exposure to the lessons of undergraduate economics makes people more selfish (or rational, if you prefer), and more likely to behave like homo economicus. Nothing like this is happening in the case of option pricing. The setting is already a market, and the self-interested motivations of traders do not change a bit. Rather, the model is put to use prospectively in essentially the same way that a researcher would go about testing it retrospectively. It is adopted in practice in a way that mirrors its assumptions and prescriptions. This correspondence is what causes the gap between theory and practice, between economics and reality, to narrow. Moreover, the narrowing happens from the side of practice: by employing the formula to identify and exploit profit opportunities, market actors moved observed prices closer to what the model predicted should be observed.

Enacted Theory and the Problem of Success

The overall theme of the book is that finance theory is performative, but at most points of detail the evidence is ambiguous. One worry is this: when some version of performativity is used to label uncontroversially sociological processes, the reader suspects that these are already understood under different names. At other times, what MacKenzie describes cuts much closer to the economics, and the reader wonders whether the native story – the model’s own account of its success, if you like – is a sufficient explanation instead.

Common-or-garden institution building

On the sociological side, the processes visible in what MacKenzie would classify as cases of “generic” or “effective” performativity seem to be fairly well-understood, though perhaps they have not been investigated quite so well before in the realm of financial markets.6 For example, his description of the institution-building and collective-action efforts of Leo Melamed and his associates in Chicago is a superb study of collective action in the service of market creation. And although MacKenzie distinguishes his “social studies of finance” approach from regular economic sociology, he points out himself that John Meriwether and his associates at Salomon Brothers behaved as classic embedded actors. They drew on network ties and rich local knowledge about institutional structure to determine whether arbitrage opportunities identified by BSM-like methods were worth pursuing in practice. “‘Mathematics was helpful,’ says Meriwhether, but the kind of understanding of the institutional structure of the market that comes only from experience was – precisely as the Granovetterian tradition would predict – ‘more important’” (216). He also shows how several prominent economists – Milton Friedman, Burton Malkiel, and others – worked hard to politically legitimate the new financial instruments. Their goal was to make them palatable to regulatory agencies and legal professionals.

Now, in a loose sense all this effort was in the service of trying to enact a theory. The various players wanted to remove the stigma from certain kinds of financial instrument, and see legal, respectable markets in them come into being. It was important to their efforts that BSM and other theoretical ideas provided evidence that their project was intellectually viable. But it was also a straightforward exercise in institution-building and political legitimation, and these do not seem to me to be performative in a strong sense. Even for the BSM case, where evidence for performativity is strongest, MacKenzie describes a range of “associated processes” (near 167) at work around the same time as the model took hold. While not strictly performative, they did have the effect of bringing financial markets closer to instantiating a “Black-Scholes world,” by creating the conditions whereby the model’s assumptions did not seem so unrealistic. These included easier credit for stock purchases, vastly increased speeds of communications and computing power, the abolition of fixed commissions to brokers, the diffusion of options trading across sectors and exchanges, and the rise of wire-based markets such as NASDAQ, with its Autoquote software.

This is all evidence that a distinctively financialized conception of trading was on the rise from the 1970s onwards. But none of these processes involves the kind of elegant homology between theoretical validation and practical application that MacKenzie identifies as the key to BSM’s Barnesian moment.7 The further we move away from the traders working with the formulae on the floor, the more things start to look like political programs and institution-building projects that we understand fairly well. Vigorous efforts to realize some desired end, coupled with an insistence on the inevitable triumph of that end, characterize any strong ideological program.

At best, then, the Barnesian performativity of Black-Scholes was only one element amongst many explaining the success of the revolution in finance. Of course, just as advocates of the strong program in the sociology of science are not under any obligation to argue that scientific knowledge is purely social (just that it always has a social component), MacKenzie nowhere claims that the performativity of finance is purely Barnesian (just that it may have a Barnesian component). Nevertheless, the obviously important role of these other powerful sociological and political processes should lead us to ask whether the BSM’s forumla’s Barnesian performativity was so important to the successful institutionalization of options trading that MacKenzie describes. That the Barnesian variety is logically the strongest of the three types of performativity is no guarantee that it is the most central in practice, either in terms of its prevalence or the force of its effects.

Why BSM worked

On the economics side, there is the question of the reason for the formula’s success. To see why this is an issue, it is worth returning to MacKenzie’s early disclaimer that not just any apparently authoritative equation for pricing options could have taken hold and been enacted. That “crude claim” is obviously false:

Imagine, for example, that as a result of a mistake in their algebra Black and Scholes had produced a formula for the value of a call option that was half or double their actual formula …, that no-one noticed, and that the formula was then used widely to price options. It would not have been a stable outcome: the sellers or buyers of options would have incurred systematic losses, and attractive arbitrage opportunities would have been created (20).

This example makes it clear that Barnesian performativity, of the sort MacKenzie wants, is not simply the forcible imposition or successful propagation of some set of beliefs about the world. Barnes himself, as quoted by MacKenzie, “conceived of a society as a distribution of self-referring knowledge substantially confirmed by the practice it sustains” (Barnes 1988: 166). On a weak reading, all social institutions worthy of the name exemplify this proposition: the mark of any institution – from religion to law to marriage to property – is that its everyday enactment by people chronically reproduces, confirms and thereby entrenches the expectations of those who bring it to life. But MacKenzie wants a stronger reading than this, because he argues there is a mechanism by which the application of a model can bring reality into line with itself.

What remains to be explained is why this mechanism worked as well as it did. As we have seen, MacKenzie argues that there was a “homology” between the testing of the model and its practical use (165). But this homology, even in conjunction with all the active institution-building described above, is not sufficient to explain the success of the formula. If an erroneous version of the formula had been implemented and tested, the same homology would have been present but traders would in the meantime have been systematically losing money. Either the fit would have been very poor and gotten worse, the formula would soon have been abandoned, or it would have been or fixed. We want to say that one of the reasons BSM thrived was that it worked – it amounted to a significant discovery about the way options should be priced. This discovery allowed traders to act in a new way, a way that raised their chances of making money. In the process their actions also changed the way that these markets worked. Precisely because this powerful technique was developed, certain features of the market which presumably existed prior to the spread of BSM – such as undiscovered opportunities for spreads – tended to disappear. The game changed.

This does not mean that the BSM formula was the best or only tool which might have been developed and applied. (Indeed, subsequent parts of the book show how BSM was subsequently surpassed in practice, or “no longer enacted,” in MacKenzie’s terms.) But it does mean that the technique worked not simply because it was enacted, but because it was a genuine discovery about the institutions and rules of the financial markets that could be practically applied within them. This aspect of the success of the formula – the fact that it actually worked, or worked well enough – is underplayed if we speak only of the theory being “enacted” or “performed.” Moreover, despite the early acknowledgment that the formula had to be right (or near enough) in order to prosper, this aspect of it does not feature in MacKenzie’s subsequent discussion. When he comes to ask, “Why Black-Scholes-Merton?” he instead emphasizes some of the formula’s other virtues, such as its explicitly theoretical (rather than econometric) grounding, the intuitive appeal of the concept of volatility and the fact that the formula was publicly available (162-163). These all mattered, but would have been of little use if the method itself was basically flawed.

At this point, it might be tempting to conclude that the reason BSM worked was simply because it was the correct way to price options. Therefore there would be no need for a concept of performativity – at least, not one that was expected to do any explanatory work. But this would be a mistake. For one thing, the evolution of futures markets since the 1970s shows that while BSM was an exemplar it was not something that was discovered to be true and remained so once-and-for-all. Recall that MacKenzie documents how the fit of the model improved but then declined as a “volatility skew” appeared and remained in the price data.

How to Think about Performativity

We can approach the issue more constructively. We know that the appearance and diffusion of options markets was not in any way inevitable. Even economists (most of them, anyway) know that well-functioning market institutions, especially for things like derivatives, do not spring up out of the earth. But the existing resources of economic sociology are well able to illuminate the political and organizational maneuvering required to get such things set up. On the other side, we have the power of finance theory to explain why, once things got rolling, they went like they did. The economic theory tells a story about why, given a certain set of institutional arrangements, we should expect things to be priced in such-and-such a way. The finance theorists will want to say that, given the institution-building, this story explains the practical success of the formulae.

Performativity is in the middle, and this is its promise and ambiguity as an idea. On the one hand, it implies that the theoretical resources underpinning option theory were enough to get it to take root. So much so, in fact, that once it began to be enacted it contained a self-sustaining mechanism to make itself more and more true. Yet, on the other hand, the very need for a concept like “performativity” seems to suggest that the model can not account for its success on its own terms: the mechanism for its success was somehow not the one advertised. So we need the sociological vocabulary to really explain what happened. The notion of performativity suggests that we know something that the traders do not, that we have a richer perspective on why BSM and methods like it took hold.

The means to resolve this ambiguity (and to reconcile the internal and external perspectives on the performativity of theory) is right at the heart of the old strong program itself, in its treatment of norms and institutions. The strong program contains two lines of attack on this problem. They are complementary, but draw proximately on different intellectual traditions.

Rules as forms of life

The first, owing mostly to David Bloor, is Wittgensteinian in inspiration. Wittgenstein’s ideas about rules and rule-following are read in a distinctively sociological way to produce a theory of the relationship between rules, knowledge and institutions (see especially Bloor 1983 and 1997). My concern here is with innovation in games, and its effect on the game itself. Think of those occasional developments in a sport that go beyond tweaking what is already known about how to play. Instead, a non-obvious gap in the rules or social organization of the game is discovered and exploited in such a way that allows someone to win more effectively. At that point, there may be a debate over whether the innovation should be legal, or whether it counts as playing the game at all.8 The new move might be banned, or it might give rise to a different game altogether (leaving the original one as before). Or the innovation might be incorporated into the original game, significantly changing it in the process.

That the analogy extends to innovations in the market is obvious. Innovations that are both radical and successful are sometimes called “game-changing” for this very reason. Bloor discusses some observations of Wittgenstein on just this point in Knowledge and Social Imagery, the classic statement of the strong program. Wittgenstein invites us to consider a game being played:

Let us suppose, however, that the game is such that whoever begins can always win by a particular simple trick. But this has not been realized; … Now someone draws our attention to it;–and it stops being a game. … That means, I want to say, it can also be taken like this: the other man did not draw our attention to anything; he taught us a different game in place of our own. –But how can the new game have made the old one obsolete? –We now see something different, and can no longer naïvely go on playing. (Wittgenstein 1983 III-77, p.203)

Bloor (1976: 140) brings this illustration up in the context of a discussion about the nature of logical inference. What I want to focus on is the idea of someone showing us the “simple trick” that changes things. Think of the financial markets as a hugely complicated game with sophisticated rules. Economic life in general is structured by a deeply institutionalized set of formal and informal rules and regulations that help specify how things look in particular circumstances. This is especially true in the world of stock markets, and by extension in markets for options and other derivatives. They sit on top of an enormously complex structure of conventional knowledge and practice. These rules define a field of play where some actions are judged out of order. But it is obvious that they do not determine the detail of what happens in practice. Real games are fluid and dynamic. Participants may have a strategy, but they do not know in advance what is going to happen. As Eric Leifer (1988: 865) observed, this is why game theory is a theory of games that do not need to be played.

Even in ordinary, quite simple games, it can be very difficult to discover some “simple trick” or strategy that allows you to win while still permitting you to say you are playing the game. The problem is immensely more difficult when complex games are considered. An important simplifying feature of markets that makes them different from other kinds of social games (such as the ones played in politics, for instance, or in the world of cultural taste) is that winnings and losses are clearly quantified and denominated in money. The well-defined nature of the outcomes makes the prospect of discovering a winning, replicable strategy somewhat more tractable.9 The Barnesian performativity that MacKenzie documents in the case of BSM is, I suggest, a version of the game-changing trick that Wittgenstein discusses. It is not simple to discover, but it is simple in practice. Moreover, it changes the game being played, even if the players stay the same: “We now see something different, and can no longer naïvely go on playing.”

Interpreting strong performativity in this way has three advantages. First, it removes potentially misleading metaphysical associations introduced by too-heavy a reliance on a vocabulary contrasting “theory” and “reality” or the transubstantiation of one into the other. But it is true to the original inspiration of the idea that rules structure the play we observe. Second, it reminds that the market itself is a complex, rule-governed social practice, and thus is properly the subject an analysis of the constitution and operation of those rules, and that this will be a sociological as well as an economic project. But third, it retains the intuition that the Black-Scholes-Merton formula was a genuine discovery about features of one such complex practice. The performative aspect of the formula is analogous to the game-changing consequences of deep innovation in other games. Thinking in these terms also renders irrelevant questions about whether the formula was “right” sub specie aeternitatis. BSM was not a discovery about nature, it was an innovation in a social practice which became incorporated into that practice, and thus changed it.

Convention and self-fulfilling prophecies

If Wittgenstein is not to your taste, a second line of thought on this topic has its roots in theories of rational choice and has been developed within the strong program mainly by Barry Barnes (1983, 1988). Barnes’ work in this area can be thought of as a reworking and extension of Robert K. Merton’s (1957) concept of a self-fulfilling prophecy. Merton’s insight was to see how some beliefs about the future could make themselves come as a consequence of people acting on their expectations. The canonical example is that of a bank failure happening because too many people demand to withdraw their deposits, because they believe the bank is about to fail. If people believe there will be a run on the bank, then in the absence of any other countervailing effort to change their minds there will indeed be a run on the bank. A limitation of Merton’s view is that he confines the idea of self-fulfilling (and self-negating) prophecies to “a false definition of the situation evoking a new behavior which makes the originally false conception come true” (Merton 1957: 421). The problem with this, noted first by Krishna (1971) and later developed in detail by Barnes, is that there is no reason to think that only false beliefs can have this character, or that it is a characteristic of self-fulfilling prophecies that the initial belief is false in some meaningful sense. In fact, for a very large class of social action the truth or falsity of the belief is beside the point when it comes to understanding its causal effects. As Krishna (1971: 1104-1105) comments,

[Merton] seems to assume that there is a true or false definition of the situation concerning social reality apart from what men think or believe about it and that it can be independently known or determined without reference to this thought or belief … Where “beliefs” or, rather, the way consciousness conceives of a situation, forms and integral part of the situation itself, it is difficult to think of the truth of the situation indpendently of the way it is conceived to be.

To put it another way, Krishna’s point was that a bank not failing is also ultimately a self-fulfilling consequence of people’s belief that it is sound.10 What Barnes did was to take this idea and develop it at length, seeing society as a huge distribution of self-referring knowledge. He connected the idea of a self-fulfilling prophecy to the analysis of institutions as conventions originated by Thomas Schelling’s early work on focal points (Schelling 1960, 1978) and developed most fully in David Lewis’s work on convention (Lewis 1969). Schelling explored ways in which individuals might come to agreement or understanding in the absence of direct communication, by way of reasonable inferences by each party about how the other might be thinking about the situation. By extension, Lewis clearly defined the concept of a convention, demonstrated how conventions might emerge, and showed how the concept could explicate the intuitive observation that languages were conventional systems.

Barnes’ concept of society as a “monumental, sublime, self-fulfilling prophecy” (1988: 52) is an effort to generalize this idea. His view of society as a self-fulfilling, self-reinforcing, self-confirming system of knowledge and belief ultimately rests on the analysis of the rational emergence, stabilization and reproduction of conventions provided by Schelling and Lewis. That intellectual genealogy might come as a surprise to critics determined to see the strong-programmers as cartoon figures devoted to “postmodern” relativism and irrationality.11

Taken together, I think, the Wittgensteinian and conventionalist lines of argument do a lot to clarify how we should think about performativity. They make it easier to see how both the economic and the sociological perspective on financial markets are related to one another, and they also clarify the intellectual roots of the concept itself in a way that should make it palatable to anyone who gets twitchy at the prospect of a sociological analysis of the conditions of scientific knowledge. This interpretation is perfectly consistent with MacKenzie’s presentation of his argument. Indeed, one only has to follow up on some of the key references he provides to see where the argument is coming from. But if you are not familiar with the development of the social theory of the strong program, it is easy to read through An Engine, Not a Camera without a good sense of what stands behind the label of “Barnesian performativity.” That makes me worry — justifiably, based on the history of polemic in the science wars — that neither MacKenzie’s supporters as well as his detractors will be willing to follow up on things in this way. It would be a shame if that were the fate of the book.

References

Barnes, Barry. 1983. “Social Life as Bootstrapped Induction.” Sociology 17: 524–545.

Barnes, Barry. 1988. The Nature of Power. Cambridge: Polity Press.

Bloor, David. 1976. Knowledge and Social Imagery. London: Routledge and Kegan Paul.

Bloor, David. 1983. Wittgenstein: A Social Theory of Knowledge. London: Macmillan.

Bloor, David. 1997. Wittgenstein, Rules and Institutions. London: Routledge.

Bloor, David. 1999. “Anti-Latour.” Studies in the History and Philosophy of Science 30: 81–112.

Bourdieu, Pierre. 1984. Distincton: A Social Critique of the Judgement of Taste. Cambridge: Harvard University Press.

Callon, Michel. 1986. “Some Elements of a Sociology of Translation: Domestication of the Scallops and the Fishermen of St Brieuc Bay.” Pp. 196–233 in Power, Action and Belief: A New Sociology of Knowledge, edited by John Law. London: Routledge and Kegan Paul.

Chwe, Michael. 2001. Rational Ritual: Culture, Coordination and Common Knowledge. Princeton: Princeton University Press.

Friedman, Milton. 1953. “The Methodology of Positive Economics.” In Essays in Positive Economics. Chicago: University of Chicago Press.

Krishna, Daya. 1971. “‘The Self-Fulfilling Prophecy’ and the Nature of Society.” American Sociological Review 36: 1104–1107.

Krugman, Paul. 1995. Peddling Prosperity: Economic Sense and Nonsense in an Age of Diminished Expectations. New York: Norton.

Latour, Bruno. 1987. Science in Action. Cambridge: Harvard University Press.

Leifer, Eric. 1988. “Interaction Preludes to Role Setting: Exploratory Local Action.” American Sociological Review 53: 865–878.

Lewis, David. 1969. Convention: A Philosophical Study. New York: Blackwell.

MacKenzie, Donald. 2006. An Engine, Not a Camera: How Financial Models Shape Markets. Cambridge: MIT Press.

Merton, Robert K. 1957. Social Theory and Social Structure. Revised edition. New York: The Free Press.

Schelling, Thomas. 1960. The Strategy of Conflict. Cambridge: Harvard University Press.

Schelling, Thomas. 1978. Micromotives and Macrobehavior. New York: Norton.

Shapin, Steven. 1982. “History of Science and its Sociological Reconstructions.” History of Science 20: 157–211.

Shapin, Steven. 2001. Review of The Social Construction of What? by Ian Hacking. American Journal of Sociology, 106: 1790–1792.

“Smith, Adam.” 1976. The Money Game. New York: Vintage.

Wittgenstein, Ludwig. 1983. Remarks on the Foundations of Mathematics. Revised Edition. Cambridge: MIT Press.


Footnotes:

1. In retrospect, much of the early philosophical criticism of the strong program sounds like just the sort of Durkheimian response to the desecration of a sacred object that Bloor himself anticipated in Chapter 3 of Knowledge and Social Imagery. Re-reading that book today also makes clear, however, that Bloor did not engage with some of the more sophisticated versions of scientific realism (or empiricism) that were developed in the 1970s.

2. This does not quite resolve things. Proponents of ANT often make strong claims about both the intentionality of non-human actants in the networks they study, and the nature of the division between subjects and objects of knowledge. But we can easily consider material objects or technological devices as crucial to the practice under study without believing they have intentionality. Here MacKenzie pragmatically bypasses these issues: he pays close attention to the material aspects of finance theory’s ideas (such as the effect of Fischer Black’s “sheets” for option pricing) without seeing the need to make any metaphysical claims about them. The only difficulty, as I discuss below, is that his use of this language encourages the reader to read such claims into the argument.

3. Paul Krugman (1995: xi) reports the following squib from Jagdish Bhagwati: “If you are a good economist, a virtuous economist … you are reborn as a physicist. But if you are an evil, wicked economist, you are reborn as a sociologist.”

4. It is interesting for outsiders to see different how (and which) intellectual tendencies tend to get expelled in different policy contexts, such as debates on corporate regulation, the housing market, the rationality of stock prices, immigration policy, the minimum wage and so on. A lucky few get to play policeman and pariah at different times in their careers. As seen in the previous note, in the 1990s Paul Krugman was a tireless defender of the discipline of economics against assorted pretenders to its expertise. These days he is subject instead to charges of political shrillness, though of course his credibility remains difficult to challenge and his political views are shared by many economists. Joseph Stiglitz is perhaps a better case, given that had the bad taste to win the Nobel Prize before writing a series of popular books containing views on free trade which most economists would repudiate.

5. For example, here is Steven Shapin making this point about Boyle’s Law: “Should a sociologist say that Boyle’s law was wholly a social construct, and should she mean that the state of affairs in nature was socially constructed, and that the law was not, therefore, a reliable generalization, she would be both mistaken and unjustified” (Shapin 2001: 1791). David Bloor’s (1999) attack on Latour’s project is an extended example.

6. It is worth noting that MacKenzie does not make all that much conceptual use of generic or effective performativity in the course of the book. They play much less of a role than one might expect from reading the first chapter, and he tends not to say, for example, that such-and-such is an instance of effective performativity.

7. As the book makes clear, after the BSM equation’s convergence with observed prices, some important discrepancies opened up such that the original formulation no longer predicted well. But the long-term importance of BSM was that, first, it was an exemplar “of a general methodology for pricing a derivative” which led to many refinements and extensions, and second, that it gave “a clear and systematic account of the economic process determining those prices … It affected how market participants and regulators thought about options” (20).

8. Think of the case of the schoolboy William Webb Ellis, who “picked up the ball and ran with it” during a game of football, and who was judged not to have innovated in soccer but to have created a different game altogether: rugby.

9. The absence of a quantifiable measure of success is one of the things that makes playing – and analyzing – games of status so much more complicated. See, e.g., Bourdieu (1984).

10. “Merton may reply that by calling the definition ‘unreal,’ he merely meant that the actual financial situation of the bank was such that a disbelief in its ability to meet its financial commitments was unwarranted. After all, the actual situation consists of the ration of assets to liabilities and the relative liquidity of the assets which one holds … But if all these by themselves are not able to save the bank from a financial crash without the belief in its financial viability on the part of a large number of its clients, then it is misleading to define the financial situation apart from the belief that men hold in the situation … Social phenomena, in fact, may be graded by the extent to which the belief or rather consciousness entertained about the situation is a constitutive element in it” (Krishna 1971: 1105).

11. The work of Michael Chwe (2001) independently extends the Schelling/Lewis approach to convention and culture in a way that Barnes ought to approve of, and also shows many unexpected connections between the analysis of common knowledge and the sociology of culture.

Written by Kieran

December 11, 2006 at 3:50 am

Posted in books, economics, sociology

16 Responses

Subscribe to comments with RSS.

  1. Kieran:

    I am one of the ones that theoretically (historically – a great story, well-written/researched and interesting) – just doesn’t see the point, at all, with “performativity.”

    Your excellent mega-post requires a paper-length response – but here’s a few, (very) quick thoughts…or I guess just elaboration on issues that I have with performativity (citing the intellectual history [Merton and Wittgenstein] does not improve matters for me).

    For me a key issue is – what are the boundaries of “performativity”? Yes, MacKenzie qualifies his arguments by saying that not just anything goes (performativity ++[strong, strong] would suggest that this is the case), but what then does? AND WHY? Again, I doubt the associated ‘strong’ program of performativity is content just to marginally explain phenomenon (when econ or science can’t do it – a la Laudan).

    So, in essence this is about self-fulfilling prophecy (though MacKenzie tries to differentiate his arguments somewhat, p. 19), as you suggest, so let me stick with that vocabulary. The question that does not get answered in this literature is why something fulfills itself, or becomes true (even when false – that remember is the key)? For me SFF-type arguments then are perhaps just very proximate explanations of social phenomenon, but more ultimate questions as to REASONS rarely get explicated. In all, shouldn’t the social DESTRUCTION (or, “counterperformativity” – which MacKenzie cites when performativity does happen to ‘pan out’) of reality be equally likely? Its interesting (as an aside), a quick JSTOR search for SFF prophecy (or pygmallion effect – same thing) versus various forms of self-destroying/defeating prophecy (counterperformativity a la Barnes) etc. reveals that at a rate of 2000-to-20 social scientists cite the former, SFF prophecy-effects. In essence, it suggests that social scientists on the whole (again, these are WRONG theories) believe that individuals are quite easily duped into false realities, and rarely figure things out (well, except perhaps us scientists – who in part create the language, reality, and rules of the game). But, boundaries to all this seem critical. So, when do we have self-destroying vs. sff effects? Why? What are the reasons?

    And, importantly, where does a priori (e.g., human nature, Strawson-like rationality – “massive central core of human thinking which has no history”) reality fit in?

    A historical story of finance and the diffusion of its models just does not seem to cut muster in support of SFF prophecy or performativity. Sure – scholars get things wrong, sure – there is a political and social process involved, sure – there are historical aspects to the development of models, sure – there is language involved, sure – models change the way people view markets and realize value; but, these again do not suggest performativity (wrong theories creating reality), or?

    In short, what is the theoretical contribution of the approach? As you suggest, MacKenzie (in the book) is very tepid in terms of the theoretical upshot of his arguments (very different from some of the other strong programme work I have read) – so, what should we theoretically take away from the book?

    The above may all of course simply reflect irreconcilable, epistemological commitments and differences, but given how much interest theoretical arguments broadly related to performativity have received – I still think the arguments are worth discussing.

    Like

    Teppo

    December 11, 2006 at 6:35 am

  2. This is quite an impressive post, Kieran. I think contrasting the MacKenzie argument with the rational choice conventions argument and the bloor argument is extremely informative. Here are some reactions as I read your article (and yes, this is certainly a full blown article!):

    1. In the conclusion, you point out that one can understand the bulk of the book without understanding performativity. I think this is an accurate description, but I don’t really see this as a problem, at least from a rhetorical standpoint. MacKenzie is making two contributions, which operate independently in the text. One is the historical contribution. His interviews and history of the financial economics field are probably the best so far and he has to present this is in a very accessible fashion.

    2. At a few points in your article, you seem critical when you say that performativity (or enacting of institutions predicted by theory) may not be the strongest explanation of the rise of various financial markets. So what? Let’s rephrase this in terms of statistical analysis. Sure, it would be nice if your prefered variable explained most of the variance. But it’s also an accomplishment if your variable is the third or fourth most important variable. Here’e my example: if you could explain, say, 15% of the French Revolution, it would still be a big deal, even if other theories capture other larger chunks of the variance.

    3. This comment is a little vague, but I summarize it as “we have to be careful with economics and performativity.” I think I agree that performativity can be recast more clearly in rules-and-games framework, but then it raises another issue. Specifically, what exactly is being performed/coordinated in this case. The skeptic economist would say: “There is no performativity. People are still acting rationally. Just as economics predicts.” The sociologist would say: “No, there were specific institutions embodied in theory that were then constructed or built into practice.” I think that the issue seems to come down to this. The economist thinks that:

    Economic theory == preference descriptors + theory of demand/supply/marginal returns/expected utility, etc. (let’s call this “ET”)

    The sociologist says:

    Economic Theory == ET + institutions that allow ET + people’s beliefs about the usefulness/legitimacy of institutions that allow ET (let’s call it ET plus)

    Even if we recast everything in terms of convention following, then it’s plausible to say that people aren’t really performing ET – do we really believe that preferenes and constraints on prefences are really just enactments of conventions predicted by academic economics? However, it’s really plausible to point out that you have to enact “ET plus.” And once you believe this, then it is easy to see how enactment affects markets and shifts prices.

    So what’s the point of this last comment? If we recast the whole debate into the issue of convention, but pay attention to what aspects of economics are more plausible described as convention following, then I think MacKenzie’s case becomes a bit stronger.

    Like

    Fabio Rojas

    December 11, 2006 at 5:45 pm

  3. Based on your comment (point 1), Fabio, I guess I have misread things then – if everyone indeed agrees that the arguments and story can, in essence, be understood without reference to performativity (the contribution is historical but not theoretical). And, if we are simply talking about Northian-type (or, insert favorite institutions-type argument, though obviously there are BIG differences) rules/conventions/institutions here, then I can roughly buy that as well.

    Like

    Teppo

    December 11, 2006 at 5:53 pm

  4. Kieran, I think you do a nice job of identifying the role of the performativity concept. I was struggling to understand when or where performativity applies, especially given that MacKenzie argues at the outset that any old theory can’t be performative. MacKenzie, however, never straightforwardly declares the conditions under which performativity should operate. By arguing that performativity only applies to theories that have some basis in reality or truth suggests that performativity has some bounds. Performativity creates the social conditions under which a “true” theory may be validated.

    With all respect, I think Teppo misses the point of Kieran’s post. I think you’re right, Teppo, that MacKenzie’s book isn’t very clear in demonstrating when or where performativity should happen (or counterperformativity). But Kieran isn’t arguing that performativity relates to the arbitrary social validation of theories (or as you say, “wrong theories creating reality”). Performativity is merely the process whereby true theories are enacted by the agents of a theory. It is based on the assumption that certain theories will not naturally be validated without a little push from the theoreticians themselves. The Black-Scholes-Merton options pricing model is a clear-cut example of this.

    Like

    brayden

    December 11, 2006 at 5:52 pm

  5. I think Kieran’s post does a great job of pulling apart all of the different strands of Mckenzie’s argument and of highlighting the rather big role that “traditional” market/institutions building processes played in his account (as well as providing an original constructive notion of performativity that I can live with). One thing that could be said for the book is that even if the study would have been a pure “institution building” book and made no mention of performativity, it would have been a great econ soc book.

    The role of institution building is fairly significant in MacKenzie’s story, but like ugly duckling, it gets overshadowed by the trendier and flashier (and French credentialized) performativity concept. Yet, MacKenzie acknowledged that these stodgy old market building processes (relational, legal, cultural moral and technological) played a significant role in making the world more like the simplified reality that the Black Scholes-Merton model assumed.

    I think that in the very same way, the BSM formula by producing easily accessible sources of information regarding the relative degree of congruence between stock performance and strike price (which could then be used for arbitrage) made the relevant economic actors more those implied in the model. Not more greedy, self-seeking etc., as Kieran points out, (i.e. the economic “theory” did not change the motivational/moral makeup of the actors as some “critical” versions of performativity seem to imply [i.e. commodification makes people into consumers] which are just Frankfurt school redux) but by changing their cognitive capabilities: the BSM formula allowed the actors to see something that they could not see before but which was crucial for the theory’s success that they see: a mismatch between implied volatility and strike price that could be used for arbitrage.

    In order to work then, the BSM formula assumed the existence of two things that did not necessarily exist initially: a physical market that functioned in the “costless” (transaction-wise) manner assumed by economic theory, and market actors endowed with the information necessary to take advantage of all arbitrage opportunities and thus produce the long run prediction of a “random walk” in terms of prices. Thus, there were two types of changes that made the BSM formula more “applicable” to the world of finance (giving it more verisimilitude) than it was initially: structural changes which created a market (institution building) and cognitive changes that allowed market actors provide themselves with the information necessary to take advantage of this market and thus make it work in the “no excess profit” way required by the theory.

    The BSM formula had nothing to do with the first set of events, and thus “performativity” does not apply; but it had a lot do with the second, and some sort of “performativity” or “self-reference” process was at work: the formula became increasingly true because it predictions were used used to take advantage of all arbitrage opportunities. Furthermore, in order for this performativity effect to work, the theory had to be “true” in some sense; that is the theory must have been picking up information that was useful for arbitrage and not pure noise; however the trueness of the theory at this stage (as a cognitive “telescope” on the market) relied on there being a market “instituted” and “built” on a previous stage.

    In this sense performativity might only be relevant for those behavioral models (like those associated with “rational expectations” accounts which assume that actors have information that can only be obtained by assuming that the actors perform the same calculations in their heads to forecast future state of affairs that are itself embodied in the model). The presence of such “actants” as calculators and computers according to MacKenzie made this wildly implausible cognitive-informational assumption regarding the epistemic capacities of actors much less implausible. It might also make some of the RE models that assume that everybody is an “econometrician” much more true in certain contexts.

    Like

    Omar

    December 11, 2006 at 8:56 pm

  6. Hi All,

    I just stumbled upon your seminar and have been much impressed. I am still in the midst of reading Mackenzie and so don’t feel qualified to jump into the discussion, but it’s a richer read for seeing your thoughts. I did want to offer a brief (and likely too pedantic) comment for Kieran.

    I completely agree with your read of performativity in some combination of Wittgensteinian and institutionalist terms. I’ll look forward to being able to cite you rather than make my own, doubtless less eloquent, version of the claim. I’d be careful, though, about applying the phrase ‘conventionalism’ to the institutionalist thread. As I read the landscape, much of the importation of science studies into economic sociology flows through Stark and colleagues, whose work on justification and accounts owes much to Boltanski and Thevenot as well as Callon.

    B&T often get tagged with the conventionalist label. I take their ‘orders of worth’ idea to have interesting possibilities both for economic sociology and for broader work on institutional change (though I have reservations about it that are analogous to your thinking on MacKenzie). I don’t, however, think that those are the links you’re interested in making and I (at least so far) haven’t seen the connection made in MacKenzie. So, all that wind-up for a soft-ball pitch, I think your terms may muddy your key points for precisely the kinds of folks you hope to reach. If this post/article, is an effort to keep economic sociologists who adopt the performativity notion from re-fighting (to my mind largely useless) battles from Science Studies circa the 1990s, then this source of confusion might be particularly problematic.

    Like

    Jason

    December 12, 2006 at 3:40 pm

  7. I’ve been thinking about this not the least since I’ve been working on a short review of MacKenzie’s book anyhow. I’ll share at some point the longer thought piece, but for now let me just ask if you think MacKenzie makes sense in light of what people actually do. There are really three sources for emiprics behind MacKenzie (and most of the research on soc studies of fin): 1) Beunza and Stark’s study of arb desks; 2) Zaloom’s study of pits in Chicago and screen traders in London; and 3) Bruegger and Knorr-Cetina’s study of foreign exchange traders. Let’s add MacKenzie’s own work on LTCM, though this was retrospective interviews. Although there are other studies (Abolafia, Baker), the empirical materials on which to base the models-make-the-world-make-the-models-make-the-world are a little thin.

    Having actually done this kind of research, I’m struck, for example by the fact that 90% of derivatives traders (maybe 99.99% on open outcry floors and 85% in banks) don’t really know or care too much about mathematics, models, etc. Yes, options traders are different, and hedge fund traders are different still. The banks looked a lot more mathematical and model-heavy from my angle, but B-S-M and EMH provide as much identity markers than guides for actually making money.

    Frank Partnoy’s F.I.A.S.C.O., probably the best little book on derivatives trading over the past decade, makes the case as a former trader for Morgan that they basically cheated, lied, and b.s.’d most of their best trades. Wall Street takes advantage of loopholes in bond rating systems, lies flat-out to customers, commits what seems tantamount to fraud in Asian markets, and basically screws Main Street silly for billions.

    (funny aside- about 3 months before Puerto Rico defaulted on its debt this past spring, an asset manager tried to get my mother-in-law to invest in what he said were just about the safest instruments around – Puerto-Rican municipal bonds. PR Munis. It’s like a bad joke. I’m sure he had the math all worked out, CAPM to the rescue! But the math is designed in these cases to head off criticism and b.s. clients, not to be right or anything silly like that.)

    On the open outcry floor, the best way to make money is to stand in front of your brother-in-law and have him feed you winning trades all day. It doesn’t matter a whit what contract you are trading.

    Even in the hedge-fund industry, when you read that Amaranth made (and lost) its money not by, you know, hedging, but by making flat-out wagers on energy markets, we’re not really talking about economists-in-the-wild, we’re talking about something a little more mundane, no?

    Like

    Peter

    December 13, 2006 at 1:19 pm

  8. […] Donald McKenzie’s new book “An engine not a camera” (2006; MIT Press) is a fascinating contribution to economic sociology and beyond. It contributed to a very vital discussion both on the recent conference on the social rule of numbers in Frankfurt and at famous academic blog orgtheory where authors hold a seminar on his book (in fact, my printer is almost smoking since, of course, I want to read Kieran’s post). * […]

    Like

  9. […] April 2nd, 2007 For some reason we have been preoccupied with Eric Leifer of late. From Kieran re-interpreting strong performativity in Leiferian terms, to Brayden dredging up some obscure […]

    Like

  10. […] these forces. What became apparent is that economic theories are actually performative (see e.g., this comment on MacKenzie’s An Engine, Not a Camera), and if you cannot understand the way money affects the […]

    Like

  11. […] as the science of rational action and sociology as the science of the irrational residuum” (Kieran Healy) is due to Parsons (and prior, Pareto). Pareto was particularly important for providing a rhetoric […]

    Like

  12. […] as the science of rational action and sociology as the science of the irrational residuum” (Kieran Healy) is due to Parsons (and prior, Pareto). Pareto was particularly important for providing a rhetoric […]

    Like

  13. […] superstar and economic sociologist Kieran Healy’s description of the three types, from a lengthy piece on MacKenzie’s new book: MacKenzie distinguishes three kinds of performativity: “generic,” “effective” and […]

    Like

  14. […] followed Teppo’s posting on performativity, and similar debates on orgtheory (here, here, and here), socializing finance, organizations and markets, and old- fashioned journal articles (AJS, AMR, […]

    Like

  15. […] We don’t shy away from long, article-length blog posts. […]

    Like

  16. […] Donald MacKenzie – An Engine, Not a Camera […]

    Like


Comments are closed.