The Lady Tasting Tea: How Statistics Revolutionized Science in the Twentieth Century by David Salsburg

From the Publisher

At a summer tea party in Cambridge, England, a lady states that tea poured into milk tastes differently than that of milk poured into tea. Her notion is shouted down by the scientific minds of the group. But one guest, by the name Ronald Aylmer Fisher, proposes to scientifically test the lady's hypothesis. There was no better person to conduct such a test. For Fisher had brought to the field of statistics an emphasis on controlling the methods for obtaining data and the importance of interpretation. He knew that how the data was gathered and applied was as important as the data themselves.

In The Lady Tasting Tea, readers will encounter not only Ronald Fisher's theories (and their repercussions), but the ideas of dozens of men and women whose revolutionary work affects our everyday lives. Writing with verve and wit, author David Salsburg traces the rise and fall of Karl Pearson's theories, explores W. Edwards Deming's statistical methods of quality control (which rebuilt postwar Japan's economy), and relates the story of Stella Cunliff's early work on the capacity of small beer casks at the Guinness brewing factory.

The Lady Tasting Tea is not a book of dry facts and figures, but the history of great individuals who dared to look at the world in a new way.

Bradley Efron

Statistics has been the stealth science of the 20th century, moving almost without public notice, nor the notice of most scientists for that matter, into a commanding methodological position in a score of important fields. Genetics, psychology, medicine, economics, rely on statistical methods when they want to speak quantitatively, and even "hard" sciences such as geophysics and astronomy have moved toward statistical modes of thinking. Salsburg's book is the story of statistical theory in the 20th century, its time of triumph, and of the mathematical/ scientific geniuses who made it happen. He writes with both experience and insight, and with a happy lack of technical barriers between the reader and his subject. Particularly well told is the story of Ronald Fisher, the double genius who founded both mathematical statistics and mathematical genetics. If scientists were judged by their influence on science then Fisher would rank with Einstein and Pauling at the top of the modern ladder. He is unknown to the general public, but perhaps Salsburg will help correct that injustice.

Alvan R. Feinstein

If you have ever been exposed to the statistical activities that permeate science, you will be fascinated by this book. In highly readable, well-written prose that avoids mathematical symbols and intricacies, the text describes all the pertinent ideas and developments of 20th century statistics, while offering charming vignettes (sometimes delicious gossip) about the personalities and peccadilloes of the leading characters. Get the book for your own educational pleasure, or give it to someone you want to delight.

Barbara A. Bailar

David Salsburg explores in a non-mathematical presentation the development of statistical methods over the past 200 years or so. Statistical thinking and applications permeate every important area of our lives--medicine, economics, industry, censuses, and insurance, to name a few. This book intricately weaves together the history of this development with short, pithy biographies of those who were major contributors. the result is a fascinating description of the kinds of people who interacted, collaborated, disagreed, and were brilliant in the development of statistics.

Publishers Weekly

The development of statistical modeling in primary research is the underreported paradigm shift in the foundation of science. The lady of the title's claim that she could detect a difference between milk-into-tea vs. tea-into-milk infusions sets up the social history of a theory that has changed the culture of science as thoroughly as relativity did (the lady's palate is analogous to quantum physics' famous cat-subject), making possible the construction of meaningful scientific experiments. Statistical modeling is the child of applied mathematics and the 19th-century scientific revolution. So Salsburg begins his history at the beginning (with field agronomists in the U.K. in the 1920s trying to test the usefulness of early artificial fertilizer) and creates an important, near-complete chapter in the social history of science. His modest style sometimes labors to keep the lid on the Wonderland of statistical reality, especially under the "This Book Contains No Equations!" marketing rule for trade science books. He does his best to make a lively story of mostly British scientists' lives and work under this stricture, right through chaos theory. The products of their advancements include more reliable pharmaceuticals, better beer, econometrics, quality control manufacturing, diagnostic tests and social policy. It is unfortunate that this introduction to new statistical descriptions of reality tries so hard to appease mathophobia. Someone should do hypothesis testing of the relationship between equations in texts and sales in popular science markets it would make a fine example of the use of statistics. Illus. (Apr.) Copyright 2001 Cahners Business Information.

Library Journal

This is an insightful and revealing history of how the emergence of statistics in scientific research revolutionized the sciences. Without using a single mathematical equation, Salsburg, a former Harvard professor and a prolific writer with three books and numerous articles on applied statistics, clearly discusses some major advances in statistics in the last century. He covers most of the major contributors to the field and dedicates two chapters to the contributions made by women. Salsburg also does an excellent job of showing how statistics has had an impact in the development of other sciences likes agriculture, cancer research, and econometrics as well as its influence in industry, where statistical methods are widely used in quality control and for the analysis of operational research. General readers with little mathematical background will be able to grasp Salsburg's lucid concepts with ease. Specialists will also enjoy reading this book for its interesting presentation and for the many biographical notations about some of the most influential researchers in the field. Since Salsburg focuses on the 20th century, readers interested in learning about earlier developments in statistics can look at Stephen M. Stigler's Statistics on the Table (LJ 10/1/99). Nestor L. Osorio, Northern Illinois Univ. Lib., DeKalb Copyright 2001 Cahners Business Information.

Booknews

A statistician with a background in pharmaceuticals, Salsburg traces the impact of his field on science through profiles of men and women who were directly involved. Among them are W. Edward Demming, the father of the modern quality religion; Janet Norwood, the first woman Commissioner of the Bureau of Labor Statistics; William Sealy Gosset of Guinness Brewing; and F.N. David, who modelled bomb damage to cities during World War II. He uses no mathematical formulae or scientific jargon. Annotation c. Book News, Inc., Portland, OR (booknews.com)

Internet Book Watch

Lady Tasting Tea is an unusual guide which explains how the statistical revolution in science came about, examining how statistical modeling examples were developed and used. Unique to Lady Tasting Tea is an exploration which includes no math formulas and assumes no prior grounding in math concepts, statistics or math history; making it quite accessible to lay readers, and recommended for leisure browsing as well as study.

Product Details

• ISBN: 0805071342
  
• ISBN-13: 9780805071344
• Format: Paperback, 352pp
• Publisher: Henry Holt & Company, Incorporated
• Pub. Date: January 2001
• Edition Description: REV
• Sales Rank: 48,852

• Table of Contents
• Read a Sample Chapter

Table of Contents

Read a Sample Chapter

Chapter One

The Lady Tasting Tea

It was a summer afternoon in Cambridge, England, in the late 1920s. A group of university dons, their wives, and some guests were sitting around an outdoor table for afternoon tea. One of the women was insisting that tea tasted different depending upon whether the tea was poured into the milk or whether the milk was poured into the tea. The scientific minds among the men scoffed at this as sheer nonsense. What could be the difference? They could not conceive of any difference in the chemistry of the mixtures that could exist. A thin, short man, with thick glasses and a Vandyke beard beginning to turn gray, pounced on the problem.

    "Let us test the proposition," he said excitedly. He began to outline an experiment in which the lady who insisted there was a difference would be presented with a sequence of cups of tea, in some of which the milk had been poured into the tea and in others of which the tea had been poured into the milk.

    I can just hear some of my readers dismissing this effort as a minor bit of summer afternoon fluff. "What difference does it make whether the lady could tell one infusion from another?" they will ask. "There is nothing important or of great scientific merit in this problem," they will sneer. "These great minds should have been putting their immense brain power to something that would benefit mankind."

    Unfortunately, whatever nonscientists may think about science and its importance, my experience has been that most scientists engage in their research because they are interested intheresults and because they get intellectual excitement out of the work. Seldom do good scientists think about the eventual importance of their work. So it was that sunny summer afternoon in Cambridge. The lady might or might not have been correct about the tea infusion. The fun would be in finding a way to determine if she was right, and, under the direction of the man with the Vandyke beard, they began to discuss how they might make that determination.

    Enthusiastically, many of them joined with him in setting up the experiment. Within a few minutes, they were pouring different patterns of infusion in a place where the lady could not see which cup was which. Then, with an air of finality, the man with the Vandyke beard presented her with her first cup. She sipped for a minute and declared that it was one where the milk had been poured into the tea. He noted her response without comment and presented her with the second cup....

The Cooperative Nature of Science

I heard this story in the late 1960s from a man who had been there that afternoon. He was Hugh Smith, but he published his scientific papers under the name H. Fairfield Smith. When I knew him, he was a professor of statistics at the University of Connecticut, in Storrs. I had received my Ph.D. in statistics from the University of Connecticut two years before. After teaching at the University of Pennsylvania, I had joined the clinical research department at Pfizer, Inc., a large pharmaceutical firm. Its research campus in Groton, Connecticut, was about an hour's drive from Storrs. I was dealing with many difficult mathematical problems at Pfizer. I was the only statistician there at that time, and I needed to talk over these problems and my "solutions" to them.

    What I had discovered working at Pfizer was that very little scientific research can be done alone. It usually requires a combination of minds. This is because it is so easy to make mistakes. When I would propose a mathematical formula as a means of solving a problem, the model would sometimes be inappropriate, or I might have introduced an assumption about the situation that was not true, or the "solution" I found might have been derived from the wrong branch of an equation, or I might even have made a mistake in arithmetic.

    Whenever I would visit the university at Storrs to talk things over with Professor Smith, or whenever I would sit around and discuss problems with the chemists or pharmacologists at Pfizer, the problems I brought out would usually be welcomed. They would greet these discussions with enthusiasm and interest. What makes most scientists interested in their work is usually the excitement of working on a problem. They look forward to the interactions with others as they examine a problem and try to understand it.

The Design of Experiments

And so it was that summer afternoon in Cambridge. The man with the Vandyke beard was Ronald Aylmer Fisher, who was in his late thirties at the time. He would later be knighted Sir Ronald Fisher. In 1935, he wrote a book entitled The Design of Experiments, and he described the experiment of the lady tasting tea in the second chapter of that book. In his book, Fisher discusses the lady and her belief as a hypothetical problem. He considers the various ways in which an experiment might be designed to determine if she could tell the difference. The problem in designing the experiment is that, if she is given a single cup of tea, she has a 50 percent chance of guessing correctly which infusion was used, even if she cannot tell the difference. If she is given two cups of tea, she still might guess correctly. In fact, if she knew that the two cups of tea were each made with a different infusion, one guess could be completely right (or completely wrong).

    Similarly, even if she could tell the difference, there is some chance that she might have made a mistake, that one of the cups was not mixed as well or that the infusion was made when the tea was not hot enough. She might be presented with a series of ten cups and correctly identify only nine of them, even if she could tell the difference.

    In his book, Fisher discusses the various possible outcomes of such an experiment. He describes how to decide how many cups should be presented and in what order and how much to tell the lady about the order of presentations. He works out the probabilities of different outcomes, depending upon whether the lady is or is not correct. Nowhere in this discussion does he indicate that such an experiment was ever run. Nor does he describe the outcome of an actual experiment.

    The book on experimental design by Fisher was an important element in a revolution that swept through all fields of science in the first half of the twentieth century. Long before Fisher came on the scene, scientific experiments had been performed for hundreds of years. In the later part of the sixteenth century, the English physician William Harvey experimented with animals, blocking the flow of blood in different veins and arteries, trying to trace the circulation of blood as it flowed from the heart to the lungs, back to the heart, out to the body, and back to the heart again.

    Fisher did not discover experimentation as a means of increasing knowledge. Until Fisher, experiments were idiosyncratic to each scientist. Good scientists would be able to construct experiments that produced new knowledge. Lesser scientists would often engage in "experimentation" that accumulated much data but was useless for increasing knowledge. An example of this can be seen in the many inconclusive attempts that were made during the late nineteenth century to measure the speed of light. It was not until the American physicist Albert Michelson constructed a highly sophisticated series of experiments with light and mirrors that the first good estimates were made.

    In the nineteenth century, scientists seldom published the results of their experiments. Instead, they described their conclusions and published data that "demonstrated" the truth of those conclusions. Gregor Mendel did not show the results of all his experiments in breeding peas. He described the sequence of experiments and then wrote: "The first ten members of both series of experiments may serve as an illustration...." (In the 1940s, Ronald Fisher examined Mendel's "illustrations" of data and discovered that the data were too good to be true. They did not display the degree of randomness that should have occurred.)

    Although science has been developed from careful thought, observations, and experiments, it was never quite clear how one should go about experimenting, nor were the complete results of experiments usually presented to the reader.

    This was particularly true for agricultural research in the late nineteenth and early twentieth centuries. The Rothamsted Agricultural Experimental Station, where Fisher worked during the early years of the twentieth century, had been experimenting with different fertilizer components (called "artificial manures") for almost ninety years before he arrived. In a typical experiment, the workers would spread a mixture of phosphate and nitrogen salts over an entire field, plant grain, and measure the size of the harvest, along with the amount of rainfall during that summer. There were elaborate formulas used to "adjust" the output of one year or one field, in order to compare it to the output of another field or of the same field in another year. These were called "fertility indexes," and each agricultural experimental station had its own fertility index, which it believed was more accurate than any other.

    The result of these ninety years of experimentation was a mess of confusion and vast troves of unpublished and useless data. It seemed as if some strains of wheat responded better than other strains to one fertilizer, but only in years when rainfall was excessive. Other experiments seemed to show that sulfate of potash one year, followed by sulfate of soda for the next year, produced an increase in some varieties of potatoes but not others. The most that could be said of these artificial manures was that some of them worked sometimes, perhaps, or maybe.

    Fisher, a consummate mathematician, looked at the fertility index that the agricultural scientists at Rothamsted used to correct the results of experiments to account for differences due to the weather from year to year. He examined the competing indexes used by other agricultural experimental stations. When reduced to their elemental algebra, they were all versions of the same formula. In other words, two indexes, whose partisans were hotly contending, were really making exactly the same correction. In 1921, he published a paper in the leading agricultural journal, the Annals of Applied Biology, in which he showed that it did not make any difference what index was used. The article also showed that all these corrections were inadequate to adjust for differences in the fertility of different fields. This remarkable paper ended over twenty years of scientific dispute.

    Fisher then examined the data on rainfall and crop production over the previous ninety years and showed that the effects of different weather from year to year were far greater than any effect of different fertilizers. To use a word Fisher developed later in his theory of experimental design, the year-to-year differences in weather and the year-to-year differences in artificial manures were "confounded." This means that there was no way to pull them apart using data from these experiments. Ninety years of experimentation and over twenty years of scientific dispute had been an almost useless waste of effort!

    This set Fisher thinking about experiments and experimental design. He concluded that the scientist needs to start with a mathematical model of the outcome of the potential experiment. A mathematical model is a set of equations, in which some of the symbols stand for numbers that will be collected as data from the experiments and other symbols stand for the overall outcomes of the experiment. The scientist starts with the data from the experiment and computes outcomes appropriate to the scientific question being considered.

    Consider a simple example from the experience of a teacher with a particular student. The teacher is interested in finding some measure of how much the child has learned. To this end, the teacher "experiments" by giving the child a group of tests. Each test is marked on a scale from 0 to 100. Any one test provides a poor estimate of how much the child knows. It may be that the child did not study the few things that were on that test but knows a great deal about things that were not on the test. The child may have had a headache the day she took a particular test. The child may have had an argument with parents the morning of a particular test. For many reasons, one test does not provide a good estimate of knowledge. So, the teacher gives a set of tests. The average score from all those tests is taken as a better estimate of how much the child knows. How much the child knows is the outcome. The scores on individual tests are the data.

    How should the teacher structure those tests? Should they be a sequence of tests that cover only the material taught over the past couple of days? Should they each involve something from all the material taught until now? Should the tests be given weekly, or daily, or at the end of each unit being taught? All of these are questions involved in the design of the experiment.

    When the agricultural scientist wants to know the effect of a particular artificial fertilizer on the growth of wheat, an experiment has to be constructed that will provide data to estimate that effect. Fisher showed that the first step in the design of that experiment is to set up a group of mathematical equations describing the relationship between the data that will be collected and the outcomes that are being estimated. Then, any useful experiment has to be one that allows for estimation of those outcomes. The experiment has to be specific and enable the scientist to determine the difference in outcome that is due to weather versus the difference that is due to the use of different fertilizers. In particular, it is necessary to include all the treatments being compared in the same experiment, something that came to be called "controls."

    In his book, The Design of Experiments, Fisher provided a few examples of good experimental designs, and derived general rules for good designs. However, the mathematics involved in Fisher's methods were very complicated, and most scientists were unable to generate their own designs unless they followed the pattern of one of the designs Fisher derived in his book.

    Agricultural scientists recognized the great value of Fisher's work on experimental design, and Fisherian methods were soon dominating schools of agriculture in most of the English-speaking world. Taking off from Fisher's initial work, an entire body of scientific literature has developed to describe different experimental designs. These designs have been applied to fields other than agriculture, including medicine, chemistry, and industrial quality control. In many cases, the mathematics involved are deep and complicated. But, for the moment, let us stop with the idea that the scientist cannot just go off and "experiment." It takes some long and careful thought—and often a strong dose of difficult mathematics.

    And the lady tasting tea, what happened to her? Fisher does not describe the outcome of the experiment that sunny summer afternoon in Cambridge. But Professor Smith told me that the lady identified every single one of the cups correctly.