A Career Postmortem: Dr. Brian Wansink

Dr. Brian Wansink. Photo courtesy of Wikimedia Commons.

Being formally trained as a Food Scientist in my undergrad years, I had heard about Wansink’s 2006 book Mindless Eating, and became an admirer after reading the book. Because I was a casual reader, I made no effort to “look under the hood” at any papers and studies he might have referred to, and took him at his word as a then-executive director of the Center for Nutrition Policy and Promotion for the US Department of Agriculture (USDA). He was responsible for overseeing the design of the 2010 Dietary Guidelines for Americans, as well as the government-run nutrition site “My Pyramid.gov”. He was also a long-time director of the Food and Brand Lab at Cornell University. With all that under his belt, why would I question what he writes?

The book Mindless Eating has inspired many to be more active and deliberate in managing their nutritional cues, and to take a deeper look into how humans are hard-wired in their perceptions of food. The real strategy would be to find ways to work around these hard-wired perceptions, rather than against them.

The ways he would run his experiments — mostly on college-aged subjects attending Cornell — was that he would offer free food (what college student wouldn’t be attracted by that?). Once you are hooked by the free food (and sometimes a movie), the science kicked in. Plates and food packaging would be weighed by difference in a way that the subject never knew it was being done. They would get a fairly accurate calorie count that way. Then they would ask you about your own perceptions: How much did you think you ate? How many calories did you think you consumed? Depending on what was being investigated, the results when fed back to the participants were often remarkable and surprising. Some of the perceptual tricks in the design of the experiments even fooled graduate students in Dietetics. He showed that these perceptual tricks can be as simple as changing the size of the plate.

Dr. Wansink seemed sly, and clever. But he had to be, because humans can sometimes be even more sly and clever in fooling themselves into thinking that they ate less than they did. The world clearly needed someone like Wansink to expose our human frailties to ourselves, and to show us how we fool ourselves into eating more than we planned to, or than we thought we did.

Two-Buck Chuck comes in many varieties, including red and white.

In Mindless Eating, among his many tales, he discusses people’s perceptions of their meal based on the perceived vintage of the wine they were served. The investigators purchased several cases of the cheapest wine possible, Charles Shaw Wine, nicknamed “2-Buck Chuck”, a wine sold at a chain store called Trader Joe’s in United States. At the time, Charles Shaw Wine could really be purchased for two dollars (USD). All bottles had their labels removed and replaced with a fictitious label suggesting it was from California, and another label suggesting the wine was from North Dakota, a state not known for making wine. The patrons given the various wines with their meals were asked to rate the food (not the wine) they were served and asked whether they would come back. The reaction was far more favourable if the label on the bottle suggested California wine. It was a bit of a sly trick, but at least the 117 diners in the study had a prix fixe all-you-can-eat gourmet meal set at $21.00 (USD), with free wine.

There was another story Wansink likes to talk about, about the bowl of tomato soup that was filled from the bottom using a food-grade feeding tube that was invisible to the participant. The tubing led to a 2-gallon pot containing the soup. The participant seemed oblivious to the bowl of soup that would never empty. The finding here is that people will eat on average 73% more soup than a normal serving if there is no visual cue to tell them to stop eating.  Our stomachs are indeed a very crude instrument for measuring how much we have eaten. We need visual cues, which can be interfered with by the bottomless bowl, but also by regular distractions. This experiment aimed to prove that. For this experimental design, Wansink received the IgNobel prize in Nutrition in 2007.

IgNobel prizes are awarded to scientists whose research makes people laugh, then makes people think. These prizes are awarded by the publication Annals of Improbable Research (AIR), and handed out at an annual ceremony held at Harvard University in Cambridge, Massachusetts, with lectures from the prizewinners being given across town at MIT.

Wansink showed how our perceptions of food quantity is vulnerable to lighting; the presence of company or entertainment or other distractions; the size of our plates; the shape of our drinking glasses; the proximity of junk food from where we happen to be sitting; and so on. All of it was compelling and often headline-grabbing. He has been on interviews about his findings from all 3 major American television networks over the years.

He was apparently able to prove his findings quantitatively, but any graduate students using his findings are now better apt to check his numbers. No one has accused him of fraudulent research, just sloppy research with statistical calculations that didn’t match up with other reported numbers. It began with a now-deleted blog post where, according to The Cut,

Wansink told the story of a Turkish Ph.D. student who came to work in his lab for free. “When she arrived,” he wrote, “I gave her a data set of a self-funded, failed study which had null results (it was a one month study in an all-you-can-eat Italian restaurant buffet where we had charged some people ½ as much as others). I said, ‘This cost us a lot of time and our own money to collect. There’s got to be something here we can salvage because it’s a cool (rich & unique) data set.’ I had three ideas for potential Plan B, C, & D directions (since Plan A had failed).”

Wansink wrote glowingly about the Ph.D. student, Ozge Sigirsci, and in her ability to see the offer of data as an opportunity and get herself published. And that she did. Five papers bylined both by Wansink and Sigirsci, came out of this “failed study”. To grad students reading the blog and wanting their own work published, this raised eyebrows. He was suggesting that it was just fine for a scientist to take a failed study, then massage the data for different null hypotheses until they come up with a correlation that falls outside of a 95% confidence interval, which rejects the null hypothesis (Ho). This is science done backwards. You usually pose the hypotheses before the experiment is run, not after. In other words, a scientist doesn’t run an experiment without knowing what they are researching beforehand.

The kind of statistical error being committed in these papers is known as a “Type M Error” (“M” stands for “Magnitude”). This is where just because you found a correlation with a 5% margin of error, the effect of this statistic might be exaggerated. Remember, this result was stumbled upon as a side effect of slicing and dicing the data until a correlation of “anything” emerged. In that context, how much information is your data giving you that rejects the Ho, which came as more of an afterthought?  It would be better to run a modified experiment to see if the same thing happens when you run the experiment deliberately.

In the blog, Wansink then listed the papers that were published and where they were published. This gave readers 5 key papers to be sceptical about. And there was a research team who did the checking. Tim van der Zee​, Jordan Anaya​, and Nicholas Brown looked into 4 of these 5 papers, and found 150 statistical errors. The error findings were based on inconsistencies in the published tables without looking at the raw data. To look at the raw data, a scientist normally needs to ask the scientist who ran that experiment. It didn’t help that after repeated requests, Wansink refused to share his data with van der Zee, et. al., to settle the matter.

Now, there is no rule saying that he has to share his data. But to paraphrase Andrew Gelman in the blog Statistical Modeling, Causal Inference, and Social Science, there is also no rule saying that anyone in the scientific community needs to take him seriously, either. The various journals have, since 2017 retracted at least 18 of his papers, according to Wikipedia. Another 15 have been formally corrected.

Stanford determined in September, 2018 that he had, according to Science Magazine from 21 September, 2018:

“In a statement issued [on the 20th of September], Cornell’s provost, Michael Kotlikoff, said the investigation had revealed “misreporting of research data, problematic statistical techniques, failure to properly document and preserve research results, and inappropriate authorship.”

Wansink was removed from researching and teaching activities at Cornell, according to Science. Wansink also resigned after this statement was issued.

 

Artificial Sweetners and weight loss

Stevia.

There was a recent article on Stevia in the New York Times. There seemed to be some question as to its safety, though it has been in use for some decades in North America, and even longer in Japan.

Stevia is a sugar substitute, with a claim of zero calories, similar to NutraSweet, Cyclamate, Sucralose, and Saccharine. Saccharine is not for sale in Canada, but the others are.

The Times article tried to raise questions of food safety with Stevia, but frankly, these are generally pretty safe. The trouble with raising food safety questions is that unless there is a focused issue for which there is widespread proof of its lack of safety, raising food safety issues willy-nilly just maintains paranoia.

The real issue we should all be concerned with is that, given the cost of these sweetners, are they really effective in helping us mange our weight? They might be good for helping the body to regulate insulin, since you are not consuming as much sugar (sucrose), but is that all?

The evidence of the negative health effects of added sugar in foods and those in processed foods is uncontroversial, according to an article from Consumer Reports from last year. This includes, of course, soft drinks, other junk foods, and any sugar that you would add to food in high quantity.

Eating for calories

In January of 2019, Doctors Dana Small and Alexandra DiFeliceantonio of Yale University School of Medicine’s Department of Psychiatry, published a short review in the journal Science, which began by giving a history of research on this topic. Early research into rats using diets equal to their spent energy (called an isocaloric diet) which varied in volume, indicated that rats’ preferred caloric intake is fairly constant across several days and trials. It indicates that “rats eat for calories”.

How do rats know about a certain level of calories? It was theorized that there must be a signal sent to the brain communicating the energetic value of the food. If that signal indicated a low value (high volume, same calories except diluted by something else), the rat would eat more. If the signal indicated a high value (low volume, same calories), it would eat less.

This has been replicated and then verified in human subjects. We can even form associations between flavours and calories. One of the most irresistible flavours to humans is the taste of sweetness, indicating the presence of sugar. If animal researchers introduced a blocker (namely 2-deoxyglucose) to prevent sugar metabolism, they found that it inhibited the animals’ ability to form food preferences. There appeared to be broader effects than just food preference inhibition, since dopamine levels appeared in lower than normal concentrations outside of the nerve cells. When glucose was put back in the diet, normal levels of dopamine returned. So hard-wired is this tendency to prefer sweetness in animals (of which we are one species) that it is referred to as an “un-conditioned stimulus” — it does not require conditioning to eat foods that are a bit sweet, we just do without hesitation, thinking it must be good to eat. These signals run independently of our conscious perceptions about the food.

The Mindless Margin

So, if humans eat for calories as well, it means that artificial sweetners can’t be relied on by themselves to help us cut back our caloric intake. A diet must account for the fact that we will have the urge to make up the calories in some other way. It comes down to self-control, but a true win over the battle of the bulge will depend on what one Cornell food scientist once called the “mindless margin” — or just enough self control over your food intake that your body doesn’t miss the lost calories, but your body still benefits by losing the weight, albeit more slowly than planned.

Space Travel for the Masses

An artist’s rendition of a family outing in “space” at a time way into the future, when we are able to populate “space” with hotels and resorts (Courtesy Hannah-Barbera).

This is a war of the billionaires. Amazon’s Jeff Bezos lost to Virgin’s Richard Branson in their bid for the space tourism dollar. Space tourism allows anyone with a quarter million bucks to see Earth in a way that was only available to astronauts.

If you have a quarter million dollars lying around, you can now put it to good use, according to Branson, who has been a passenger on the first test flight over the planet, some 50 or so miles above the Earth’s surface. While this is at the bare minimum to be considered “space” by NASA, it is just high enough for the passenger to feel the effects of zero gravity. Indeed it is space travel for the masses. That is, if the masses each have a quarter million bucks they aren’t using.

I just wonder if, in Branson’s travels, was he able to spot the massive forest fires in the northwest US, and southern British Columbia? If these rich people were taxed a little more, maybe we could do something about it, along with addressing social and economic problems.

I have heard of another, separate effort from a Florida-based company called Space Perspective, which is putting the finishing touches on a helium-filled balloon carrying 8 passengers. But rather than going to “space”, it merely goes as high as the stratosphere, just 19 miles into the sky. This is a cheaper venture, costing each passenger a mere 125 thousand dollars, half the price of Branson’s flight. It might be low enough to smell the smoke from the California fires, but I am not sure.

The Space Perspective venture is staffed by many of the same people that came up with a previous vanity project called Biosphere 2. Biosphere 2 was a failed attempt at trying to re-create the biosphere under entirely man-made conditions for the purpose of having these closed systems deployed in outer space. Located in an Arizona desert, it was marketed to rich investors who feared an apocalypse.

Early on into the project, insect species were dying, vertebrates were dying, there were enourmous cost overruns causing investors to bail out of the project, and soon the human inhabitants of the man-made biomes couldn’t stand each other, people were bringing in food and nutrients from outside of this so-called “closed system”, and there was Steve Bannon. Yes, that Steve Bannon. Before he knew Trump and ran Breitbart News, he was hired by Ed Bass (one of the project’s founders) to curb the huge runaway costs of the Biosphere 2 project.

A depiction of Steve Bannon, during his time being chief advisor to former president Agent Orange.

While Breitbart is famous for attempting to debunk global warming, Bannon was quite instrumental in promoting theories of global warming when he was justifying the basis for Biosphere 2 to potential investors. His highly politicized, misogynistic style of managing people is well-known to most people not under a rock between the years 2015-2020, since it bears similarity to Donald Trump and his cronies, among which was Bannon for a time. The only “scientists” who took the project seriously were, according to Wikipedia, the Russian Academy of Sciences. The site has since been taken over by the University of Arizona. Perhaps now the research will be halfway serious.

The real lesson which humanity could have learned is that there is no ecosystem ever made by man  that is better than the one we all get for free here on Earth. It is a lesson not lost on Abigail Alling, former researcher and resident of Biosphere 1 and a thorn in the side of Steve Bannon.