Douglas Yao (@douglasyaody) 's Twitter Profile
Douglas Yao

@douglasyaody

Making drugs. Prev computational bio PhD @harvard

ID: 1162252445335953408

linkhttps://douglasyao.github.io/ calendar_today16-08-2019 06:39:15

270 Tweet

1,1K Followers

280 Following

Douglas Yao (@douglasyaody) 's Twitter Profile Photo

RCTs cannot be hacked in the same way that biomedical research can be. The fact that the clinical trial success rate has not changed in 50 years tells the real story of how much we actually understand biology.

Douglas Yao (@douglasyaody) 's Twitter Profile Photo

When you’re a CEO/salesperson and you’re raising hype for your company, hyperbolic predictions will only benefit and never harm you. Might as well just say the craziest thing you can imagine.

Douglas Yao (@douglasyaody) 's Twitter Profile Photo

The greater the number of data points per measurement, the easier it is to make spurious associations. This is why high-dimensional measurements (of e.g. the microbiome, epigenome, genome) can be linked to virtually anything, to the point of being meaningless.

Douglas Yao (@douglasyaody) 's Twitter Profile Photo

The fact that high-dimensional measurements can feasibly be linked to anything and everything makes them a prime story-telling tool, even if it lowers their scientific validity. The entire field of genomics has learned to take advantage of this fact.

Douglas Yao (@douglasyaody) 's Twitter Profile Photo

The figure in this article illustrates exactly how most biology papers are secretly p-hacked. A large number of hypotheses is explored, and only the ones that form a coherent story are reported. This is actually the main reason behind the replication crisis in biology IMO.

The figure in this article illustrates exactly how most biology papers are secretly p-hacked. A large number of hypotheses is explored, and only the ones that form a coherent story are reported. 

This is actually the main reason behind the replication crisis in biology IMO.
Douglas Yao (@douglasyaody) 's Twitter Profile Photo

It’s quite revealing that the academics who wrote this article are oblivious to the bad implications of this figure. It’s presented as a good thing.

Douglas Yao (@douglasyaody) 's Twitter Profile Photo

There's a sweet spot to scientific storytelling - your story needs to be EXACTLY 'slightly more complicated than what your audience can immediately grok'. Too understandable and you don't signal expertise and lose mystique. Too complicated and you totally lose your audience.

Douglas Yao (@douglasyaody) 's Twitter Profile Photo

Biology’s sub-25% replication rate is an EXISTENTIAL issue for the field. Most academics don’t seem to care, which shows that their priorities are not in doing good science.

Douglas Yao (@douglasyaody) 's Twitter Profile Photo

Two things can simultaneously be true: 1. In absolute terms, we’ve made tremendous progress in understanding biological systems in the past 50 years. 2. Relative to the full complexity of these systems, our current understanding is approximately 0%.

Douglas Yao (@douglasyaody) 's Twitter Profile Photo

Despite decades of biomedical research, trillions of dollars in R&D, and dozens of Nobel prizes, drugs developed today have the same chance of curing disease in clinical trials as drugs did in the 1960s, when the strategy was basically pure trial and error.

Douglas Yao (@douglasyaody) 's Twitter Profile Photo

The fact that so many different compounds “cure cancer” in cancer model systems says much more about the model systems than it does about the compounds. Wittgenstein’s ruler.

Douglas Yao (@douglasyaody) 's Twitter Profile Photo

Having a poor model of the world is often worse than having no model at all. This is because models reduce flexibility, and in complicated/unpredictable domains, the best strategy to make progress is usually to maximize flexibility.