Simulated Side Effects: FDA Uses Novel Computer Model to Guide Kratom Policy
Posted on February 8, 2018 by masonmarks
By Mason Marks
FDA Commissioner Scott Gottlieb issued a statement on Tuesday about the controversial plant Mitragyna speciosa, which is also known as kratom. According to Gottlieb, kratom poses deadly health risks. His conclusion is partly based on a computer model that was announced in his recent statement. The use of simulations to inform drug policy is a new development with implications that extend beyond the regulation of kratom. We currently live in the Digital Age, a period in which most information is in digital form. However, the Digital Age is rapidly evolving into an Age of Algorithms in which computer software increasingly assumes the roles of human decision makers. The FDA’s use of computer simulations to evaluate drugs is a bold first step into this new era. This essay discusses the potential risks of basing federal drug policies on computer models that have not been thoroughly explained or validated (using the kratom debate as a case study).
Kratom grows naturally in Southeast Asian countries such as Thailand and Malaysia where it has been used for centuries as a stimulant and pain reliever. In recent years, the plant has gained popularity in the United States as an alternative to illicit and prescription narcotics. Kratom advocates claim it is harmless and useful for treating pain and easing symptoms of opioid withdrawal. However, the FDA contends it has no medical use and causes serious or fatal complications. As a result, the US Drug Enforcement Agency (DEA) may categorize kratom in Schedule I, its most heavily restricted category.
In his recent statement, Commissioner Gottlieb reported that the FDA analyzed kratom using a new computational model developed in-house. The agency calls it “PHASE” or the Public Health Assessment via Structural Evaluation methodology. Gottlieb says it uses 3-dimensional computer technology to simulate the chemical structure of drugs and predict their effects in humans. According to the Commissioner, “These kinds of models have become an advanced, common and reliable tool for understanding the behavior of drugs in the body.” An image based on the simulation is shown below in Figure 1
Figure 1: FDA Kratom/Mu-Opioid Receptor Simulated Binding
Computational modeling is often used in the pharmaceutical industry to aid drug discovery. Simulations of drug binding and toxicity are called “in silico” models in contrast to “in vivo” testing conducted in living organisms and “in vitro” studies performed on cells and tissues in test tubes or petri dishes. Some computational models use artificial intelligence tools, such as machine learning algorithms, to predict the binding of drugs to cell surface receptors. Molecular docking analyses and pharmacophore “modeling” and “virtual screening” are two common methods used to predict the ideal fit between one molecule and a larger protein when they bind together in a stable complex. It is unclear how the FDA’s PHASE model works because few details have been disclosed.
The FDA’s use of computer models is not surprising. Last July, Gottlieb announced his intention to conduct “in silico clinical trials” to evaluate drugs and medical devices. According to his July press release, the FDA is already using simulations “to predict clinical outcomes, inform clinical trial designs, support evidence of effectiveness, optimize dosing, predict product safety, and evaluate potential adverse event mechanisms.” Gottlieb also discussed the use of computer models in precision medicine to stratify patients into subgroups requiring different doses of a medication based on genetic variations. These potential uses for in silico models are exciting and have the potential to improve clinical care. However, the use of models to predict the protein binding and physiologic effects of kratom’s constituents is somewhat puzzling and creates a concerning precedent.
There are significant limitations of in silico models that simulate drug binding. The effects of a drug depend on several factors other than protein binding affinity including its means and rate of absorption, how quickly it is metabolized, and how readily it crosses the blood-brain barrier. These parameters are more difficult to predict than binding affinity. Most importantly, the data produced by binding simulations are mere predictions of physiologic activity, and drug-protein binding is only one piece of an elaborate puzzle. Differences in other factors explain the considerable variation between drugs that bind to the same receptors. A comparison of the structures of two antidepressants, nefazodone and trazodone, illustrates how compounds with similar structures, that bind to the same receptor, can have significantly different side effect profiles. Both drugs bind to the 5-HT2A receptors. However, nefazodone was pulled from the market due to concerns over liver failure, whereas trazodone is currently available and generally considered safe.
Figure 2: Even without a background in organic chemistry, one can appreciate the structural similarities between nefazodone, which was removed from the market due to concerns about liver toxicity, and trazodone, which is widely available by prescription and generally considered safe. [Nefazodone image by Emeldir, public domain via Wikimedia Commons; Trazodone image by Fvasconcellos, public domain via Wikimedia Commons]
The FDA has published few details on how its PHASE simulation model works, how the software was validated, and the scope of data on which it was trained. Aside from the lack of transparency with respect to PHASE, it is strange that the FDA chose to do this kind of modeling in the first place because the binding of kratom’s active ingredients to mu and delta opioid receptors is already well established. Numerous scientific articlesreport that kratom’s most active ingredients, mitragynine and 7-hydroxymitragynine, bind to mu and kappa opioid receptors. According to Andrew Kruegel, a research chemist at Columbia University, the FDA’s use of computer modeling is significantly less rigorous than the methods used in previous kratom studies. Furthermore, according to Kruegel, the FDA’s claim that kratom has risks comparable to morphine is akin to “saying that all opioid agonists have the same effect, which is not true based on what we’ve learned about these compounds.” Instead of lumping kratom in with classic opioids such as morphine and heroin, Kruegel prefers to call it an atypical opioid because it may have different effects, and a preferable side-effect profile, compared to classic opioids. Figure 3 compares the chemical structures of morphine and mitragynine.
Figure 3: Chemical structure of morphine and mitragynine. [Morphine image by Neurotiker, public domain via Wikimedia Commons. Mitragynine image by Fuse809, public domain GFDL http://www.gnu.org/copyleft/fdl.html, via Wikimedia Commons]
This example shows that while there are some similarities between the chemical structures of morphine and mitragynine, there are also significant differences. The structural differences likely account for their different observed receptor binding affinities, intracellular and physiologic effects, adverse event profiles, and potential for dependence and abuse. According to University of Florida clinical toxicologist Oliver Grundman, the interaction of mitragynine and 7-hydroxymitragynine with opioid receptors “is distinctly different from classical opioids.” In addition, binding to cell surface receptors is only the first step in an elaborate cascade of intracellular activity. As reported by Kruegel in 2016, mitragynine and 7-hydroxymytragynine have intracellular effects that differ from those of traditional opioids. Specifically, much like traditional opioids, the mitragynines act through a G-protein-mediated intracellular signaling cascade. However, unlike traditional opioids, mitragynines do not activate an intracellular molecule called Beta-arrestin 2, which is believed to play a role in producing the side effects and dependence that are characteristic of classic opioids. Based on the limited information provided by the FDA in its February 6 announcement, it seems unlikely that its PHASE model accounted for these differences in downstream, intracellular effects.
A diverse group of individuals including scientists like Grundmann, 51 Members of Congress, and numerous kratom advocates are concerned that the FDA may be gathering evidence that the DEA will use to classify kratom as a Schedule I controlled substance (the most highly restricted category that includes heroin and marijuana). According to Grundmann, doing so would make additional research on kratom extremely difficult. I have argued previously that Schedule I is like a regulatory black hole because once drugs enter this category, they rarely come out. There is an asymmetry between the standard of evidence required by the FDA to approve drugs and the quality of evidence needed by the DEA to ban them. When approving medications, the FDA has exacting standards. Phase 3 randomized controlled trials involving hundreds, or thousands of human subjects are required before a drug can be marketed and prescribed. However, to ban a substance, significantly less evidence is required by the DEA. This asymmetry traps Schedule I controlled substances in a regulatory black hole because the barrier to leave this category is much higher than the barrier to enter it.
The need to discover new treatments is no less important than the need to shield the public from adverse events. As a result, the negative effects of banning a drug prematurely or placing it in Schedule I based on weak evidence, or on the predictions of an undisclosed or untested algorithm, could be more harmful to public health than leaving a drug on the market that has not been thoroughly tested. According to Bloom “When determining the risk of using a drug or chemical it is essential to also consider the risk of not using it. The risk of not having kratom available, despite all its liabilities, may be greater than whatever harm the drug may cause.”
Basing drug policy decisions on computational binding simulations could be dangerous because they are only suggestive of a drugs physiologic effects. Using them to predict which drugs may be harmful, and banishing those drugs to Schedule I, will inevitably result in false positives that could deprive society of needed therapies. The need for novel treatments is particularly pronounced in psychiatry, an area of research from which drug companies have increasingly withdrawn. New therapies are also needed in the field of addiction medicine, where less habit forming medical treatments are required to combat the opioid crisis. Kratom is one potential candidate for treating opioid addiction, but it is at risk of being lost to the public and the scientific community. Unless more powerful and sophisticated predictive models are developed, and their code and training data are disclosed for public inspection, computer simulations should not be a significant factor in removing substances from the marketplace. As we move from the Digital Age toward an Algorithmic Society, transparency and accountability must be required features of drug regulation. Anything less than full disclosure could jeopardize public health.
Commentary by John Deininger
This is a good explanation of the computer modeling program used, but there is some mythology that needs debunking here.
It is a completely legitimate program, but it has been misrepresented by both Gottlieb and the kratom community and that need to be cleared up.
Firstly, this program is not new or novel, it had been in use for years as a tool for analyzing molecules for their POTENTIAL to have certain effects that might make them good candidates for pharmaceutical drugs. Molecules that are found to have potential are then exhaustively researched to assess if they do, in fact, do what the model predicts. In other words, it is a screening tool only and it's modeling is not a legitimate source of empirical data.
It is not a "garbage in, garbage out" program. It is not altered to produce a desired result. The modeling is based on the knowledge of how receptors and molecules interact. That knowledge is incomplete as is the technology, but it is a perfectly valid tool. Gottlieb simply misrepresents the importance of it as an experimental, analytical tool. It's modeling must be confirmed by actual experimentation to have any evidentiary weight. Once again, it is a useful tool, but only for screening purposes.
Most importantly, all of this is moot. Mitragynine and other molecules in kratom DO bind with opioid receptors. This had been known for years and verified multiple times. This supposedly "novel" tool is telling us nothing new. Gottlieb just misrepresents the nature and the importance of the modeling results. Firstly, he doesn't mention that many of the "opioid" molecules actually act as antagonists and that the agonist, themselves, act as partial agonists making them quite different than full agonists like morphine in their ability and to what degree they can activate the mu opiod receptors. Also not mentioned is the incredibly important fact that the mitragynines act as biased agonists, which accounts for major differences in their potential for abuse and adverse effects.
The computer modeling is not "garbage in, garbage out". I wish that people would stop with that. The lie that Gottlieb tells involves misrepresentation of both the facts and the usage of the program and its results.
Neurobiology is complex and I see many misconceptions about it when kratom advocates discuss related issues. I know many people are simply repeating what they have heard in the groups, and that is understandable, but that has traditionally lead to "whisper down the lane" distortions of the facts. But Gottlieb also oversimplifies complexities for rhetorical effect, effectively trying to "baffle with BS".
The Harvard blog is a very good resource...use it. I'd rather people hand it to their representatives instead of trying to explain or criticize Gottlieb remarks based on their own misconceptions and misrepresentations.
His words are lies, but they are lies of omission, not of falsified facts. He presents information without crucial context. We need to be better than him. The facts are behind us, we don't need to stoop to rhetorical misrepresentations ourselves.
Thankyou for your time,
Kelly Devine, CMT
Veterans Care Alliance Botanicals