Hostname: page-component-586b7cd67f-2brh9 Total loading time: 0 Render date: 2024-11-22T10:42:56.680Z Has data issue: false hasContentIssue false

Proxy failure in academia: More than just another example

Published online by Cambridge University Press:  13 May 2024

Milind Watve*
Affiliation:
Independent Researcher, Pune, India https://milindwatve.in/
*
Corresponding author: Milind Watve; Email: [email protected]

Abstract

Proxy failure in academia has progressed much ahead of what John et al. describe. We see advanced phenomena such as proxy complimentarity in which different players push each others' proxy failures; proxy exploitation in which external agents exploit players' proxies and predatory proxies that devour the goal itself. Academics need to avoid proxy failures by designing behaviorally sound systems.

Type
Open Peer Commentary
Copyright
Copyright © The Author(s), 2024. Published by Cambridge University Press

John et al. make a remarkable articulation of the phenomenon of proxy failure although many components of it have been already well known. However, I am surprised that they do not adequately cover proxy failure in academia apart from a passing mention. I feel it is necessary to deal elaborately with proxy failure in academia for two reasons. One is that proxy failure has reached unprecedented and unparalleled levels in academia leading to bad incentives (Rammohan & Rela, Reference Rammohan and Rela2021; Roy & Edwards, Reference Roy and Edwards2023; Stephan, Reference Stephan2012) so that we can easily identify phenomena much ahead of what John et al. describe. Apart from the three consequences of proxy failure, namely proxy treadmill, proxy cascade, and proxy appropriation (John et al.) at least three more levels are observed in academia that might be difficult to find in other fields.

Proxy complimentarity: In this, more than one type of actors benefit in different ways from a proxy and therefore they reinforce each others' dependence on the proxy resulting in a rapidly deteriorating vicious cycle. Because prestige of a journal is decided by the citations its papers receive and the impressiveness of the curriculum vitae (CV) of a researcher is decided by the impact factors of the journals, the two selfish motives complement each other in citation manipulation (Fong & Wilhite, Reference Fong and Wilhite2017). The reviewers also may pressurize the authors to cite their papers (Teixeira da Silva, Reference Teixeira da Silva2017) and the authors may agree in return of paper acceptance (Chawla, Reference Chawla2023). Institutions and funding agencies are benefited because bibliographic indices lead to a pretense of evaluation saving the cost of in-depth reading of a candidate's research (Watve, Reference Watve2023). Such mutually convenient positive feedback cycles can potentially drive rapid deterioration of the goal.

Proxy exploitation: This is a phenomenon in which apart from the agents in the game optimizing their own cost benefits, a party external to the field achieves selfish benefits by exploiting proxies in the field. In academic publishing profit-making publishers of journals thrive almost entirely on journal prestige as the proxy. Editorial boards appear to strive more for journal prestige than the soundness and transparency of science (Abbott, Reference Abbott2023). More prestigious journals often have higher author charges (Triggle, MacDonald, Triggle, & Grierson, Reference Triggle, MacDonald, Triggle and Grierson2022) and make larger profits with little contribution to the original goals.

Predatory proxy: This might be the most advanced and disastrous form of proxy failure where the proxy devours the goal itself. The process of proxy appropriation where the higher-level goal does a corrective hacking of lower-level proxies (John et al.) does not work in epistemology because the goal itself is difficult to define. In business, the higher-level player directly monitors the goal of profit making and accordingly controls proxies at lower level. This does not work in academia because the higher-level organizations themselves do not have an objective perspective of the goal. As a result not only the proxies are used to evaluate individual researcher, but also they might often be confused with the progress of science itself.

In many fields of science highly complex work involving huge amounts of data and sophisticated methods of analysis are being published in prestigious journals adding little real insights to the field. For example in diseases such as type 2 diabetes, in spite of huge amount of research being published and funds being allocated, there is no success in preventing, curing, reducing mortality (ACCORD study group et al., Reference Gerstein, Miller, Byington, Goff, Bigger and Friedewald2008; Lee et al., Reference Lee, Heckman-Stoddard, Dabelea, Gadde, Ehrmann and Ford2021; Ojha, Vidwans, & Watve, Reference Ojha, Vidwans and Watve2022; The NICE-SUGAR Study Investigators, 2009) or even addressing the accumulating anomalies (Diwekar-Joshi & Watve, Reference Diwekar-Joshi and Watve2020) in the underlying theory. Nevertheless large numbers of papers continue to get published, huge amount of funding is allotted which by itself is viewed as “success” in the field. Failure of achieving the goal is not a crime in science, but quite often the failure is disguised as “success” and researchers receive life-time “achievement” awards. No scientist receiving any such awards appears to have admitted that they have actually failed to “achieve” the real goals. Efforts of a researcher, failed by this definition, should still be appreciated but it should not be called “success” or “achievement” just based on proxies. The worst outcome of proxy failure in academia is the failure to identify research failure as a failure. Many other fields including theoretical particle physics or string theory have received similar criticism (Castelvecchi & Nature magazine, Reference Castelvecchi2015; Hossenfelder, Reference Hossenfelder2022).

The three outcomes of proxy failure might be the reason why the creativity and disruptive content in published science is deteriorating even when it is measured by proxy itself (Chu & Evans, Reference Chu and Evans2021; Park, Leahey, & Funk, Reference Park, Leahey and Funk2023). Simultaneously the frequency of research misconduct, data fabrication, reproducibility crisis, paper mills, predatory journals, citation manipulations, peer-review biases, and paper retractions are alarming (Fanelli, Reference Fanelli2009; Ioannidis, Reference Ioannidis2005; Smith, Reference Smith2006; Xie, Wang, & Kong, Reference Xie, Wang and Kong2021) and appear to be rising (de Vrieze, Reference de Vrieze2021).

Interestingly, many researchers working on aspects of human behavior, system design, or behavior-based policy that are potentially relevant to academia avoid talking about the academic systems (Chater & Loewenstein, Reference Chater and Loewenstein2022; Cushman, Reference Cushman2019). The academic system is the nearest, most accessible and most relevant system to be studied. This is the second important reason why studying proxy failure in academia needs to be prioritized. However, research addressing behavioral aspects of academia is scanty and fragmentary (Chapman et al. Reference Chapman, Bicca-Marques, Calvignac-Spencer, Fan, Fashing, Gogarten and Chr Stenseth2019; Clark & Winegard, Reference Clark and Winegard2020; Watve, Reference Watve2017, Reference Watve2023) and not yet even close to addressing the haunting questions at a system design or s-frame level (Chater & Loewenstein, Reference Chater and Loewenstein2022). Unless researchers address the issues in their own field and come out with sound solutions; unless they design their own systems that are behaviorally sound and little prone to proxy failure; unless they are able to minimize flaws and make the system work smoothly toward the goals, why should other fields follow their advice to redesign their systems? The natural first reaction of a citizen like me working outside mainstream academia is “Academics, mend your house first!!”

Acknowledgments

I thank Preetee O. for useful discussions in a conceptualization stage.

Financial support

There was no funding for this work.

Competing interest

None.

References

Abbott, A. (2023). Strife at eLife: Inside a journal's quest to upend science publishing. Nature, 615(7954), 780781. https://doi.org/10.1038/d41586-023-00831-6CrossRefGoogle ScholarPubMed
ACCORD Study Group, Gerstein, H. C., Miller, M. E., Byington, R. P., Goff, D. C. Jr., Bigger, J. T., … Friedewald, W. T. (2008). Effects of intensive glucose lowering in type 2 diabetes. The New England Journal of Medicine, 358(24), 25452559. https://doi.org/10.1056/NEJMoa0802743Google ScholarPubMed
Castelvecchi, D and Nature magazine. (2015). Is string theory science? Scientific American, December 23, 2015.Google Scholar
Chapman, C. A., Bicca-Marques, J. C., Calvignac-Spencer, S., Fan, P., Fashing, P. J., Gogarten, J., … Chr Stenseth, N. (2019). Games academics play and their consequences: How authorship, h-index and journal impact factors are shaping the future of academia. Proceedings of the Royal Society of London. Series B, Biological Sciences, 286(1916), 20192047. https://doi.org/10.1098/rspb.2019.2047Google ScholarPubMed
Chater, N., & Loewenstein, G. (2022). The i-frame and the s-frame: How focusing on individual-level solutions has led behavioral public policy astray. Behavioral and Brain Sciences, 46, E147. doi:10.1017/S0140525X22002023CrossRefGoogle ScholarPubMed
Chawla, D. S. (2023). Researchers who agree to manipulate citations are more likely to get their papers published. Nature, Advance online publication. https://doi.org/10.1038/d41586-023-01532-wGoogle Scholar
Chu, J. S. G., & Evans, J. A. (2021). Slowed canonical progress in large fields of science. Proceedings of the National Academy of Sciences of the United States of America, 118(41), e2021636118. https://doi.org/10.1073/pnas.2021636118CrossRefGoogle ScholarPubMed
Clark, C. J., & Winegard, B. M. (2020). Tribalism in war and peace: The nature and evolution of ideological epistemology and its significance for modern social science. Psychological Inquiry, 31(1), 122. doi:10.1080/1047840X.2020.1721233CrossRefGoogle Scholar
Cushman, F. (2019). Rationalization is rational. The Behavioral and Brain Sciences, 43, e28. https://doi.org/10.1017/S0140525X19001730CrossRefGoogle ScholarPubMed
de Vrieze, J. (2021). Landmark research integrity survey finds questionable practices are surprisingly common. Science Insider, July 7th, 2021 https://www.science.org/content/article/landmark-research-integrity-survey-finds-questionable-practices-are-surprisingly-commonCrossRefGoogle Scholar
Diwekar-Joshi, M., & Watve, M. (2020). Driver versus navigator causation in biology: The case of insulin and fasting glucose. PeerJ, 8, e10396. https://doi.org/10.7717/peerj.10396CrossRefGoogle ScholarPubMed
Fanelli, D. (2009). How many scientists fabricate and falsify research? A systematic review and meta-analysis of survey data. PLoS ONE, 4(5), e5738. https://doi.org/10.1371/journal.pone.0005738CrossRefGoogle ScholarPubMed
Fong, E. A., & Wilhite, A. W. (2017). Authorship and citation manipulation in academic research. PLoS ONE, 12(12), e0187394. https://doi.org/10.1371/journal.pone.0187394CrossRefGoogle ScholarPubMed
Hossenfelder, S. (2022). No one in physics dares say so, but the race to invent new particles is pointless. The Guardian, September 26th, 2022. https://www.theguardian.com/commentisfree/2022/sep/26/physics-particles-physicistsGoogle Scholar
Ioannidis, J. P. (2005). Why most published research findings are false. PLoS Medicine, 2(8), e124. https://doi.org/10.1371/journal.pmed.0020124CrossRefGoogle ScholarPubMed
Lee, C. G., Heckman-Stoddard, B., Dabelea, D., Gadde, K. M., Ehrmann, D., Ford, L., … Diabetes Prevention Program Research Group. (2021). Effect of metformin and lifestyle interventions on mortality in the diabetes prevention program and diabetes prevention program outcomes study. Diabetes Care, 44(12), 27752782. https://doi.org/10.2337/dc21-1046CrossRefGoogle Scholar
Ojha, A., Vidwans, H. & Watve, M. (2022). Does sugar control arrest complications in type 2 diabetes? Examining rigor in statistical and causal inference in clinical trials. Medrxiv https://doi.org/10.1101/2022.08.02.22278347CrossRefGoogle Scholar
Park, M., Leahey, E., & Funk, R. J. (2023). Papers and patents are becoming less disruptive over time. Nature, 613, 138144. https://doi.org/10.1038/s41586-022-05543-xCrossRefGoogle ScholarPubMed
Rammohan, A., & Rela, M. (2021). Ranking list for scientists: From heightening the rat-race to fraying the scientific temper. Journal of Postgraduate Medicine, 67(2), 9192. doi:10.4103/jpgm.JPGM_112_21CrossRefGoogle ScholarPubMed
Roy, S., & Edwards, M. A. (2023). NSF fellows’ perceptions about incentives, research misconduct, and scientific integrity in STEM academia. Science Reports, 13, 5701. https://doi.org/10.1038/s41598-023-32445-3CrossRefGoogle ScholarPubMed
Smith, R. (2006). Research misconduct: The poisoning of the well. Journal of the Royal Society of Medicine, 99(5), 232237. doi:10.1177/014107680609900514CrossRefGoogle ScholarPubMed
Stephan, P. (2012). Perverse incentives. Nature, 484, 2931. https://doi.org/10.1038/484029aCrossRefGoogle ScholarPubMed
Teixeira da Silva, J. A. (2017). The ethics of peer and editorial requests for self-citation of their work and journal. Medical Journal Armed Forces India, 73(2), 181183. doi:10.1016/j.mjafi.2016.11.008CrossRefGoogle ScholarPubMed
The NICE-SUGAR Study Investigators. (2009). Intensive versus conventional glucose control in critically ill patients. New England Journal of Medicine, 360(13), 12831297. https://doi.org/10.1056/NEJMoa0810625CrossRefGoogle Scholar
Triggle, C. R., MacDonald, R., Triggle, D. J., & Grierson, D. (2022). Requiem for impact factors and high publication charges. Accountability in Research, 29(3), 133164. doi:10.1080/08989621.2021.1909481CrossRefGoogle ScholarPubMed
Watve, M. (2017). Social behavioural epistemology and scientific publishing. Journal of Genetics, 96, 525533.CrossRefGoogle Scholar
Watve, M. (2023). Behavioral optimization in scientific publishing. Qeios, https://doi.org/10.32388/8W10ND.3CrossRefGoogle Scholar
Xie, Y., Wang, K., & Kong, Y. (2021). Prevalence of research misconduct and questionable research practices: A systematic review and meta-analysis. Science and Engineering Ethics, 27, 41. https://doi.org/10.1007/s11948-021-00314-9CrossRefGoogle ScholarPubMed