What is “Credible Science”?

What is “Credible Science”?

At the heart of every peer-reviewed journal is a publication philosophy. Most popular medical journals focus on “important” medical science. However, from my vantage point as a career scholar, “importance” is an ethereal “eye of the beholder” standard which inevitably feeds reviewer bias; one day a topic is hot but soon thereafter journals have lost interest, simply mirroring trends in the broader culture. Meanwhile author provenance also tends to weigh heavy on reviewer decisions about importance; even double-blinded review is not truly blind in the deeply specialized world of medicine in which we live. In contrast, from an author’s vantage, journal acceptance or rejection decisions tend to be rather capricious; submit to a journal (i.e. not Cureus), wait for the rejection before reformatting and resubmitting to a second journal, and repeat as many times as necessary to be published. Although this practice is a huge waste of everyone’s time, it has forever been the modus operandi for a journal industry obsessed with identifying and publishing “important” medical science.

Given the colossal time inefficiency of the current journal paradigm, as well as the real-world expense associated with such subjective decision making, Cureus’ philosophy has been to embrace a very different threshold for publication, which we term “credible medical science”.

What do we mean by the term “credible” science? “Credible science” is published science that simply reflects a “good faith” effort to ask and answer a relevant medical question. It involves care in collecting and analyzing data, then writing and formatting a proper manuscript, and finally responding appropriately to reviewer questions. At the end of this elaborate process, Cureus’ credible science may or may not ultimately be proven correct via future confirmatory studies. Even though this is and always has been the identical reality for every other published peer-reviewed journal, Cureus’ willingness to live without the charade of article importance miffs some (self-anointed) high priests within academic publishing. Furthermore, a lazy news media has grown comfortable with the axiomatic fig leaf that peer-reviewed science is, drum roll, absolute truth. The absence within Cureus of an absolute truth façade that our “credible science” standard accepts is disorienting to those who prefer a black-and-white world while blissfully ignoring the countless examples of once important scientific articles, published in the “best” journals, that are eventually debunked.

My point is that no peer review process is ever foolproof and like everything in life, when it comes to interpreting published science in ALL journals, the old adage “buyer beware” applies. What is presented on the written digital or analog page must, like other forms of human communication, always be interpreted by an engaged reader. Cureus’ “credible science” standard is, at its core, a grown-up acknowledgement of reality. Now I understand that Cureus’ disinterest in article “importance” is particularly irksome to some industry insiders who have made long careers defining and evangelizing on behalf of (and benefitting from) “important” (supposedly) medical science. Cureus’ commonsense standard for “credible science” and our journal’s refusal to censor unpopular (unimportant?) ideas does occasionally rankle critics. However, I am struck by the fact that some of the most vociferous critics of our “credible science” philosophy have themselves almost zero experience publishing real science in real medical journals. I liken most of these experts to the proverbial guy on the couch drinking beer and watching Sunday football on TV. How often is the guy futilely telling the coach on the field how to do his job, himself a former professional star with deep domain knowledge of football? Almost never! Nearly always, the critic is just another dude with an opinion. Nevertheless, if you really know how to call better plays for a professional football team, I urge you to get with it and become a highly-paid coach.

Meanwhile, if you think you know how to create better science, and publish better articles, please be my guest and allow our journal to make the process as effortless as possible. Important or not, all that Cureus demands is that your science be ”credible”.

Cureus Conversations: Q&A With Cureus Co-Founder Alex Muacevic

Dr. Alex Muacevic Cureus Co-founder and Co-editor-in-chief

Alexander Muacevic is the Medical Director of the European Cyberknife Center in Munich, Germany and holds an academic teaching position at the University of Munich Hospitals. Dr. Muacevic is a board-certified neurosurgeon and radiosurgeon and his main clinical and scientific interest is full body radiosurgery using advanced image-guided robotic technology. In addition to earning a European Neurosurgery Certificate, Dr. Muacevic has published over 100 scientific contributions including peer-reviewed articles, book chapters and congress proceedings. Dr. Muacevic is also a member of several academic societies and president of the International Radiosurgery Society containing over 700 members. Last, but not least, Dr. Muacevic is the Co-Founder and Co-Editor-in-Chief of the Cureus Journal of Medical Science.

Q: What was your first publishing experience like? 

A: I started with smaller retrospective studies around Gamma Knife radiosurgery and I remember it was tough as a junior resident to fulfill all of the scientific standards.  

Q: How did your relationship with Dr. John Adler begin?

A: We knew each other from neurosurgery meetings but got to work more closely together via the Radiosurgery Society and finally when we started our Cyberknife center in Munich in 2005.

Q: Has open science always been something you’ve been passionate about? 

A: No, this developed over time and was based on frustrations in the conventional publishing world with more and more bureaucratic hurdles.

Q: In your opinion, what are the greatest challenges facing Open Access publishing?

A: Getting wide spread acceptance in the academic world.

Q: Is there anything about Cureus that you are particularly proud of?

A: Of course! We started from scratch over 10 years ago with only four people working to publish one article a month and now we have a much larger team and are publishing close to 10,000 articles this year. A great team effort and achievement!

Q: Do you have any advice for first-time authors?

A: Take your time, try to be precise and correct, and learn from more experienced people. Perhaps a simple case report with Cureus is the ideal introduction to the academic world.  

Q: What are you looking for from Cureus peer reviewers?

A: A clear, concise and unbiased analysis of the paper in question.

Q: What is it like having Dr. Adler as a partner?

A: He is the best partner to have, as he is always open to strong arguments. I enjoy the fair battles we have behind the curtain to make Cureus a better journal each and every day.

Q: Why should researchers submit to Cureus?

A: Because it is the best and fastest way to get peer reviewed science out to the world. I might be biased but I don’t know any journal which is more comfortable and also fun to publish with.

Q: Are you currently working on any research? If so, what can you tell us about it?

A: We are working on multiple projects like SRS for Trigeminal Neuralgia, Meningiomas and Renal Cell Cancer.

Hospital Rankings: Can Docs Make the Process Less Stupid?

It’s that time of the year. As Halloween decorations give way to Thanksgiving and now Christmas ornamentation, I, like many other American academic physicians, am sent an array of end-of-the-year email reminders from hospital and medical school leadership about sundry matters ranging from holiday parties to Press Ganey Scores. However none of these notifications stands out quite like being urged to update my membership with Doximity and thereby ensure my good standing with the social media network.

And what lofty academic or clinical function is being served? None other than the academic medical community’s best effort to get out the faculty vote for Doximity’s upcoming and all-important hospital and departmental yearly reputation scoring – a number which ultimately feeds into the even more important, annual hospital rankings among the US News and World Report.

Continue reading “Hospital Rankings: Can Docs Make the Process Less Stupid?”

Our Founder & Editor-in-Chief won the AANS Cushing Award!

We are delighted to announce that Cureus Founder and Editor-in-Chief Dr. John Adler was presented with the American Association of Neurological Surgeons’ Cushing Award for Technical Excellence and Innovation in Neurosurgery!

DcNba_DUwAET-VU

Presented at the 2018 AANS annual meeting in New Orleans on Monday April 30th, the Cushing Award could well be considered the Nobel Prize for Neurosurgery. The award was established in 2013 to honor innovation, skill and technical prowess in the development of new procedures which have become part of the arsenal neurosurgeons use to treat disease or trauma. John’s formative role in founding Cureus, “a disruptive platform for creating and sharing medical knowledge” was cited during the award presentation. Here at Cureus we are proud to call John our leader as his lifetime of professional accomplishments, including the creation of Cureus, led him to this point.

Founded by Harvey Cushing, after which the award is named, the 2018 AANS Annual Scientific Meeting is attended by neurosurgeons, neurosurgical residents, medical students, neuroscience nurses, clinical specialists, physician assistants, allied health professionals and other medical professionals, the AANS Annual Scientific Meeting is the largest gathering of neurosurgeons in the nation, with an emphasis on the field’s latest research and technological advances.

Congratulations, John!

Scholarly Roulette: Impact Factor & Scientific Quality

A friend and colleague referred me to a recent publication that represents a major indictment of the peer-reviewed journal cartel.

This article summarizes a blog published by what is arguably a Cureus competitor, the open access-publishing house, Frontiers, which in this study could find no correlation between rates of rejection and journal impact factor.

Just for argument’s sake, let’s assume that impact factor does correlate with scientific quality. So if this study is correct, it means by extension that the rate of rejection also doesn’t correlate with quality. In turn this means that the standard peer review process (which totally dominates the journal industry) has no bearing on article quality. In other words, getting published, or not, appears to be a random event.

Accepting this fact (parenthetically one which I already subscribe to) means that despite all the process and rituals of scientific journal publishing, and the huge importance of this matter to society and academic tenure decisions, there is currently no objective index for assessing research article quality. Of course if one believes that impact factor is not a measure of quality, then the above random publication process is even more random than I implied in my argument! Based on this observation, I would like to sarcastically suggest we should rename this current process “scholarly roulette.”

Clearly there are huge shortcomings to the Frontiers study, such as selection bias and the non-medical nature of many scholarly journals. However, to a huge research community that has invested so much of their lives into the existing peer review process these type of findings must be dispiriting. Nevertheless, this current set of observations does resonate with our philosophy at Cureus, where we subscribe to the belief that as long as the medical science within is credible, there is no reason not to publish an article. In other words, we believe that we are, on average, no better equipped to discern quality than any other journal.

A big part of our confidence stems from Cureus’ unique post-publication SIQ scoring system. Although we are no smarter in finding scientific quality up front, we do believe that it is quite possible for the medical community-at-large to find quality over time, post publication. Nevertheless, to make this a reality, every reader has a role to play, which of course includes you!

Does Peer Review = Better Science?

It is widely assumed that the peer review process improves the article that is eventually published. This concept is taken largely as an article of faith except for one miniscule question posed to a range of published international academics as part of a large survey in 2009; in this survey, 91% of respondents, none of whom were medical professionals, agreed with the idea that the revisions made to their article as a result of the conventional peer review process improved the end product. Of note, most of this subjective sense of manuscript improvement was felt by authors to be within the discussion section. The response to this one question represents the only evidence of which I am aware that demonstrates peer review resulting in better published papers.

Obviously one cannot simply dismiss the findings in the above study out of hand. However, it seems to be worth asking whether or not peer review has the same advantages outlined in the above survey when considered in the rich world of observational studies that describes so much of medical publishing. Moreover, is an improvement in a article’s discussion section significant enough to warrant all the added time and effort on the part of the very busy physician authors who write most medical articles and who represent some of the busiest individuals on our planet?

As an editor of a journal myself (Cureus) I cannot help but ask these questions. I also pose this line of inquiry now, however, due to a recent discussion with a colleague who is a very senior and internationally respected neurosurgeon. He is about to publish an article in a well-known neurosurgery journal having now jumped through the usual reviewer hoops requiring several revisions and months of effort. I asked this colleague whether his article was any better after all this effort. His simple response: “NO!” In fact, in my own academic career, which involves more than 150 peer-reviewed articles, I find it difficult to recall a single instance where I felt the final published article was meaningfully improved through the peer review process.

Oh, I jumped through plenty of hoops, like routinely needing to add additional references so that my paper would cite the reviewer’s own publications, but sadly I have found far too much of the peer review process to be merely an exercise in power and vanity. With so many diseases so poorly treated, and so much clinical research that needs to (or could) be published, is all this inefficiency justifiable? It is for this very reason that we at Cureus emphasize a much more efficient post-publication “peer review” process, or as we term it, SIQ (Scholarly Impact Quotient). I would very much like to hear from any readers of this blog who have published in conventional peer-reviewed journals  – did the review  process improve the ultimate published article?

Scientific Publishing: No Need To Suffer

Scientific publishing is a long established process, often presenting its share of frustrations to authors. Lengthy peer review processes and subsequent rejections can prevent timely publication of important research. A recent article in the Economist (June, 2013) addressed the issue of scientific publishing, stating that “slowness” is often identified by authors as the primary drawback of the publication process. According to the article, the average time for publication is six months after submission, and frequently follows submissions to multiple journals, as the article may be rejected for publication by journal after journal despite high scientific quality. This contributes to the extended time to publication. In addition, the article must be peer reviewed by multiple experts in the field, which adds  to the time for publication. This has been particularly true for print journals, in which the article, once approved, must also wait for publication of the particular edition of the journal.

A new generation of journals has been created in recent years. Cureus.com is an online medical journal with an Editorial Board that consists of hundreds of experts in a wide variety of medical specialties. The goal of the Cureus journal is to provide a transparent and rapid publishing process in which authors receive feedback, and an unbiased measure of the scientific merit of their papers via a novel crowd-sourcing algorithm, the SIQ, from reviewers and all readers. Authors on Cureus have the ability to have their work published in a timely manner, for no cost, and while retaining copyright at all times. The online accessibility also enables patients to access the most recent research on their particular medical condition. The structure and publication process provided by Cureus addresses and eliminates the historical problems in scientific publishing. Most importantly, it allows important research to be published quickly, and to be viewed by medical professionals and patients alike.

Time is Critical in Recovery from Stroke

hourglassStroke is a leading cause of death in the United States, killing one American every 4 minutes, according to the Centers for Disease Control and Prevention. A stroke is an interruption of the blow flow to the brain. Strokes and be caused by a blocked blood vessel, or one that bursts and bleeds into the brain. Strokes can occur at any point in life, but the risk of stroke increases with age. Each year, over 795,000 Americans have a stroke, resulting in long-term or permanent disability.

The speed at which a stroke victim receives treatment can mean the difference between recovery and long term, or even fatal, consequences.  This was highlighted in a recent study published in the Journal of the American Medical Association by Dr. Jeffrey Saver, director of UCLA’s Comprehensive Stroke Center and his colleagues. In their study, Dr. Saver et al., found that the risk of suffering from stroke symptoms or death decreases by 4% for each 15 minutes doctors gain when intervening with a stroke victim. John Adler, MD, a Dorothy & TK Chan Professor of Neurosurgery and Radiation Oncology at Stanford University, and CEO of Cureus, Inc., stated “This paper by Saver et al. adds to a large body of now incontrovertible data.  In the setting of ischemic stroke, the speedy restoration of brain perfusion with tPA leads to better functional outcomes.  The big unmet public health challenge is ensure the fastest possible recognition of ischemic stroke to be followed by ever more timely therapeutic intervention.”

Common signs of stroke can include sudden numbness or weakness of the face, arm or leg, confusion, trouble seeing, loss of balance or coordination, or a sudden, severe headache. At risk are those with diabetes, poor diet, obesity, physical inactivity, and those who consume excessive amounts of alcohol. Concerned about your own risk of stroke? Use this stroke calculator developed at the UCLA Stroke Center: