Showing posts with label open access. Show all posts
Showing posts with label open access. Show all posts

Saturday, January 19, 2013

Academic Publisher Unveils New Journal Which Prevents All Access To Its Content

AMSTERDAM - Academic publishers are currently under attack by scientists, governments and the general public for hiding the majority of published research articles behind paywalls. Readers have to pay either a one-time access fee of up to $50 to read one article or obtain an annual subscription to the journal in order to access the research findings. The access fees for research articles generate multi-billion dollar profits for academic publishers, but this lucrative industry is having a hard time justifying the fees. Since the bulk of research is funded through government grants, most people feel that the research articles which summarize and document the public-funded research should be freely available to the public. Some academic publishers are gradually giving in to these demands and are now offering "open access" publishing. In this model, researchers pay a fee to cover the publication costs, but the publications are then available without any fees to all readers.

Not all academic publishers agree with this approach. Else Beer, the CEO of the prominent academic publisher Elsebeer, has condemned the open access approach and is instead betting on a new line of closed-access journals. Beer unveiled the new closed-access journal "Facts of Life" at a press conference.

"We realize that there is a big push towards open access publishing in science, but few people think about the problems that come with open access. If everyone is able to access a scientific paper, it is far more likely that they will read the paper and perhaps even try to replicate the results. This is a huge problem for scientists who routinely publish irreproducible results, as well as for scientists who want to keep their tools and scientific methods secret."

Unlike previous closed access journals in which articles are hidden behind a paywall and can be accessed after paying a fee, "Facts of Life" guarantees that nobody other than the author can access the published article. This allows scientists to include the article as a published paper on their CV and cite their work, without ever having to worry that someone else might read the article. Beer expects that this new concept will be embraced by many researchers

The physician-scientist and poet Yuri Zhivago is among the first researchers to submit manuscripts to the new journal. "It is a blessing to have this journal", Zhivago commented, "I have at least three manuscripts that contain experiments that cannot be replicated.  Now I can publish them without having to worry about my tenure committee criticizing me for having too few publications. If I published them in an open access journal, I would eventually have to retract the papers and this would could damage my reputation as a researcher. By publishing in "Facts of Life", I can be sure that nobody will ever be able to accuse me of publishing fraudulent data."

Beer is confident that there are many other Zhivagos out there who need a completely closed-access journal. "We are taking closed access publishing to a new level and we think that we provide a much-needed forum for all the researchers want to publish but have no sound data." She is convinced that other publishers will follow suit when they see the success of the "completely closed access" model.    

Monday, October 15, 2012

Open Science and Access to Medical Research

Juggling on the Berlin Wall
Wikimedia / Yann

It is rather odd how often I hear the expression paradigm shift during contemporary scientific presentations and seminars. The expression was popularized by Thomas Kuhn’s book "The Structure of Scientific Revolutions". In that book, Kuhn referred to ground-breaking and revolutionary changes in scientific thought as paradigm shifts, but the expression is so over-used today that even minor discoveries are sometimes marketed as paradigm shifts.

However, once in a while a true paradigm shift does come along and I believe we are currently witnessing such an emerging paradigm shift: open science. This concept entails that research results should be freely and openly accessible to the broad scientific colleagues as well as the public.

The idea of open science goes beyond merely providing public access to published scientific articles because it also includes offering access to the original research data. This would permit fellow researchers to help evaluate and analyze the results, so that the broader scientific community as well as the public can weigh in on the interpretation of the scientific findings. This aspect of open science likely does qualify for being a true paradigm shift, because it will require that we think of ourselves as part of research communities and usher in “networked discovery”, as has been described in a recent book by Michael Nielsen and discussed by Bora Zivkovic.

There are still many obstacles that need to be addressed before “open science” becomes generally accepted. Academic publishers currently reap significant profits from selling high-priced annual subscriptions to academic institutions, and they would lose this income if scientists started publishing their results in open-access journals that freely provide articles to readers without charging for subscriptions or per-article fees. Furthermore, academic institutions and individual scientists may be concerned about how they would apply for patents, if the discovery process is networked and involves score sof collaborating scientists.

Marc Kuchner recently wrote about how individual academic careers are currently built on marketing or branding oneself as a leader in defined research areas. If data and research methodologies are openly shared, it becomes much harder for individual investigators to take credit for discoveries and succeed in the competitive academic rat-race. Therefore, the current academic environment does not reward or provide incentives for openly sharing data or research methods.

Nevertheless, under pressure from the public and funding agencies that rightfully demand public access to the results of the funded research, it is likely that our current research culture will change. We will gradually tear down the walls that exist in our current scientific culture. It will not happen overnight, and we will have to develop new infrastructures to share scientific data, novel ways to assess academic success and reward contributions of individual scientists as well as establish high quality open access journals in a variety of scientific areas.

However, one has to keep in mind that certain areas of research are associated with unique challenges when it comes to the implementation of open science. The obstacles presented openly sharing original data and results in biomedical research may be very different from those in astrophysics.

Clinical research is often funded by the private industry and may thus evade mandates of public funding agencies or not-for-profit foundations to publish in open access journals and openly share results. But even publicly funded biomedical research is characterized by some unique challenges.

One such challenge is the importance of maintaining patient confidentiality when it comes to data sharing. Institutional Review Boards monitor the ethics of studies involving human subjects or patients at all academic institutions and one of their biggest concerns is how personal data of subjects or patients is handled. Usually, the data is de-identifed for the purpose of publication so that any kind of description of the disease state, symptoms, mutations or other findings cannot be linked to individuals.

Only a very small group of trained professionals have access to the names of the subjects or patients and usually only these review the medical charts or personal questionnaires of the participants. If the data-sets are made publicly available, it is imperative that appropriate safeguards are put in place to assure the participants that the data will only be shared in a de-identified format and that anybody seeing the data-set will not be able to link the diseases to the individual identity of the participants.

There is another critical obstacle that needs to be addressed when open science is implemented in medical research. The primary target audience for basic research that is not related to medicine or health consists of fellow scientists and science journalists.

I remember that I started my research career working as a chronobiologist on the circadian rhythms of the unicellular marine algae Gonyaulax polyedra. I doubt that anyone other than fellow scientists or science journalists would have been interested in accessing or interpreting our original data, even if all the data and results had been presented in an open access format.

On the other hand, my research in recent years has shifted to areas that have a more direct medical relevance, such as metabolism and stem cells in vascular disease, heart failure and cancer. My research approach is still focused on basic biological mechanisms, but due to the change in my research topics, I have encountered much broader interest from patients as well as healthcare providers.

Patients with severe chronic illnesses and their loved ones scour the internet for possible new therapies, even if these therapies have not been proven to work. The burden of disease makes them emotionally vulnerable so that they may selectively read and interpret the scientific literature in a manner that gives them false hopes.

For example, I remember talking to one of my heart failure patients who wanted to pay out of his own pocket for a trip to Thailand so that he could receive adult stem cell injections to improve his heart failure. He had found out about this experimental therapy through the internet. Since he did not qualify for any of the ongoing adult stem cell therapy trials in the US, he was extremely interested in trying out this therapy that was being offered overseas (for a substantial fee). He was not aware of the potential side effects of invasive stem cell injections or the importance of quality control and he assumed that it was proven that they work for heart failure. It was only after extensive counseling that he understood there was no clear evidence supporting the therapy and decided to avoid subjecting himself to the questionable therapy.

Many healthcare providers such as practicing physicians do not have a scientific background and are not necessarily trained to critically evaluate research data. They currently rely on review articles or meta-analyses published in respected journals, but they are also influenced by scientific data that are presented to them by representatives or consultants for the pharmaceutical industry.

At first glance, open access to original data sets should increase the transparency of research. However, if we remember the adage that “we only see what we want to see”, we have to realize that open access to research data will also create an opportunity for pharmaceutical companies or for-profit hospitals to promote medical therapies on the basis of limited scientific data.

Selective reporting of the publicly available data by special interest groups could find an excellent breeding ground among emotionally vulnerable patients or healthcare providers who may be easily swayed by the plight and hopes of their patients. One example of selective reporting or selective analysis would be when negative clinical trials are re-analyzed to identify some subgroups of patients that showed a statistically significant improvement with the experimental therapy.

Another example could be that the clinical significance of in vitro cell signaling studies or animal studies could be over-stated. In a traditional academic paper, most of our scientific colleagues (voluntarily or after peer-review) highlight the limitations of their studies. If the data is publicly available, the data would be open to variant interpretations, even by members of the community who are not trained to appropriately interpret the data.

The solution to these potential issues that may arise when we transition to an open science format is not to limit the access of the data. Instead, it is imperative that concomitant with the creation of an open science environment we also build independent institutions or organizations that help interpret the available the data in a manner that non-scientists are able to receive accurate and solid information about the nature and significance of the results.

“Consumer Reports” in the US or “Stiftung Warentest” in Germany routinely test consumer products for their quality and safety, and report them in a manner that members of public can understand the results. Consumers buy subscriptions to their websites or magazines and they enjoy respect among consumers, who have confidence in their unbiased evaluations of products.

One could envision similar institutions that evaluate the biomedical research data and can give solid advice to non-specialists. Ideally, such institutions would need to include independent expert scientists as well as independent experts at communicating science to the broader public. The reason for including expertise in science reporting and science communication is simply due to the fact that many scientists are “communicatively challenged”. It does not help the broader public if a group of scientists charged with providing independent evaluation of publicly available datasets produces reports that are full of technical jargon. As funding agencies and the public push for open access to scientific research data, they also need to push for developing and funding infrastructures that can help the public interpret the openly accessible data.

In summary, I believe that the time for open science and networked discovery has arrived and that it will definitely enhance the progress of scientific research, as long as we build institutions that help us process and understand the flood of scientific data that will be released in the new open science world.

Tuesday, August 28, 2012

Transparency During Scientific Peer Review

F1000 Research is an Open Access publishing program which allows biomedical researchers to submit a scientific manuscript, which is subjected to a rapid in-house editorial review to confirm the appropriateness of the article:

Our editorial team will check the appropriateness of the article (including content, quality, tone and format), ensure it is intelligible and that it is written in good English. If a submission fails our initial checks, it will be returned to the authors to address the issues, and if they are not addressed satisfactorily, the article will not be accepted. If our in-house editorial team have concerns but are not completely sure whether to accept a submission, we will contact a relevant member of the Editorial Board for advice.  

The anonymous reviewer
(Photo from Wikimedia commons)
 If an article is thought to be appropriate during this rapid initial review, it is immediately published. This approach is in sharp contrast to current publishing approaches in most biomedical journals, where a manuscript is sent out to peer reviewers prior to publication. As many of us who routinely write such articles can attest, the traditional peer review approach can take months (or in some extreme cases even 1-2 years) of reviews, revisions and re-submissions, before an article is eventually published.

The F1000 Research approach avoids this lengthy pre-publication peer review, and instead focuses on a post-publication peer-review.  Selected reviewers first indicate if they approve, reject or approve the manuscript with reservations. They are then asked to comment the quality and strength of the scientific findings in the manuscript and their responses are then published alongside with the actual paper. The published manuscript can then be revised by the authors according to these comments by the reviewers. Additional researchers can also weigh in and write comments about the paper, even if they do not belong to the group of  reviewers that were specifically asked by the editorial team to review the paper. This allows the authors of a paper to take into account the comments of a broader group of fellow researcher and colleagues, especially when revising the paper. If a manuscript receives only negative reviews by the reviewers, it will be removed. It is only indexed by research databases such as PubMed if it receives two or more positive reviews. The editors of F1000 Research are still working with biomedical indexing databases to decide how to best index the multiple versions of the published manuscript as it is revised in this post-publication peer review process.
One of the most interesting aspects of this new, open review process is that the names of the reviewers are also made public. In the conventional pre-publication peer-review model,  anonymity of the reviewers is somewhat of a sacred corner-stone. It has the advantage that reviewers can be very frank in their comments, without fearing any repercussions or ill-will from the authors. The downside of this anonymity is that some peer-reviewers write scathing, non-constructive reviews and in some rare cases even abuse the anonymity to prevent the publication of manuscript by a competitor.
The obvious question is: Does such post-publication peer review work? It may be too early to tell since F1000 Research was only launched in July 2012. However, this early assessment by its publisher Rebecca Lawrence does sound very promising:


Many had predicted that our “publish first, peer review later” model would attract substandard work and that we would be inundated with poor quality articles, but we are very pleased to see that this has not been the case thus far.  Furthermore, the fact that our referees are clearly quite happy to openly criticize where they have concerns further supports our hunch that scientists will think twice before submitting sloppy articles as this will lead to open criticism of their work, which will be eternally linked to their paper by way of the article citation.


We obviously need more time to assess the scientific quality of the articles submitted as well as whether this novel post-publication peer review process actually improves the quality of the science presented in the paper as the paper is revised in accordance with the  reviewer comments. I have to admit that I am quite optimistic about this new peer-review approach because it is more similar to how we practice science. Most of the time, when scientific findings are presented at seminars or conferences, we receive feedback from non-anonymous colleagues and this feedback is extremely valuable. Most of us enjoy presenting our work to colleagues at conferences because we look forward to positive and negative comments. In the past, such feedback has been limited to the fellow researchers that happen to attend the conference. On the other hand, when articles are submitted for publication in the traditional model, we only receive feedback from 2-4 anonymous colleagues and it does not allow for a dialogue that is generally characteristic of good science. My hope is that this novel approach will allow the selected reviewers, fellow researchers and the authors of a scientific article to engage in a transparent and fruitful dialogue that will benefit all involved and help strengthen the quality of scientific research.