The peer-review process under review with SciRev

SciRevI am probably not going to surprise you much by saying that the peer-review process of research articles could be improved. As I see it, peer-review should be an opportunity for researchers to improve their work. It should help detect flaws in the methodologies used and advise on how to improve the manuscript itself. But sadly, for many, peer-review feels like an unproductive waste of time, with sometimes endless waiting periods when the manuscript is in the hands of editors or slow reviewers. Even more frustrating is when the feedback consists of minimalistic reviews that bring little to the work. But things are slowly changing. Many journals now advertise their quick turn arounds and their network of competent and responsive reviewers. But with thousands of research journals in activity, it can be hard for researchers to know which journal is doing a good job at it and which are not.

SciRev is a platform that allows researchers to publish reviews of their experience with the peer-review process of specific journals. Facts including: the duration of the first review round, total handling time, number of reviewers, quality of the reviews, and an overall rating are displayed. A very useful “motivation” section also allows users to explain a bit about their experience with the journal. This usually gives interesting insights on the peer-review process. SciRev also allows you to compare several journal side by side.

Review of journals by users.

Review of journals by users.

The reviews seemed to be well balanced between the positive and the more negative. SciRev also gathers very valuable data that could help grasp the problems in the publishing sector. Based on the user data, SciRev also provides interesting statistics about the review process within various scientific fields (see below).

Rejection time and duration of the first round of review averaged for all scientific fields

This initiative, along with others that help researchers choose the right journals to publish in, will likely play a role in improving the publishing system. Indeed, the cost supported by universities associated with publication and with subscription to journals, should come with a matching service. For the price, we should expect services such as open access, innovative ways of communicating the research, and an efficient peer review process. Such journal-rating platforms could become key to identifying the journal that are ahead of the game.

Journal Guide helps you find, compare and rate journals

Screen Shot 2014-02-03 at 1.03.11 PMSo, after years at the bench, months fighting with your co-authors about the wording of the second phrase of the 5th paragraph, you are ready to publish! The question is, where should we publish the paper? With over 25,000 journals to choose from, the possibilities are plentiful and can be overwhelming. And for your paper to have impact, you must find your audience and thus find the journal that your audience reads…

Journal Guide is a platform that helps authors navigate through this profusion of scientific journals. It asks for your paper’s title and abstract, then extracts the important keyword and identifies a series of journals that seem to be a good fit.

Screen Shot 2014-02-03 at 12.59.32 PM

Example of search result in Journal Guide

The results are displayed in a table (see image above) with the search score, journal name, publisher and impact factor. For each journal, Journal Guide also identifies published articles that are related to your title and abstract. If others in your field have chosen a particular journal, you might want to consider it as well. Once you have chosen a couple of journals that seem appropriate, Journal Guide offers a tool to compare their characteristics side by side (see screen capture below).

Screen Shot 2014-02-03 at 1.00.12 PM

Comparison of three different journals

At any time during your search, clicking on the name of the journal will display another layer of information. There, one can learn about the journal’s aims and scope, costs and open access policies. But even more interesting is the ability of users to provide anonymous feedbacks about their personal experience with the journal. Information such as the speed of publication can be particularly useful.

Another online service provided by Edanz also helps authors decide on a journal by analyzing title and abstract. Journal Guide pushes the concept further by offering user accounts, side by side journal comparisons and journal rating. Although still in new and in beta version, Journal Guide has the potential to help create a more healthy competition between journals by making it easier to compare them and can already help young researchers better promote their research by choosing the right journal.

Out of curiosity, I have tested a few of my publications. Entering the title and abstract and looking down the list to see how the journal that I have selected are ranked by Journal Guide.  Some of my articles came up with the journal I published in as first choice. Others did not even show the journal they are published in. Perhaps this is a sign that the choice of journal can be quite irrational some times. Journal Guide could help us make more objective decision.

Journal Guide is a division of Research Square, a for profit organization also creators of AJE and Rubriq.

Publish and Network on the ScienceOpen plateform

Screen Shot 2014-01-22 at 9.30.33 PMA quick note to say I’m adding ScienceOpen in the list of online tools for researcher.

The platform qualifies itself as a “Research and Publishing Network”. It is an open access publisher, inviting members of the ScienceOpen network to  review submitted papers.  ScienceOpen then opens it up to all researchers with a ORCID and has at least five publication to further comment on the article after publication. At the moment it is referencing over 1,000,000 open access articles from various open access databases. ScienceOpen also included a networking component, to share papers, open discussion groups and collaborate with other researchers.

ScienceOpen is a start-up company based in Berlin (Germany) and Boston (USA). Learn more about ScienceOpen here.

 

Comment on published manuscripts with PubPeer

Logo_PubPeerThe other day, I ran into PubPeer, which allows readers to comment on publications. Here’s a description directly taken from the “about” section:

PubPeer seeks to create an online community that uses the publication of scientific results as an opening for fruitful discussion. 

  • All comments are consolidated into a centralized and searchable online database. 
  •  Authors, as well as a small group of peers working on similar topics, are automatically notified when their article is commented on.
  • Pubpeer strives to maintain a high standard of commentary by inviting first and last authors of published articles to post comments.
  • The chief goal of this project is to provide the means for scientists to work together to improve research quality, as well as to create improved transparency that will enable the community to identify and bring attention to important scientific advancements. 

PubPeer is democratizing the peer review process. This is driven by the idea that publishing research results should be open to all since publishing costs are driven down by massive digitization. However open discussions and reviews should be retained to assure good science and generate new ideas.

Shifting the peer review process from before to after publication is an ongoing effort shared by others. The idea is usually to first build a community around a collection of papers then get discussion started.  I love to concept, but feel like the system is taking its time to get adopted by the masses. Why is that? Could it be because the communities are too small? Because they are too diverse maybe? Or perhaps because such comments are not taken into account to measure research impact?

Trouble understanding publisher copyright policies for self-archiving? RoMEO service is here.

SherpaRomeoAuthors are increasingly encouraged to deposit their published articles in open access repositories. This can be institutional sites, personal or laboratory homepages or social websites. The one that do, often find the process a bit tedious but rewarding.

However, a majority of journals are not open access and limit the diffusion of the article in its published format. Every publisher have slightly different policies, some allowing only pre-prints (ie pre-refereeing), post-prints (ie final draft post-refereeing), or event full formatted text in certain case. In any case, the variety of policies can be discouraging.

Luckily, RoMEO, a service based  at the University of Nottingham, gathers the copyright and self-archiving policies of an impressive list of over 2200 journals.  Simply enter the name of the journal and the tool will display the journal’s policy concerning pre-print, post-prints and the publisher’s version, while detailing any restrictions that apply. To make it easier, RoMEO also assigns a color for each journal that corresponds to the degree of openness of the policies.

  • Green  – can archive pre-print and post-print or publisher’s version/PDF
  • Blue – can archive post-print or publisher’s version/PDF
  • Yellow – can archive pre-print
  • White – archiving not formally supported

Publish the unpublishable with ResearchGate

ResearchGate recently announced that they now encourage researchers to share data through their platform. They hope to get more unpublished information out in the open to fuel scientific discussion. Such information include:

  • Datasets and raw data
  • Negative results
  • Figures and media files
  • Unpublished articles

ResearchgatePublishTool

This new service comes in addition to a set of other services that already allow researchers to share data and unpublished information. ResearchGate, with their 2+ million users, will probably quickly become one of the main platform to publish such information. By steadily releasing new services, ResearchGate seems to be taking the lead as a social platform for scientific exchange.  However published data should be easily searchable, citable and not prisoner of proprietary formats. This is not the case as of today, and I would be curious to learn more about efforts currently underway to address these issues.