All 4 entries tagged Quality

Reviewer Roundup ‘22

Follow-up to Refreshing Exchanges' Reviewer Database from Exchanges Reflections: Interdisciplinary Editor Insights

Reviewers are a vital part of the Exchanges team - and making sure our records for each of them are up-to-date is just as vital.

Today I’m working on one of those tasks that’s been sitting in my to-do list for sometime: going through all the registered reviewer records to see which ones haven’t added any reviewer interests. Long-time readers will recall I did a similar task a few years ago, and the result was a wave of researchers upgrading their records, albeit alongside some who decided to request we remove their contact details – as is their right.

You would think tools which permit functionality like ‘display all reviewer users’ where ‘researcher interest is a null field’ would be the sort of thing baked into a journal management system like OJS. But, as with so much of the platform’s management information systems it’s not really been as well developed as say the core editorial workflow controls. The most recent update we applied to the platform did – I am pleased to report – provide some much-improved managerial tools that I’ve been pleased to make use of on more than one occasion. It is now possible for example to output a .CSV file containing the names of all users within a certain group. So, I guess from where I’m sitting, we’re halfway there[1].

However, in this file the reviewer interests information is not among the information which can be outputted. This is a shame as a simple Excel function would have enabled me to filter all 700+ registered reviewers down to just those lacking any listed research interests. Which means I had to go to speak to my technical guru in IT Services and crave a boon from them! Thankfully, this the lovely OJS Technical Lead was able to deploy a little back-office Python scripting to quickly draw out exactly the data I needed. Kudos, as on so many occasions, to them. It’s no reflection on them that this obvious functionality is lacking from a editorial user perspective. Maybe I can wish for it to appear in a future update…[2]

Following a little data clean-up - names with non-British characters seem to have been rendered oddly in the output file for one – all that remains now is to prepare my mailshot text and send it out (BCC of course) to all our reviewers via a mail merge. Based on the experience last time, I suspect we’ll have one of three reactions from those were contact:

(1) Email bounceback, indicated a defunct account

(2) A request for us to remove the account

(3) An update to the record made by the user[3]

Option 3 is my desired outcome of course, but I suspect I’ll be dealing with a fair bit of (1) and (2). Users can inactivate, or remove their reviewer registration themselves, but if they ask, I’ll happily adjust their account as requested. For those dead accounts though, I’ll need to go through and check they weren’t actively involved in any recent reviews before, with regrets, removing them from our reviewer’s list.

Hence, if you are one of our reviewers, and you get a message from me this week to update your account details – don’t feel singled out – you’re just one among many we’re asking to help us to help you – and direct the right kind of reviews in your direction!

---

Endnotes

[1] Livin’ on a prayer or not

[2] I shall not hold my breath on this one.

[3] If you want to jump the gun and update your details - you'll find instructions here: https://exchanges.warwick.ac.uk/index.php/exchanges/FAQ#reviewers

Gareth Johnson : 13 Jun 2022 10:59 |  Tags: Cleanup Data ITS Profiles Quality Reviewers Updates Users |  Comments (0) |  Close comments |  Report a problem

Editorial Entrances & Departures

Writing about web page https://exchanges.warwick.ac.uk/about/editorialTeam

This week we’re witnessing a slight changing of the guard with Exchanges. Firstly, some of my associate editors who have been working on our various special issues have come off the team. My thanks to Sophie, Freya and James for their various contributions to the title, and I hope they’ve found it a useful learning experience [1].

Meanwhile, behind the scenes at Exchanges I’ve been working these past two years to gradually increase the internationalisation of the Board, by talking with Warwick’s various institutional partners. It can be tricky overseeing and supporting a distributed editorial team around the globe, and it’s a time consuming (and occasionally frustrating) task to engage with those institutions where we don’t have any direct representation for the journal. Much as I’d like to do a spot of globetrotting and make some connections in person [2], it hasn’t been practical – so I’ve been involved in extensive chains of email correspondence. It probably won’t surprise you to read that Exchanges isn’t top of many scholars’ priorities. This might be understandable, but from a Managing Editor perspective, it can make for false starts and occasional stagnation.

Nevertheless, as of today, I’m delighted to welcome aboard our newest two members of the Editorial Board as Dr Guilherme Sampaio and Dr Salvatore Monteleone join us from CY Cergy Paris Université. Guilherme is an intellectual historian, specialising in particular on the French reception of Keynes and generally on the relation between economic thought and policy in Modern France. By contrast, Salvatore is a researcher focussing on cyber-physical systems, embedded systems, and network-on-chip architectures. I’m confident they’ll both bring some much appreciated new perspectives and insights, alongside their more practical contributions to the journal.

[1] More about that in a later post and conference paper next month!

[2] Perhaps less so currently, given the current global health crisis

Gareth Johnson : 05 Mar 2020 09:48 |  Tags: Board Editors Quality Team |  Comments (0) |  Close comments |  Report a problem

Refreshing Exchanges' Reviewer Database

Writing about web page https://exchanges.warwick.ac.uk/peerreviewer

Today I finally hit the big red button on something I’ve been working on over the summer. This has been a task which has oscillated between being a labour of love, while also posing a seemingly Sisyphean task [1]. Thus, reaching its conclusion has brought a combination of relief and satisfaction but also unsurprisingly generated a bit more work for me before I could call it a day. It involved that most crucial of academic journal contributors: peer-reviewers. As I’ve mentioned before, peer-reviewers aren’t just an essential part of the Exchanges editorial workflow, they’re contributions and insights are deeply valued by the Editorial Team and authors alike.

In short, in my spare working moments I’ve been methodically working though our database of registered peer-reviewers and examining what each and every one of them has listed as their reviewer interests. Registered reviewer interests are crucial as these are what my editors and I search when we’re looking for people to participate in peer review of our submitted papers. The main part of my ‘summer fun’ exercise was to identify those people who’ve registered profiles and expressed a willingness to be potential reviewers for Exchanges, and examine what they say about themselves.

But, and it’s a big but, where registered reviewers haven’t listed any research interests then, well they’re essentially invisible to the editors when seeking potential peer-reviewers. If we don’t know what field you work in, or the areas of expertise you profess, then we’re not going to approach you as a reviewer. A surprising 38.5% of our registered reviewers turned out to have failed to supply this key information on their registered profiles. Hence, today’s figurative ‘button’ dispatched emails to those would-be reviewers identified as deficient in this respect, asking if they’d kindly spend a few moments reviewing their profiles and adding in this information.

This naturally uncovered over 40 dead email addresses, and while I’ve managed to correct a few, sadly I’ve removed the majority from our reviewer register. This won’t stop people re-registering with a new email address, something I’d strongly encourage, but does mean our reviewer database now only contains contacts with valid contact addresses. I’ve also had a number of nice chats with former and would be reviewers as a result, which is an unexpected bonus, as engaging with our readership and continuators alike is always a pleasure.

A further serendipitous part of this exercise was the chance to do some light data cleansing work on the rest of the reviewer profiles. Quite a few of these had reviewer interests somewhat confusingly listed, which means, I suspect, they’d have risked being overlooked by my editors. I’m happy now these registered reviewers will turn up more frequently and accurately when we’re looking for people to contribute to our quality assurance activities.

If you are one of our reviewers, then checking your review interests are up-to-date, accurate and complete is one of the most useful things you can do for our journal. Many of the reviewers who do have information on their interests, have only listed one or two areas, whereas five or more would be far more representative of a ‘good’ record. Updating your reviewer profile only takes a few moments and there are easy instructions on how to go about it [2].

Conversely, if you would like to register as a reviewer with us, then by all means please do consider it. You’ll likely find our peer-reviewer guidance helpful [3]. And if you've never peer-reviewed before - then can I recommend this excellent text to get you started [4].

In the meanwhile, I can now crack on with planning my workshops, meetings and presentations for the autumn term now, with this grand summer task solidly in the rear-view mirror.

---

[1] Foolishly I thought OJS might be able to run off a report for me, with a list of all reviewers lacking any entries in their review field, but it appears the way the database is designed or implemented makes this impossible. Or at least highly impractical for my tech support people. One of the many reasons why much better managerial reporting tools for the platform are right up at the top of my technical wishlist for the platform! The time they could save me is not inconsiderable.

[2] https://exchanges.warwick.ac.uk/FAQ#reviewers

[3] https://exchanges.warwick.ac.uk/peerreviewer

[4] http://www.plotina.eu/wp-content/uploads/2019/03/Introduction-to-Peer-Review-Guide.pdf #ShamelessSelfPromotion

Gareth Johnson : 09 Oct 2019 15:40 |  Tags: Assurance Cleansing Data Peer Profiles Quality Review Reviewers Updating |  Comments (0) |  Close comments |  Trackbacks (1) |  Report a problem

How do I become an Exchanges Reviewer?

The question of how one becomes a reviewer with Exchanges is one I'm asked from time to time, and I will confess how this is achieved isn’t automatically obvious from the journal’s home pages. Anyone with a research background from a PhD student through to established professor from any academic or research institution from around the globe is warmly welcomed to consider joining our growing peer reviewer community. It couldn’t be simpler to join, as there are there are three easy ways potential new reviewers can register with us.

The easiest approach is to register yourself with the journal as a reviewer via the online form: https://exchanges.warwick.ac.uk/user/register. You’ll want to ideally use your academic institutional email here, as the Editors will validate potential reviewers before we use them, and checking email addresses is one of the most common starting points for this process.

As you create your account with Exchanges, you’ll have the opportunity to add in a range of research interests to your profile. These should ideally be both disciplinary broadly and specific, because when my Editorial Board are looking for reviewers, the first place we turn is to search on these terms. We don’t use a controlled vocabulary, so you are free to describe your research interests in any way you like. However, remember to add terms you know others are more likely to search on, alongside the more specific ones, as the Editorial team won’t necessarily be conversant with the more niche disciplinary terminology.

Secondly, if you’ve already got an account with Exchanges but didn’t register as a reviewer when you initially registered, it is possible to sign up as one by logging into your user profile (https://exchanges.warwick.ac.uk/user/profile), clicking into the Roles tab and then checking the box for Reviewer. You’ll need to add in your reviewing interests as well at this point in the box provided (Reviewing Interests), otherwise we’ll never find you to ask. You can repeat this process as often as you like to add, or subtract, reviewing interests from your profile.

Thirdly, and most informally, you can contact myself or any of my Editors and ask to become a reviewer. It might be you’d like to know more about the process, and the potential workload, before signing up, and that’s just fine too. Myself, and my team, can happily create you an account, which you can later amend via the profile page as discussed above. The reverse is also true, as we do seek our reviewers in the wider academic world, via our professional networks, where we don’t have sufficient good matches within our own reviewers’ database for articles on various disparate topics.

There is actually a fourth way you can become a reviewer, and that is to publish with Exchanges. In common with standard academic journal practice, all prior authors with the title are considered as potential future reviewers. Hence, if you take the wise move of choosing to publish an article with Exchanges, don’t be too surprised if we come knocking on your door some time later to help us maintain the quality standards of future academic publications. Believe me when I say, your fellow authors will be especially grateful for the insight you’ll bring.

For more formal details about how we conduct and manage quality assurance, see Exchanges’ guidance for peer reviewers.

Oh, and finally, if you ever want to stop being a potential reviewer for us, while we’ll be sorry to see you go, you can either uncheck the box on your Role Profile page. Or alternately, if you want us to remove your information from the database altogether, then email myself or any of the Editorial Board, and we’ll delete your account.

Gareth Johnson : 17 Jul 2018 15:34 |  Tags: Assurance Contribution Intellectual Labour Peer Quality Review |  Comments (0) |  Close comments |  Report a problem