OU blog

Personal Blogs

Black cat sitting up in bed with a pink blanket

Researching Openness (Activity 2.3) #2

Visible to anyone in the world
Edited by Anita Naoko Pilgrim, Friday, 29 Sep 2017, 08:42
For my second 'open' term, I picked out 'open peer review'. (This term was not in the module Wordle; it was in the material about Open Science on Wikipedia - it was on the e(LATE)D course that I learnt the tip of going online to search for something, picking up something-else and following that, and so on - like a breadcrumb trail.)

I deliberately avoided the Wikipedia entry at first, and went for the second entry which is an organisation called Open Scholar. Guess what! they have a Wordle too smile

Wordle based on 'peer review'

I know, however, that how you get to the top of search engines is not a transparent process - this is part of the reason I use DuckDuckGo rather than a more commercial search engine like Google, although I often resort to Google as well because it is undeniably efficient. I therefore checked up the Wikipedia entry to see if Open Scholar are the main spokesperson(s) for this initiative. What I found there was reference to material about open peer review offering several definitions of the term, from a European organisation openAIRE, with a well-populated blog. Clearly there is lots going on and at least two groups have formed to develop what they see as their own vision of an open peer review.

openAIRE are coy about who exactly the '50 partners' in their project are, so I don't know who is involved; they are funded by the European Commission. Open Scholar have a UK URL, with scholars from Greece and Ireland and Norway on the working team. Their working team of seven appear to be all white men although their members look more diverse.

The activity looks like it's happening in Europe, but this may be because I am based in the UK and the search engine recognises that. A search for 'open peer review USA' throws up a couple of articles but not any organisation in the States. (Unlike the European material, the US articles are dotted with advertising.)

The apparent drivers and motivators for calls for peer review to be open are mainly the opportunity. Publishing online means there isn't the same stranglehold control over academic writing which paper journals had. There has for a long time been dissatisfaction with the 'blind' peer review system, and having personally suffered from it, I am all for it being changed.

Open Scholar have one particular kind of 'open peer review' in mind, which they seek to foster through their own multidisciplinary open journal of science. openAIRE publish this blogpost in which they seek to identify the different kinds of 'open peer review'. This does not necessarily mean online peer review, this could just be a review where the reviewer names themself rather than anonymously comments.

TBH, it's not very clear to me how open peer review might connect now, or in the future, with learning and teaching activity. The issue of peer review is crucially important to research rather than teaching. I had already thought of it as something which open science would need to consider. The difficulty with publishing information widely and freely is that there can be such a lot of it, and nobody can be sure if it is reliable.

In the OU, we have a nice mnemonic called PROMPT which the library encourages us to use to determine whether research is reliable. The second 'P' is for 'provenance' - who was it who published the thing? Lay persons often suppose that a published book will be the most valued scholarly product, and are amazed to hear it is the much shorter journal article. This is because the journal article will have been read by two, three or even more peers - who reviewed it and said it was of sufficient scientific merit to be published.

That is the academic scandal of the MMR Vaccine story (when research apparently linking the triple vaccine to autism led to a mass of parents refusing it for their children, and a sudden spike in measles in the UK) - that Andrew Wakefield et al's paper was published by the Lancet in spite of these supposed precautions - and let's note too that in common with hard science practice, there were twelve (12) other scientist-authors who had supposedly produced that article and should at least have read it before putting their names to it.

So we can already see that the 'blind' peer review process is not efficient at filtering out poor research. My story shows the other side - how it can block publication.

A few years ago, I wrote up an article for a special issue, about a highly relevant project on which I had been the Research Fellow. As an early career scholar, I was very keen to start publishing and since the journal particularly asked for contributions in a further topic area which my research was based in, I was hopeful of my article being accepted. I did, however, ask that the article not be sent to the one other person in the UK who had done research in that field, on the grounds that he had been the Principal Investigator for the project I was writing about, so was too closely associated with it to comment without bias. I didn't add that he had bullied me mercilessly and hated my guts! as I felt this wasn't an academic argument. Unfortunately the editors didn't read my note, sent him the article and he promptly accused me of plagiarism. (I only found this out because the guy who did the investigation bumped into me at a memormial event and told me about it!)

I was of course cleared of the plagiarism accusation - not that I was even supposed to know about it, but the editors of the journal then sent my article to three specialists in community safety mixed - I dunno; frankly I see that as prejudiced - the article was not about security issues at all, it was about family and kinship mixed

I would really have liked to have named a couple of specialist thinkers in family and kinship studies - especially since my article was partly based in anthropological rather than sociological thinking about kinship. Even if they had said the writing was poor, they would have given me good feedback in my own area of work - rather than the useless feedback I got which was all about how I hadn't covered issues of community safety in my article (because that wasn't what it was about! wide eyes)

The article was turned down and has lain dormant on my C drive ever since. Perhaps I will dig it out and offer it to the Open Society journal - once I have got over this sinus infection, fed the cats, been the farmers' market for fresh food for the family, bought and delivered a couple of ready meals to my elderly friend who is housebound, sorted out my students' tutorials and done another thing (which I might write a blogpost about since it is a great case study for the open/closed debate).

On a more positive note, a couple of years later I did get an article published out of my PhD material. The journal editors were friends of mine wink, so I was able to make sure the article got sent to someone appropriate. I had fantastic feedback which drew my attention to some great material in the field which I could use to re-draft the article. I don't know who that good reviewer was, I wish I did so I could thank them.

The closed journal article publishing world is all very Bourdieu! and four forms of capital, I think that is probably material for another blogpost smile


Permalink Add your comment
Share post
Black cat sitting up in bed with a pink blanket

Researching Openness (Activity 2.3) #1

Visible to anyone in the world

My ignorance about internet matters made it difficult for me to be sure how to identify a search term in the Wordle we were offered, but I guess you take the words and add 'open' to any of them.

Wordle based on the word 'open

For my first word, I picked 'open science'. I snuck off to the first link in DuckDuckGo that popped up: the open resource I am always telling my own students not to use big grin, Wikipedia.

(The reason I say it's not a good idea for students to use Wikipedia is that it presents summaries of complicated material. If you have got an academic background in that material, you can tell what it is they are referring to but if you are coming to this fresh, you can be misled by the summary. Wikipedia is not peer-reviewed like journal articles are, so the information may not be reliable - here we see one problem with open access material. In my own case, I am looking for some other links to follow up which I hope I will be able to recognise as authoritative, rather than for an accurate summary of 'open science' - although that would be nice too.)

Gosh, there are clearly a lot more 'open' terms I can go off and explore underneath the term 'open science' wide eyes

Diagramme showing other areas of openness which make up Open Science

(Developed by Andreas E. Neuhold. and made available under CC)

It's not clear who are the main spokesperson(s) for this initiative, as it seems to be very widespread. However a paper by Pontika et al (2015) mentions a European Union funded project (FOSTER) which is looking to develop training and a taxonomy of open science (presumably just in Europe - and not including us Brits any more sad). There is also The Open Knowledge Foundation.

Open Science is happening all around, but there are some quite different opinions about when it started.

On the one hand, Wikipedia (2017) says Open Science developed in the seventeenth century. Earlier scientists (eg Gallileo) had been obliged to circulate their thinking in code. The founding of the Royal Society in England and the Académie des Sciences in France allowed for government funding of scientific projects, and of academic journals in which scientists could openly write about our work.

On the other hand, Pontika et al (2015) say: "OS is a relatively new and complex concept and its adoption will require a shift in the researchers' behaviour regarding the conduction of research and information sharing and will demand the adoption of new practices." We are seeing a shift in practices for writing about academic work - one so great that we might even call it a paradigm shift in the strict Kuhnian sense of that term (as discussed in Smith 1998). However Open Science is clearly not that new a concept; having been developing since the Enlightenment on the principles of rationality and humanism which Enlightenment thinking is based in (again see Smith 1998). What has changed is the medium through which Open Science can be disseminated - it has gone from paper to internet.

It's interesting that this mere shift in medium is viewed as an opportunity to be even more open. Primarily it seems to me that this is about money (and social class). It's expensive to train up in the sciences, become a member of a (Royal) Society and get copies of the journal sent to you, it costs comparatively little to make material available online for anyone in the world to read. (Although not nothing.)

The apparent drivers and motivators for Open Science becoming viewed as even more open are the internet. However a serious barrier here is our capitalist economic system of governance. It's necessary to tinker around and provide government funding to support the people doing research, and the person who uploads the findings online for everybody else to access. This is vulnerable to political change like Brexit - who now is going to fund the open dissemination of British science?

In terms of products and progress, there seems to be a lot of research on how we could do open research. Some blogs and some material is being made publicly available. In my own field, Education, a massive database (whose name escapes me at the moment!) of information on British children has been made freely available in the last few years, and the 'owners' of it are strongly encouraging education researchers to come and use it rather than spend money collecting their own data. Researchers appear reluctant, it seems that using primary data has more kudos than using data someone-else has collected, starting from scratch is more exciting. 

Another open resource is information from the Office for National Statistics, made publicly available in raw form and also in summary bulletins which offer a brief analysis.

How these might connect now, or in the future, with learning and teaching activity? My immediate thought is that I ought to dig out the reference to that database and suggest to my Education students that they could go to it and make use of it. Particularly in postgraduate studies, it allows us to give students access to 'real' data and teach them to handle this messy stuff in the raw. Making this particular data so openly available might also allow someone to provide an illuminating analysis of it which would support better education. (That would be better than the English government just introducing education policy on the basis of a good idea that occurred to them while eating breakfast! I'm not sure if government ministers have time for breakfast unless they are having a breakfast meeting, which would explain a lot. Research shows that the most important factor in children being able to concentrate and work well in school, is whether they had something to eat before they got there.)

References

Pontika, N.; Knoth, P.; Cancellieri, M.; Pearce, S., 2015. "Fostering Open Science to Research using a Taxonomy and an eLearning Portal". Available at: https://docs.google.com/uc?authuser=0&id=0ByewXV9UyaMtVnFVd3FWNklBNTA&export=download, Accessed 28/09/2017

Smith, M.J., 1998. Social Science in Question. London: Sage Publications.

Wikipedia (2017) Open Science [Online], 7 September 2017. Available at https://en.wikipedia.org/wiki/Open_science (Accessed 28/9/2017).


Permalink 3 comments (latest comment by Anita Naoko Pilgrim, Saturday, 28 Oct 2017, 10:00)
Share post

This blog might contain posts that are only visible to logged-in users, or where only logged-in users can comment. If you have an account on the system, please log in for full access.

Total visits to this blog: 24586