OU blog

Personal Blogs

Henry James Robinson

Summary of ‘Open educational resources repositories: Towards a comprehensive quality approaches framework’ (Clements et al., 2015)

Visible to anyone in the world
Edited by Henry James Robinson, Tuesday, 2 Jun 2020, 13:31


Image: Baumgartner, P. (2016) ‘Economic Aspects of OER’ 


Open educational resources repositories: Towards a comprehensive quality approaches framework’

The following is a summary based on direct quotes from the title article by Clements et al. (2015). The purpose is to provide a context for the design of our learning object repository (LOR) website that we are designing as a team of students on the Masters in Online and Distance Education (Open University).  Find our under construction website and more of my team's article summaries among the 'preliminary research' pages here: Higher Education Open Education Resources.

'OER are commonly stored... within Learning object repositories (LORs), which have recently started expanding their design to support collaborative teaching and learning. ...many LORs struggle to find sustainable business models and get the users’ attention. Previous studies have shown that Quality assurance ....is a significant factor (in) the success of the repository (Clements et al. p. 1098, 2015). This opening statement could be confusing for anyone who has learned to distinguish between OER and LO - learning objects (there is no need for any fundamental distinction).  For example, the Centre for Innovation in Teaching & Learning (CITL) describe the distinction as being that OER typically undergo the 4Rs of revise, remix, reuse and redistribute, whilst learning objects are often just repurposed and redistributed.  So whether our site will finally be categorised as an OER repository or LO repository, the implications of the article's conclusions are similar.  Please note, the article title is paraphrased above.  Its analysis and conclusions are drawn from a literature review of related sources. 

Origins (history, key figures)
The authors claim to have 'systematically analysed technology enhanced learning literature regarding LORs’ quality approaches and specific collaborative instruments.' The outcome is claimed to represent a comprehensive framework of LOR quality assurance framework (LORQAF) 'that will 'assist LOR developers in designing sustainable quality assurance approaches utilizing full the potential of collaborative quality assurance tools' (Clements et al. p. 1098, 2015).  

Key ideas, concepts, and principles
OER enable forms of collaborative learning (Dillenbourg, 1999) and LORs of today can be considered as computer supported collaborative learning (CSCL) environments as they provide users tools for posting knowledge productions into a shared working space and providing tools for progressive discourse interaction between the users (Scardamalia & Bereiter,1994).  Adding social and collaborative features has been a recenttrend of LORs to facilitate wider user engagement (Monge,Ovelar,  &  Azpeitia,  2008;  Sánchez-Alonso,  Sicilia,  García-Barriocanal, Pagés-Arévalo, & Lezcano, 2011). However, repositories are not used up to their full potential (Dichev & Dicheva, 2012; Mitchell & Lutters, 2006; Ochoa & Duval, 2009) because of deficiencies in quality control, assurance and evaluation (Downes, 2007; Palavitsinis, Manouselis, &Sánchez-Alonso, 2013).  Therefore, it is vital to study LORs quality approaches (Clements, Pawlowski, & Manouselis, 2014). 

The study investigated quality approaches for LORs with a systematic literature review (Kitchenham (2004) in order to understand the holistic phenomenon of quality assurance and to form a quality approaches framework which LOR developers can consider when designing or improving repositories. 

The following classification was used as the starting theoretical framework:

Learning object repositories quality approaches have previously been classified as (Pawlowski & Clements, 2010):
1. The Generic Approach of Quality standards (e.g. ISO 9000 standards) (Stracke,  2009),  European  Foundation  for  Quality Management Excellence (European Foundation for Quality Management, 2014).
2. Specific Quality Approaches (e.g. Content development criteria or competency requirements) (Leacock & Nesbit, 2007).
3. Specific Quality Instruments (e.g. user-generated collaborative quality approaches such as rating (Nesbit, Belfer, & Vargo,2002), peer review (Neven & Duval, 2002) or recommender systems. 



Fig. 1 Learning object repositories quality assurance framework (Clements et al. 2015, p. 1102).

Implications
Repositories are in fact collaborative tools.  Social interaction is considered to be the dominant factor affecting the success of collaboration. Quality control must logically involve knowing what the audience expects and working with them to deliver.

Quality assurance must involve using specific instruments.

Therefore, the design and delivery/publication process must involve (e.g.) ‘peer-reviewing’ and ‘recommendation systems’. 
Developers have to go deeper than rating systems to understand the dynamic behind OER use and repository 'popularity' - what works on E-bay might not work in the field of education.

Therefore, a mixed approach to assuring quality is recommended including expert review to evaluate the substance of the resources in the repository alongside user-generated collaborative quality instruments such as peer reviews, comments, and rankings.   Both are needed to build the community.
 
References

Baumgartner, P. (2016) ‘Economic Aspects of OER’ [Online]. Available at: 

https://slideplayer.com/slide/6599837/ (accessed 02 June 2020).

Centre for Innovation in Teaching & Learning (2020) 'Learning Objects (LO) vs Open Educational Resources (OER)' [Online]. Available at: https://blog.citl.mun.ca/instructionalresources/courses/learning-object-vs-open-educational-resource-oer/ (Accessed 02 June 2020).

Clements, K., Pawlowski, J. and Manouselis, N. (2015) 'Open educational resources repositories literature review–Towards a comprehensive quality approaches framework.' Computers in human behavior51, pp.1098-1106 [Online]. Available at https://reader.elsevier.com/reader/sd/pii/S0747563215002162?token=5B32DA88FFF9C26D5C6E94BDC1F3F034ED748C8061EF68DC0F36C6580CFA93DD51BF77639D64E533F05A2AE4FFF8A286  (Accessed 01 June 2020).

Permalink Add your comment
Share post
Henry James Robinson

Creating an Open Education website: My contribution to setting the context

Visible to anyone in the world
Edited by Henry James Robinson, Wednesday, 27 May 2020, 19:44

dynomapper image

Image source: Dynomapper

The following is my reflection on my contribution to the writing/setting of the context behind a team assignment as part of my master's in online and distance learning.  Our team's challenge (there are 7 teams) was to formulate an online response to the COVID-19 pandemic.  We decided to focus on higher education institutions. In particular, to aid the ongoing widespread and partial transition to online teaching, and to support both educators and learners in this. For many who are unfamiliar with this mode of teaching /learning, the transition is a huge challenge, but solutions need to be found in order to secure their short term goals and long term survival. 

Of course, the development of our website is a very long term thing and the preliminaries are still ongoing. 

The site: Higher Education Open Education Resources, H817 COVID-19 RESPONSE TEAM 

My contribution to the context

I think my contribution was substantial.  I created the first draft of the aims, the context, the target audience.  Basically, the idea was the following:

  • To  help educators and learners the world over to respond to the COVID-19 epidemic by aiding the transition to online teaching  by:

    • Creating an online repository for the sourcing of the open educational resources (OER) for independent learning of various subject areas. 

    • In addition to teaching/learning materials in a range of subject areas, we will place materials that support knowledge and understanding of open educational practices (OEP), its technology, tools, and open pedagogy in all its forms.

The context involved describing the pandemic but also the general need for universal education as articulated by bodies like the EU and UNESCO and how this was manifested in the growing interest in OER which gives access to wider audiences cheaper under open licenses.  I noted how COVID-19  had merely added to the momentum. I was one of the first to complete my personas, providing more concrete bases for our design. The context also involved distilling our conversation of the forces and concerns at work in student's lives in a definition of the website design challenge. I was responsible for drafting this definition of the design challenge that enabled us to correctly capture the essence of what the site needs to achieve and to focus on how.

My teammates
My teammates substantially added to and improved my initial draft by bringing more alive 'my concept' (of course repositories of this kind are not a new idea!) of a collaborative creator/user experience by expressing the interactive parts - the site would have a chatbot for queries, for example as well as other things I'd missed. I'd only mentioned that we should host the occasional webinar via the site and that it would contain instructional videos and podcasts we'd create. I was concerned about how much time the creators would have for these activities. 

Most challenging

The things I found most challenging were working to a deadline while working full time and applying for jobs.  Also, I learned more than anything about working with people - you have to be diplomatic and things seldom get off to a rip-roaring start when you don't know each other. I learned how to set up a website, which was important for me. Most important, perhaps, what huge incentive teamwork creates. Is it the competitive instinct? Is it the urge to please and help each other as well as learn together? A bit of everything really. 


Permalink Add your comment
Share post
Henry James Robinson

the future of open education: open repositories, open pedagogy and global working

Visible to anyone in the world
Edited by Henry James Robinson, Wednesday, 13 May 2020, 15:48


Image Source: Global Hands

Macbeth:
"Is this a dagger which I see before me..."
Macbeth (II, i, 33)


Hi! This is my response to a study assignment on the same topic of open learning. See my original spoken version on YouTube. Also my articles on LinkedIn.


We were asked to imagine the future of learning. I didn't need to go beyond the guidelines my course on online learning had already laid down for me. Still, we all have our own unique take on things. And like McBeth, I am in awe of the awful choices involved in reaching out to it and aware of the part my own hands will play in my own future.


The future is probably in the clouds, so long as current trends continue and that is definitely towards universities posting more and more content online to both attract learners to learning and also provide a subsistence through the paid services the university offers. Once learners get hooked by the free services offered, there is more chance they become more general subscribers.


So based on trends (open learning facilitating by open educational resources - OER - are on the up), I think that in the future, most universities will have created repositories for open educational resources; it will be for the purpose of marketing the institution. It will both hook into the current trend for online engagement, educational apps, and more sophisticated hardware - smartphones, laptops, and whatever other mobile and semi-mobile devices evolve.


I think that all universities will have them, I think that artificial intelligence will be the systems that organize them. They’ll be much more discoverable because the current aggregators will have refined. Repositories will be more interactive internally because the functions will be voice-responsive, and they'll teach the skills the user needs to conduct searches, without having to type in the input. This will be within a future of OER, where most institutions of education have gone online and so I see a decline in brick and mortar institutions. There will be far less need for physical resources like paper, and that will be another cause of the cost of education going down.


So, for economic reasons, I think that education will go global in the sense that we'll teach all over the world remotely. That that will facilitate much more face-to-face contact via video - tutors will have to open up their schedule, so they are not working the standard 9 to 5 hours within their time zone if they want to benefit from being able to work. We'll be compelled to be compatible with wherever our clients are. Then they will be doing more like shift work in the future. 

More to the point, jobs will be harder to find and at the moment we are already moving to the commodification of labour. No surprise that OER is one of those things that helps facilitate it more! Being part of the global marketplace is not all negative, what I am suggesting may be one way that more teachers stay relevant and employed and internationalization is surely a challenge we embrace, even if we have to adapt to a different sleep pattern.


I think that sums up my view of the future of education. It's not all negative because we still have at least the chance to work, despite my students repeatedly envisaging a world free of teachers - I'm sure it's personal! See my previous articles on connectivist and rhizomatic forms of teaching because for OER to kick in, so do new ways of teaching and learning.


I'd never have been so cocksure of myself, of course, were it not for COVID-19. It's worth reflecting on how this one little pandemic can change our whole perspective on life!

Permalink Add your comment
Share post
Henry James Robinson

Digital Visitors and digital residents

Visible to anyone in the world
Edited by Henry James Robinson, Monday, 13 Apr 2020, 07:50


Image: 'Digital literacy disciplines' Creative Commons

Digital Visitors and digital residents

I recall exploring the concept of ‘digital natives versus digital immigrants’ (Prensky 2001) in a previous iteration of my journey into open learning/teaching and education as a now quaint idea that digital technology belonged to the millennials who grew up as Web 2.0 was taking hold and those born to earlier generations were immigrants, needing to pass some kind of naturalisation procedure to gain residency or full digital-age citizenship.  The ageism aspect of it tended to go over our heads, as we realised that digital citizenship was more a matter of exposure and interest than age.  Bennett, Maton, and Kervin (2008) found as much difference in technological know-how between those born during the coming of the full-on digital age of the late 90s to early 21st century as between those born earlier. Take my students, born in conservative Central Asia.  My impression is there is a technology gap between girls and boys and between my students and western students of UK, US and Australia, as my region, emerges from its post-soviet isolation – very rapidly I might add. Kazakhstan ranks highest in terms of internet access of all Central Asian countries, however, behind Russia and much of the world. Internet only appeared in 1994 in Kazakhstan, but it ranks 61st place out of 177 countries for broadband Internet speed. 

The concept of ‘digital natives versus digital immigrants’ has since been modernised and now the terms ‘digital visitors’ and ‘digital residents’ (White and Le Cornu 2011) are in currency – those that only occasionally use a technology and who have not developed much expertise in its use and those who use a tech often and who developed some expertise in its use.  White on his website, and in an accompanying video describes his approach to mapping an individual’s level of acculturalisation to a technology, including the use of his openly licenced software.

I decided to map my own level of engagement with different technologies using White and Le Cornu’s ‘Visitors and Residents’ concept (e.g. including my use of, VLEs, blogs, Facebook, Skype, etc.), cross-referenced with my adaptation of their personal/institutional axis  (I break it into social, professional and educational) as well as the visitors/resident one. I used Miro, the online collaborative whiteboard platform to create my grid. Click on this link to see my visualisation:

Henry’s Visitors and Residents’ concept (public)

Henry’s Visitors and Residents’ concept (course members – editable)

If you can, feel free to adapt the model I created in any way you please and send me an image or link of your version of the model!

I found it a useful way to reflect on my current use and to consider other technologies I do not use, especially when comparing my grid with others’ on my course, whose were often very different, based on their jobs, experience etc.  

 


References

Prensky, M. (2001) ‘Digital natives, digital immigrants part 1’, On the horizon, 9(5), 1–6.

White, D. and Le Cornu, A. (2011) ‘Visitors and residents: a new typology for online engagement’, First Monday, vol. 16, no. 9, 5 September 2011 [Online]. Available at http://firstmonday.org/ojs/index.php/fm/article/view/3171/3049 (Accessed 21 October 2019).


Permalink 1 comment (latest comment by Tanya Andrewes, Sunday, 19 Apr 2020, 21:49)
Share post
Henry James Robinson

Technologies for openness

Visible to anyone in the world
Edited by Henry James Robinson, Monday, 13 Apr 2020, 07:33


Technologies for openness

An open education technology
Here, I summarise some of the key technologies that are important for open education, focussing on one that I feel has been significant and will become increasingly relevant - open educational resource repositories.


I believe open educational resource repositories will become more and more important for open education in the future because they are not only a source of materials that are vital for the sustainability of open education, but they are a starting point for those who wish to become providers of OER.  It is also vital that the quality of the materials provided by these sources remains high, and this is another important role that can be played by supporters of the OER movement.  

When we define open learning, it is not always effective to do so in terms of the principles that underlie open education – education for all, empowerment of the disenfranchised, addressing inequality and stimulating educational achievement for individual self-efficacy and self-development  and economic development through education (i.e. a more able and employable workforce), especially among women, the disabled and discriminated-against minorities.  Nor should we just define open education as being education that is free, globally accessible and fulfilling the 5Rs of (able to) Retain, Reuse, Revise, Remix and Redistribute.   We should also define OER in terms of its resources and technologies – ‘the 4 Qs’ (Robinson 2020) Where can we create it? How can we create it? Where can we get it and How can we get it?

Today, I want to focus on these in terms of the technology. To quickly summarise some of these….

HTML allowed the enriching of any site with the capacity to link seamlessly content with other content, whilst remaining in simultaneous touch with the source. One of the main components of what we call ‘web 2.0’.  HTML coul be especially useful in edu-blogs for sharing educational content.

Blogs and its community of ‘edubloggers’, attracted to this format as a way of bypassing formal, rigid and it could be argued, antiquated forms of publishing on a global level to establish an academic identity. Blogs became popular as an OER because of its similarity to print sources – through which most educational materials were shared.

Social networks enable users to share personal ideas, thoughts, news and information through virtual networks and communities through messaging. One of their features is combining of multimedia to distribute documents, videos, and photos via computer, tablet or smartphone using downloaded to your devices or via web-based software or web applications.  Beyond blogs, social networking tools exist in many more formats.; for example, Slideshare and YouTube each represent a different visual format extension of educational print dominated sources such as Twitter or Scribd.

MOOCs and VLEs can act as explicitly open education sources because they act as virtual classrooms or academies, while all the others are often used for many different purposes – not just educational, like entertainment. They can combine with any of the above to enrich the educational or training learning environments they represent.

OER repositories are an additional technology that is important for open education, from the role of both learners and providers because they can help establish academic identity like a blog, as they give a voice to the provider to express their philosophical basis for providing the source and the materials in the source itself can be tailored to a specific audience, that the provider wishes to speak to.  This can be enhanced if the provider is a producer him/herself of the materials, not just a conduit for the creators.  A network or academic community of creators and users can be established via the repository.  Some examples of OER repositories include: CitizendiumCommonSpacesCurriki (K-12), Gooru (K-12), Internet Archive’s OER Library, Knowledge to Work, MERLOTOER CommonsWikiEducator (Open Education Global 2020). As, in many circles, education becomes more and more commercialised and less accessible, it is important to mark the distinction between education in general an open education.  As an example, Open Education Global (the provider of my edited list of repositories it names on its website) states its mission ‘improving education access, affordability, success and quality for all’ (Open Education Global 2020).


Permalink Add your comment
Share post
Henry James Robinson

OER repositories

Visible to anyone in the world
Edited by Henry James Robinson, Wednesday, 25 Mar 2020, 12:26

HI!

Happy Nauryz everyone. I hope you all found time to spend time with your mothers on Mother's Day!

This week, we were asked to imagine we were constructing a five-week, online course aimed at providing a set of learners with resources for developing their ‘digital skills’, with a different subject each week.  For me, it would be for young learners - pre-undergraduates.   We were asked to visit a set of Open Educational Resource (OER) Websites (sources of materials that can be reused, repurposed, redesigned freely) and evaluate them in terms of how they were able to cater to each of the topics of our imaginary courses. 

I devise a broad outline of the topics to be covered every week (see the grid below).  The OER repositories we were given are the following:

Solvonauts

Merlot

MIT

OpenLearn

OpenStax

Saylor

I used the topics listed below and added the word 'training' or 'skills' for my searches and looked for teaching or readily adaptable for teaching materials in my results.   Overall, I did find a few of them useful and some of them not very useful at all.  I am happy they are there and the ones I liked I will probably use again. 

Have a look at how each of the sites did:

Week

Topic

Resources

Suitability (G/M/B)

1

Social Media

Solvonauts: The search engine is clunky to use. I needed to enter the search several times. Resources limited to picture, Video and Audio search

I couldn’t find a range of video or audio, so I tried for images. Materials there were fine, as it says, not its own repositories, so suitability criteria of little relevance except that it brought me to an irrelevant page of Flikr.  It can all be repurposed (CC) but audio I found was a bit out of date.

2

Search Engine Marketing

Merlot:  The website easy to use, except the type of material not always clear until you click. Some interesting features like ’create a learning material’ and volunteer to be a reviewer.

A lot of UpToDate materials including eBooks and articles that could be repurposed.  What I wanted could not be repurposed (CC) coz Prezi is online and it was a bit out of date and was focussed on the US. 

3

Analytics

MIT:  State of art; subscription options, links to twitter, FB, WP, and Instagram.

Found two full beginners’ courses on inc this: analytics.  The clear spoken audio also great sound quality and available on YouTube made it readily adaptable. Up to date and highly suitable with loads of additional materials of different kinds.

4

Mobile

Open Learning: Very attractive design and user friendly.

The searches were aided by a warning for materials over 5 years old and I like the pdf, Word format choices. I found materials at advanced called: Accessibility of eLearning and low level called 'Digital literacy succeeding in a digital world' and a podcast a variety of other materials from video to audio to a podcast called University of the Future - very good.

5

Video

Stax and Saylor Clunky, slow and a bit bewildering to use.  E.g click on courses – there’s a limited choice; click on programs and I get a mockup of a Saylor course certificate. I wanted something on books so Stax is maybe not the sources, coz It apparently only has books.

I found zilch that was useful on either site -  maybe it was me but also maybe it’s good that Stax is retiring, to be moved to an archive. However, when I tried the Open University Open Learning site, I found a course on creating open materials including a section on video – great. A start anyway.

 

 As you can see, generally I was quite satisfied, but one or two of the sites fell below my expectations.  There is a possibility that is because the sites just were not suitable for my course and/or my lack of knowledge of them meant I was unable to use them properly in the limited time I had to search.  As our course tutor points out:  Different sites have different requirements, follow different 'regulations', and restrictions.  'Some make accessibility a requirement, while others offer guidelines' (Open University, 2020). 

Commons Licence

Permalink 1 comment (latest comment by Alan Clarke, Friday, 27 Mar 2020, 10:13)
Share post
Henry James Robinson

Assessing Innovation

Visible to anyone in the world
Edited by Henry James Robinson, Wednesday, 25 Mar 2020, 12:55

OER bookshelf

Image: Opensource.com CC BY-SA 2.0
This week, we were asked to again practice our research skills by using them to assess how innovative a project was and how successful OER (open educational resources) had been as an innovation since its introduction.   Our task was structured around the following questions:


1.    How would you judge OpenLearn in terms of your definition of innovation?

I would judge OpenLearn to be very innovative because it incorporates many, if not all, of the features of OL, OEP, and OER in one. These include all that was envisaged since the article McAndrew and Farrow (2013) was published and those envisaged by early writers on open learning mentioned in the section entitled 'OER as the Supporter of Educational Theory', even as far back as the beginning of the previous century.  The OU was one of the pioneers of OL in practice and the OpenLearn has around for more than 20 years and OpenLearn in its current form has already been active for 14 years.   An illustration we get from the article is the use of digital badges, once looked upon as the 'future of learning' (Duncan, 2011, cited in the article).  Duncan, however, argues that 'the badge system cannot work without an open educational infrastructure'  (McAndrew and Farrow, 2013, p71).  OpenLearn provides that. 


2.    What key challenges facing the OER movement can be dealt with more quickly than others?
The article suggests that certain persistent challenges exist - copyright, technology, access.  But I think what they recognise the reality that technology, granting more and more access is advancing very quickly and that the copyright issues have been addressed significantly by Creative Commons (though there is an ongoing problem of 'theft' of ostensibly protected open resources materials).  The evidence suggests, according to the authors, that of the challenges listed on page 68, the first 3 have been addressed the quickest, to some extent, whilst solutions to the others remain in question.  


3.    How do open educational resources challenge conventional assumptions about paying for higher education modules?  
The assumption is that higher education modules are high quality, delivered by experts and that they provide essential revenue for the institutions that produce and purchase the materials and resources the modules are based on and can therefore only be made available for its registered users.  That way they can pay for the use of the resources and for their products and for the faculty to deliver them.  It seems counter-intuitive that they make these modules available free of charge.  The institutions do, however, can valuable 'PR', publicity and promotion from doing it; they also provide fee-paying services within these free programmes.  All this, along with support from the government to expand education provision go a long way to making these enterprises worthwhile.  The challenge is that the academic cultural environment has not yet fully accepted this way of working, as mention on the section entitled 'Research and Scholarship' - the implications of this non-acceptance of open publishing go beyond whether faculty produce and publish in the traditional way, but touch on the whole idea of the purpose of HEIs. 


I found this to be a good way to revise the real significance to education change OER represents and the meaning of its related terms such as OEP (open educational practice), Open Science, Open data etc. OER has gone a long way since its inception with projects started by Rice University, Carnegie Mellon and MIT (Connexions, Open Learning Initiative, and OpenCourseWare respectively, though Connexions has changed its name and is soon to retire).


I noticed I am becoming more proficient at researching. I am using keyword searches and my resources such as the OU library service, EBSCOhost, and Google scholar more efficiently and I am getting my ideas down faster in writing.  These are all benefits of my study with the OU.  I should continue to manage my time efficiently so I can continue to get the most out of my studies, as I have not even begun to make the most of the resources available to us to supplement what I discover myself and to improve my tech skills. 




Permalink
Share post

This blog might contain posts that are only visible to logged-in users, or where only logged-in users can comment. If you have an account on the system, please log in for full access.

Total visits to this blog: 82019