OU blog

Personal Blogs

New photo

Wikipedia defining Learning Analytics - H817 Activity 1, Part 1.

Visible to anyone in the world
Edited by Steve Bamlett, Thursday, 2 Jun 2016, 18:05

H817 Learning Analytics Activity 1, part 1.

REFERS to the definitions in Wikipedia page and its 'history'

Task is ‘to reflect on the differences and similarities between the definitions. Which, if any, elements remain constant?’

Returning from self-imposed exile to what I thought might be a barren land, to my surprise I’m delighted to have begun to study ‘learning analytics’ (LA). Already a few of my preconceptions and prejudices have been challenged by this exercise, not least about Wikipedia (W).

But to the task!

1.       First though I’d like to share a puzzle and my thoughts about it.

1.1.    The current W definition describes LA as a number of processes. Yet reading lists like this are never easy for me. Thus if LA is ‘the measurement, collection, analysis and reporting of data about ….’ Are each of the processes in this list meant to be totally independent of each other as instances of processes that each constitute LA?

1.2.    Or are they dependent processes in which the performance of a number of them (but not one alone) would constitute LA? And if it is a number is it all 4 of them or at least 2?

1.3.    This struck me because I find that I attempt to make sense of such lists as a series starting from an initial to an end process. Yet can you ‘measure’ variable data without collecting it first?

1.4.    The aim was, to my mind to ensure the grand dame of quantitative method (measurement) was given pride of the place, thus tying the concept to methods that are essentially numeric. The same order is, by the way, reproduced in French W, showing that ‘la mesure’ reigns there too. This implicit preference was not necessarily implicated in the August 2010 GB W since intelligent data, learner-produced data and analysis models’ can equally apply to qualitative data and its analysis.

1.5.    I do not know enough of the politics and rationale yet of the history of the movement to see whether my suspicions have any basis. If they have, it suggests that since 2010 the leading force has been numerical data or ‘Big Data’. [1]

2.       The PURPOSE of LA.

2.1.     There was a significant change in W between the August and November 2010 definitions

2.2.     A number of issues here are raised here, but some by subtleties in language use only:

2.3.    Thus line i becomes line ii below:

i.         To provide learners with relevant content resources and social connections, predict learner success and perform necessary interventions.

ii.       To discover information and social connections for predicting and advising people’s learning.

2.4.    In the following points, I’ll take the colour-coded comparisons between lines i & ii, one by one.

3.       Let’s start with the verbs signifying the active processes that define the stated purpose in terms of what it does.

3.1.    The first clear difference is that three active processes (provide, predict, perform) are replaced by one (discover). This suggests that the use of LA now only empowers its user to do one thing – to ‘find out’ about elements of learning interactions.

3.1.1.  In August, that person is expected instead to have a defined active role in relation to three different participants.

3.1.2.  Clearly, providing, predicting and performing each show a different activity that impinge upon the teaching and learning process by in some way transforming the learner to a passive recipient of that action. AL is really empowered here, and by implication empowers its user to do something that must have an effect on learners whether learners request that action or not. For instance, it is the user of LA who is empowered to perform learning interventions. The issue of who or how these interventions are decided or determined to be ‘necessary’ is left unsaid. That little word subtly insinuates the power of LA to justify the actions it empowers.

3.1.3.  By November, all LA allows the user to do is to discover resources, whose further or onward use depend on other unnamed processes. The learner has much more freedom from being the object of LA here.

4.        The object of LA and its user’s actions changes:

4.1.    in August, it is ‘learners’ who, via a number of relationship forms implied by each of the three phrases non-finite phrases in the clause  – as the passive recipient of ‘a gift relationship’, the owner of the success predictively measured and the implied object of interventions, the ‘necessity’ of which  it is not clear that the learner is involved in assessing.

4.2.    By November, it is information and accessible services only that the user of LA acts upon. If these things have a function it applies only to the abstraction, ‘learning’. It is up to ‘people’ to decide, I would argue, whether they avail themselves of these objects.

5.       The domains upon which LA claims to act change too:

5.1.    In August LA seems empowered not only to predict but also ‘define’ the conditions of success. At no point can it be suggested here that ‘success’ for a ‘learner’ may be different both quantitatively and qualitatively for different people.  Similarly we are not told their involvement in the assessment, delivery and review of ‘necessary interventions’

5.2.    By November, the user LA can only make available to people data that it is up to them to use in their ‘learning’. To be clear LA only equips you to talk about ‘learning’ now not the person – hence the decision to drop the nominalisation ‘learner’.

6.       Finally, since the areas of potential exploration are legion and this issue is presented to the TGF as a contribution to participative discussion, let us consider why and how the current W definition abandons the current naïve term ‘discover’ to characterise research in LA by the 4-fold processes of measuring, collecting, analysing and reporting, whether or not each is a ‘necessary and sufficient’ condition for LA to be being done or not (see [1] above) .

6.1.    My first thought is that the need by 2016 is to ‘professionalise’ the research done in LA by indicating the multiple actions involved in the whole process. It involves a thoroughly specialised academic lexical items – because after all, even babies ‘discover’ things.

6.2.    Similarly learning is not something belonging to ‘people’ now, as it was in 2010, but a reified (‘thingified’) category which is in itself open to manipulation – ‘understanding and optimizing’.

6.3.    Am I alone in wondering if the technocrats have taken over here again? Since if we see ‘learning’ as something to which we have a right of intervention, we can imply that we might do this regardless of any one person instantiated by ‘person’s learning’.

6.4.    The loss of the word ‘person’ is a sore loss I think. That is not because I’m resistant to innovation but it begs all the questions about what is constituted by learning. But that is a much bigger issue, and I’ve extended this blog long enough.

All the best

Steve

PS. I have also made this blog available to colleagues on E845 'Language in Action' and I have invited them to feedback corrections, including matters of accuracy, either in comment here, in E845 Module Forum or personally to me. 

Click here for Part 2.

[1] Despite my own commitment to qualitative work, this may not be a bad thing, since the data in learning analytics is collected incidentally and often ‘stealthily’. In that case, it might be better that we only collect after we consider the reason why we want to measure what we are collecting.

However, how many OU students know for instance about the statistics collected in the OU VLE and to whom they are available? As we shall see in this course there is no malign desire in such collection but I remember the digital intake of breath in the H800 last year when I raised this and the requests for sharing that followed.

These took the tutor (a very decent and wonderful tutor) by storm. However, people expressed even more surprise when he shared with us (with common consent) league tables of asynchronous forum participation, including comparisons of active and ‘lurking’ presence. What this suggests is that the shock in some people following Snowden in 2013 is still not opening users of VLE to the potential for collecting and selectively distributing data. For instance, my own students are often shocked to know that their participation in forums can be and is collected and analysed, even when that participation is ‘passive’ and apparently ‘secret’ to them only.


Permalink Add your comment
Share post