OU blog

Personal Blogs

Christopher Douce

Adopting a critical approach in your project EMA

Visible to anyone in the world

One way to think about the term ‘criticality’ is to understand that it can mean ‘to demonstrate that you’re thinking things through’. In your project module report, there are many different ways you can show your critical thinking. Here are some of the ways that came to mind:

Problem context. What is the problem? Why is the problem important? Who benefits from the problem being solved? How will you investigate the problem domain? Who are the stakeholders? What questions will you ask them? How will you capture their responses?

Literature review. Why are the resources, reports or articles you have found considered useful? Is the resource from a trustworthy source? Which modules you have studied are relevant to your project? How, and where will you be using the articles that you have found in the body of your report? Have you found any articles that present conflicting or opposing views? How will you structure your literature review? What subheadings will you use?

Resources. Why is a particular resource, or set of resources useful? When you get to the end of the project, were some resources more useful than others?

Skills. Towards the start of your project report, it is important to share a list of skills you expect you will need to draw on. Preparing this list will help you to identify what skills (and knowledge) you need to develop. When you get to the end of your project, what skills have been the most useful, and which skills have you developed the most.

Planning. When preparing your project plan, it is not good enough to say ‘agile’ or ‘waterfall’. You need to say why you have chosen a particular approach, and what advantages your chosen approach gives you. Sometimes an agile approach is selected since there is the misunderstanding that it avoids planning. You need to demonstrate planning irrespective of whatever project model you choose. When you get to the end of

Methodology. In the context of your project, the term methodology can be used to refer to what you will be doing to answer questions, and to solve your problem. Why are you doing what you are doing? If you use a survey, are the answers to the questions you ask actively going to help you to achieve what you wish to achieve? If you interview people to gather requirements, have you asked the right questions?

Requirements. Where did requirements come from? What did you do to collect them, and how did you go about collecting them? Can you provide evidence from data that is collected that suggest a particular requirement. Who have you spoken with to gather your requirements, and why have you chosen those people? What documents have you looked at (and, again, why have you chosen them and why are they important). An important question to ask is: are your requirements traceable? What are the most appropriate form of diagrams you could use to represent your requirements, or the problem context? Why have you chosen that approach? Has the literature you have identified been helpful? If so, are you able to provide a quotation and page reference?

Design. What approaches did you use, and why did you use them? Which tools are you using? Are these tools mentioned in your literature review? What is your architecture? Can you able to justify your design decisions in a way that the examiner can follow? What approaches have you used to describe your design? Have you used sketches, prototypes, or diagrams? Why have you chosen that particular approach? What evaluation have you done to your design? What articles or source have you used that have informed your design? Can you evidence this by quoting from them, and providing a reference that includes a page number?

Technology choices. What are the advantages of different tools and technologies? Is one set of technology choices likely to be better than another? If so, why is that the case? Also, what evidence do you have to show this is the case? Is the examiner able to see what you have done, and why you have done what you have done?

Testing. What testing approaches have you used, and why have you used them? What evidence is there of the testing you have done? To what degree do you feel that you have confidently uncovered any bugs or problems that exist within your product.

Evaluation. Testing and evaluation are linked, but they can be used to answer slightly different questions. Testing can answer the question of: does it work as I expect it to work? Evaluation can ask the question: does it solve the problem I set out to solve? If an evaluation is carried out, does you chosen approach help you to answer that question? Have you asked the right evaluation questions, and have you dealt with all the ethical questions that must be attended to? What about resources? Have you provided some? Do they work? Are they helpful for you, or for your participant?

Diversity, accessibility, legal, social, ethical and professional issues. In the project report, this group of concerns can, of course, be grouped under the label LSEPI. A really useful question to ask is: to what extent does the project, or product, potentially impact the society or community in which it is used?

Reflection. When reflecting on your project and what you have learnt, consider a set of ‘wh’ (and ‘h’) questions. For example: What have you learnt? What did you do? Why did you do what you did? Was your project model choice appropriate? Where there any surprises during your project? How would you have planned it differently? Where there any differences between your plan and what actually happened? What would you do differently? Also, are you able to support your points from comments that you have left in your project log?

Reflections

When I’m not a computing tutor, or working on module teams, I'm also an OU student. A few months ago, I was attending a tutorial where a tutor said something about essay writing that was really simple, which really resonated me. My tutor said ‘whoever is marking your EMA wants to see your thinking’. This principle applies as much to your Computing EMA as it does to an English literature essay.

There is another phrase that I have picked up from my studies that is useful; there is a creative writing adage, which goes ‘show, don’t tell’. Show the reader what is happening, rather than tell the readers what has been done. The same principle also applies to good Computing EMAs. Show the examiner what you have done (show them your code, and show them the problems you have solved), rather than just telling the examiner that you have done something. Examiners always look for evidence. Show what you have built, and show your thinking. I think the mathematicians have their own expression, which is (of course), ‘show your working’.

My final point is: reference everything. By showing your reading, you also show your understanding.

Permalink Add your comment
Share post
Christopher Douce

Critical thinking and writing (Intermediate)

Visible to anyone in the world
Edited by Christopher Douce, Wednesday 14 June 2023 at 08:32

On the evening of 13 June 2023, I attended a university wide session about critical thinking and writing, which was delivered as a part of the Student Hub Live programme. The event was facilitated by Margaret Greenhall, study skills specialist, and OU tutor in Science, and was supported by another tutor, Nicky Mee. An edited recording to this session is available through the Student Hub Live website.

Margaret presented what could be described as a “a buffet of ideas” to help students to work through ideas and concepts they are presented with during their studies. Whilst it is intended to be a starting point, the buffet presents some really useful tools that could be used by anyone who is approaching the study of a new subject. It may also be useful for anyone who needs to do a review of a topic, or to carry out a literature review.

We were given a lot of notes to download, which shared some of the key concepts which I hope to summarise through this short blog.

What follows is my own notes from the session, which are presented, of course, from my own perspective, complete with my own understandings (and misunderstandings!)

What does critical thinking mean to you?

We were asked a question, and invited to respond by giving answers in a text box. We were then led towards a suggestion, that perhaps critical thinking could be thought of a pyramid, or hierarchy, which has a number of levels, such as:

  1. Content
  2. Validity
  3. Relevance
  4. Criteria
  5. Evaluation

These concepts could be unpacked further, by asking accompanying questions, such as:

  1. What? What is the content?
  2. Who? Who wrote it?
  3. Why? Why is it relevant to you and the problem?
  4. What? What is important with what you have found?
  5. How? How does it connect to other things and how is it useful?

In the following sections, I summarise how each of these key points were broken down.

Content: What?

A question I noted down during the presentation as: is this all about reading the information? We were also asked a question during the session: what do you do before you read the course materials? This question led to a short activity, where we were shown sections of text.

There was an important point which was made here, which is: critical thinking starts before you read the assessments; you’re gathering criteria before you start. Critical thinking before reading helps to prime oneself with respect to what things we will be looking at.

I made a note of some tips: read the TMA first, write down your own questions, look at big picture and detail, leave things overnight before reading in detail, and then go back to review the material. I might have imagined this, but I’m pretty sure that spider diagrams were mentioned too.

Validity: Who?

In other words, where did the information come from? This connects to the source of the material. Who wrote it? Did it come from a reputable source.

The tool that we were introduced to help us think about validity was PROMPT: Provenance, Relevance, Objectivity, Method, Presentation, Timeliness. There is some accompanying OU materials about PROMPT on the OU website.

Another tool, which was gently rephrased as being ‘CAARP’ serves a similar purpose: CRAAP: Current, Relevance, Authority, Accuracy and Purpose (University of the West of Scotland)

Relevance: Why?

Simply put, why is something important? It is very well looking at an article and thinking you know something is important, but why is it really important? 

One tool is to keep continuing the ‘why’ question 5 times over. When you get an answer to the first ‘why’ rephrase it, and ask another ‘why’ question, until you create a chain of five of them. This might be the real reason why something is studied or examined. By rephrasing question, you dig deeper into the issue.

Criteria: What?

What is important? In other words, how do you make an evaluation about whether a particular article or source (or topic) is important in the context of the problem? A meta question (questions about questions) is: what questions would you ask what is important?

An interesting tool that was shared was something called the CIA Phoenix list (Wikiversity).

Three of the first questions from this list are: Why is it necessary to solve the problem?, what benefits will you receive by solving the problem?, and what is the unknown? The idea is to use this list to try to dig deeper to evaluate a problem. There is also a list of questions that relate to evaluating a plan.

One further question was asked, which was: which question (on the Phoenix list) is your favourite?

Evaluation: How?

How does everything all connect with each other. In other words, if you have found something out, how can you use it? When it comes to being a student, an evaluation is often expressed through a tutor marked assessment, which is often in the form of an essay.

One of the tools that might be useful for essay writing is something called PEEL, which is an abbreviation for: Point, Evidence, Explain, Link. In other words, you make a point, you evidence that point (with a reference), explain to the reader what it is (and why it is important in the context of an argument), and then add some words which link to the next paragraph. There could well be one PEEL per paragraph.

Another tool was introduced was PESELS, which is an abbreviation for: Point, Explain, Support with evidence, Evaluate (for or against), Link, Signpost to the next paragraph.

Reflections

I haven’t ever come across this particular pyramid before, but I do know of another (and arguably similar) pyramid, Bloom’s taxonomy (Wikipedia) which is likely to be more useful in terms of thinking about our own understanding and learning of a topic, as opposed to surveying, and reading. 

I had heard of the PEEL approach to essay writing, but I had not heard of the PESELS abbreviation; this just goes to show that there are always things to learn! Another tool that was unfamiliar to me was the Phoenix list, which looks quite useful in terms helping to reflect on what has been found about a subject. A lot was covered in a short time, and I will certainly have come round for another pass of this buffet.

The closing points were helpful, which included: critical thinking starts before reading, it takes time, and you need to spread it out over an extended period of time; it is something that can take days, since you need time to let things sink in.

It was also a quite a busy session, with up to 120 students attending. The session is, of course, one of a series on Student Hub Live. A later section will focus on the evaluation stage of the pyramid model. It was also interesting to learn about what general study skill support is available for students. There are, of course, recordings of other sessions that are available.

A final point: please don’t use Wikipedia in formal pieces of writing; always consider the validity of your sources. Formal references from the university library presented using the Harvard format, as described in CiteThemRight is always the way to go. 

Acknowledgements

Many thanks to Student Hub Live, and to Margaret Greenhall who was the presenter and facilitator of this session. The structure of this blog completely mirrors what she presented. I also have quoted from her directly when preparing these notes. I did try to find references for each of the tools that are mentioned in this blog, but I haven’t managed to track these down.

Permalink Add your comment
Share post

This blog might contain posts that are only visible to logged-in users, or where only logged-in users can comment. If you have an account on the system, please log in for full access.

Total visits to this blog: 4300831