head-teach on BlueSky l CEO I Coauthor of #TheNextBigThing and author of #LeadersWithSubstance I Blogger I https://xitter.cf/t.co/PdsAsfSpRT

Swindon, England
Joined May 2013
Matthew Evans retweeted
Summarising the arguments from us nasty oracy sceptics:
3
10
1
18
3,168
Matthew Evans retweeted
I found the Children's Commissioner's Childhood Lottery a frustrating read. I have no doubt more children have difficult childhoods in Middlesbrough than Surrey. But excluding obvious confounding factors and selecting on dependent variables is not a good way to make that case.🧵
6
14
12
56
22,058
“a single inspection continues to carry consequences disproportionate to the evidence that can reasonably be collected during a short visit.”
1
5
23
2,895
25 is not the magic maturity number. “some 8-year-olds can come out more mature than 25-year-olds” creativecure.substack.com/p/…
1
2
662
Matthew Evans retweeted
A fundamental rule of assessment is that there must be clear agreement about what is being assessed which is why “oracy” has so many problems. Even if you specify elements like “presentation skill, dialogic reasoning, confidence, listening,turn-taking, ability to disagree politely” etc., the problem is that these are all very different constructs. Vocabulary is knowledge, presentation is a performance and confidence is personal trait that is questionable as something you can even teach. Can they all be grouped together and assessed by individual teachers as a “level 7”? Or a “grade B”? These elements don’t all travel together or map onto one thing either: a confident speaker can have a very weak argument and vice versa. It’s not one thing. Do you grade each separately and average them? So a pupil scoring 9 for confidence and 3 for reasoning gets the same 6 in oracy as a pupil scoring 3 for confidence and 9 in reasoning? And “Dialogic reasoning” depends almost entirely on what the pupil knows about the topic under discussion: nobody reasons well aloud about something they understand poorly, so a reasoning score is basically a knowledge score without the knowledge specified. Another one is “Listening” which is essentially unobservable; we can only really infer it from what someone says next after the assumed listening. How do you measure that? And if a pupil responds well to what was just said, was that listening? Or was it knowing enough about the topic to have something to say, or being confident enough to say it, or being quick enough to get in before someone else? To get a speaking assessment anywhere near the reliability of a written one, you’d need many different tasks, each rated by trained assessors. Even if that was agreed, the workload would inevitably fall on overworked teachers. We can all agree dialogic talk is a very laudable end but it’s largely a philosophical disposition, but assessment as Dylan points out is something very different. It’s a question of precision, of measurement, of validity and reliability which doesn’t care about how philosophically worthy something is.
The psychometric issues in assessing oracy are significant, and generally underappreciated. In particular, including speaking and listening in GCSE examinations will make them less reliable, unless the amount of testing time is increased substantially.
14
14
2
41
8,345
Get past the click bait headline and read this. It may or may not be right, but it makes a complex argument understandable in a humorous way. neubroscience.substack.com/p…
396
Matthew Evans retweeted
**NEW POST** #352 Learning About Talk saysmiss.substack.com/p/lear…
2
1
5
646
Rather than snipe at each other on this platform about Oracy, why don’t we just get together and talk about it? 😉
4
1
19
1,853
Matthew Evans retweeted
You can only speak eloquently about things you know well. Honing speaking skills is about as useful as attempting to teach reading comprehension skills: there are a small number of useful strategies, but by far the best way is to teach subject knowledge exceptionally well. 1/
We’re hardwiring oracy into the revised National Curriculum, so speaking, listening, and communicating will light up every classroom. Read @LucyMPowell's speech in full: gov.uk/government/speeches/e…
16
36
6
177
22,272
Matthew Evans retweeted
I've started a substack. First up, a series co-authored with @PepsMccrea exploring 'evolutionary mismatch' - the idea that some of the challenges we experience in life are the result of a mismatch between the world we live in and the one we evolved for... substack.com/home/post/p-218…
5
5
1,258
If Ofsted is judging school standards, context is irrelevant. If it is judging school effectiveness, context is everything. The problem comes when they do the former but it is interpreted as the latter.
8
20
5
91
19,132
“Properly understood, it makes accountability more demanding, more intelligent and more truthful. It helps us identify where schools are transforming lives, where children are overcoming the greatest barriers and where apparently impressive outcomes may conceal complacency.”
1
1
6
1,189
Matthew Evans retweeted
Inspection should identify those schools who are breaking the mould for schools in their context so others can learn from them ... And identify those who really should be doing better given their context, so they can be challenged and supported.
3
1
10
988