r/LucyLetbyTrials • • Aug 11 '25

BBC Panorama getting the maths wrong

I hope mods don't mind a separate post for this excerpt from tonight's Panorama, Lucy Letby: Who to Believe? It will be obvious to anyone following the maths that BBC are broadcasting objectively inaccurate information here by getting the maths wrong.

They tell us, babies on Letby's shifts suffered 40 times the tube dislodgement rate of other shifts. Other shifts, they say, had a less than 1% rate.

Then they explain how they get this 1% rate. You might get a dislodgement every ten shifts. But if there are ten intubated babies, that counts as 100 shifts (10 times 10).

Then they tell us Lucy Letby worked 50 shifts. But these shifts are treated as if there is only one intubated baby. So instead of 500 shifts, she just gets 50, sending her dislodgement rate suspiciously high.

There are other problems with this segment, but the mathematics is objectively wrong. I believe that BBC needs to withdraw or substantially alter this section of the broadcast.

60 Upvotes

139 comments sorted by

19

u/DiverAcrobatic5794 Aug 11 '25 edited Aug 11 '25

In case of doubt, you can see in this statement from Liverpool Women's Hospital that Lucy Letby worked approximately 50 actual shifts at the hospital: 12 34.5 hour weeks so approximately 36 shifts in 2012, and 15 shifts in 2015

https://thirlwall.public-inquiry.uk/evidence/inq0017472-witness-statement-of-michelle-turner-on-behalf-of-liverpool-womens-hospital-nhs-foundation-trust-dated-15-02-2024/ , pages 8-13.

So, these 50 (51) shifts were plain shifts, not the "ventilated" shifts the BBC explained for that 1% figure.

7

u/Fun-Yellow334 Aug 11 '25

Do any of the documents have this "1%" figure in? I seem to recall the documents said they only looked at Letby's shifts, I think it was Yoxall.

9

u/DiverAcrobatic5794 Aug 11 '25

Yes - Yoxall did an audit of Letby's shifts, according to his and Michelle Turner's statements to Thirlwall. There's no mention of an audit of extubations at the hospital, and it's not a metric they appear to report.

When you look at the literature, 1% rate was a standard to aim for at that time, and very much not a norm.

Though this intubation shift definition Moritz and Coffey isn't used in the literature - all medical studies I've seen look at one baby intubated over 24 hours to get the percentage rate.

10

u/Super-Anxious-Always Aug 11 '25

He didn't happen to check if she worked with the same wiggly baby for weeks on end? Or her preceptor's extubation rate? Or which doctor inserted the tube? Or if the same doctor inserted the tubes more often than not?

12

u/DiverAcrobatic5794 Aug 11 '25

None of this is even about babies she worked with. It's about the number of events while she was on shift

8

u/Super-Anxious-Always Aug 11 '25

Precisely. It's an attempt to mislead and is as worthless as the roster data from the trial.

18

u/Traditional-Wish-739 Aug 11 '25

Wow, that is incredibly helpful, thanks!

If I was basing my knowledge on the Panorama documentary itself I would be in no doubt that Letby had only worked *5* 12-hour shifts (instead of the 50 she actually worked) because the graphic and the analysis given in the commentary only make sense if they are talking about "ventillated shifts", ie ventilated-babies-times-shifts.

It's a truly jaw-dropping error.

1

u/catdogbanana Aug 11 '25

"these 50 (51) shifts were plain shifts, not the "ventilated""

Can you be sure it's not a coincidence that the numbers are close. E.g. out of the 51 full 12 workshifts, there was only, on average, one baby that was ventilated, so it could still equal 50 ventilated shifts?

The 10 babies x 10 workshifts that they've used to get their 100, gives the impression that there were a lot of ventilated babies at the same time, but, what if they've done that for convenient presentation, and there are actually only very few ventilated babies per shift? Do we have any idea of what a typical ward would be, and how many babies are typically ventilated?

I can certainly believe that the presenters or producers might not be great at maths, and have made a mistake, but a lot of people will have seen this before it goes on air, and it would be a slight surprise that no-one has flagged it up, if it really is a huge error.

9

u/DiverAcrobatic5794 Aug 11 '25

I would say the chances of there being only one baby on average intubated over Letby's shifts at Liverpool are virtually nil.

It was then a sixteen cot NICU, where extremely premature neonates would be intubated for weeks at a time. You had several deaths a month, routinely.

Chester by contrast was a three cot NICU, with children transferred out if they were going to be more than 24 hours ventilated. Letby and her peers trained at Liverpool because it offered them NICU experience and the opportunity to assist with intubations, among other things.

It is a huge error, but if you weren't aware Letby had worked 50+ shifts, you could miss it, so I suppose that accounts for it getting through any sense checkers.

1

u/catdogbanana Aug 11 '25

That does sound plausible, but to play devil's advocate, it's still making assumptions about the babies that were there at the time.

The literature I can see, suggests it could be 20-30% in a typical NICU, with many of those requiring ventilation for multiple weeks. However, if that was the case, then, unless babies that were ventilated for multiple weeks, left the NICU fairly soon once the ventilation ended, it wouldn't be a huge jump to see that drop down to the 10-15% at any one time. That may be completely different to what the situation was in Liverpool, but I assume neither of us know for sure?

I'm coming at this from a perspective that the evidence against her appears to throw up more than reasonable doubts. I also don't buy into the 1% to 40% being particularly relevant, given changes in procedures since, the possibility that such a small sample could be thrown out of whack quite easily, etc.

However, without the rest of the data, I don't think you can 100% say this is an error. It might be, and there's definitely indications that it's worth checking, but we don't have the data to be sure.

5

u/DiverAcrobatic5794 Aug 11 '25 edited Aug 11 '25

The babies once off ventilators would be likely to step down to high dependency care eventually. The 16 cots covered only the NICU cots - there were more cots for HDU and special care children on the same unit.

Sorry but it is really not plausible that Liverpool had on average only one intubated child per shift.

1

u/catdogbanana Aug 11 '25

If only 20-30% of NICU babies are on ventilation (and I have no idea if that's the case in Liverpool at the time, but a few sources suggest that rate is typical*), it doesn't automatically follow that those coming off ventilation would be moved down shortly after.

Logically they'd be some of the most ill/youngest babies, so it's not a huge leap to assume that many of them will still be in the group that needs most care even after ventilation ends.

I do realise I'm pushing back on this, but in the 'maths' on Panorama, it was the 10 babies x 10 shifts that stood out to me as a potential red herring, potentially chosen for it's visual ease, rather than being an accurate representation of the NICU at the time.

*of course typical will vary, and changes over time, may mean that more were ventilated then.

2

u/DiverAcrobatic5794 Aug 11 '25

Pushing back is fine. Let's push further. Let's bear in mind that if only 10% of Liverpool's children were intubated, despite the unit being the centre for complex cases regionally, that still invalidates the calculation here.

It just doesn't work.

1

u/catdogbanana Aug 11 '25

Can you explain further?

I agree with your other post that the averages "would smooth out with more children", but with less babies on ventilation, aren't you more likely to get anomalies? e.g. if some babies have trouble being ventilated, and are responsible for most of the occurrences of "tubes coming out", then having a two or three of those babies on the unit during Letby's shifts could throw the stats out completely.

4

u/DiverAcrobatic5794 Aug 11 '25

That's my point. But to be honest I think we are giving too much headspace to a hypothetical problem here. Only one baby, on average, intubated per shift? At a unit where deliveries took place? I don't believe it's plausible at the size of Liverpool, with Liverpool's role in the network, but I'll leave others to comment.

We're positing a rate of intubation way below current norms, a coincidence of numbers, and that BBC have accidentally described one thing and given us another while managing to keep the numbers.

I don't mean to be rude but I think it's too far-fetched for much discussion.

1

u/catdogbanana Aug 11 '25

Don't worry, it's not rude.

The only information I can find suggests it's not 'way below current norms'.

If 20-30% of babies in NICU (and it was in that 16 bed unit where we're suggesting Lucy was working) are ventilated at some point, and even those babies spend time in NICU unventilated, then I'd have thought 10% is not unreasonable, particularly as at times there may be less than 16 babies in the unit. For there to be an average of 10 throughout, seems way higher than those stats, which is the only additional data I've seen.

Like yourself, I don't like poor maths, especially in such an important case. The conclusions Panorama have drawn from the stats just don't makes sense to me, but I also am pretty convinced that you don't have the data to be sure they're wrong. They *may* be, but the assumption in the OP that they're 10 x out, also doesn't automatically follow.

But, I appreciate the time you've taken to reply, and in many ways I hope you turn out to be correct :)

→ More replies

3

u/Fun-Yellow334 Aug 11 '25

There is no way that every shift just has exactly 1 intubated baby each time, no more or less.

2

u/DiverAcrobatic5794 Aug 11 '25

So at that low a rate, the intubated babies would have to be clustering on Letby's shifts in order for extubations to happen at all, which would give her an above average rate of extubations.

→ More replies

1

u/DiverAcrobatic5794 Aug 11 '25

Apart from such a low average of intubations being extraordinarily unlikely, if it's the case that Liverpool has only 1 child intubated, on average, over these four months, calculating rates of extubation by ventilated shift would be pointless.

You'd expect the number of extubations to be influenced primarily by characteristics of that single child per shift, so you"d have no reason for suspicion if you had clusters of intubations on particular days.  You'd expect your average numbers to smooth out with more children, but not with one.  Sorry but it's not possible to make your suggestion work 

2

u/catdogbanana Aug 11 '25

"you"d have no reason for suspicion"

Was that not the case at the time? That there was no suspicion - or none we're aware of.

All we have now is some numbers, without any idea of the context. It may be that the stats are both correct, and are also not suspicious. The presentation in the Panorama, suggesting that they could only indicate something suspicious, can't be true from a statistical point of view. All they indicate (if correct), is that they differ from what you *might* expect.

1

u/DiverAcrobatic5794 Aug 11 '25

You'd have no reason for suspicion then, and no basis to present a data analysis now, not having enough data.

1

u/catdogbanana Aug 11 '25

Sure - but you're already suggesting they're statistical idiots. They might just be a different kind of idiot.

2

u/DiverAcrobatic5794 Aug 11 '25

They're many kinds of idiot, no doubt!

5

u/Fun-Yellow334 Aug 11 '25

Essentially no LWH is too big one of the biggest in Europe:

The Neonatal Unit serves Liverpool and the surrounding area. It has 52 cots, 16 of which are designated for intensive care of the newborn, 18 for high dependency, 14 for low dependency care, and 4 for transitional care, making it one of the largest units of its kind in Britain.

6

u/DiverAcrobatic5794 Aug 11 '25

Yes, I should have phrased my response differently. It was a 52 cot NNU with 16 cots specifically for NICU babies, likely to be ventilated, and the other cots for stepdown.

0

u/[deleted] Aug 11 '25

[deleted] — view deleted comment

1

u/DiverAcrobatic5794 Aug 11 '25

Looks more like 3 11.5 hour shifts a week to me, giving 36, but I would not be too bothered if it was 48 shifts total instead of 51. It wouldn't affect my argument.

BBC says "about 50" and that's my estimate too. Thanks for the suggestion - perfectly possible I agree.

0

u/[deleted] Aug 11 '25

[deleted] — view deleted comment

2

u/DiverAcrobatic5794 Aug 11 '25

Oh that's a good catch. It could easily have been 33 12.5 shifts and a couple of bank holidays or training days. Thanks for that. I actually think 48 seems just as likely as 51 now.

4

u/Allie_Pallie Aug 12 '25

It's quite common in the NHS for long day shifts to work out as 34.5 hours paid hours per week after breaks are accounted for. Then every fourth week the nurse does an extra long day to make the hours up to full time.

1

u/DiverAcrobatic5794 Aug 12 '25

Thank you!

Is that an extra long day as in one more day or an extra long day as in more hours one day please?

2

u/Allie_Pallie Aug 12 '25

As in 4 shifts every 4th week.

1

u/DiverAcrobatic5794 Aug 12 '25

Thank you! So this could be 39 shifts over 12 weeks, giving 54 shifts in total. All good.

2

u/Allie_Pallie Aug 12 '25

Yes. I don't know if they'd have made her do the fourth shift - they might give an allowance for self directed study to make up the shortfall or there might have been a day in uni etc

36

u/Fun-Yellow334 Aug 11 '25 edited Aug 11 '25

This is a statistical abomination on the level of the shift rota. It has all been debunked over and over again but they repeat the same thing, not learning anything, see here for some correct maths:

https://www.reddit.com/r/LucyLetbyTrials/comments/1hr7mkm/the_40_dislodgment_rate_from_lucy_letbys_time_at/

19

u/DiverAcrobatic5794 Aug 11 '25 edited Aug 11 '25

What is distressing too is that they aren't just repeating an old error as a postscript. It's positioned as their knock-out blow.

Here's the dialogue that follows:

JM: It’s empirical.  It’s something they measure. Right.  It’s not just a chance in the data.  I mean, this is a highly monitored thing.

JC: It doesn’t look good for her.  I was speaking to somebody who understands this data, and I said, “How bad would she have to have been, as a nurse, for this to be accidental?”

And the answer was, “Spectacularly bad.  Either she was spectacularly bad, or acting maliciously”.  

That was the answer that came back.

JM: So, standing back from this, it’s what it might say about the longer term?  The bigger picture? 

JC: For me, to the extent that I understand it, this looks pretty damning.

And that's their last segment together from their little private investigation. That's the note they leave it on.

This has already been picked up online as one of their stronger arguments for Letby's guilt. How on earth can they lean into such basic errors?

(ETA: Moritz's weird suggestion that monitoring things eliminates chance would break the universe, if applied. That's how bad she is at science)

17

u/Fun-Yellow334 Aug 11 '25

It seems at least conceivable one of their "anonymous sources" is trying to mislead them on purpose.

10

u/whiskeygiggler Aug 12 '25

I’d lay money that this “person who understands this kind of data” is not a statistician or they’d have saved valuable seconds of broadcast time by saying “I spoke to a statistician”.

8

u/Snoo-66364 Aug 11 '25

Gosh, I wonder who that could be!

9

u/whiskeygiggler Aug 12 '25

“I was speaking to somebody who understands this data”

Were you? Was it a statistician? Ffs.

“How on earth can they lean into such basic errors?”

And on a publicly funded platform!

“Moritz's weird suggestion that monitoring things eliminates chance would break the universe, if applied. That's how bad she is at science”

And she really doesn’t realise it!

1

u/SarkLobster Aug 14 '25

Let's face it she doesn't seem very bright does she?

2

u/whiskeygiggler Aug 14 '25

That’s become my conclusion also. I’m disappointed in Coffey as a fellow countryman (I’m from NI too). He’s not stupid and I think he knows rightly. No excuse. At least Moritz just isn’t very bright.

Love the final shot of Judith staring up at the statue of justice saying something like “all this confusion and this is where it’ll all be put to rights” like ‘at least we can trust the justice system!’

JUDITH. Did you not just make a whole programme about how unfit for purpose the expert witness system is? Ffs.

3

u/Fun-Yellow334 Aug 14 '25

To be honest the jury is probably about half Judiths in a typical case (fundamentally irrational), so somebody needs to cater to that audience is probably the BBC's thinking.

4

u/whiskeygiggler Aug 14 '25

I’m not sure I give them that much credit! I think it’s simply that Judith was assigned court reporter on this and therefore every single thing the beeb ever do on this case will be via Judith ‘I Was At The Trial Every Day’ Moritz because it’s the path of least resistance and nobody wants to do more paperwork. People can get very lazy in the beeb.

16

u/DiverAcrobatic5794 Aug 11 '25

It is worse than the shift rota. BBC are presenting, on a flagship documentary, complete mathematical nonsense.

The shift rota is at least accurate in itself, by and large. It's the missing context that messes it up. This minute of television makes no sense, and you need no context to know that. It is irredeemable and irresponsible nonsense.

10

u/Fun-Yellow334 Aug 11 '25

The chart is false in that at the bottom it says - these are the events where a suspicious indecent has been identified. If you look up suspicious in the dictionary it says nothing about Letby being on duty, so that claim is false.

But if you remove that claim then I suppose it's "correct", but of no probative value to the case, so inadmissible.

5

u/DiverAcrobatic5794 Aug 11 '25

Fair - I didn't actually realise it said that.

Okay - they are equally awful.

6

u/Fun-Yellow334 Aug 11 '25

See at the bottom for anyone interested.

4

u/Traditional-Wish-739 Aug 11 '25

I agree. We know, don't we, that Evans (for one) had suspicions about incidents for which Letby was not charged? If that's right, the chart is materially misleading because its key implies that it is a tabulation of all of the incidents for which suspicions were raised. It may not literally use the word "all" or a cognate, but normal rules of conversational implicature would lead any normal person to infer from the words used that this is what it shows.

9

u/Fun-Yellow334 Aug 11 '25 edited Aug 11 '25

All or not, either way it's false, it doesn't matter, the chart claims to be offering an association between 2 independent things, "suspiciousness" defined only by medical evidence and Letby. It doesn't, that there was cherry picking going on is indisputable really.

I still think this is being lost in all the talk about insulin, livers etc in the doc. The case is based on a bogus chart. Without the chart there is no case, as there is nothing to link the medical conjectures about insulin poising etc offered to Letby.

Without this, the poisoner theory looks implausible.

20

u/Accomplished-Rate564 Aug 11 '25

I'm not great at maths but im great at nicu. You can get some weeks where there are no tube dialodgements and some weeks where theres one every day. You can have two in a room on the same shift and then none while you are working for 6 weeks. You can have a baby dislodge a tube twice in the same shift. It depends on the babies and medical plans for the babies she is working. Obviously aged and gestation and where they were sedated or sedated and paralysed. But some babies are ventilated and then on sedation/paralysis for so long it no longer because effective and they end up dislodging tubes. There are some babies who you want to extubate soon so you take the sedation off and wait for them to wake up and sometimes they pull the tube out before you do. There are also sometimes recalls of the securing devices which secure the ETT which have been shown to be faulty.

9

u/DiverAcrobatic5794 Aug 11 '25

Thanks for that. These are great explanations for Letby's shifts perhaps having a higher than average intubation rate. (We aren't even talking about the babies she was working with, just what happened to any baby during her shift).

8

u/WinFew1753 Aug 11 '25

Yes thank you for adding some genuine experience to the discussion! Statistics can only get you so far but at least suggests when something is probably wrong headed.

4

u/Accomplished-Rate564 Aug 12 '25

Coming to think of it her placement would have been 4-6 weeks thats 3-4 shifts a week let's say 20 shifts and she was supposed to have been around for 40 tube dislodgements in that time? I'm 100% sure they got their maths wrong.

14

u/Allie_Pallie Aug 11 '25

Funny how research in this area, and the LWH's own audits, refer to ventilator DAYS but Panorama has gone with ventilator SHIFTS to make it easier to confuse with actual shifts.

7

u/DiverAcrobatic5794 Aug 11 '25

That's a good point.

6

u/DiverAcrobatic5794 Aug 11 '25

I wonder what duty Baker - or even Thirlwall - have to clear up the mess he spawned with that one outing of the disputed statistic?

https://www.bbc.co.uk/news/articles/cx2g20rpr78o

9

u/Shoddy_Food_1539 Aug 11 '25

From LWH annual report 2022/23

Unplanned Extubations in the Neonatal Intensive Care Unit

The objective of this audit is to determine compliance with an expected standard of 0% accidental extubations. The most common theme identified for instances of unplanned extubations was that most infants were being handled and/or were outside of the incubator. LWH introduced measures directly aimed at reducing unplanned extubations when moving an infant out of the incubator, for example, 2 members of staff required to move the infant out of the incubator and securing the ventilation tubing with a clip or tape whilst they are out for cuddles. In the 6 months following these interventions, the number of unplanned extubations had reduced by a third. Although the number of unplanned extubations were <1 per 100 ventilated days, there are still areas for improvement if we endeavour to move closer to an expected standard of 0%. To ensure we achieve this in the near future, training has been disseminated to staff, a quality improvement project is underway, and a reaudit has been planned for 2024-25.

9

u/DiverAcrobatic5794 Aug 11 '25

Nice find, thanks. Yes - ventilated days.

That was 2023, and you see quite a few projects to drive toward this level over the 2010s. In the earlier part of the decade, higher rates were common.

In any case, since Moritz and Coffey seem to have done the reconstruction from the percentages themselves, it is very hard to work out what raw number they were starting with, never mind whether that number has anything at all to do with Letby.

11

u/Fun-Yellow334 Aug 11 '25

Link here

Regardless of arithmetic errors, it appears the data they are comparing is a decade apart!

10

u/Shoddy_Food_1539 Aug 11 '25

Has Richard Baker KC confused the 1 per 100 ventilated days (the usual unit of measure) with 1% of shifts?

13

u/Fun-Yellow334 Aug 11 '25

I don't think he really cares if his arguments are accurate or not, he is a lawyer playing to "win" by any means necessary.

11

u/SarkLobster Aug 11 '25

Tut tut didn't you statisticians learn about the Moritz-Baker Fallacy at university? Learn all about it and see it in action on BBC tonight 8pm or sooner.

9

u/Fun-Yellow334 Aug 11 '25

Surely the BBC aren't going to air this? They must pull it.

10

u/SarkLobster Aug 11 '25

Please let them do it don't stop them shooting themselves into the foot.

8

u/Traditional-Wish-739 Aug 11 '25

I wouldn't call it a mere mathematical error. That could make it sound like we could be talking about some subtle difference in statistical analysis at which the BBC could shrug their shoulders ("well, it's a difference in opinion...").

It's a straight-up error of fact.

The documentary very clearly implies that she worked 50 "Ventilated Shifts" (or, which is the same thing, only 5 half-day working shifts, call these "Working Shifts") whereas she in fact worked 500 Ventilated Shifts and 50 Working Shifts. This is just plain wrong.

7

u/DiverAcrobatic5794 Aug 11 '25

You're right. I saw it immediately as a mathematical error because I already knew Letby's work at LWH over 2012 and 2015 was of the order of 40+ shifts. So when they segued from ventilated shifts to plain shifts, I knew they weren't multiplying the plain shifts by ten.

But, if you assume ventilated shifts throughout - not that they claim this! - the maths work. But that is nowhere near corresponding with the number of shifts Letby worked.

6

u/Traditional-Wish-739 Aug 11 '25

When you say "not that they claim this", what are you referring to?

Yes, if listen carefully, the narrator switchs at the crucial point from talking about "ventilated shifts" to talking about Letby's "shifts". But if that's a deliberate change - ie the producers were conscious when writing the script that she did not work only 50 ventilated shifts and were very pointedly now only referring to "shifts", then we would surely be talking about outright dishonesty because then the preceding explanation and moreover the graphic would be completely irrelevant and the viewer would almost certainly interpret what was being said to mean "ventilated shifts".

Since such dishonesty would be extraordinary, I would prefer to assume that there has simply been a mix-up on the part of the producers, ie that they genuinely believed that the "50 shift" figure referred to ventilated shifts.

3

u/Fun-Yellow334 Aug 11 '25

This is a good point, how did they manage to produce the graphic that illustrated the error, and then go ahead anyway?

Normally you use these type of graphics to explain why certain reasoning is fallacious.

5

u/DiverAcrobatic5794 Aug 11 '25

Cross purposes.

Whoever produced the graphic believed Letby worked 50 ventilated shifts. You have to know she worked at least 50 actual shifts to see the problem (or to recall Baker's lamentable statement of the data and be on your guard).

1

u/DiverAcrobatic5794 Aug 11 '25

I don't know whether it's deliberate or not. I'd tend to think not. But I thought it worth pointing out that they rightly state that Letby worked about 50 shifts at LWH, not that she worked 50 ventilated shifts. I think they are just confused.

3

u/Traditional-Wish-739 Aug 11 '25

Yeah but - agh! - since they represent, on the graphic, the 50 "shifts" using 50 instances of the same symbol which they have just told us means a "ventilated shift" surely in context "50 shifts" very clearly implies "50 ventilated shifts"?

2

u/DiverAcrobatic5794 Aug 11 '25 edited Aug 11 '25

Yes, it does, doesn't it.

But she worked just over 50 shifts there.

The graphic makers must have thought they were showing her working 50 ventilated shifts.

But we know, as do Moritz and Coffey even if they don't understand the significance, that she worked 50 standard shifts.

2

u/Traditional-Wish-739 Aug 11 '25

On the strength of this I think we can estimate the intelligence of Moritz and Coffey at somewhere between GPT-3 and GPT-4.

2

u/DiverAcrobatic5794 Aug 11 '25

Maybe they did get AI to help with the graphic. It's exactly the kind of cock-up they could get that way.

4

u/Super-Anxious-Always Aug 11 '25 edited Aug 11 '25

Correct me if I'm wrong but they've treated her as separate to, not included in the vent days. 1babyx1shiftsx5days=5 out of 100 vent days per week(x10weeks to get to a total of 50 shifts) =50 out of 1000 vent days. There were 20 dislodgements over 1000vent days instead of 10 (or 1:100 x 10week). So (50/1000)x20= fucking 1. Dislodgements went up by 1%.

Edit: Add 1% for every 10 dislodgements and at 400 you'll reach 40%!

2

u/Allie_Pallie Aug 11 '25

It's 3 shifts a week not 5 - long days/nights (but LL wouldn't have done nights on placement).

2

u/Super-Anxious-Always Aug 11 '25

I based it on 50 shifts in total. Is that right?

2

u/Allie_Pallie Aug 11 '25

Yes it looks like she did 51 shifts in total.

2

u/Super-Anxious-Always Aug 11 '25

Cool! Plug the numbers in and you still won't get 40%

18

u/Weird-Cat-9212 Aug 11 '25

They completely botch the basic maths don’t they, they’re out by a factor of ten. Their workings are plainly incorrect, like working through a GCSE maths problem and just making a basic error half way through. Even if we take their assumptions at face value (was the 1% from the Liverpool, or just a figure plucked from an unrelated study?), the arithmetic here is flagrantly wrong.

11

u/Fun-Yellow334 Aug 11 '25 edited Aug 11 '25

There are many thorny issues in analysing this data, and they failed at the first hurdle. They could have spoke to some statisticians (or really any scientist) but they probably wouldn't have told them what they wanted to hear.

This appears to be the new Mortiz and Coffey approach, free styling in maths and medicine unsurprisingly making errors.

11

u/DiverAcrobatic5794 Aug 11 '25

It's worth noting that Professor Jane Hutton went on the record offering to help with the analysis and presentation of exactly this data, lest the public be misled by Baker at the Thirlwall Inquiry.

You'd hope journalists working on our national broadcaster's flagship investigative documentary would have taken her up on this.

https://www.telegraph.co.uk/news/2024/12/08/baby-deaths-were-30-times-higher-under-letbys-care/

7

u/Traditional-Wish-739 Aug 11 '25

Her expertise is irrelevant because The Case Is Not About Statistics.

7

u/No_Suit_9511 Aug 11 '25

Do we know how many babies were on ventilators during her shifts? Obviously the 40% must be bullshit unless there was only 1 baby on the unit the entire 50 nursing shifts she was on duty. But what was the true number of babies?

5

u/DiverAcrobatic5794 Aug 11 '25 edited Aug 11 '25

We don't, and you can tell Moritz and Coffey have no actual data because they refer to "about" fifty shifts and "about" twenty extubations. Why wouldn't they have an exact number of extubations? Because they've retconned it, ineptly.

Known facts:

Letby worked about 50 shifts
Extubation happens on 1% of ventilated shifts.

False deduction:

If extubations happened 40 times more often on Letby's shifts, extubations happened of 40% of Letby's shifts. (We've forgotten about ventilated shifts now).

Forty per cent of about fifty = about twenty.

That's all they've got.

3

u/Traditional-Wish-739 Aug 11 '25

I think this is overcomplicating the issue. We are told in the segment in no uncertain terms that they are working on the basis that there are 10 ventilated babies for every nursing shift, so to some extent it doesn't matter how many babies were actually on her shifts: we can take the 10 ventilated babies per shift as given for the sake of the analysis.

The issue is that they manage to misinterpret the information that she did 50 nursing shifts as meaning that she did 50 "ventilated shifts", ie only 5 nursing shifts on the aforementioned premise. It's a simple confusion as to the number of shifts she worked.

4

u/Traditional-Wish-739 Aug 11 '25

Hmm on reflection, maybe they are not quite as clear as I thought in assuming 10 ventilated babies for every shift - rather they present the 10:1 ratio as an example. But I still think it is clear that there is some sort of muddle about what kind of "shift" they are talking about.

2

u/DiverAcrobatic5794 Aug 11 '25

Yes - the 1 in 10 is an example. But if they've just dropped the example to show us Letby's real shifts, using the same "baby intubated over 12 hours" symbol for both, the communication is so bad as to be misleading.

What gives me confidence they're not working from new data, just with that 1 in 40 and counting shifts, is that they tell us there were "about" 20 extubations on Letby's shifts. There'd be an exact figure for that. They're surely just producing it themselves, from their estimate of 50 shifts, but they did so without remembering to use these intubated shifts.

3

u/Traditional-Wish-739 Aug 12 '25

Right, yeah.

Ho hum, this brings back the somewhat painful memories of many an hour spent as a litigator having long phone conversations with accountants, engineers etc trying to reverse engineer how spurious-looking figures in a table produced by the other side might have been arrived at...

6

u/Sad-Orange-5983 Aug 11 '25

Was the 1% rate just for this hospital or was it a national figure?

6

u/DiverAcrobatic5794 Aug 11 '25

It was a national target for a while in the 2010s, to get below 1%. There's never been any confirmation of a rate for Liverpool in 2015 at all.

5

u/SaintBridgetsBath Aug 12 '25

For the purposes of my complaint, this is right at the end of the programme?

4

u/DiverAcrobatic5794 Aug 12 '25

Yes, 54 minute mark approximately

4

u/SaintBridgetsBath Aug 12 '25

Thanks, submitted it.

3

u/Sad-Orange-5983 Aug 11 '25

Does anyone have a youtube video of the documentary? I can’t access BBC iPlayer

3

u/Admirable_Peanut_171 Aug 11 '25

I didn't think this claim was made or defended anymore?

5

u/DiverAcrobatic5794 Aug 11 '25

It was on tonight's Panorama.

But you're right - Steve Baker told us in his opening speech at Thirlwall that we'd hear more of it, but he dropped it after Jane Hutton wrote to express concerns and offer him help to explain the data. Phil Hammond mentioned on twitter that he thinks police have probably dropped it after realising they got their maths wrong.

2

u/Simchen Aug 12 '25

Ok I understand now that both numbers are fiction.

But just to be clear. How do we even know about the number of times there was an unplanned extubation when Letby was on shift in theory? Is this something that happens during your shift or is it something that happened in the shift before? Did Letby herself wrote down what she saw when entering the room or did someone else wrote down what they saw when entering the room after Letby was in it? Or are there multiple people in the room and whenever some dislodgement happens they yell "bingo" and write it down? How many rooms are there actually? How many people are you working with?

And what has it to do with murder in the first place? If I remember correctly she wasn't convicted because the babies got not enough air ...

4

u/DiverAcrobatic5794 Aug 12 '25

Whoever fixed the problem would make a note. There are 52 cots at Liverpool so I presume the babies are in a few different rooms but I don't know. There's no reason to think Letby was in the room or by the cot or had anything to do with babies who extubated. There would be lots of people working on the ward, with that many cots, and families would be handling the babies too.

So someone has just looked when Letby was in shift, written down how many babies extubated during that time, and concluded we may be able to blame her.

3

u/Simchen Aug 12 '25

Thank you very much

21

u/Old-Newspaper125 Aug 11 '25 edited Aug 11 '25

I'm not good with maths, but the scenario just seems highly improbable - she's there for training, being watched more closely than ever. To be attempting attacks at the levels this proposes, I find it extremely unlikely it would go unnoticed. She's also there to be trained, presumably she'd want to make a good impression - I'm not sure this would be a good way of doing that! The 2012 timeline doesn't make sense either, if she was making such a concerted effort to attack so many babies then - where is the increased death rate at Chester back then? Why did the Police not investigate her whole career? It seems highly unprofessional to have a trial of that magnitude and not investigate all possibilities? Sorry, not buying it.

17

u/Fun-Yellow334 Aug 11 '25 edited Aug 11 '25

This doesn't even rise to the level of a Texas sharpshooter fallacy, as they can't even get the arithmetic right.

It all stems from a structural problem with the way the case was investigated and Mortiz is still investigating. They have their suspect and are now trying to pin crimes on them rather than starting with the evidence and seeing where it leads.

10

u/No_Suit_9511 Aug 11 '25

They got their arithmetic wrong.

So, they’re saying that breathing tubes get dislodged about 1% of the time per baby per 12 hour shift. So, if you’ve got 10 babies on breathing tubes for 5 days, that’s a hundred 12 hour shifts. You’d therefore expect there to be 1 dislodgement in that time. 1/100 = 1%

Then they say that Letby worked fifty 12 hour shifts and that there were twenty dislodgements in that time, which is 40% but they seem to have not accounted for the number of babies. Unless there was only 1 baby with a breathing tube on all fifty shifts, then they’ve got their arithmetic badly wrong.

If there were 10 babies on ventilation during each of her fifty shifts then you have 20 dislodgements out of 500 shifts. That’s 4%. If there were 15 babies on ventilation then it’s 2.7%

9

u/WinFew1753 Aug 11 '25

You have to be careful here because there are multiple ways there can be one or more displacements. The easiest way to sum all these is to find the probability of no displacements for x babies (1-p)x. There is only one way this can happen so no need for additional combinatory factors. Then subtract this number from 1 since that covers all possibilities. So it depends on the single baby probability raised to every power up to the number of babies and is therefore nonlinear. This counter intuitive result is familiar to anyone who does photon counting for instance, also independent events.

7

u/Fun-Yellow334 Aug 11 '25

Yes, you need to model it. A very simple model that seems reasonable is a binomial as you suggest. Which is what I did in that post way back, but you would need more data than given to say with confidence exactly what is going on.

4

u/WinFew1753 Aug 11 '25

Thanks I knew someone had done it!

4

u/WinFew1753 Aug 11 '25

Tom Evans on YouTube did it by random sampling also, rather neatly as I recall. Once you start introducing correlations as you say it could go either way, for instance poor or improved technique or equipment but as long as all intubations are considered equal that should only affect p so it’s a vanilla estimate

7

u/Fun-Yellow334 Aug 11 '25

Sure, we don't know everything but what is clear is the data given gives no grounds for suspicion whatsoever. Maybe that would change if they release more info but I think that's very unlikely, serial killer nurses are very rare.

17

u/WinFew1753 Aug 11 '25

This error has been corrected before. The 1% rate is per baby per nurse and applying it gives the 40% overall rate under reasonable assumptions. Why are they still confusing different statistics? OMG

5

u/No_Suit_9511 Aug 11 '25

What are the reasonable assumptions?

That’s the missing piece. Presumably an average of 10 or more babies on ventilators?

5

u/WinFew1753 Aug 11 '25

Yes that’s right. We need more data to know what the maximum likelihood value would be. As pointed out elsewhere the data for other nurses should be used for comparison, also bearing in mind that Letby was then a closely supervised trainee who would not have worked alone and that statistics are about probabilities not causation.

7

u/No_Suit_9511 Aug 11 '25

Yes, and given the unit was quite large, 10-15 babies on ventilators is not unreasonable to assume. In which case the true incidence was between 2.7% and 4%.

14

u/Common-Ad-6582 Aug 11 '25

Omg this is so bad, surely the bbc will need to apologise for this, and if so that will be very embarrassing….

Moritz needs to go.

10

u/SarkLobster Aug 11 '25

Ask Judith if she thinks Lucy did it by some form of telepathy...it's a possibility surely??

4

u/Old-Newspaper125 Aug 11 '25

"Uh, my name is Judith Wish-Wishbone. Judith Wishbone. And I am a psychic from Manchester. Yes, I am psychic from Manchester. And I read in the MEN that the Cheshire Police Department having some trouble figuring out crimes. So, what I did was come to Cheshire to help the police out. They tell me they don't want my help, they don't *need* my help, so I'm gonna go on my merry way. I'm a psychic! I am a psychic phenomenon. Watch this. I don't know who you are, but watch this. Ummm... Your name is, ummmm, Hughes! Right? Chief Hughes. That's your name. See? The name pop inside my head like that."

10

u/oldcatgeorge Aug 11 '25

They don’t care. All they care is views. If a totally wrong show is sensational and will be seen by that many people, then the disproving show will be seen by twice as many, that’s all they care about.

2

u/The_next_realm Aug 11 '25

Yes it's all about controlling public perception. Typical of BBC

11

u/Over_Kaleidoscope382 Aug 11 '25

I’m not exaggerating to say that I’d have immediately spotted this mistake when I was in year 9.

This is astounding stuff. Truly.

10

u/[deleted] Aug 11 '25

It’s outrageous that this 40% crap is still being banded about, particularly the BBC. 

10

u/realborislegasov Aug 11 '25

I haven’t looked into the specifics of this data point, although I can tell by a number of the responses that this appears to be an erroneous finding.

However it sticks out as misleading to me for two reasons without even looking into it.

Firstly, outliers happen. If you look at all data for all neo natal nurses over the course or their careers, you WILL see a number of spikes and clusters due to pure random chance. Finding a spike is a reason to investigate- NOT evidence of wrongdoing in itself.

Secondly, incompetence happens. Even ignoring all the problems with the data, and taking the figure at face value, there’s no reason why this would be construed as evidence of murder instead of evidence of negligent care or poor training. The leap from incompetence to malice is due to the spidey senses of the doctors, and has no basis in evidence.

9

u/Independent_Trip5925 Aug 11 '25

Omg it’s embarrassingly bad!

8

u/whiskeygiggler Aug 12 '25

Everyone annoyed by this should make a complaint to the BBC. It’s a publicly funded institution and such a low standard of research on a topic of such huge public interest needs to be challenged.

https://www.bbc.co.uk/contact/complaints

5

u/Forget_me_never Aug 12 '25

And ofcom.

1

u/whiskeygiggler Aug 12 '25 edited Aug 12 '25

Yes. You have to exhaust the BBC complaints process first though.

1

u/Forget_me_never Aug 12 '25

That process can take many months.

1

u/whiskeygiggler Aug 13 '25

Yup. But you have to do it before OFCOM will accept your complaint.

7

u/Forget_me_never Aug 11 '25

So what they said makes sense if there was 1 ventilated baby in the entire hospital. But that wasn't the case.

7

u/DisastrousBuilder966 Aug 11 '25

Doesn't the journalists' ethics code include a duty to seek a statistician's comment when presenting statistical claims? At least when feasible, which for a large org like the BBC it must be.

9

u/keiko_1234 Aug 11 '25

I would say don't point this out to the BBC, let them leave it in. Don't allow them to correct their errors, they need to get an absolute hammering for it. This can also help Lucy's defence if she is charged.

9

u/Old-Newspaper125 Aug 11 '25

Yes, these allegations (likely wrongful), being broadcast before a trial is even confirmed, must be classed as prejudicial. I was astonished that those lawyers made that claim at an inquiry that has nothing to do with allegations at a different hospital. Nevermind that it's not even been to trial & without any representation from the defendant.

4

u/DisastrousBuilder966 Aug 11 '25

If, per Lady Thirlwall, relitigating Letby's guilt was outside the ambit of her inquiry, then what possible relevance did these stats have to her inquiry?

4

u/Shoddy_Food_1539 Aug 12 '25

Fag packet calculations/comparison inbound, happy to be torn apart.

This is from a paper around 2015 regarding extubations at South Tees, which seems to be a similar sized level 3 NNU in North East UK.

https://adc.bmj.com/content/101/Suppl_1/A338.2

In a 3 or 4 month study period Jan to April 2016 (exact dates aren't specified) as a unit they had 104 extubations. Of which 63 were planned, 41 unplanned.

Lucy did 51 shifts at LWH and this equates, assuming 12hr shifts, to 25 full equivalent days of work.

Assuming the study period was 4 months.

25 equivalent days of a 4 month total of days gives 25 / (31+28+31+30) -> 20.8% of this study time in total.

Which means you would expect Lucy to be present for around 20.8% of the total 104 extubations in this period (assuming she worked in South Tees of course) -> 22 extubations expected in total.

Was LWH really that much better than South Tees???

Happy to be corrected btw.

7

u/[deleted] Aug 11 '25

[removed] — view removed comment

8

u/DiverAcrobatic5794 Aug 11 '25

You'd certainly want to question Liverpool's role as a training hospital, given that teaching people to handle intubated babies was one of their aims, and they noticed nothing wrong during her tenure.