1947 stories
·
2 followers

The U.K. Post Office Scandal: Software Malpractice At Scale

1 Share

Topics like Generative AI are deservedly receiving a lot of attention regarding software and data trust these days, but another software trust story that caught my attention is the U.K. Post Office Scandal, something I first started reading about in 2023. The scandal is centered around a dystopian software solution that turned on its sub-postmaster users, falsely charging over 900 with theft, sending over 200 to prison (including at least one who was pregnant), ruining countless lives, and is morally responsible for least four suicides. And this from accounting software. Accounting software.  Accounting software should be predictable and boring, not falsely send people to prison. The story defied belief, yet it was true. 

The U.K. Post Office Scandal should be required software ethics reading for all software professionals, whether a student or grizzled veteran.  The story is massive and deserves an entire book, but these are some of the major points as I understand them.

Who Owns What

To a U.K.-outsider, the Royal Mail and the U.K. Post Office sound like the same thing, but they are not. Their origins date roughly to the 16th and 17th centuries and through other now-defunct governmental entities such as the General Post Office, but have diverged in the recent years.  The U.K. Post Office is a private company owned by the British Government. The Royal Mail started selling shares publicly in 2011, and when the British Government sold off their remaining stake in 2015, it made the Royal Mail an entirely private and non-governmental entity. We’ll come back to this later.

Horizon

The scandal centers around an accounting and financial system called Horizon, which was implemented by Fujitsu in 1999 under contract from the Post Office. Branches were moving from paper-based accounting, which had been in place for hundreds of years. The desire to convert to digital was not entirely crazy, at least on paper (bad pun intended).

Sub-postmasters ran the approximately 11,000 local branches of the Post Office.  They were self-employed and under contract from the Post Office, and not Post Office employees.  While this relationship was not new at the time of Horizon, it would be the foundation of an adversarial dynamic.  Additionally, the sub-postmasters’ contract with the Post Office stated explicitly that they were liable for shortfalls. This was the critical paragraph:

  • “The Operator shall be fully liable for any loss of or damage to, any Post Office Cash and Stock (however this occurs and whether it occurs as a result of any negligence by the Operator, its Personnel or otherwise, or as a result of any breach of the Agreement by the Operator)… Any deficiencies in stocks of Products and/or any resulting shortfall in the money payable to Post Office Ltd. must be made good by the Operator without delay so that, in the case of any shortfall, Post Office Ltd. is paid the full amount.”

With the old paper-based system, the sub-postmasters had full access to all records for an audit.  With Horizon, the sub-postmasters effectively had to trust the system.  If Horizon said a sub-postmaster was short, then the sub-postmaster was short and had make up the difference themselves …  or else.  Remember how the Post Office was owned by the British Government? That made Horizon issues not just civil, because the Post Office can act as a prosecutor for criminal charges.

In terms of the financial scale of the project, Fujitsu’s contract for the Horizon implementation was the largest non-military contract in Europe at the time.  When government contracts get this big, they also can get political in very weird ways, where truth and accuracy become precious.

The scene was already set for something ominous, but it got worse.  Horizon had originally been created in 1996 by computer company ICL (acquired by Fujitsu in 1998) as a swipe-card system for payment of pensions and benefits from Post Office branch counters.  By 1999, the House of Commons public accounts committee deemed it “one of the biggest failures in the public sector” at a cost of £700 million (nearly U.S.$900 million).  Rather than write the project off, to save face this software mess was repurposed.  This is what the Post Office started using in 1999 as the foundation of its branch accounting system.  Yikes.

The Prosecutions

Problems with Horizon started almost immediately, with shortfalls appearing out of nowhere and increasingly, literally in front of sub-postmasters’ eyes.  They weren’t rounding errors, either—shortfalls were hundreds of pounds, thousands of pounds, tens of thousands of pounds, and more.  These were large and life-affecting amounts of money. 

When sub-postmasters complained of Horizon issues, Fujitsu and the Post Office both insisted that they were the only ones having problems, and whatever was happening was their own fault. That deliberate gaslighting went on for years.

The Post Office pursued payment on shortfalls, and failing that, prosecuted with vengeance. The Martin Griffiths case is archetypal.  He had already been running a Post Office branch for 14 years, but four-figure discrepancies started showing up by 2009.  By 2011, the discrepancies grew to £23,000.  Between January 2012 and October 2013, another £57,000 went “missing.”  Griffiths had to turn to his parents, who lent him their life savings.  There were almost 1,000 other instances of this, ending in a combination of termination, bankruptcy, or prison.  Or all three. Griffiths later stepped in front of a bus. 

On top of the malignant software, the sub-postmasters had a feeling there was a ghost in the machine and that somebody was accessing and modifying their accounts without their knowledge. The Post Office insisted for years that nobody had access to branch accounts and this was impossible.  Naturally, that was exactly what Fujitsu was doing behind the scenes.

The Investigations and Re-Assurances

Alan Bates, a former sub-postmaster, led a home-grown response for his own case and other sub-postmasters after his contract was terminated in 2003 due to shortfalls in Horizon.

National Federation of Sub-Postmasters is an organization founded in 1897 with the goal to “improve the conditions under which subpostmasters labour and to undertake the advancement of our interests by all legitimate and honourable means.”  This sounds exactly like an organization that would come to the aid of affected sub-postmasters.  However, the organization was insisting as late as 2015 that the system was “robust.” The sub-postmasters were truly on their own.

Computer Weekly broke the story in 2009 through the efforts of Alan Bates and other sub-postmasters.  The news satire magazine Private Eye started covering it in 2011 as well, and has not let up.  It is somehow fitting in this insane story that those who first recognized the scandal for how serious it was were computer nerds and humorists, well before the mainstream media.

Ernst & Young (EY) was the long-time auditor of Horizon until 2018.  An EY report sent to Post Office directors in 2011 warned that Fujitsu staff had “unrestricted access” to sub-postmasters’ accounts, that “may lead to the processing of unauthorised or erroneous transactions.”  This fact did not come to light until years later, because it was buried by the Post Office.

A forensic accounting company, Second Sight, was brought to attempt a review after pressure was applied from some Members of Parliament.  Second Sight, according to the BBC, “was brought in by the Post Office in 2012 to look into the Post Office’s IT and business processes, but it was later sacked after the Post Office became worried about the conclusions it was drawing.”

Deloitte was engaged for an audit, and wrote a draft of something called “The Bramble Report” in 2016, noting that authorized access was not just possible, based on a sample of account transactions not approved by sub-postmasters, but was likely to be actually happening.  The Post Office buried that report as well.

And there is Paula Vennells.  Vennells started at the Post Office in 2007 and became CEO in 2012.  In her defense, the Horizon project and prosecutions started years before she even arrived at the Post Office, let alone became CEO. That said, during her tenure as CEO, prosecutions not only continued unabated, but she did her best to undermine any investigations into Horizon issues.  In 2015, Vennells said before a House of Commons committee that the Post Office was a “business that genuinely cares about the people who work for us.” And if “there had been any miscarriages of justice, it would have been really important to me and the Post Office that we surfaced those… So far we have no evidence of that.”  But the evidence was there.  It was everywhere.  Vennells was doing her best to ignore and hide it.

Back to the Royal Mail.  When the Horizon project started, the Royal Mail was still owned by the British Government. The Royal Mail was spun off during Vennells’ tenure at CEO.  As was reported by the BBC, Vennells considered it her job to minimize the scandal such that it would not impact that transaction.  Sub-postmasters and justice be damned—there was money to be made!

Vennells is also an ordained Anglican priest and was a finalist to become Bishop of London in 2017.  She was also on the Church of England’s Ethical Investment Advisory Group. Read that again for emphasis. This was at the same time she was the CEO of the Post Office and, as previously stated, continued to prosecute innocent sub-postmasters and torpedo meaningful inquiries into Horizon.  She could have played the hero by acknowledging Horizon problems and offering redress; she chose to perpetuate the scandal. The chasm between her public piety and what she put into practice, while not unique in the modern business world, was still astonishing.

As a cherry-on-top for her efforts, Vennells received a Commander of the British Empire (CBE) award “for services to the Post Office and to charity” in 2019.  Of the five classes of the Order (Knight Grand Cross, Knight Commander, Commander, Officer, and Member), the CBE is the 3rd highest. To put this in perspective, the Beatles got a mere MBE in 1965, which is the lowest.  Buckingham Palace has some explaining to do.

Eventually Bates’ efforts wound up in a court case Bates & Others vs. Post Office Ltd. that started in 2017 and was decided in 2019.  What Alan Bates and the other sub-postmasters did to push their cause was truly heroic, because it involved thousands and thousands of unpaid hours over 20+ years, while the Post Office spent many millions on doing everything in its power to stop the truth from coming out.  It wasn’t just an Alan vs. Goliath situation, it was Alan vs. Goliath, Goliath’s Government, and Goliath’s Giant Legal Team.

The first set of convictions were only overturned in April 2021.  The pace of justice was agonizingly and maddeningly slow and incomplete in terms of scope, but it was still some justice.  It was a beginning, and this story is still developing.  Vennells’ CBE was formally revoked in 2024 for “bringing the honours system into disrepute.”  That was a nice touch, but cold comfort for lives ruined and lost. There are dozens and dozens from Fujitsu, the Post Office, and other organizations who should be fined and jailed for either lacking the moral courage to stand up and say something, or the ethical failure of repeatedly lying to protect the Post Office and defaming and prosecuting blameless sub-postmasters. The full list of those accountable needs to go back to the late 1990’s, as well, not just those recently in charge. That will probably never happen, as it will be too embarrassing for the British Government.  But it should.

Lessons For The Software Community

Users suffer with new software systems in all sorts of ways—half-baked functionality, performance issues, and erratic uptime, to name a few.  Those issues can be frustrating enough, but no user should ever suffer like this. The failures were implemented in software, but they were allowed to persist by humans.  Among those humans were many technical professionals who should have known and done better.

References

Doug Meil is a software architect in healthcare data management and analytics. He also founded the Cleveland Big Data Meetup in 2010. More of his BLOG@CACM posts can be found at https://www.linkedin.com/pulse/publications-doug-meil

Read the whole story
koranteng
1 day ago
reply
Share this story
Delete

The Last Holdouts

1 Share
The last holdouts, it's come to this
The Walker brothers would be leaving this place
Yes, they'd delayed the purchase for months and strung things out
But now time was up, they had to move out of the house

At least the two of them had made a stand
Scrap dealers, their hustle was hard
The mountain of bikes scavenged for parts
Machinery under the tarp

Old man Jackson would be the very last holdout
His house on the other side of the tracks
Specialist in all styles, you had to respect him
The end of an era, and now it's come to this

...

Down by the train tracks, the very last patch
On the east side, past the highway
Bad soil, badlands
Bordered by the railway and the creek
Cul-de-sac
Halfway houses
Depression era bungalows
Functional and plain homes for our kind of folk
Featuring Terry's stealth restaurant in one of the backyards
One of his jook joint ideas that didn't go nowhere
Left with barbecues, conversation and soul food
Frankie Beverly and Maze blaring,
Cheap malt, it was all good
And now the blues grinder is over, it's come to this

...

Bars, heavy iron burglar bars over the windows
During the crack years it wasn't far from a combat zone
Drugs, man, I tell you, a hell of a thing
Charnel houses, dens of iniquity, they saw it all
And if it wasn't dope, well all vices could be bought
Mind you, there were fifteen churches within the six blocks
Sin and redemption were the nosy neighbors
It was hard to tell which you would end up crashing with
The churches too are moving out, it's come to this

...

Now that the trail has been done up, it's come to this
The developers have their eye on things
It's the American way, we understand cold cash
Someone expert with the building code, real estate
A couple of miles from downtown, it's a no-brainer
Multiple units or townhouses with the right contractor
An offer you can't refuse, a fateful decision
Suburbia here we come, some call it gentrification


graveyard of champions, urban decay


The Last Holdouts, a playlist


A soundtrack for this note (spotify version)
See previously: The Old Man who Lives in the Park

This note is part of a series: In a covidious time

File under: , , , , , , , , , , , , , ,

Writing log: April 11, 2022

Read the whole story
koranteng
3 days ago
reply
Share this story
Delete

First Responder

1 Share
First on the scene, smell of sulfur
Spent cartridges, overturned tables
Kicked a hand grenade, it was live
Luck. Tonight was not my time
Out of the darkness, a mess
The bodies, the bodies. Look

No time to check for vital signs
Training kicked in, adrenaline
Secure the premises
Clear. Damage assessment
The bodies, the bodies. Count

Then blood, first aid. Hurry
Flesh distorted, unnatural positions
Wrenching. Anatomy lessons
The sounds, such sounds
Gasps. Screams. Sobs
The bodies, the bodies. Damn

The brutality of field triage
Tourniquets fashioned
Technique. Muscle memory
Blood, so much blood, a new smell
Broken glass, splinters
Eyes darting. Holding hands
Stay with me. Help is coming
The bodies, the bodies. Hold on

Out on the street, male cadaver
Too late, he lay in the gutter
Looked around, table cloth
Makeshift shroud, best you could do
Back inside. The golden hour. Help
First time for everything, terrorism
You'll never forget the bodies
First responder. Life and death
The bodies, the bodies. Baptism


digable planets


Soundtrack for this note



roots and culture hasa 1993-1994



See previously: Heidelberg Tavern Massacre

File under: , , , , , , , , , , ,

Writing log. April 8, 2022

Read the whole story
koranteng
8 days ago
reply
Share this story
Delete

Head Nods - Toli Turns Twenty

1 Share
So apparently I've been writing at this joint for 20 years
To all who've been reading, a head nod in your direction
An interruption perhaps to your regular programming here
A head nod, twenty years is worth a little commemorating...

I've found that, when it comes to the heart of the matter,
The typical toli intervention still adheres to the old formula
The ingredients are well known: some prose, a poem, and a playlist
I vary things as enthusiasms ebb and flow, even on technical topics

But it seems that poetry has taken over these past few years:
Even book reviews are escaping in virtual ink dressed in verse
The slightest thing sends me into significations and wonders
But the muse wills what she wants, who am I to question her?

The poetry started to flow, as it were, for want of a bolt
First a golden encounter (a hungry man offered me some gold)
Then a broken lawnmower turned out to be the proximate cause
Now, having settled into a groove, I've been steadily adding to the vault
Hell, I've got things scheduled out for the next six years and more

I tend to cover mostly familiar topics:
Small things, whimsy and dark matters
Albeit the arrival of parenthood affected the quantity of toli chatter
Some were concerned at the prolonged absences; I told them
"Sleep deprivation will only get you so far"
And trusted that the fallow years of writing would soon come to pass

I'm firing on all cylinders these days,
  Covering humanity's curriculum
Writing from the torrid zone,
 A far region of the mind under the sun

Meanwhile, I dream in hypertext.
 My books of toli all start with a link
So, again, a head nod in your direction, Dear Reader,
  Do let me know what you think


Koranteng globe portrait


Head Nods, a playlist


A soundtrack for this note (spotify version) And I leave you with the Kings of Swing again from the golden age of hip hop: Nod your head to this

File under: , , , , , , , , ,

Writing log: July 13, 2024

Read the whole story
koranteng
14 days ago
reply
Share this story
Delete

Final Journey

1 Share
Blinking lights, funeral procession
The police escort slowly led the way
The motorbike rider up front occasionally blowing the horn
The long parade of cars followed from Mission funeral home

Frustrated. A couple of stragglers, delayed by a red light
Stopped and faced the onlooker at the crosswalk
Eyes red after the earlier mourning
Newfangled mask pulled under the chin

In that minute, a wordless exchange
A head nod, then a gesture to the heart
A smile, and a head nod in return
Solidarity
The light changed, they revved to catch up
Onward to the last rites at the cemetery


demolition in East Austin



See previously: The Laws of Grief


This note is part of a series: In a covidious time.


File under: , , , , , , , , ,

Writing log. April 24, 2022

Read the whole story
koranteng
17 days ago
reply
Share this story
Delete

Goddamn Lies

1 Share
They cut deeper, they do
 They hurt more than the unvarnished ones
Sure, you can make your peace with the white lies,
  The garden variety deceptions
And deal with the untruths
 And the artful omissions
The distinctions without a difference,
  The what-have-yous
But it's hard to cope with the goddamn lies

You are well familiar with the symphony of deceit
Intimate even, with the ways of evasion
The instinctive lies
 The barefaced ones
The reflexive ones
 The rank denials
The wholly unnecessary ones
 The exaggerations
The diversionary ones
 The outright fabrications
But it's hard to abide with the goddamn lies

And what, you may ask, elevates a lie into that august territory
Moving forward, worthy of that emphatic qualifier?

The texture of a goddamn lie is of the nature of a wound
A goddamn lie aims for, and achieves, infamy
Its essential quality goes far beyond shame
A goddamn lie rises above the highest peaks of untruths
It is of a piece with the surreal, devastating and brazen,
A goddamn lie summons irony, borne as it is out of its bed of hypocrisy
Most of all, a goddamn lie celebrates the lie qua lie
A goddamn lie dances on the grave of its achievement

II.

Politicians, as a matter of course, are avid connoisseurs of the lie
Indeed we expect a close acquaintance of it of most of their breed
Some breathe it with a naturalness that is often unnerving
Grifters too are students and daily practitioners of its corruption
And deploy it in a manner that is all too self-serving
But it is the rarest beast that achieves the goddamn lie

All cultures have their own folklore,
  Often at the expense of others
Founding myths, origin stories,
  Their striking legends soaked in blood

Erecting statues of the colossus,
  Destinies manifest and men's burdens
On terrain where equality, dreams and fond promises
  Meet ceilinged glass
The rhetoric of the powerful
  And the strategy of the shrewd
The hand of god,
  Witness the triumph of the trickster
Freedoms and liberties,
  The laws of grifters

From faulty biology, allusions to race, and sundry nationalisms
History books point to those who heed the conqueror's catechism
But when everything they claim to uphold is written in sand
It's hard to keep things straight when all is goddam lies


chief zaachi physical and spiritual center


Deceit, a playlist


A soundtrack for this evasion. (spotify version)

See previously: Symphony of Deceit

This folktale is part of a series: In a covidious time

File under: , , , , , , , , , , , , , , , , ,

Writing log. April 22, 2022

Read the whole story
koranteng
24 days ago
reply
Share this story
Delete
Next Page of Stories