prorso Guide Library Articles Features Enterprise
For teams
Sign inCreate account

Automate, assist or retain manual assessment of a benefits caseload

Open in the app

By · Published

A public body with a growing backlog decides whether to automate entitlement assessments, use a system to assist caseworkers, or leave the work manual. The log shows a legal position under the UK GDPR...

The options

The question: Should assessment of the benefits caseload be automated, used to assist caseworkers, or left as a manual decision by a caseworker?

Option 1: Retain manual assessment of every application

For

  • Judgement. A caseworker can recognise the circumstances the rules did not anticipate, and the discretionary element in the scheme exists precisely because the rules cannot enumerate every household.

Against

  • Risk. Capacity is below intake, so this option does not hold the position — it worsens it. On current trend the backlog grows by about 9,000 cases a year, reaching about 23,000 within a year and 32,000 within two, and median time to decision continues to rise. The people bearing that delay are by definition those with the least means to absorb it.

Option 2: Assist: the system produces a recommended assessment, a caseworker decides

For

  • Pilot. In a six-week pilot on 900 cases, caseworkers departed from the recommendation in 12 per cent of cases, and in four fifths of those the departure concerned household composition or a discretionary element rather than an arithmetic error.
  • Recommendation. Adopt the assisted option now, and seek the regulatory amendment that would permit automating the straightforward class. The assisted option is the only one that raises capacity above intake without relying on a legal position the function cannot presently support. Full automation is not recommended at any speed advantage while its authorisation under Article 22B is contested, because a determination successfully challenged as unlawful is worse for the applicant than a slow one.

Against

  • Risk. The legal position and the quality benefit both rest on caseworkers genuinely departing from the recommendation. A throughput target applied to the same role would erode that without any decision being taken to change it, and under Article 22A a review without real authority to depart is not meaningful human involvement.
  • Risk. A recommendation shown before the caseworker forms a view anchors the assessment. The pilot did not test presenting the recommendation after the caseworker's provisional decision, which would test the effect but slow the process.

Option 3: Automate every assessment, with human review available on request

Against

  • Risk. The model was fitted on past caseworker decisions, so it reproduces their errors as faithfully as their correct judgements, and the overturn rate measured against them cannot detect that. The function holds no independent record of what the right answer was.
  • Risk. The legal position is contested rather than merely complex. Proceeding would put the scheme's determinations at risk of challenge as a class rather than case by case, and a successful challenge would fall on decisions already issued.
  • Risk. The capacity gain is partly illusory. Review demand more than doubles, and a review is more expensive than a first decision because it examines one that has already been made and explains why it is being changed.
  • Regulation. Article 22A makes meaningful human involvement the test of whether a decision is solely automated, consistent with earlier regulatory guidance that a token human step does not change the character of the decision. A human step without real authority or capacity to depart from the automated output is not meaningful involvement. A caseworker who nominally signs a recommendation but has neither the time nor the standing to reject it does not convert an automated decision into a human one.

Option 4: Automate the straightforward cases under an express legal authorisation, refer the rest to a caseworker

For

  • Judgement. On the approximately 55 per cent of applications identified as straightforward in the case-mix assumption, with a single income source, undisputed household composition and no discretionary element, the rules determine the outcome arithmetically, and caseworker judgement adds nothing a reader of the regulations could not reproduce.

Against

  • Risk. The option is not available until the regulations are amended, which is outside the function's control and on published timetables takes twelve to eighteen months. The backlog grows throughout.
  • Risk. The boundary between straightforward and referred is itself a determination affecting the applicant, and it would be made automatically. An applicant wrongly routed as straightforward receives an automated decision on a case that needed judgement, and the routing rule needs the same scrutiny as the assessment.

Criteria and values

CriterionOption 1Option 2Option 3Option 4
Annual decision capacity (higher is better)52,00068,000—74,000
Article 22 positionoutsideoutsidecontestedauthorised
One-off implementation cost (lower is better)0 GBP———
Median time to decision (lower is better)34 day21 day3 day9 day
Overturn rate on internal review (lower is better)11%———
Internal review demand (lower is better)5,7006,10014,2007,300
Time to availability (lower is better)0 month6 month—15 month
Effect on caseworker roles (lower is better)nonecontent_changesroles_ceasecontent_changes

What constrained the decision

Related decisions

Open the decision log in the app

Spotted an error? Report a problem (ivan@ivanjureta.com). Corrections are listed on the page with their date.