Page 70 - Reforming Benefits Decision-Making
P. 70
systematic information about how the automated system operates. Further,
although there are enhanced data protection requirements for automated
decision making under Article 22 of the UK General Data Protection
Regulation these only apply to “solely automated decision making”, i.e.
without human involvement, something that the DWP does not currently do.
2.92 We recommend that the DWP should publish information on how and
when automation is used in the benefits decision-making processes and
how it feeds into the final decision made by the decision-maker, including
in relation to fraud detection and prevention. The DWP should disclose
the data inputs and parameters of the system, and where possible, the
algorithms themselves, but at a minimum the criteria or indicators used
by the system. The DWP should also be clear about the constraints of
automated systems and what is, and is not, technologically possible. The
DWP should work with civil society organisations in order to establish
196
the most useful way to publish and present this information.
Standards, quality control, training and oversight
2.93 Throughout our research and consultations with users of the system and their
advisers and with the DWP themselves, it became apparent that in relation to
many issues that we identified there is a significant disconnect between what
DWP policy or ‘best practice’ is on the one hand and claimants’ experience of
benefits decision-making, on the other. In addition, there does not appear to
be a process or system in place to understand why decisions are frequently
being overturned on appeal and to implement changes as a result of lessons
learned.
196 In this context the DWP should have regard to the Information Commissioner’s Guidance on
automated decision-making. Although the guidance applies to decision-making by automated means
without any human involvement, which is not something the DWP currently does, the principles and
practices in the guidance may be helpful in addressing this recommendation. For example using visuals
to explain what information is collected and why it is relevant to the process and having a set of ethical
principles to help build trust in the process (Information Commissioner’s Office, ‘Rights related to
automated decision making including profiling’, Guide to the General Data Protection Regulation
(GDPR)
61