Page 70 - Reforming Benefits Decision-Making
P. 70

systematic  information  about  how  the  automated  system  operates.  Further,
               although  there  are  enhanced  data  protection  requirements  for  automated
               decision  making  under  Article  22  of  the  UK  General  Data  Protection
               Regulation  these  only  apply  to  “solely  automated  decision  making”,  i.e.
               without human involvement, something that the DWP does not currently do.

          2.92  We  recommend  that  the  DWP  should  publish  information  on  how  and
               when automation is used in the benefits decision-making processes and
               how it feeds into the final decision made by the decision-maker, including
               in relation to fraud detection and prevention. The DWP should disclose
               the  data  inputs  and  parameters  of  the  system,  and  where  possible,  the
               algorithms themselves, but at a minimum the criteria or indicators used
               by  the  system.  The  DWP  should  also  be  clear  about  the  constraints  of
               automated systems and what is, and is not, technologically possible. The
               DWP should work with civil society  organisations  in  order to establish
                                                                        196
               the most useful way to publish and present this information.

          Standards, quality control, training and oversight

          2.93  Throughout our research and consultations with users of the system and their
               advisers and with the DWP themselves, it became apparent that in relation to
               many issues that we identified there is a significant disconnect between what
               DWP policy or ‘best practice’ is on the one hand and claimants’ experience of
               benefits decision-making, on the other. In addition, there does not appear to
               be a process or system in place to understand why decisions are frequently
               being overturned on appeal and to implement changes as a result of lessons
               learned.





          196   In  this  context  the  DWP  should  have  regard  to  the  Information  Commissioner’s  Guidance  on
          automated decision-making. Although the guidance applies to decision-making by automated means
          without any human involvement, which is not something the DWP currently does, the principles and
          practices in the guidance may be helpful in addressing this recommendation. For example using visuals
          to explain what information is collected and why it is relevant to the process and having a set of ethical
          principles  to  help  build  trust  in the  process  (Information  Commissioner’s  Office,  ‘Rights  related  to
          automated  decision  making  including  profiling’,  Guide  to  the  General  Data  Protection  Regulation
          (GDPR)


          61
   65   66   67   68   69   70   71   72   73   74   75