Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Optimal recovery of unsecured debt via interpretable reinforcement learning
 
research article

Optimal recovery of unsecured debt via interpretable reinforcement learning

Mark, Michael  
•
Chehrazi, Naveed
•
Liu, Huanxi
Show more
2022
Machine Learning with Applications

This paper addresses the issue of interpretability and auditability of reinforcement-learning agents employed in the recovery of unsecured consumer debt. To this end, we develop a deterministic policy-gradient method that allows for a natural integration of domain expertise into the learning procedure so as to encourage learning of consistent, and thus interpretable, policies. Domain knowledge can often be expressed in terms of policy monotonicity and/or convexity with respect to relevant state inputs. We augment the standard actor–critic policy approximator using a monotonically regularized loss function which integrates domain expertise into the learning. Our formulation overcomes the challenge of learning interpretable policies by constraining the search to policies satisfying structural-consistency properties. The resulting state-feedback control laws can be readily understood and implemented by human decision makers. This new domain-knowledge enhanced learning approach is applied to the problem of optimal debt recovery which features a controlled Hawkes process and an asynchronous action–feedback relationship.

  • Files
  • Details
  • Metrics
Type
research article
DOI
10.1016/j.mlwa.2022.100280
Author(s)
Mark, Michael  
Chehrazi, Naveed
Liu, Huanxi
Weber, Thomas A.  
Date Issued

2022

Published in
Machine Learning with Applications
Volume

8

Start page

1

End page

9, 100280

Subjects

Reinforcement learning

•

Interpretable machine learning

•

Deterministic policy gradient

•

Monotonicity constrained learning

•

Debt recovery

•

Control of Hawkes processes

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
OES  
Available on Infoscience
March 30, 2022
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/186789
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés