Library Header Image
LSE Research Online LSE Library Services

Optimizing expected shortfall under an ℓ1 constraint—an analytic approach

Papp, Gábor, Kondor, Imre and Caccioli, Fabio (2021) Optimizing expected shortfall under an ℓ1 constraint—an analytic approach. Entropy, 23 (5). ISSN 1099-4300

[img] Text (entropy-23-00523-v2) - Published Version
Available under License Creative Commons Attribution.

Download (445kB)

Identification Number: 10.3390/e23050523


Expected Shortfall (ES), the average loss above a high quantile, is the current financial regulatory market risk measure. Its estimation and optimization are highly unstable against sample fluctuations and become impossible above a critical ratio r=N/T, where N is the number of different assets in the portfolio, and T is the length of the available time series. The critical ratio depends on the confidence level α, which means we have a line of critical points on the α−r plane. The large fluctuations in the estimation of ES can be attenuated by the application of regularizers. In this paper, we calculate ES analytically under an ℓ1 regularizer by the method of replicas borrowed from the statistical physics of random systems. The ban on short selling, i.e., a constraint rendering all the portfolio weights non-negative, is a special case of an asymmetric ℓ1 regularizer. Results are presented for the out-of-sample and the in-sample estimator of the regularized ES, the estimation error, the distribution of the optimal portfolio weights, and the density of the assets eliminated from the portfolio by the regularizer. It is shown that the no-short constraint acts as a high volatility cutoff, in the sense that it sets the weights of the high volatility elements to zero with higher probability than those of the low volatility items. This cutoff renormalizes the aspect ratio r=N/T, thereby extending the range of the feasibility of optimization. We find that there is a nontrivial mapping between the regularized and unregularized problems, corresponding to a renormalization of the order parameters.

Item Type: Article
Official URL:
Additional Information: © 2021 The Authors
Divisions: Systemic Risk Centre
Subjects: H Social Sciences > HG Finance
H Social Sciences > HB Economic Theory
Q Science > QA Mathematics
Date Deposited: 16 Jul 2021 13:42
Last Modified: 31 May 2024 00:27

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics