True Contribution (TC)
True Contribution is a measure of your model's contribution to the hedge fund's returns.
- 1.Numerai combines submitted predictions via the stake-weighted average of every signal to create the Stake-Weighted Meta Model (SWMM). A data scientist who stakes a large amount of NMR on their model will have a larger weight in the Stake-Weighted Meta Model.
- 2.The SWMM and hundreds of risk constraints (such as market, country and sector risk neutralization) are input into an optimizer. This transforms the SWMM into a realistic hypothetical portfolio.
- 3.Numerai observes the hypothetical returns of that portfolio and calculates the gradient of the optimized portfolio return with respect to the stake. True Contribution is the magnitude of this gradient for each set of predictions constituting the SWMM.
- 4.Numerai pays users based on a scaled version of this gradient magnitude. This is akin to Neural Network architecture and the idea of gradient descent.
End-to-end diagram of Numerai's portfolio creation
This is possible using new techniques developed by Stephen Boyd of Stanford University, Brandon Amos from Facebook AI et al (see their paper: Differentiable Convex Optimization Layers)
By using cvxpylayers, we can include a cvxpy defined convex portfolio optimization as a layer in a PyTorch model. This lets us efficiently compute the gradient of the optimized portfolio return with respect to the stake values and determine the True Contribution of every signal submitted to Numerai.
We've found a few metrics seem to act as good indicators for TC. Currently, FNCv3 is the best we currently have. Numerai's Chief Data Scientist Michael Oliver also wrote a forum post discussing this topic.
Last modified 20d ago