Scoring
There are two main scores used for payouts
We also have informational scores not used for payouts
- Feature Neutral Correlation (FNC): Your prediction's correlation to the target after neutralizing against all features
- Correlation with the Meta Model (CWMM): Your prediction's correlation to the Meta Model (stake weighted average of all predictions).
Within a single round, submissions will receive 20 score updates until the final score of the round is computed.
For example, here is what the scoring schedule looks like for a hypothetical weekend round opening on Saturday 6th and closing on Monday 8th. The first day of scoring is on Friday 12th, with daily updates every Tuesday-Saturday, until the final score 4 weeks later on Thursday 8th of the next month.
The reason why scoring is done over these 20 days is because the main target is built on 20 days of returns ignoring the first 2 days after round close. This is commonly referred to as "20D2L", where "20D" means "20 days of returns" and "2L" means "ignoring the first two days". Each score update is computed using an expanding window of returns.
For example, the first day of scoring on Friday 12th uses a 1D2L target, which includes returns from Wednesday 10th only. The second day of scoring on Saturday 13th uses a 2D2L target which includes returns from Wednesday 10th through Thursday 11th. The final day of scoring 4 weeks later on Thursday 8th of next month uses a 20D2L target which includes returns starting from Wednesday 10th through Tuesday 6th of the next month.
Only the final scores for rounds count towards a model's live performance.
The 1 year average score is also called
reputation
and your model's rank on the leaderboard is primarily based on your model's 1 year average TC score.
Last modified 29d ago