HYPERPRIOR

Working papers

HyperPrior Research
London

Five working papers are in preparation, one from each of the group’s programmes. The programmes cut across the seven research areas on the home page. Each paper will carry its date, its version and how far we trust its main claim.

  1. No. 001Research Probabilistic inference

    The prior is the product

    Programme P-01 Prior Engineering

    Pretraining data is a prior, whether or not anyone meant it to be. We argue for designing that prior deliberately, and for measuring what a model actually absorbs from it.

    Version
    In preparation
    Date
    In preparation
    Confidence
    In preparation
    Revisit
    In preparation

    In preparation

  2. No. 005Research Reinforcement learning

    Forgetting on purpose

    Programme P-02 Filtration

    A model that learns from a stream has to keep deciding how much of the past still applies. We make the case for models that forget on purpose, and for measuring when and why they let go.

    Version
    In preparation
    Date
    In preparation
    Confidence
    In preparation
    Revisit
    In preparation

    In preparation

  3. No. 002Research Environments and graders

    Scoring the future

    Programme P-03 Out-of-Sample

    The only benchmark that cannot leak is one that has not resolved yet. We set out a protocol for scoring forecasts committed before their outcomes exist, including when the forecaster can move the outcome.

    Version
    In preparation
    Date
    In preparation
    Confidence
    In preparation
    Revisit
    In preparation

    In preparation

  4. No. 004Research World models

    Where beliefs live

    Programme P-04 Belief Geometry

    A model that predicts well has to track the hidden state of whatever produced its data. We look at reading those beliefs off its activations, and at what their geometry says about how the model represents that process.

    Version
    In preparation
    Date
    In preparation
    Confidence
    In preparation
    Revisit
    In preparation

    In preparation

  5. No. 003Research Complex adaptive systems

    Other people’s world models

    Programme P-05 Shared Worlds

    In a market, most of the environment is other agents. We ask what a world model has to learn there, and how to plan with a model that goes stale once the other agents adapt to it.

    Version
    In preparation
    Date
    In preparation
    Confidence
    In preparation
    Revisit
    In preparation

    In preparation