Skip to content

moirai

Moirai 2, Moirai 1.x, and Lag-Llama, plus every hub model.

extra CPU tag GPU tag families models example
moirai :moirai :moirai-gpu Moirai 2, Moirai 1.x, Lag-Llama 8 moirai_2

Python pins

gluonts, lightning, and hydra-core are pinned only for python_version < '3.14'.

Start a server

docker run --rm -p 8000:8000 sktime/tserve:moirai moirai_2
uv pip install "tserve[server,moirai]"
uv run tserve moirai_2
pip install "tserve[server,moirai]"
tserve moirai_2

Check what loaded:

curl -s http://127.0.0.1:8000/models

Predict

Python needs the client extra on the caller.

curl -s http://127.0.0.1:8000/predict -H "Content-Type: application/json" -d '{
  "past": {
    "timestamp": ["2024-01-01", "2024-01-02", "2024-01-03", "2024-01-04", "2024-01-05"],
    "sales": [120, 135, 128, 142, 138]
  },
  "time": "timestamp",
  "target": ["sales"],
  "fh": 3,
  "model": "moirai_2"
}'
curl.exe -s http://127.0.0.1:8000/predict -H "Content-Type: application/json" -d '{"past":{"timestamp":["2024-01-01","2024-01-02","2024-01-03","2024-01-04","2024-01-05"],"sales":[120,135,128,142,138]},"time":"timestamp","target":["sales"],"fh":3,"model":"moirai_2"}'
from tserve.client import Client

past = {
    "timestamp": ["2024-01-01", "2024-01-02", "2024-01-03", "2024-01-04", "2024-01-05"],
    "sales": [120, 135, 128, 142, 138],
}

with Client("http://127.0.0.1:8000") as client:
    result = client.predict(
        past=past,
        time="timestamp",
        target=["sales"],
        fh=3,
        model="moirai_2",
    )
print(result.predictions)

Models

Moirai 2

Moirai2Forecaster extra moirai 1 model
model checkpoint
moirai_2 Salesforce/moirai-2.0-R-small

Moirai 1.x

MOIRAIForecaster extra moirai 6 models
model checkpoint
moirai_1_0_r_small Salesforce/moirai-1.0-R-small
moirai_1_0_r_base Salesforce/moirai-1.0-R-base
moirai_1_0_r_large Salesforce/moirai-1.0-R-large
moirai_1_1_r_small Salesforce/moirai-1.1-R-small
moirai_1_1_r_base Salesforce/moirai-1.1-R-base
moirai_1_1_r_large Salesforce/moirai-1.1-R-large

Lag-Llama

LagLlamaForecaster extra moirai 1 model
model checkpoint
lagllama time-series-foundation-models/Lag-Llama

Also loadable here

Next steps