What is Murr

A caching layer for ML/AI data serving that sits between your batch data pipelines and inference apps.

Tiered storage

Hot data in memory, cold data on disk. S3-based replication. RAM is expensive — keep only the hot stuff there.

Batch I/O

Native batch reads and writes over columnar storage. Dumping a 1GB Parquet file into the API is a valid use case.

Zero-copy wire protocol

No conversion needed when building np.ndarray, pd.DataFrame, or pt.Tensor from API responses.

Stateless

All state lives on S3. When a node restarts, it self-bootstraps from block storage. No replication drama.