rten-generate is a layer on top of RTen which handles the generation loop for
auto-regressive transformer models (aka. "transformer decoders" or "generative
AI"). This includes managing the KV cache, sampling and post-processing logits
etc.
