# microsoft/sarathi-serve

> A low-latency & high-throughput serving engine for LLMs

**Source**: https://4ort.xyz/entity/microsoft-sarathi-serve


## References

1. [Source](https://github.com/microsoft/sarathi-serve)