Explore projects

vLLM scheduler simulator. Simulates batched inputs and runtime performance, without running any model, based on observed runtime performance of real runs.