Explore projects

vLLM scheduler simulator. Simulates batched inputs and runtime performance, without running any model, based on observed runtime performance of real runs.

Visible at https://pcom.pages.upb.ro/labs/

The subject's website