Lab 11: KServe Inference with HAMi DRA GPU Sharing
Deploy a KServe Standard vLLM service and run two Predictor replicas on one NVIDIA GPU through native HAMi DRA claims.
4 docs tagged with "hami"
View all tagsLab 15: Run SGLang on HAMi GPU Shares
Install HAMi on a GPU cluster and schedule SGLang inference services with GPU partitioning.
Lab 16: Dynamic MIG Lifecycle on RTX PRO 6000
Install HAMi v2.10.0 and verify per-Pod MIG placement, mixed profiles, selective reclamation, restart recovery, and multi-GPU spillover.
Lab 5: Fake-GPU Scheduling with nvml-mock
Simulate 8 A100 GPUs with HAMi scheduling features, no real GPU needed.
