[Misc][V1] Skip device checking if not available (#15061)

Cody Yu committed over 1 year ago

[Doc] Minor v1_user_guide update (#15064)

Jennifer Zhao committed over 1 year ago

fix long dtype in topk sampling (#15049)

Chujie Zheng committed over 1 year ago

[V1] TPU - CI/CD use smaller model (#15054)

Alexander Matveev committed over 1 year ago

[V1][Spec Decode] Optimize Rejection Sampler with Triton Kernels (#14930)

Woosuk Kwon committed over 1 year ago

[V1] Refactor Structured Output for multiple backends (#14694)

Russell Bryant committed over 1 year ago

[Bugfix] Fix LoRA extra vocab size (#15047)

Jee Jee Li committed over 1 year ago

[Bugfix] Fix broken CPU quantization due to triton import (#15038)

Isotr0py committed over 1 year ago

[MODEL] Add support for Zamba2 models (#13185)

yury-tokpanov committed over 1 year ago

MI325 configs, fused_moe_kernel bugfix (#14987)

ekuznetsov139 committed over 1 year ago

[TPU][V1][Bugfix] Fix chunked prefill with padding (#15037)

Nicolò Lucchesi committed over 1 year ago

[Bugfix] Register serializers for V0 MQ Engine (#15009)

Simon Mo committed over 1 year ago

[Bugfix] Loosen type check to avoid errors in V1 (#15021)

Cyrus Leung committed over 1 year ago

[Misc][Docs] fix the comments of KV_T and CACHE_T in CALL_RESHAPE_AND_CACHE_XX macros (#14347)

Serena committed over 1 year ago

[Bugfix][Frontend] Fix validation of `logprobs` in `ChatCompletionRequest` (#14352)

Sebastian Schoennenbeck committed over 1 year ago

[Bugfix] torchrun compatibility (#14899)

hoshi-hiyouga committed over 1 year ago

[Misc] Embedding model support LoRA (#14935)

Jee Jee Li committed over 1 year ago

[Mistral-Small 3.1] Update docs and tests (#14977)

Patrick von Platen committed over 1 year ago

[Kernels] LoRA - Retire SGMV and BGMV Kernels (#14685)

Varun Sundar Rabindranath committed over 1 year ago

[Doc][V1] Fix V1 APC doc (#14920)

Shanshan Shen committed over 1 year ago