[Docs] [V1] Update docs to remove enforce_eager limitation for hybrid models. (#21233)

Thomas Parnell committed over 1 year ago

GLM-4 Update (#20736)

Yuxuan Zhang committed over 1 year ago

[BugFix] Fix full cuda graph slot_mapping (#21228)

fhl2000 committed over 1 year ago

[V0 Deprecation] Deprecate BlockSparse Attention & Phi3-Small (#21217)

Woosuk Kwon committed over 1 year ago

[V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (#21194)

Thomas Parnell committed over 1 year ago

[BugFix] Make PD work with Ray (#21072)

kourosh hakhamaneshi committed over 1 year ago

[Docs] Update the link to the 'Prometheus/Grafana' example (#21225)

Jiayi Yan committed over 1 year ago

[CI/CD][bugfix]fix: error argument to loads has incompatible type (#21223)

Sungjae Lee committed over 1 year ago

Fix/remove some broken model executor tests (#21224)

Rabi Mishra committed over 1 year ago

[bugfix] Fix auto thread-binding when world_size > 1 in CPU backend and refactor code (#21032)

Li, Jiang committed over 1 year ago

[Bugfix][Frontend] Fix openai CLI arg `middleware` (#21220)

22quinn committed over 1 year ago

[NVIDIA] Add SM100 Flashinfer MoE blockscale fp8 backend for low latency (#20645)

Kaixi Hou committed over 1 year ago

Add torch golden impl for moe_align_block_size kernel test (#20653)

shixianc committed over 1 year ago

[BugFix] Fix potential cuda-graph IMA (#21196)

Lucas Wilkinson committed over 1 year ago

[Bugfix] Fix ndarray video color from VideoAsset (#21064)

Isotr0py committed over 1 year ago

[V0 deprecation] Remove long context LoRA (#21169)

Jee Jee Li committed over 1 year ago

Fix a couple of Voxtral tests (#21218)

Huy Do committed over 1 year ago

[Misc][Tools][Benchmark] Add readme file for auto_tune script (#20779)

Chenyaaang committed over 1 year ago

[Model] EXAONE 4.0 model support (#21060)

김종곤 committed over 1 year ago

[Bug] DeepGemm: Fix TypeError: per_block_cast_to_fp8() missing 1 required positional argument: 'use_ue8m0' for SM100 (#21187)

Wentao Ye committed over 1 year ago