[Core] Rename `get_max_tokens_per_item` for backward compatibility (#20630)

Cyrus Leung committed over 1 year ago

[Bugfix] Fix topk_ids indices_type for CUTLASS w8a8 FP8 MoE (#20166)

Ming Yang committed over 1 year ago

[CI] Increase the threshold of the MTEB RERANK tests (#20615)

wang.yuqi committed over 1 year ago

Revert invalid spellchecker fix on deepseek_vl2 (#20618)

viravera committed over 1 year ago

[Model] Implement missing `get_language_model` for Keye-VL (#20631)

Cyrus Leung committed over 1 year ago

Update torch/xla pin to 20250703 (#20589)

XiongfeiWei committed over 1 year ago

[xpu]feat: support multi-lora on xpu (#20616)

Yan Ma committed over 1 year ago

Stop using title frontmatter and fix doc that can only be reached by search (#20623)

Harry Mellor committed over 1 year ago

Remove unnecessary explicit title anchors and use relative links instead (#20620)

Harry Mellor committed over 1 year ago

[Docs] Improve documentation for Deepseek R1 on Ray Serve LLM (#20601)

Ricardo Decal committed over 1 year ago

[PD][Nixl] Remote consumer READ timeout for clearing request blocks (#20139)

Nicolò Lucchesi committed over 1 year ago

[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow passing arbitrary arguments during save/load (#19619)

Sanger Steel committed over 1 year ago

[TPU] Temporary fix vmem oom for long model len by reducing page size (#20278)

Chenyaaang committed over 1 year ago

[CI/Build][CPU] Fix CPU CI and remove all CPU V0 files (#20560)

Li, Jiang committed over 1 year ago

[Misc] improve error msg (#20604)

Reid committed over 1 year ago

[Docs] Add Anyscale to frameworks (#20590)

Ricardo Decal committed over 1 year ago

[Docs] Add Ray Serve LLM section to openai compatible server guide (#20595)

Ricardo Decal committed over 1 year ago

[Docs] Improve docstring for ray data llm example (#20597)

Ricardo Decal committed over 1 year ago

[Docs] Rewrite offline inference guide (#20594)

Ricardo Decal committed over 1 year ago

[Doc] Syntax highlight request responses as JSON instead of bash (#20582)

Harry Mellor committed over 1 year ago