[Bugfix][Model] Attempt to fix eagle in V0. (#18978)

Gregory Shtrasberg committed over 1 year ago

[Frontend] enable custom logging for the uvicorn server (OpenAI API server) (#18403)

Frαnçois committed over 1 year ago

[Model] enable data parallel for Llama4 vision encoder (#18368)

jennyyyyzhen committed over 1 year ago

[doc] add pytest tips (#19010)

Reid committed over 1 year ago

[Core] Support inplace model weights loading (#18745)

22quinn committed over 1 year ago

[Bugfix][Nixl] Fix DP Metadata Handshake (#19008)

Robert Shaw committed over 1 year ago

[Misc] reuse num_tokens_across_dp of get_dp_padding to avoid unnecessary dp all reduce in set_forward_context (#18935)

zhrrr committed over 1 year ago

[doc] wrong output (#19000)

Reid committed over 1 year ago

[BugFix] Fix incorrect metrics shutdown error log message (#18992)

Nick Hill committed over 1 year ago

[BugFix] fix data parallel construct ipv6 url addres (#18991)

rongfu.leng committed over 1 year ago

Let max_num_batched_tokens use human_readable_int for large numbers (#18968)

Michael Goin committed over 1 year ago

[doc] small fix - mkdocs (#18996)

Reid committed over 1 year ago

[LoRA] Support dynamically initialize `packed_modules_mapping` for VLM with arbitrary components (#18987)

Isotr0py committed over 1 year ago

[Core] Rework dtype resolution (#18751)

Cyrus Leung committed over 1 year ago

[Bugfix] Fix EAGLE3 broken logits (#18909)

Benjamin Chislett committed over 1 year ago

[Misc][Benchmark] Add support for CustomDataset (#18511)

Ekagra Ranjan committed over 1 year ago

[Misc] add return token strs for tokenize (#18941)

Reid committed over 1 year ago

[BugFix] Fix multi-node offline data-parallel (#18981)

Nick Hill committed over 1 year ago

[P/D] NixlConnector use cache device index for memory registration (#18969)

ptarasiewiczNV committed over 1 year ago

[ROCm][Kernel] Add gfx950 support for skinny gemms (#18010)

Charlie Fu committed over 1 year ago