[Misc] add litellm integration (#18320)

Reid committed over 1 year ago

Fix copy-paste error in phi4mm image processing (#18315)

Lifu Huang committed over 1 year ago

[Model] Use sigmoid for single-label classification (#18313)

22quinn committed over 1 year ago

[doc] update reasoning doc (#18306)

Reid committed over 1 year ago

Support sequence parallelism combined with pipeline parallelism (#18243)

cascade committed over 1 year ago

[MISC] fix typo (#18305)

Ning Xie committed over 1 year ago

[Model] use AutoWeightsLoader for solar (#18113)

rongfu.leng committed over 1 year ago

Fixed build on ppc64le due to openssl conflicts (#18262)

Nishidha committed over 1 year ago

Update Dockerfile to build for Blackwell (#18095)

Michael Goin committed over 1 year ago

[Hardware][TPU] Optionally import for TPU backend (#18269)

Siyuan Liu committed over 1 year ago

[P/D][V1] Support dynamic loading of external KV connector implementations (#18142)

David Ben-David committed over 1 year ago

[BugFix] Correct max_model_len derivation from config.json for Mistral format (#17937)

汪志鹏 committed over 1 year ago

[Misc] reformat the collect-env output (#18285)

Reid committed over 1 year ago

Move cli args docs to its own page (#18228) (#18264)

Trevor Royer committed over 1 year ago

[V1][P/D] Local attention optimization for NIXL (#18170)

Michael Goin committed over 1 year ago

[Spec Decode] Don't fall back to V0 when spec decoding is enabled (#18265)

Woosuk Kwon committed over 1 year ago

[Bugfix] fix `an illegal memory access was encountered` of marlin kernel + act_order (#18245)

Jinzhen Lin committed over 1 year ago

[Sampler] Adapt to FlashInfer 0.2.3 sampler API (#15777)

Bowen Wang committed over 1 year ago

[CI] Assign reviewer to mergify with changes to Tensorizer files (#18278)

Sanger Steel committed over 1 year ago

[BugFix] Fix ordering of KVConnector finished send/rcv sets (#18211)

Nick Hill committed over 1 year ago