[CI][Bugfix] Spawn engine in mm cache sleep test to fix ROCm HIP error (#46749)

peizhang56 committed 4 months ago

[ROCm][Bugfix] Fix HIP fork re-init in multimodal offline examples (#46741)

peizhang56 committed 4 months ago

[ModelRunner V2] Fix whisper test (#46773)

Nick Hill committed 4 months ago

[Hardware][AMD][CI] Fix AMD CI image build (#46792)

Matt committed 4 months ago

[Rust Frontend] Make Granite4 string argument scanning incremental (#46507)

Reid committed 4 months ago

Fix relative allowed local media paths (#45263)

Matti4 committed 4 months ago

[Bugfix][Rust Frontend] Reject min_tokens above max_tokens (#46733)

Reid committed 4 months ago

[CI][NIXL] Fix NIXL EP import canary for the nixl 1.3.0 wheel and pin nixl==1.3.0 (#45166)

ovidiusm committed 4 months ago

[NVFP4][Emulation] Fuse NVFP4 weight dequantization with compute in triton kernel for w13/w2 MOE MLP linears (#44667)

fxmarty-amd committed 4 months ago

[DFlash] Fuse precompute kv per-layer rmsnorms (#46761)

Giancarlo Delfin committed 4 months ago

[Model Runner V2][Spec Decode] Reduce TP communication for draft token generation (#46448)

yiheng committed 4 months ago

[Model Runner V2][DFlash] Enable dflash attention backend selection (#46770)

Giancarlo Delfin committed 4 months ago

[Bugfix][MRV2] Forward seq_lens_cpu_upper_bound for mamba hybrid models (#46759)

Michael Goin committed 4 months ago

[Refactor] Remove dead kernel code (#46405)

Wentao Ye committed 4 months ago

[ModelRunner V2] Bound memory for large logprobs requests (#46746)

Nick Hill committed 4 months ago

[Bugfix] Default tie_weights to sharing the weight (fix tied quantized embeddings, e.g. ModelOpt Gemma4) (#45544)

Mike G committed 4 months ago

[Rust Frontend] Switch `rustls` to `native-tls`/OpenSSL (#46696)

Bugen Zhao committed 4 months ago

[Rust Frontend] Extract renderer fixture test utilities (#46719)

Bugen Zhao committed 4 months ago

[Rust Frontend] Migrate gemma4 to unified parser (#46602)

Bugen Zhao committed 4 months ago

[Model Runner V2][Spec Decode] Use log1p to compute residual during rejection sampling (#46665)

Giancarlo Delfin committed 4 months ago