fix: use configured max_logprobs instead of hardcoded 20 in derender validation (#47834)

Juan Pérez de Algaba committed 4 months ago

[Perf] Use blocking CUDA events to avoid busy polling cuda driver lock (#47081)

Summer Yang committed 4 months ago

[HARDWARE][POWER] optimize math functions of VSX power (#47321)

Rukhaiya2004 committed 4 months ago

[Bugfix][Spec Decode] Skip uniform spec-decode padding for diffusion models (#47464)

Kyung Sub Lee (Daniel) committed 4 months ago

[MoE] FI autotuning: max bucket = max token count [e.g. `DP_size*MNBT`] (#47427)

Netanel Haber committed 4 months ago

[Kernel] Applies routed_scaling_factor internally (#47408)

Jee Jee Li committed 4 months ago

[Rust Frontend][CI] Unblock more end-to-end test cases (#47735)

Bugen Zhao committed 4 months ago

[Bugfix] Match the mapped filename in find_loaded_library (#47586)

Gabriel Wu committed 4 months ago

[Bugfix][Core] Fix host memory leak from undrained new_block_ids (#44490)

Ting SUN committed 4 months ago

[docs update] Update usage of `hf` cli for cache list and removal (#47830)

Aritra Roy Gosthipaty committed 4 months ago

fix(security): add resource bounds validation to derender endpoints (#47260)

Juan Pérez de Algaba committed 4 months ago

[KV Offloading] Add basic offloading metrics (#45958)

Srinivas Krovvidi committed 4 months ago

[ROCm][Bugfix] Convert ModelOpt FP8 per-channel weights to e4m3fnuz on MI300/MI325 (#47201)

Micah Williamson committed 4 months ago

[XPU][CI]Adjust memory request for tests in Intel GPU CI (#47758)

xiangdong committed 4 months ago

[Bugfix] Forward callable hf_overrides to the draft model config (#45352)

Humphrey committed 4 months ago

[ROCm] Align mixed encoder-decoder KV cache views in V2 runner (#47685)

Andreas Karatzas committed 4 months ago

[UX] Add `model_class_overrides` for development and debugging (#47148)

Jee Jee Li committed 4 months ago

[Perf] Bound DiffusionGemma sampler transient via request-tiled logits (#45672)

Guan-Ming Chiu committed 4 months ago

[Rust Frontend] Stamp `arrival_time` at the frontend entry (#47787)

Tahsin Tunan committed 4 months ago

[Rust Frontend] Avoid extra copies for multimodal tensors (#47581)

Reid committed 4 months ago