Support mnnvl all2allv from Flashinfer (#21003)

Shu Wang committed about 1 year ago

[Bugfix] add cache model when from object storage get model (#24764)

rongfu.leng committed about 1 year ago

Fixes and updates to bench_per_token_quant_fp8 (#25591)

Michael Goin committed about 1 year ago

[ROCm][Build][Bugfix] Fix ROCm base docker whls installation order (#25415)

Gregory Shtrasberg committed about 1 year ago

[ROCm][Bugfix] Only enable +rms_norm based on aiter if not explicitly disabled (#25275)

Gregory Shtrasberg committed about 1 year ago

[Misc] Improve type annotations for jsontree (#25577)

Cyrus Leung committed about 1 year ago

Move `DeviceConfig`, `ObservabilityConfig`, `SpeechToTextConfig` to their own files (#25564)

Harry Mellor committed about 1 year ago

[Bugfix] Fix DeepSeekV31ToolParser to correctly parse multiple tools in non-streaming output (#25405)

Tao Hui committed about 1 year ago

[docs] fix nixl kv_connector_extra_config.backends key (#25565)

Peter Pan committed about 1 year ago

[Benchmark] Fix regression in structured output benchmark (#25500)

Russell Bryant committed about 1 year ago

[Bug] fix import and unit test (#25558)

Jonas M. Kübler committed about 1 year ago

[Bugfix] Fix dummy video number of frames calculation (#25553)

Roger Wang committed about 1 year ago

[misc] update the warning message (#25566)

youkaichao committed about 1 year ago

[BugFix] Potential Fix for FA3 full-cudagraph IMA (#25490)

Lucas Wilkinson committed about 1 year ago

[V0 Deprecation] Remove max_seq_len_to_capture (#25543)

Woosuk Kwon committed about 1 year ago

[CI/Build] add nightly prime-rl integration tests (#25207)

Jackmin801 committed about 1 year ago

[Misc]] Move processing context to multimodal directory (#25548)

Cyrus Leung committed about 1 year ago

[CI/Build] Fix v1 OOT registration test (#25547)

Isotr0py committed about 1 year ago

[Bugfix][CPU] Skip unsupported custom op register on CPU (#25534)

Li, Jiang committed about 1 year ago

[Misc] Retry HF processing if "Already borrowed" error occurs (#25535)

Cyrus Leung committed about 1 year ago