[BugFix][Frontend] apply task instruction as system prompt in cohere v2/embed (#38362)

Walter Beller-Morales committed 7 months ago

[CI]revert initialize_model context manager (#38426)

Kunshang Ji committed 7 months ago

[ROCm][CI] Fix UV install in Dockerfile.rocm to detect curl failures and retry (#38415)

Andreas Karatzas committed 7 months ago

[CI] Fix Ernie4.5-VL initialization test (#38429)

haosdent committed 7 months ago

[Misc]: clean up non-core lint issues (#37049)

whyiug committed 7 months ago

[Bugfix] Disallow renderer_num_workers > 1 with mm processor cache (#38418)

Bvicii committed 7 months ago

[CI Bugfix] Pre-download missing FlashInfer headers in Docker build (#38391)

Michael Goin committed 7 months ago

[Test] Fix flaky race condition in test_abort_final_step (#38414)

yzong-rh committed 7 months ago

Fix Device Index for ROCm Ray Workers in MoE Benchmark (#38108)

Liwen committed 7 months ago

[ROCm] [Release] Update ROCm variant from rocm700 to rocm721 (#38413)

TJian committed 7 months ago

[Bugfix]fix output Nan/Inf in marlin if dtype=float16 (#33972)

IriKa committed 7 months ago

[Perf] Use torch compile to fuse pack topk in trtllm moe (#37695)

Wei Zhao committed 7 months ago

Add nvidia h800 moe config (#31201)

rongfu.leng committed 7 months ago

[ROCm][Documentation] update quickstart and installation to include rocm nightly docker tips (#38367)

Hongxia Yang committed 7 months ago

[ROCm][CI/Build] ROCm 7.2.1 release version; torch 2.10; triton 3.6 (#38252)

Gregory Shtrasberg committed 7 months ago

[NVIDIA] Fix DGX Spark logic (#38126)

Johnny committed 7 months ago

[Model Runner V2] Rebuild attention metadata before eagle decode full… (#38311)

Giancarlo Delfin committed 7 months ago

[CI] Skip failing test (#38369)

Nicolò Lucchesi committed 7 months ago

[QeRL] Compose online quantization with quantized reloading (#38032)

Kyle Sayers committed 7 months ago

Add short flag `-sc` for `--speculative-config` argument (#38380)

Michael Goin committed 7 months ago