Truncation control for embedding models (#14776)

Gabriel Marinho committed over 1 year ago

[release] Always git fetch all to get latest tag on TPU release (#17322)

Kevin H. Luu committed over 1 year ago

[V1][Feature] Enable Speculative Decoding with Structured Outputs (#14702)

Benjamin Chislett committed over 1 year ago

Remove Bamba 9B from CI (#17407)

Harry Mellor committed over 1 year ago

[V1][Spec Decode] Apply torch.compile & cudagraph to EAGLE (#17211)

Bryan Lu committed over 1 year ago

Fix: Python package installation for opentelmetry (#17049)

Dilip Gowda Bhagavan committed over 1 year ago

Remove Falcon3 2x7B from CI (#17404)

Harry Mellor committed over 1 year ago

Simplify (and fix) passing of guided decoding backend options (#17008)

Harry Mellor committed over 1 year ago

[Bugfix] Fix Minicpm-O-int4 GPTQ model inference (#17397)

Isotr0py committed over 1 year ago

[CI/Build] Add retry mechanism for add-apt-repository (#17107)

Reid committed over 1 year ago

[CI] Uses Python 3.11 for TPU (#17359)

Aaron Pham committed over 1 year ago

[TPU][V1][CI] Replace `python3 setup.py develop` with standard `pip install --e` on TPU (#17374)

Nicolò Lucchesi committed over 1 year ago

[Doc][Typo] Fixing label in new model requests link in overview.md (#17400)

casinca committed over 1 year ago

[Docs] Propose a deprecation policy for the project (#17063)

Russell Bryant committed over 1 year ago

Enabling multi-group kernel tests. (#17115)

Alexei-V-Ivanov-AMD committed over 1 year ago

[Misc][ROCm] Exclude `cutlass_mla_decode` for ROCm build (#17289)

TY-AMD committed over 1 year ago

fix gemma3 results all zero (#17364)

Qiming Zhang committed over 1 year ago

[Bugfix] add qwen3 reasoning-parser fix content is None when disable … (#17369)

mofanke committed over 1 year ago

[V1] Remove num_input_tokens from attn_metadata (#17193)

Chen Zhang committed over 1 year ago

Improve literal dataclass field conversion to argparse argument (#17391)

Harry Mellor committed over 1 year ago