[CI] Re-use whisper_client for all tests (#30148)

Nicolò Lucchesi committed 11 months ago

[Misc] Rename CohereForAI references to CohereLabs (#30147)

Russell Bryant committed 11 months ago

[Enc-Dec] Fix OOT tokenizer issue (#30144)

Nicolò Lucchesi committed 11 months ago

[KVConnector][Feature] Support KV connector cache reset via /reset_prefix_cache (#27170)

Tova Movshovitz committed 11 months ago

[Compile] Conditional compilation. Introduce compile_ranges (#24252)

Ilya Markov committed 11 months ago

[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315)

Matthew Bonanni committed 11 months ago

[NIXL] Add remote_request_id to kv_transfer_params (#29665)

Mark McLoughlin committed 11 months ago

[BugFix] Eagerly abort cancelled final-step requests (#29987)

Nick Hill committed 11 months ago

[NIXL] Small cleanup of unused variables (#29618)

Nicolò Lucchesi committed 11 months ago

[bugfix] Pass globals to aot_compiled function (#29428)

Angela Yi committed 11 months ago

[responsesAPI][5] ResponsesParser with tools for full MCP python loop (#29798)

Andrew Xia committed 11 months ago

[NIXL] Add compatibility checking to NIXL KV connector handshake (#29503)

Mark McLoughlin committed 11 months ago

Reduce validation to a warning (#28749)

Alec S committed 11 months ago

[Compressed Tensors] Add XPU `wNa16` support (#29484)

Yi Liu committed 11 months ago

[CPU][Perf] Add fast vectorized exp impl from Arm Optimized Routines (#30068)

Elham committed 11 months ago

[CI] Have pre-commit comment on a PR if pre-commit was not used (#30077)

Harry Mellor committed 11 months ago

[Feature] Add Layer-wise NVTX Support (#29990)

Max Hu committed 11 months ago

[ROCm][MXFP4] Infer w4a4 quant method in rocm aiter fused moe (#29775)

Zhiwei committed 11 months ago

[Bugfix] Fix parse_output_message crash on commentary with no recipient (#29972)

strinczer committed 11 months ago

[typing] fix type (#29964)

Ning Xie committed 11 months ago