[responsesAPI][7] Browser, Container MCP tools for non harmony models (#29989)

Andrew Xia committed 11 months ago

[Frontend] Add MCP type support infrastructure to Responses API (#30054)

daniel-salib committed 11 months ago

[Performance] Fused blockwise quant RMS norm (#27883)

ElizaWszola committed 11 months ago

[BugFix][DeepSeek-V3.2] Fix backend selection logic for Blackwell (#30195)

Lucas Wilkinson committed 11 months ago

[v1] Add PrefixLM support to FlexAttention backend (#27938)

Isotr0py committed 11 months ago

[Perf] Deepgemm fused layout kernel for activations, 4.3% throughput improvement, 10.7% TTFT improvement. (#29546)

Wentao Ye committed 11 months ago

[CI/Build]Temporary workaround for test_default_mm_loras timeout (#30202)

Jee Jee Li committed 11 months ago

[Kernel][MoE] optimize `moe_align_block_size` (#29642)

Jinzhen Lin committed 11 months ago

[Misc][Core] Remove unused `req_index` increment in scheduler (#30176)

Yifan Qiao committed 11 months ago

Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199)

Cyrus Leung committed 11 months ago

[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)

Cyrus Leung committed 11 months ago

Lazy loading to avoid importing all files (#29716)

Luke committed 11 months ago

[Perf] Enable cuda graph for deepepHT, 5.3% throughput improvement, 4.4% TTFT improvement (#29558)

Wentao Ye committed 11 months ago

Support multiple image/audio embeddings per requests (#29988)

jeremyteboul committed 11 months ago

[Frontend] Remove confusing -O.xx flag error (#30169)

Yanan Cao committed 11 months ago

[MISC]: change NIXL compatibility hash logging level to debug (#30182)

AuruTus committed 11 months ago

[ez] move harmony utils to parser folder (#30117)

Andrew Xia committed 11 months ago

[Model] Move `multimodal_cpu_fields` definition to field config (#30181)

Cyrus Leung committed 11 months ago

Gigachat 3 tool parser and tests (#29905)

Viacheslav committed 11 months ago

simplify requires_files list creation (#29656)

Chukwuma Nwaugha committed 11 months ago