[Bugfix] Fix activation quantization for compressed-tensors W4A16 (#31572)

Tmn07 committed 10 months ago

[ROCm][CI] Fix ModernBERT token classification test (#31612)

Andreas Karatzas committed 10 months ago

[Model] Enable LoRA support for tower and connector in LLaVA (#31513)

Jay Hemnani committed 10 months ago

[Bugfix] Fix block size used in EAGLE slot mapping (#31540)

Benjamin Chislett committed 10 months ago

feat: support LoRA for DeepSeek-OCR(Language Model part) (#31569)

zhima771 committed 10 months ago

[ROCm][CI] Fix failure in Language Models Tests (Extra Standard) by reducing agent pool size (#31553)

Andreas Karatzas committed 10 months ago

[Bugfix] Replace BaseException with specific exceptions in FLA utils (#31590)

Kevin McKay committed 10 months ago

Add Multimodal Processor Benchmark (#29105)

Reagan Lee committed 10 months ago

[Audio] Improve Audio Inference Scripts (offline/online) (#29279)

Ekagra Ranjan committed 10 months ago

[CI][Bugfix] Fix token counting in chunked prefill streaming test (#31565)

Andreas Karatzas committed 10 months ago

[BugFix] Fix async scheduling for pooling models (#31584)

Nick Hill committed 10 months ago

[Bugfix] Fix BAGEL online serving for text and image understanding (#31546)

Fanjiang Ye committed 10 months ago

Add GLM-ASR multimodal support (#31436)

baonudesifeizhai committed 10 months ago

[ROCm][CI] Update MiniCPM model test: MiniCPM3-4B to MiniCPM4.1-8B and simplify attention backend testing (#31551)

Andreas Karatzas committed 10 months ago

[Bug] Fix log issue with `\n` (#31390)

Wentao Ye committed 10 months ago

Add get_expert_mapping to NemotronHModel (for LoRA support) (#31539)

danisereb committed 10 months ago

[CI] [Critical] [CUDA] Fix duplicated test name (#31562)

TJian committed 10 months ago

[Core] Remove unused `num_tokens` parameter from `_init_model_kwargs` (#31517)

maang-h committed 10 months ago

[BugFix] Fix NUMA node validation in CPU platform (#31520)

SameerAsal committed 10 months ago

[Mics] add pcp basic support to MoE model (#31003)

Qiu committed 10 months ago