@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

main

use combo kernel to fuse qk-norm and qk-rope (#26682)

Boyuan Feng committed about 1 year ago

[CI/Build] Cleanup LoRA test (#26752)

Jee Jee Li committed about 1 year ago

[Feature] Change vllm.py with pydantic validation (#26726)

Vladislav Bronzov committed about 1 year ago

[CI] Fix test_tool_id_kimi_k2 (#26787)

Chauncey committed about 1 year ago

[Doc] ruff format some Python examples (#26767)

Cyrus Leung committed about 1 year ago

Don't allow `typos` to fix by default (#26785)

Harry Mellor committed about 1 year ago

← Newer Page 599 of 1120 Older →