@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 06:45 UTC

main

Delay GPU->CPU sync in sampling (#1337)

Antoni Baum committed about 3 years ago

Fix bias in InternLM (#1501)

Woosuk Kwon committed about 3 years ago

Support repetition_penalty (#1424)

ljss committed about 3 years ago

fix: don't skip first special token. (#1497)

Ricardo Lu committed about 3 years ago

Add rope_scaling to Aquila model (#1457)

Qing committed about 3 years ago

Support SqueezeLLM (#1326)

chooper1 committed about 3 years ago

Pin pydantic dependency versions (#1429)

Thiago Salvatore committed about 3 years ago

remove useless statements (#1408)

Wang Ran (汪然) committed about 3 years ago

Fix type hints (#1427)

Light Lin committed about 3 years ago

Fix typo (#1383)

Wang Ran (汪然) committed about 3 years ago

Add Mistral 7B to `test_models` (#1366)

Woosuk Kwon committed about 3 years ago

Change scheduler & input tensor shape (#1381)

Woosuk Kwon committed about 3 years ago

Bump up the version to v0.2.1 (#1355)

Zhuohan Li committed about 3 years ago

Fix sampler test (#1379)

Woosuk Kwon committed about 3 years ago

Fix PyTorch index URL in workflow (#1378)

Woosuk Kwon committed about 3 years ago

Fix PyTorch version to 2.0.1 in workflow (#1377)

Woosuk Kwon committed about 3 years ago

← Newer Page 1099 of 1120 Older →