@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 08:00 UTC

main

GPTJConfig has no attribute rotary. (#532)

leegohi04517 committed over 3 years ago

Add support for LLaMA-2 (#505)

Zhuohan Li committed over 3 years ago

Ray placement group support (#397)

Antoni Baum committed over 3 years ago

fix(ray_utils): ignore re-init error (#465)

Massimiliano Pronesti committed over 3 years ago

hotfix attn alibi wo head mapping (#496)

Song committed over 3 years ago

Merge pull request #498 from MoeedDar/main

Lily Liu committed over 3 years ago

Fixed old name reference for max_seq_len

MoeedDar committed over 3 years ago

fix max seq len (#489)

Lily Liu committed over 3 years ago

Add support for baichuan (#365)

codethazine committed over 3 years ago

[Fix] Fix the condition of max_seq_len (#477)

Zhuohan Li committed over 3 years ago

[Doc] Add doc for running vLLM on the cloud (#426)

Zhanghao Wu committed over 3 years ago

Offload port selection to OS (#467)

Zhangir Azerbayev committed over 3 years ago

Optimize MQA Kernel (#452)

Zhuohan Li committed over 3 years ago

fix: freeze pydantic to v1 (#429)

Keming committed over 3 years ago

← Newer Page 1108 of 1120 Older →