@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 5d2a1a9cf0
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 23:15 UTC

Unmark more files as executable (#5962)

Tyler Michael Smith committed Jun 28, 2024 at 17:34 UTC 5d2a1a9cf0f47ac4f1676c17a835a05d4b4e4175
3 files changed
csrc/punica/bgmv/bgmv_config.h
examples/offline_inference_neuron.py
vllm/model_executor/models/__init__.py