A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 00:30 UTC
[Doc] Add checkmark for GPTBigCodeForCausalLM LoRA support (#5171)
Nick Hill committed
May 31, 2024 at 17:20 UTC
657579113f714c2e74bca373ecfb6c2c245b4101
1 file changed
+1
-1
docs/source/models/supported_models.rst
+1
-1
@@ -62,7 +62,7 @@ Alongside each architecture, we include some popular models that use it.
62
* - :code:`GPTBigCodeForCausalLM`
63
- StarCoder, SantaCoder, WizardCoder
64
- :code:`bigcode/starcoder`, :code:`bigcode/gpt_bigcode-santacoder`, :code:`WizardLM/WizardCoder-15B-V1.0`, etc.
65
- -
65
+ - ✅︎
66
* - :code:`GPTJForCausalLM`
67
- GPT-J
68
- :code:`EleutherAI/gpt-j-6b`, :code:`nomic-ai/gpt4all-j`, etc.