A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 22:00 UTC
Remove unnecessary trailing period in spec_decode.rst (#6405)
Yuan Tang committed
Jul 14, 2024 at 02:58 UTC
6ef3bf912cfb878ff57cf395c4e5908fd9b2a42b
1 file changed
+1
-1
docs/source/models/spec_decode.rst
+1
-1
@@ -73,5 +73,5 @@ Resources for vLLM contributors
73
-------------------------------
74
* `A Hacker's Guide to Speculative Decoding in vLLM <https://www.youtube.com/watch?v=9wNAgpX6z_4>`_
75
* `What is Lookahead Scheduling in vLLM? <https://docs.google.com/document/d/1Z9TvqzzBPnh5WHcRwjvK2UEeFeq5zMZb5mFE8jR0HCs/edit#heading=h.1fjfb0donq5a>`_
76
-* `Information on batch expansion. <https://docs.google.com/document/d/1T-JaS2T1NRfdP51qzqpyakoCXxSXTtORppiwaj5asxA/edit#heading=h.kk7dq05lc6q8>`_
76
+* `Information on batch expansion <https://docs.google.com/document/d/1T-JaS2T1NRfdP51qzqpyakoCXxSXTtORppiwaj5asxA/edit#heading=h.kk7dq05lc6q8>`_
77
* `Dynamic speculative decoding <https://github.com/vllm-project/vllm/issues/4565>`_