@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 6ef3bf912c
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 22:00 UTC

Remove unnecessary trailing period in spec_decode.rst (#6405)

Yuan Tang committed Jul 14, 2024 at 02:58 UTC 6ef3bf912cfb878ff57cf395c4e5908fd9b2a42b
1 file changed +1 -1
docs/source/models/spec_decode.rst
+1 -1
@@ -73,5 +73,5 @@ Resources for vLLM contributors
73 -------------------------------
74 * `A Hacker's Guide to Speculative Decoding in vLLM <https://www.youtube.com/watch?v=9wNAgpX6z_4>`_
75 * `What is Lookahead Scheduling in vLLM? <https://docs.google.com/document/d/1Z9TvqzzBPnh5WHcRwjvK2UEeFeq5zMZb5mFE8jR0HCs/edit#heading=h.1fjfb0donq5a>`_
76 -* `Information on batch expansion. <https://docs.google.com/document/d/1T-JaS2T1NRfdP51qzqpyakoCXxSXTtORppiwaj5asxA/edit#heading=h.kk7dq05lc6q8>`_
76 +* `Information on batch expansion <https://docs.google.com/document/d/1T-JaS2T1NRfdP51qzqpyakoCXxSXTtORppiwaj5asxA/edit#heading=h.kk7dq05lc6q8>`_
77 * `Dynamic speculative decoding <https://github.com/vllm-project/vllm/issues/4565>`_