@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / c579b750a0
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 01:45 UTC

[Doc] Add meetups to the doc (#4798)

Zhuohan Li committed May 13, 2024 at 18:48 UTC c579b750a083931ad03ecac898aca5ad67c6c59c
2 files changed +19
docs/source/community/meetups.rst new
+12
@@ -0,0 +1,12 @@
1 +.. _meetups:
2 +
3 +vLLM Meetups
4 +============
5 +
6 +We host regular meetups in San Francisco Bay Area every 2 months. We will share the project updates from the vLLM team and have guest speakers from the industry to share their experience and insights. Please find the materials of our previous meetups below:
7 +
8 +- `The third vLLM meetup <https://robloxandvllmmeetup2024.splashthat.com/>`_, with Roblox, April 2nd 2024, `slides <https://docs.google.com/presentation/d/1A--47JAK4BJ39t954HyTkvtfwn0fkqtsL8NGFuslReM/edit?usp=sharing>`_.
9 +- `The second vLLM meetup <https://lu.ma/ygxbpzhl>`_, with IBM Research, January 31st 2024, `slides <https://docs.google.com/presentation/d/12mI2sKABnUw5RBWXDYY-HtHth4iMSNcEoQ10jDQbxgA/edit?usp=sharing>`_, `video (vLLM Update) <https://youtu.be/Y0C-DUvEnZQ>`_, `video (IBM Research & torch.compile) <https://youtu.be/m0dMtFLI-dg>`_.
10 +- `The first vLLM meetup <https://lu.ma/first-vllm-meetup>`_, with a16z, October 5th, 2023, `slides <https://docs.google.com/presentation/d/1QL-XPFXiFpDBh86DbEegFXBXFXjix4v032GhShbKf3s/edit?usp=sharing>`_.
11 +
12 +We are always looking for speakers and sponsors at San Francisco Bay Area and potentially other locations. If you are interested in speaking or sponsoring, please contact us at `vllm-questions@lists.berkeley.edu <mailto:vllm-questions@lists.berkeley.edu>`_.
docs/source/index.rst
+7
@@ -50,6 +50,7 @@ For more information, check out the following:
50 * `vLLM announcing blog post <https://vllm.ai>`_ (intro to PagedAttention)
51 * `vLLM paper <https://arxiv.org/abs/2309.06180>`_ (SOSP 2023)
52 * `How continuous batching enables 23x throughput in LLM inference while reducing p50 latency <https://www.anyscale.com/blog/continuous-batching-llm-inference>`_ by Cade Daniel et al.
53 +* :ref:`vLLM Meetups <meetups>`.
54
55
56
@@ -112,6 +113,12 @@ Documentation
113 dev/kernel/paged_attention
114 dev/dockerfile/dockerfile
115
116 +.. toctree::
117 + :maxdepth: 2
118 + :caption: Community
119 +
120 + community/meetups
121 +
122 Indices and tables
123 ==================
124