docs/features · tduncan/Nvidia-Optimization-Stack-VLLM · siGit Code & Deploy

@tduncan / Nvidia-Optimization-Stack-VLLM

Code Commits Issues Pulls Cloud Agent CI/CD

main

quantization

speculative_decoding

automatic_prefix_caching.md

batch_invariance.md

context_extension.md

cross_encoder_cache.md

custom_arguments.md

custom_logitsprocs.md

disagg_encoder.md

disagg_prefill.md

ec_cpu_connector.md

engram.md

index_cache.md

initialized_snapshots.md

interleaved_thinking.md

kv_offloading_usage.md

lora.md

mooncake_connector_usage.md

mooncake_ec_connector_usage.md

mooncake_store_connector_usage.md

moriio_connector_usage.md

multimodal_inputs.md

nixl_connector_compatibility.md

nixl_connector_usage.md

per_request_metrics.md

preload.md

prompt_embeds.md

README.md

reasoning_outputs.md

sleep_mode.md

structured_outputs.md

tool_calling.md

watermarking.md