Packages

vLLM for Elixir via SnakeBridge - Easy, fast, and cheap LLM serving for everyone. High-throughput LLM inference with PagedAttention, continuous batching, and OpenAI-compatible API.

Current section

Files

Jump to
vllm lib snakebridge_generated vllm distributed graph_capture_context.ex
Raw

lib/snakebridge_generated/vllm/distributed/graph_capture_context.ex

# Generated by SnakeBridge v0.15.0 - DO NOT EDIT MANUALLY
# Regenerate with: mix compile
# Library: vllm 0.14.0
# Python module: vllm.distributed
# Python class: GraphCaptureContext
defmodule Vllm.Distributed.GraphCaptureContext do
@moduledoc """
GraphCaptureContext(stream: torch.cuda.streams.Stream)
"""
def __snakebridge_python_name__, do: "vllm.distributed"
def __snakebridge_python_class__, do: "GraphCaptureContext"
def __snakebridge_library__, do: "vllm"
@opaque t :: SnakeBridge.Ref.t()
@doc """
Initialize self. See help(type(self)) for accurate signature.
## Parameters
- `stream` (term())
"""
@spec new(term(), keyword()) :: {:ok, SnakeBridge.Ref.t()} | {:error, Snakepit.Error.t()}
def new(stream, opts \\ []) do
SnakeBridge.Runtime.call_class(__MODULE__, :__init__, [stream], opts)
end
end