Stream module output asynchronously — stream

Streams text output from a module asynchronously. Returns a promise that resolves to an async generator. Only ordinary PredictModule objects are supported. Modules and composites with specialized forward() semantics are rejected before provider work; use run() for their complete workflows.

Usage

stream_async(module, ..., .llm = NULL)

Arguments

module: A dsprrr Module object
...: Named inputs matching the module's signature
.llm: Optional ellmer Chat object

Value

A promise that resolves to an async generator

Examples

if (FALSE) { # \dontrun{
stream_async(mod, question = "Write a story") |>
  promises::then(function(gen) {
    # Process async generator
  })
} # }