Interface for the indices of a new token produced by an LLM or Chat Model in streaming mode.

Hierarchy

  • NewTokenIndices

Properties

Properties

completion: number
prompt: number

Generated using TypeDoc