The GradientLLM class is used to interact with Gradient AI inference Endpoint models. This requires your Gradient AI Access Token which is autoloaded if not specified.

Hierarchy

Constructors

Properties

model: any
modelSlug: string = "llama2-7b-chat"
adapterId?: string
gradientAccessKey?: string
inferenceParameters?: Record<string, unknown>
workspaceId?: string

Methods

Generated using TypeDoc