Class: DeepInfra
Unified language model interface
Extends
Constructors
new DeepInfra()
new DeepInfra(
init
?):DeepInfra
Parameters
• init?: Partial
<OpenAI
>
Returns
Overrides
Defined in
packages/llamaindex/src/llm/deepinfra.ts:9
Properties
additionalChatOptions?
optional
additionalChatOptions:OpenAIAdditionalChatOptions
Inherited from
Defined in
packages/llamaindex/src/llm/openai.ts:163
additionalSessionOptions?
optional
additionalSessionOptions:Omit
<Partial
<ClientOptions
>,"apiKey"
|"timeout"
|"maxRetries"
>
Inherited from
OpenAI
.additionalSessionOptions
Defined in
packages/llamaindex/src/llm/openai.ts:170
apiKey?
optional
apiKey:string
=undefined
Inherited from
Defined in
packages/llamaindex/src/llm/openai.ts:166
maxRetries
maxRetries:
number
Inherited from
Defined in
packages/llamaindex/src/llm/openai.ts:167
maxTokens?
optional
maxTokens:number
Inherited from
Defined in
packages/llamaindex/src/llm/openai.ts:162
model
model:
string
Inherited from
Defined in
packages/llamaindex/src/llm/openai.ts:159
session
session:
OpenAISession
Inherited from
Defined in
packages/llamaindex/src/llm/openai.ts:169
temperature
temperature:
number
Inherited from
Defined in
packages/llamaindex/src/llm/openai.ts:160
timeout?
optional
timeout:number
Inherited from
Defined in
packages/llamaindex/src/llm/openai.ts:168
topP
topP:
number
Inherited from
Defined in
packages/llamaindex/src/llm/openai.ts:161
Accessors
metadata
get
metadata():LLMMetadata
Returns
Inherited from
Defined in
packages/llamaindex/src/llm/openai.ts:226
supportToolCall
get
supportToolCall():boolean
Returns
boolean
Inherited from
Defined in
packages/llamaindex/src/llm/openai.ts:222
Methods
chat()
chat(params)
chat(
params
):Promise
<AsyncIterable
<ChatResponseChunk
<ToolCallLLMMessageOptions
>>>
Get a chat response from the LLM
Parameters
• params: LLMChatParamsStreaming
<OpenAIAdditionalChatOptions
, ToolCallLLMMessageOptions
>
Returns
Promise
<AsyncIterable
<ChatResponseChunk
<ToolCallLLMMessageOptions
>>>
Inherited from
Defined in
packages/llamaindex/src/llm/openai.ts:303
chat(params)
chat(
params
):Promise
<ChatResponse
<ToolCallLLMMessageOptions
>>
Get a chat response from the LLM
Parameters
• params: LLMChatParamsNonStreaming
<OpenAIAdditionalChatOptions
, ToolCallLLMMessageOptions
>
Returns
Promise
<ChatResponse
<ToolCallLLMMessageOptions
>>
Inherited from
Defined in
packages/llamaindex/src/llm/openai.ts:309
complete()
complete(params)
complete(
params
):Promise
<AsyncIterable
<CompletionResponse
>>
Get a prompt completion from the LLM
Parameters
• params: LLMCompletionParamsStreaming
Returns
Promise
<AsyncIterable
<CompletionResponse
>>
Inherited from
Defined in
packages/core/dist/llms/index.d.ts:168
complete(params)
complete(
params
):Promise
<CompletionResponse
>
Get a prompt completion from the LLM
Parameters
• params: LLMCompletionParamsNonStreaming
Returns
Promise
<CompletionResponse
>