Optional
apiOptional
azureADTokenA function that returns an access token for Microsoft Entra (formerly known as Azure Active Directory), which will be invoked on every request.
Optional
azureAzure OpenAI API deployment name to use for completions when making requests to Azure OpenAI. Completions are only available for gpt-3.5-turbo and text-davinci-003 deployments. This is the name of the deployment you created in the Azure portal. This will fallback to azureOpenAIApiDeploymentName if not provided. e.g. "my-openai-deployment" this will be used in the endpoint URL: https://{InstanceName}.openai.azure.com/openai/deployments/my-openai-deployment/
Optional
azureAzure OpenAI API deployment name to use for completions when making requests to Azure OpenAI. This is the name of the deployment you created in the Azure portal. e.g. "my-openai-deployment" this will be used in the endpoint URL: https://{InstanceName}.openai.azure.com/openai/deployments/my-openai-deployment/
Optional
azureAzure OpenAI API deployment name to use for embedding when making requests to Azure OpenAI. This is the name of the deployment you created in the Azure portal. This will fallback to azureOpenAIApiDeploymentName if not provided. e.g. "my-openai-deployment" this will be used in the endpoint URL: https://{InstanceName}.openai.azure.com/openai/deployments/my-openai-deployment/
Optional
azureAzure OpenAI API instance name to use when making requests to Azure OpenAI. this is the name of the instance you created in the Azure portal. e.g. "my-openai-instance" this will be used in the endpoint URL: https://my-openai-instance.openai.azure.com/openai/deployments/{DeploymentName}/
Optional
azureAPI key to use when making requests to Azure OpenAI.
Optional
azureAPI version to use when making requests to Azure OpenAI.
Optional
azureCustom endpoint for Azure OpenAI API. This is useful in case you have a deployment in another region. e.g. setting this value to "https://westeurope.api.cognitive.microsoft.com/openai/deployments" will be result in the endpoint URL: https://westeurope.api.cognitive.microsoft.com/openai/deployments/{DeploymentName}/
Optional
configurationOptional
frequencyPenalizes repeated tokens according to frequency
Optional
logitDictionary used to adjust the probability of specific tokens being generated
Optional
logprobsWhether to return log probabilities of the output tokens or not. If true, returns the log probabilities of each output token returned in the content of message.
Optional
maxMaximum number of tokens to generate in the completion. -1 returns as many tokens as possible given the prompt and the model's maximum context size.
Optional
modelModel name to use
Optional
modelHolds any additional parameters that are valid to pass to openai.createCompletion
that are not explicitly specified on this class.
Optional
modelModel name to use
Alias for model
Optional
nNumber of completions to generate for each prompt
Optional
openAIApiAPI key to use when making requests to OpenAI. Defaults to the value of
OPENAI_API_KEY
environment variable.
Alias for apiKey
Optional
prefixChatGPT messages to pass as a prefix to the prompt
Optional
presencePenalizes repeated tokens
Optional
stopList of stop words to use when generating
Alias for stopSequences
Optional
stopList of stop words to use when generating
Optional
streamWhether or not to include token usage data in streamed chunks.
Optional
streamingWhether to stream the results or not. Enabling disables tokenUsage reporting
Optional
supportsWhether the model supports the 'strict' argument when passing in tools.
Defaults to true
if modelName
/model
starts with 'gpt-' otherwise
defaults to false
.
Optional
temperatureSampling temperature to use
Optional
timeoutTimeout to use when making requests to OpenAI.
Optional
topAn integer between 0 and 5 specifying the number of most likely tokens to return at each token position, each with an associated log probability. logprobs must be set to true if this parameter is used.
Optional
topPTotal probability mass of tokens to consider at each step
Optional
userUnique string identifier representing your end-user, which can help OpenAI to monitor and detect abuse.
API key to use when making requests to OpenAI. Defaults to the value of
OPENAI_API_KEY
environment variable.