OpenAI APIs for SquirroGPT

1

Hey Squirro. Shortly, we’re going to start implementing SquirroGPT. We will use the Azure OpenAI service but are trying to determine which model to use.

  • Does SquirroGPT support both GPT-3.5 or GPT-4,?

  • Does SquirroGPT use the Completion API or the Chat Completion API? Is that configurable?

2
  • SquirroGPT supports both GPT-3.5 as well as GPT-4 in terms of configuration. You can use Microsoft Azure’s documentation to deploy the LLM of your choice using the following documentation and then use Squirro documentation to configure the deployed model to be used by SquirroGPT. But given that the SquirroGPT prompts have been heavily optimized for GPT-3.5, the performance of SquirroGPT might vary when configured with GPT-4. Developing optimized prompts for GPT-4 is currently on the roadmap of SquirroGPT.
  • SquirroGPT currently uses the chat completions API. The completions API from OpenAI has already been marked as a legacy object and most models that support the legacy API would be deprecated on January 4th, 2024. More details here
2 Likes
3

Thanks for the info @saurabh !