GroqAI

GroqAI is a high-performance artificial intelligence platform developed by Groq Inc., a company specializing in high-performance computing and AI solutions.

GroqAI utilizes advanced models like Mixtral 8x7B and Llama 2 70B, optimized for natural language processing and data analysis. With its unique Language Processing Unit (LPU), Groq achieves impressive speeds, generating up to 525 tokens per second with the Mixtral model. This architecture allows for efficient data processing, making it suitable for real-time applications.

This is a step-by-step guide on installing and configuring GroqAI for ONLYOFFICE Docs.

Connecting and configuring GroqAI models

  1. Follow this guide for general configuration.
  2. Once the plugin is installed, add AI models. Go to the AI tab, and open Settings.
  3. Select Edit AI models in the bottom left corner of the window and click Add.
  4. In the window that appears, select GroqAI from the drop-down list.
  5. Input your API key in the provided field. The API key is issued by the AI provider and can be generated on the GroqAI official website. Click the Update models list button.
  6. In the row of icons, select the model used for: text, images, embeddings, audio processing, content moderation, real-time tasks, coding help, and visual analysis.
  7. Click OK and close the window. The model will appear in the list of available models in the AI model list.
  8. Assign different tasks to the AI. From the drop-down list, select the installed AI models that will perform these tasks.
  9. Access the AI features through the AI tab or by selecting text and right-clicking to open the context menu.

Host ONLYOFFICE Docs on your own server or use it in the cloud

Article with the tag:
Browse all tags