Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Groq is not working anymore #860

Open
bharath-naik opened this issue May 20, 2024 · 1 comment
Open

Groq is not working anymore #860

bharath-naik opened this issue May 20, 2024 · 1 comment

Comments

@bharath-naik
Copy link

I've been using Groq for a while, and recently I've encountered an issue where there is no response. Additionally, if I attempt to access the endpoint too frequently, it indicates that the limit has been exceeded. Has there been any recent change in Groq?

activeLlm = new Groq({
          apiKey: process.env.GROQ_API_KEY,
          model:"gemma-7b-it"
        });
@marcusschiesser
Copy link
Collaborator

Just tested examples/groq.ts - works nicely with version 0.3.13.

Also with your model:

Settings.llm = new Groq({
  apiKey: process.env.GROQ_API_KEY,
  model: "gemma-7b-it",
});

If you get a "limit has been exceeded" error this sounds like rate limiting from Groq to me - maybe you need a paid version?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants