Groq nuked my free-tier eval at case 91
Ran a 180 case prompt eval against llama 3.3 70b on Groq this morning. First 90 finished in under 4 minutes which felt illegal. Then the free tier hard stopped me mid batch. Error was just rate limit…
Groq
Ultra-fast LLM inference on custom LPU chips