Groq
Inference Acceleration · since 2016Groq is an AI API inference acceleration provider. TokenAPI Scan independently monitors model authenticity, protocol coverage, response latency, and pricing transparency.
This page aggregates AI API relay detection data for Groq, focusing on whether Claude / OpenAI / Gemini are truly passthrough, whether usage fields are anomalous, whether model lists are usable, and accessibility across different network regions. If you're searching for "Groq real or fake", "Groq review", "API relay detection", or "relay price comparison", we recommend checking the detection summary, network status, and public pricing evidence below before deciding whether to continue using it.
Related:Relay Rankings · Price Comparison · Network Tools · FAQ · Buying Guide
/models endpoint is access-protected; anonymous requests return 401/403. Not counted as "0 models" — marked as "requires API key". 💰 Public Price Snapshot
🟡 Self-reportedFrom the provider public page, not recently verified by us. Here is the full price table for Groq (scraped from the public pricing page, 4 models) - cross-provider comparison at pricing page, API volatility at AI service status.
| Model | Input / M | Output / M | Cache R | W 5m | W 1h | Gov |
|---|---|---|---|---|---|---|
llama3-70b-8192 |
$0.5900 | $0.7900 | — | — | — | raw |
llama3-8b-8192 |
$0.0500 | $0.1000 | — | — | — | raw |
gemma-7b-it |
$0.0700 | $0.0700 | — | — | — | raw |
mixtral-8x7b-32768 |
$0.2400 | $0.2400 | — | — | — | raw |
4 models · Source Groq pricing page · Snapshot 2026-07-29（23:02 UTC） · Last tested 2026-05-21 · Total 16 tests
✅ Strengths
- Top-tier inference speed
- Generous free tier
- Clean API
⚠️ Notes
- Only supports open-source models
- Requires proxy for China access
- Limited model selection
🎯 Use Case
- Ultra-latency-sensitive apps
- Real-time conversation scenarios
- High-throughput scenarios
⚡ Speed Test from Your IP
🔬 Real Detection Summary
Last check: 2026-05-21 20:36 UTC
Recent Detection Latency Trend (30 times, old->new)
By Protocol
Last 5 reports
Source: All metrics from real detections after users submit API keys,Server-side Calls Groq protocol verification requests from endpoints,. Pass rate = Requests returning correct responses / Total Requests。 -> Full Methodology
🛰️ System Probe Summary
The platform runs keyless connectivity probes every 6 hours on this site's OpenAI / Anthropic / Gemini protocol list-models endpoints (HTTP 401/403 counts as connected, indicating the endpoint is alive). Below are the cumulative real results.
By Protocol (System Probe)
Note: Connectivity rate = endpoint responses (incl. 401/403 auth responses) / probe count, measures endpoint liveness not service quality; service quality is determined by key-submitted detections in "Real Detection Summary" above.
📊 Real-time Detection Data
Groq
100.0% Median Pass Rate · Snapshot Loaded💧 Water Rate v2 42.0 / 100 · Fair Real request http=200 ratio 42% avg 1902ms Click to expand formula →
| Report | Protocol | Score | Duration | Time |
|---|---|---|---|---|
| View Report | OPENAI | 100% | 2026-05-21 20:36 | |
| View Report | OPENAI | 100% | 2026-05-18 18:00 | |
| View Report | OPENAI | 100% | 2026-05-18 18:00 | |
| View Report | OPENAI | 100% | 2026-05-17 18:00 | |
| View Report | OPENAI | 100% | 2026-05-17 18:00 |
📋 Protocol Suitability Matrix
Based on 16 real tests of protocol coverage and median pass rate, answering "Which protocols can I use with Groq?"
| Protocol | Tests | Median Pass Rate | Status | Suggestion |
|---|---|---|---|---|
| openai | 16 | 0% | - Unknown | Test with small traffic first |
⏱ Rate Limits & Pricing Multiplier
Key operational parameters that determine whether you can scale concurrent calls.
⚠️ Actual multipliers depend on Groq's backend account. This site does not directly hold account tokens and cannot see hidden SLAs.
🛠 Integration Tutorial: Get Started with Groq in 3 Steps
- Register an account and create an API Key in the backend (the console usually has "My Keys" or "API Tokens" entry).
- Replace the base URL in your code with
https://api.groq.com/openai/v1, and select the model name from Groq's list. - Test a request:
curl https://api.groq.com/openai/v1/v1/chat/completions -H "Authorization: Bearer YOUR_KEY" -H "Content-Type: application/json" -d '{"model":"gpt-4o-mini","messages":[{"role":"user","content":"hello"}]}'
✅ This is an OpenAI Compatibility Mode integration example. Anthropic / Gemini protocols vary slightly by provider, see each site's documentation.。
❓ Frequently Asked Questions
Is Groq reliable?
Based on 16 independent tests by TokenAPI Scan, the median pass rate is 100%.Stable quality, suitable for production.
How much does Groq cost?
Groq's public price page lists 4 models. See the "💰 Public Price Snapshot" section above. Source:Groq。
Which models does Groq support?
Groq's model list is not publicly enumerated yet; log in to the backend to view.
What's the difference between Groq and official?
Official (OpenAI/Anthropic/Google) = first-hand pricing + stable direct connection + strict content moderation and account ban risk. Third-party relays = usually discounted pricing + domestic accessibility + but compounded availability, content moderation, SLA, and service shutdown risks. Which to choose depends on your cost sensitivity, content moderation requirements, and stability priorities. It is recommended to use official for critical paths + relays as backup.
Will Groq shut down?
We continuously monitor relay site reachability. Multiple consecutive failed detections within 30 days = high risk signal. Recommendations: ① Don't top up too much ② Rotate across multiple providers for critical services ③ Watch the Rankings warnings.
💭 Related Questions
💰 Popular Model API Prices
Compare API prices across relay providers: