Groq

[PROVIDER]
id: groq
npm: @ai-sdk/groq
env: GROQ_API_KEY

Models

Canopy Labs Orpheus Arabic Saudi

canopylabs/orpheus-arabic-saudi
in
out
ctx: 4,000 max out: 50,000 in: text out: audio
reasoning tools vision structured temp open weights beta

Canopy Labs Orpheus V1 English

canopylabs/orpheus-v1-english
in
out
ctx: 4,000 max out: 50,000 in: text out: audio
reasoning tools vision structured temp open weights beta

Compound

groq/compound
in
out
ctx: 131,072 max out: 8,192 in: text out: text
reasoning tools vision structured temp open weights

Compound Mini

groq/compound-mini
in
out
ctx: 131,072 max out: 8,192 in: text out: text
reasoning tools vision structured temp open weights

GPT OSS 120B

openai/gpt-oss-120b
in $0.15/M
out $0.60/M
cache read $0.07/M
ctx: 131,072 max out: 65,536 in: text out: text
reasoning tools vision structured temp open weights

GPT OSS 20B

openai/gpt-oss-20b
in $0.07/M
out $0.30/M
cache read $0.04/M
ctx: 131,072 max out: 65,536 in: text out: text
reasoning tools vision structured temp open weights

Llama 3.1 8B

llama-3.1-8b-instant
in $0.05/M
out $0.08/M
ctx: 131,072 max out: 131,072 in: text out: text
reasoning tools vision structured temp open weights

Llama 3.3 70B

llama-3.3-70b-versatile
in $0.59/M
out $0.79/M
ctx: 131,072 max out: 32,768 in: text out: text
reasoning tools vision structured temp open weights

Llama 4 Scout 17B 16E

meta-llama/llama-4-scout-17b-16e-instruct
in $0.11/M
out $0.34/M
ctx: 131,072 max out: 8,192 in: text, image out: text
reasoning tools vision structured temp open weights beta

Llama Prompt Guard 2 22M

meta-llama/llama-prompt-guard-2-22m
in $0.03/M
out $0.03/M
ctx: 512 max out: 512 in: text out: text
reasoning tools vision structured temp open weights beta

Prompt Guard 2 86M

meta-llama/llama-prompt-guard-2-86m
in $0.04/M
out $0.04/M
ctx: 512 max out: 512 in: text out: text
reasoning tools vision structured temp open weights beta

Qwen3-32B

qwen/qwen3-32b
in $0.29/M
out $0.59/M
ctx: 131,072 max out: 40,960 in: text out: text
reasoning tools vision structured temp open weights beta

Safety GPT OSS 20B

openai/gpt-oss-safeguard-20b
in $0.07/M
out $0.30/M
cache read $0.04/M
ctx: 131,072 max out: 65,536 in: text out: text
reasoning tools vision structured temp open weights beta

Whisper

whisper-large-v3
in
out
ctx: 0 max out: 0 in: audio out: text
reasoning tools vision structured temp open weights

Whisper Large V3 Turbo

whisper-large-v3-turbo
in
out
ctx: 0 max out: 0 in: audio out: text
reasoning tools vision structured temp open weights