Llama-3.1-8B-Instruct

meta/llama-3.1-8b-instruct

Maker: Meta, United States
Released: 2024-07-23
Knowledge cutoff: 2023-12
Family: llama
Weights: open (llama3.1)
Tasks: text.chat
Cheapest offering: Groq, about $0.000074 for a typical text.chat call

Try it in the sandbox Use it from the API

Offerings

Provider	Model id at the provider	Status	Price per 1M tokens	Per-unit prices	Limits	Capabilities (level)
Amazon Bedrock	`meta.llama3-1-8b-instruct-v1:0`	deprecateddeprecated 2027-03-30	Input: $0.22 Output: $0.22 Since 2026-11-03 · models.dev, MIT	none	Context: 128,000 tokens Max output: 4,096 tokens	`input.text` claimed `output.text` claimed `tools` claimed
Amazon Bedrock	`us.meta.llama3-1-8b-instruct-v1:0`	deprecateddeprecated 2027-03-30	Input: $0.22 Output: $0.22 Since 2026-11-03 · models.dev, MIT	none	Context: 128,000 tokens Max output: 4,096 tokens	`input.text` claimed `output.text` claimed `tools` claimed
Groq	`llama-3.1-8b-instant`	deprecated	Input: $0.05 Output: $0.08 Since 2026-11-03 · models.dev, MIT	none	Context: 131,072 tokens Max output: 131,072 tokens	`input.text` claimed `output.text` claimed `tools` claimed
OpenRouter	`meta-llama/llama-3.1-8b-instruct`	ga	Input: $0.05 Output: $0.08 Cache read: $0.025 Since 2026-11-03 · models.dev, MIT	none	Context: 131,072 tokens Max output: 117,964 tokens	`input.text` claimed `output.text` claimed `tools` claimed `structured_output` claimed

Run it locally

Free on your own device. Memory is the weights, the KV cache at the context shown and about 10% overhead; a longer context needs more. GB are 10⁹ bytes. See local models.

Runtime	Model id in the runtime	Quantization	Needs	Context
llama.cpp	`lmstudio-community/Meta-Llama-3.1-8B-Instruct-GGUF:Q4_K_M`	Q4_K_M	Memory: 6.6 GB at 8,192 tokens GPU memory: 6.6 GB Disk: 4.93 GB Parameters: 8B License: llama3.1	Context: 131,072 tokens
llama.cpp	`lmstudio-community/Meta-Llama-3.1-8B-Instruct-GGUF:Q5_K_M`	Q5_K_M	Memory: 7.49 GB at 8,192 tokens GPU memory: 7.49 GB Disk: 5.74 GB Parameters: 8B License: llama3.1	Context: 131,072 tokens
llama.cpp	`lmstudio-community/Meta-Llama-3.1-8B-Instruct-GGUF:Q6_K`	Q6_K	Memory: 8.44 GB at 8,192 tokens GPU memory: 8.44 GB Disk: 6.6 GB Parameters: 8B License: llama3.1	Context: 131,072 tokens
llama.cpp	`lmstudio-community/Meta-Llama-3.1-8B-Instruct-GGUF:Q8_0`	Q8_0	Memory: 10.58 GB at 8,192 tokens GPU memory: 10.58 GB Disk: 8.55 GB Parameters: 8B License: llama3.1	Context: 131,072 tokens
LM Studio	`lmstudio-community/Meta-Llama-3.1-8B-Instruct-GGUF/Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf`	Q4_K_M	Memory: 6.6 GB at 8,192 tokens GPU memory: 6.6 GB Disk: 4.93 GB Parameters: 8B License: llama3.1	Context: 131,072 tokens
LM Studio	`lmstudio-community/Meta-Llama-3.1-8B-Instruct-GGUF/Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf`	Q5_K_M	Memory: 7.49 GB at 8,192 tokens GPU memory: 7.49 GB Disk: 5.74 GB Parameters: 8B License: llama3.1	Context: 131,072 tokens
LM Studio	`lmstudio-community/Meta-Llama-3.1-8B-Instruct-GGUF/Meta-Llama-3.1-8B-Instruct-Q6_K.gguf`	Q6_K	Memory: 8.44 GB at 8,192 tokens GPU memory: 8.44 GB Disk: 6.6 GB Parameters: 8B License: llama3.1	Context: 131,072 tokens
LM Studio	`lmstudio-community/Meta-Llama-3.1-8B-Instruct-GGUF/Meta-Llama-3.1-8B-Instruct-Q8_0.gguf`	Q8_0	Memory: 10.58 GB at 8,192 tokens GPU memory: 10.58 GB Disk: 8.55 GB Parameters: 8B License: llama3.1	Context: 131,072 tokens
MLX	`mlx-community/Meta-Llama-3.1-8B-Instruct-4bit`	4bit	Memory: 6.16 GB at 8,192 tokens GPU memory: 6.16 GB Disk: 4.52 GB Parameters: 8B License: llama3.1	Context: 131,072 tokens
Ollama	`llama3.1:8b`	Q4_K_M	Memory: 6.63 GB at 8,192 tokens GPU memory: 6.63 GB Disk: 4.95 GB Parameters: 8B License: llama3.1	Context: 131,072 tokens
Ollama	`llama3.1:8b-instruct-q8_0`	Q8_0	Memory: 10.59 GB at 8,192 tokens GPU memory: 10.59 GB Disk: 8.55 GB Parameters: 8B License: llama3.1	Context: 131,072 tokens
WebLLM	`Llama-3.1-8B-Instruct-q4f16_1-MLC`	q4f16_1	Memory: 5.25 GB at 4,096 tokens GPU memory: 5.25 GB Disk: 4.53 GB Parameters: 8B	Context: 4,096 tokens

Quality scores

Basis	Score (0–1)	Raw	Measured	Source
`epoch:gpqa_diamond`	0.280	0.2696	2026-08-27	Epoch AI, CC-BY-4.0, normalized by Nanner Tech

Aliases

Other names the API accepts for this model.

llama-3.1-8b-instant
meta-llama/llama-3.1-8b-instruct
meta.llama3-1-8b-instruct-v1:0
us.meta.llama3-1-8b-instruct-v1:0

Use it from the API

Look this model up, or ask for the best model for its task on the providers that offer it. See the quickstart and the API reference.

Look up this model

curl 'https://rhumbdata.com/v1/models/meta/llama-3.1-8b-instruct' \
  -H "Authorization: Bearer $RHUMB_KEY"

Resolve text.chat on its providers

curl 'https://rhumbdata.com/v1/resolve?task=text.chat&providers=bedrock,groq,openrouter' \
  -H "Authorization: Bearer $RHUMB_KEY"

Built from catalog version 2026-11-04.3 of 2026-11-04. Prices are list prices per 1M tokens unless marked otherwise; every score shows its source's notice (see Attributions).