Skip to the content

Qwen 2.5 7B Instruct Turbo

alibaba/qwen2.5-7b-instruct

Maker
Alibaba (Qwen), China
Released
2024-09-19
Family
qwen
Weights
open (apache-2.0)
Tasks
text.chat
Cheapest offering
Together AI, about $0.00039 for a typical text.chat call

Offerings

ProviderModel id at the providerStatusPrice per 1M tokensPer-unit pricesLimitsCapabilities (level)
Together AIQwen/Qwen2.5-7B-Instruct-Turbodeprecated
  • Input: $0.3
  • Output: $0.3
Since 2026-11-03 · models.dev, MIT
none
  • Context: 32,768 tokens
  • Max output: 32,768 tokens
  • input.text claimed
  • output.text claimed
  • tools claimed
  • structured_output claimed
  • parallel_tools claimed
  • tool_choice claimed

Run it locally

Free on your own device. Memory is the weights, the KV cache at the context shown and about 10% overhead; a longer context needs more. GB are 109 bytes. See local models.

RuntimeModel id in the runtimeQuantizationNeedsContext
llama.cpplmstudio-community/Qwen2.5-7B-Instruct-GGUF:Q4_K_MQ4_K_M
  • Memory: 5.67 GB at 8,192 tokens
  • GPU memory: 5.67 GB
  • Disk: 4.69 GB
  • Parameters: 7.6B
  • License: apache-2.0
  • Context: 32,768 tokens
llama.cpplmstudio-community/Qwen2.5-7B-Instruct-GGUF:Q6_KQ6_K
  • Memory: 7.4 GB at 8,192 tokens
  • GPU memory: 7.4 GB
  • Disk: 6.26 GB
  • Parameters: 7.6B
  • License: apache-2.0
  • Context: 32,768 tokens
llama.cpplmstudio-community/Qwen2.5-7B-Instruct-GGUF:Q8_0Q8_0
  • Memory: 9.43 GB at 8,192 tokens
  • GPU memory: 9.43 GB
  • Disk: 8.1 GB
  • Parameters: 7.6B
  • License: apache-2.0
  • Context: 32,768 tokens
LM Studiolmstudio-community/Qwen2.5-7B-Instruct-GGUF/Qwen2.5-7B-Instruct-Q4_K_M.ggufQ4_K_M
  • Memory: 5.67 GB at 8,192 tokens
  • GPU memory: 5.67 GB
  • Disk: 4.69 GB
  • Parameters: 7.6B
  • License: apache-2.0
  • Context: 32,768 tokens
LM Studiolmstudio-community/Qwen2.5-7B-Instruct-GGUF/Qwen2.5-7B-Instruct-Q6_K.ggufQ6_K
  • Memory: 7.4 GB at 8,192 tokens
  • GPU memory: 7.4 GB
  • Disk: 6.26 GB
  • Parameters: 7.6B
  • License: apache-2.0
  • Context: 32,768 tokens
LM Studiolmstudio-community/Qwen2.5-7B-Instruct-GGUF/Qwen2.5-7B-Instruct-Q8_0.ggufQ8_0
  • Memory: 9.43 GB at 8,192 tokens
  • GPU memory: 9.43 GB
  • Disk: 8.1 GB
  • Parameters: 7.6B
  • License: apache-2.0
  • Context: 32,768 tokens
MLXmlx-community/Qwen2.5-7B-Instruct-4bit4bit
  • Memory: 5.23 GB at 8,192 tokens
  • GPU memory: 5.23 GB
  • Disk: 4.29 GB
  • Parameters: 7.6B
  • License: apache-2.0
  • Context: 32,768 tokens
Ollamaqwen2.5:7bQ4_K_M
  • Memory: 5.75 GB at 8,192 tokens
  • GPU memory: 5.75 GB
  • Disk: 4.75 GB
  • Parameters: 7.6B
  • License: apache-2.0
  • Context: 32,768 tokens
WebLLMQwen2.5-7B-Instruct-q4f16_1-MLCq4f16_1
  • Memory: 5.36 GB at 4,096 tokens
  • GPU memory: 5.36 GB
  • Disk: 4.3 GB
  • Parameters: 7.6B
  • Context: 4,096 tokens

Quality scores

BasisScore (0–1)RawMeasuredSource
epoch:gpqa_diamond0.3680.35482026-08-30Epoch AI, CC-BY-4.0, normalized by Nanner Tech

Aliases

Other names the API accepts for this model.

  • qwen/qwen2.5-7b-instruct-turbo

Use it from the API

Look this model up, or ask for the best model for its task on the providers that offer it. See the quickstart and the API reference.

Look up this model
curl 'https://rhumbdata.com/v1/models/alibaba/qwen2.5-7b-instruct' \
  -H "Authorization: Bearer $RHUMB_KEY"
Resolve text.chat on its providers
curl 'https://rhumbdata.com/v1/resolve?task=text.chat&providers=together' \
  -H "Authorization: Bearer $RHUMB_KEY"

Built from catalog version 2026-11-04.3 of . Prices are list prices per 1M tokens unless marked otherwise; every score shows its source's notice (see Attributions).