Llama 3.1 8B Instruct API

Meta's Llama 3.1 8B Instruct, through an OpenAI-compatible API. Providers quote it on an open exchange, and each request goes to the offer with the lowest estimated charge that meets your rules.

Providers compete for each request. The exchange ranks the offers that meet your rules by estimated charge. It fixes your maximum charge before the first token, and you pay for the tokens that the model uses.
The OpenAI and Anthropic APIs. Use the OpenAI or Anthropic SDK that you have. Set the base URL and your key, and send llama-3.1-8b-instruct as the model.
Your data rules. Send x-liquid-retention: none and only offers whose provider does not keep your content compete for the request.

Facts

Model name: llama-3.1-8b-instruct
Maker: Meta
Context window: 131.1K tokens
Input price: $0.020 per million tokens
Output price: $0.040 per million tokens
Providers: 1 independent provider
Regions: us

Providers

Architect: us, $0.020 input and $0.040 output per million tokens, $0.020 cache read per million tokens, 131.1K tokens of context

Scores

HLE: 5.3, #194 of 273
GPQA: 25.9, #248 of 250
AA-LCR: 18.0, #218 of 237
Terminal-Bench Hard: 0.8, #159 of 166
LiveCodeBench: 11.6, #124 of 130
AIME 2025: 4.3, #97 of 100
MMLU-Pro: 47.6, #125 of 133
τ²-Bench: 16.4, #156 of 169
IFBench: 28.6, #165 of 178

Scores: Artificial Analysis (https://artificialanalysis.ai/)

Request

curl https://router.inference.ai.exchange/v1/chat/completions \
  -H "Authorization: Bearer $LIQUID_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.1-8b-instruct",
    "messages": [{"role":"user","content":"Say hello."}]
  }'

Questions

What is Llama 3.1 8B Instruct?: Llama 3.1 8B Instruct is a model from Meta.
How much does Llama 3.1 8B Instruct cost?: Offers now ask $0.020 per million input tokens and $0.040 per million output tokens. A job pays for the tokens it uses. The exchange picks the cheapest eligible offer.
What is the context length of Llama 3.1 8B Instruct?: The largest offer takes 131,072 input tokens. A smaller offer can take less. The exchange skips an offer that cannot take your message.
What can Llama 3.1 8B Instruct do?: Its providers list Reasoning effort, JSON object, JSON schema, Frequency penalty, Logit bias, Log probabilities, Min-p sampling, Presence penalty, Repetition penalty, Seed, Stop sequences, Top-k sampling, Top-p sampling, Text, Tools.
What inputs and outputs does Llama 3.1 8B Instruct support?: Text → Text.
Which providers serve Llama 3.1 8B Instruct?: 1 independent provider quote it now, with 1 offer. The table above ranks them by the cost of a typical job.
How do I call Llama 3.1 8B Instruct?: Send "llama-3.1-8b-instruct" as the model in an OpenAI or Anthropic request. The API section links to setup steps for each client.
When was Llama 3.1 8B Instruct listed?: The exchange first listed it on 10/10/2026. This is not its release date.