Llama 3.1 Nemotron 70B Instruct API

NVIDIA's Llama 3.1 Nemotron 70B Instruct, through an OpenAI-compatible API. Providers quote it on an open exchange, and each request goes to the offer with the lowest estimated charge that meets your rules.

Providers compete for each request. The exchange ranks the offers that meet your rules by estimated charge. It fixes your maximum charge before the first token, and you pay for the tokens that the model uses.
The OpenAI and Anthropic APIs. Use the OpenAI or Anthropic SDK that you have. Set the base URL and your key, and send llama-3.1-nemotron-70b-instruct as the model.
Your data rules. Send x-liquid-retention: none and only offers whose provider does not keep your content compete for the request.

Facts

Model name: llama-3.1-nemotron-70b-instruct
Maker: NVIDIA
Context window: 131.1K tokens
Input price: $0.600 per million tokens
Output price: $0.600 per million tokens
Providers: 1 independent provider
Regions: us

Providers

Architect: us, $0.600 input and $0.600 output per million tokens, $0.600 cache read per million tokens, 131.1K tokens of context

Request

curl https://router.inference.ai.exchange/v1/chat/completions \
  -H "Authorization: Bearer $LIQUID_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.1-nemotron-70b-instruct",
    "messages": [{"role":"user","content":"Say hello."}]
  }'

Questions

What is Llama 3.1 Nemotron 70B Instruct?: Llama 3.1 Nemotron 70B Instruct is a model from NVIDIA.
How much does Llama 3.1 Nemotron 70B Instruct cost?: Offers now ask $0.600 per million input tokens and $0.600 per million output tokens. A job pays for the tokens it uses. The exchange picks the cheapest eligible offer.
What is the context length of Llama 3.1 Nemotron 70B Instruct?: The largest offer takes 131,072 input tokens. A smaller offer can take less. The exchange skips an offer that cannot take your message.
What can Llama 3.1 Nemotron 70B Instruct do?: Its providers list Reasoning effort, JSON object, JSON schema, Frequency penalty, Logit bias, Log probabilities, Min-p sampling, Presence penalty, Repetition penalty, Seed, Stop sequences, Top-k sampling, Top-p sampling, Text, Tools.
What inputs and outputs does Llama 3.1 Nemotron 70B Instruct support?: Text → Text.
Which providers serve Llama 3.1 Nemotron 70B Instruct?: 1 independent provider quote it now, with 1 offer. The table above ranks them by the cost of a typical job.
How do I call Llama 3.1 Nemotron 70B Instruct?: Send "llama-3.1-nemotron-70b-instruct" as the model in an OpenAI or Anthropic request. The API section links to setup steps for each client.
When was Llama 3.1 Nemotron 70B Instruct listed?: The exchange first listed it on 10/10/2026. This is not its release date.

Llama 3.1 Nemotron 70B Instruct API

Facts

Providers

Request

Questions

Related pages