Llama 3.1 Nemotron 70B Instruct Hf API

NVIDIA's Llama 3.1 Nemotron 70B Instruct Hf, through an OpenAI-compatible API. Providers quote it on an open exchange, and each request goes to the offer with the lowest estimated charge that meets your rules.

Providers compete for each request. The exchange ranks the offers that meet your rules by estimated charge. It fixes your maximum charge before the first token, and you pay for the tokens that the model uses.
The OpenAI and Anthropic APIs. Use the OpenAI or Anthropic SDK that you have. Set the base URL and your key, and send llama-3.1-nemotron-70b-instruct-hf as the model.
Your data rules. Send x-liquid-retention: none and only offers whose provider does not keep your content compete for the request.

Facts

Model name: llama-3.1-nemotron-70b-instruct-hf
Maker: NVIDIA
Context window: 16.4K tokens
Input price: $0.357 per million tokens
Output price: $0.408 per million tokens
Providers: 1 independent provider
Regions: us

Providers

Architect: us, $0.357 input and $0.408 output per million tokens, $0.357 cache read per million tokens, 16.4K tokens of context

Request

curl https://router.inference.ai.exchange/v1/chat/completions \
  -H "Authorization: Bearer $LIQUID_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.1-nemotron-70b-instruct-hf",
    "messages": [{"role":"user","content":"Say hello."}]
  }'

Questions

What is Llama 3.1 Nemotron 70B Instruct Hf?: Llama 3.1 Nemotron 70B Instruct Hf is a model from NVIDIA.
How much does Llama 3.1 Nemotron 70B Instruct Hf cost?: Offers now ask $0.357 per million input tokens and $0.408 per million output tokens. A job pays for the tokens it uses. The exchange picks the cheapest eligible offer.
What is the context length of Llama 3.1 Nemotron 70B Instruct Hf?: The largest offer takes 16,384 input tokens. A smaller offer can take less. The exchange skips an offer that cannot take your message.
What can Llama 3.1 Nemotron 70B Instruct Hf do?: Its providers list Reasoning effort, JSON object, JSON schema, Frequency penalty, Logit bias, Log probabilities, Min-p sampling, Presence penalty, Repetition penalty, Seed, Stop sequences, Top-k sampling, Top-p sampling, Text, Tools.
What inputs and outputs does Llama 3.1 Nemotron 70B Instruct Hf support?: Text → Text.
Which providers serve Llama 3.1 Nemotron 70B Instruct Hf?: 1 independent provider quote it now, with 1 offer. The table above ranks them by the cost of a typical job.
How do I call Llama 3.1 Nemotron 70B Instruct Hf?: Send "llama-3.1-nemotron-70b-instruct-hf" as the model in an OpenAI or Anthropic request. The API section links to setup steps for each client.
When was Llama 3.1 Nemotron 70B Instruct Hf listed?: The exchange first listed it on 10/10/2026. This is not its release date.

Llama 3.1 Nemotron 70B Instruct Hf API

Facts

Providers

Request

Questions

Related pages