Skip to content
OpenKey

Llama 3.1 70B Instruct

Meta AIReleased Jul 23, 2024

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...

Try in playground
Context window
131K tokens
Max output
16K tokens
Input
text
Output
text
Tokenizer
Llama3
Knowledge cutoff
Dec 31, 2023
Released
Jul 23, 2024

Pricing

Per 1M tokens. The provider price and our flat 3% fee are separate columns — what you pay is their sum.

Per 1M tokensProvider+ 3% feeYou pay
Input$0.400$0.012$0.412
Output$0.400$0.012$0.412

Supported parameters

  • frequency_penalty
  • logit_bias
  • logprobs
  • max_tokens
  • min_p
  • presence_penalty
  • repetition_penalty
  • response_format
  • seed
  • stop
  • structured_outputs
  • temperature
  • tool_choice
  • tools
  • top_k
  • top_logprobs
  • top_p

Call it

OpenAI-compatible: point your SDK at api.openkey.ai/v1 and use model meta-llama/llama-3.1-70b-instruct.

Code sample language
curl https://api.openkey.ai/v1/chat/completions \
  -H "Authorization: Bearer $OPENKEY_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/llama-3.1-70b-instruct",
    "messages": [{"role": "user", "content": "Hello"}]
  }'
import os
from openai import OpenAI

client = OpenAI(
    base_url="https://api.openkey.ai/v1",
    api_key=os.environ["OPENKEY_API_KEY"],
)

completion = client.chat.completions.create(
    model="meta-llama/llama-3.1-70b-instruct",
    messages=[{"role": "user", "content": "Hello"}],
)
print(completion.choices[0].message.content)
import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.openkey.ai/v1",
  apiKey: process.env.OPENKEY_API_KEY,
});

const completion = await client.chat.completions.create({
  model: "meta-llama/llama-3.1-70b-instruct",
  messages: [{ role: "user", content: "Hello" }],
});
console.log(completion.choices[0].message.content);

Questions

How much does Llama 3.1 70B Instruct cost via API?
Through OpenKey, Llama 3.1 70B Instruct costs $0.412 per 1M input tokens and $0.412 per 1M output tokens. That is the provider price ($0.400 / $0.400) plus a flat 3% fee — nothing else.
What is Llama 3.1 70B Instruct's context window?
Llama 3.1 70B Instruct accepts up to 131K tokens of context and returns up to 16K tokens per request.
Is Llama 3.1 70B Instruct OpenAI-compatible?
Yes. Send requests to OpenKey's /v1/chat/completions endpoint with model "meta-llama/llama-3.1-70b-instruct" using any OpenAI SDK — only the base URL and API key change.
What inputs does Llama 3.1 70B Instruct support?
Llama 3.1 70B Instruct accepts text input and produces text output. Its knowledge cutoff is Dec 31, 2023.

More from Meta AI

All Meta AI models →