Skip to content
OpenKey

Llama 3.2 3B Instruct

Meta AIReleased Sep 25, 2024

Llama 3.2 3B is a 3-billion-parameter multilingual large language model, optimized for advanced natural language processing tasks like dialogue generation, reasoning, and summarization. Designed with the latest transformer architecture, it...

Try in playground
Context window
131K tokens
Max output
80K tokens
Input
text
Output
text
Tokenizer
Llama3
Knowledge cutoff
Dec 31, 2023
Released
Sep 25, 2024

Pricing

Per 1M tokens. The provider price and our flat 3% fee are separate columns — what you pay is their sum.

Per 1M tokensProvider+ 3% feeYou pay
Input$0.051$0.0015$0.052
Output$0.335$0.010$0.345

Supported parameters

  • frequency_penalty
  • logit_bias
  • logprobs
  • max_tokens
  • min_p
  • presence_penalty
  • repetition_penalty
  • seed
  • stop
  • temperature
  • top_k
  • top_logprobs
  • top_p

Call it

OpenAI-compatible: point your SDK at api.openkey.ai/v1 and use model meta-llama/llama-3.2-3b-instruct.

Code sample language
curl https://api.openkey.ai/v1/chat/completions \
  -H "Authorization: Bearer $OPENKEY_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/llama-3.2-3b-instruct",
    "messages": [{"role": "user", "content": "Hello"}]
  }'
import os
from openai import OpenAI

client = OpenAI(
    base_url="https://api.openkey.ai/v1",
    api_key=os.environ["OPENKEY_API_KEY"],
)

completion = client.chat.completions.create(
    model="meta-llama/llama-3.2-3b-instruct",
    messages=[{"role": "user", "content": "Hello"}],
)
print(completion.choices[0].message.content)
import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.openkey.ai/v1",
  apiKey: process.env.OPENKEY_API_KEY,
});

const completion = await client.chat.completions.create({
  model: "meta-llama/llama-3.2-3b-instruct",
  messages: [{ role: "user", content: "Hello" }],
});
console.log(completion.choices[0].message.content);

Questions

How much does Llama 3.2 3B Instruct cost via API?
Through OpenKey, Llama 3.2 3B Instruct costs $0.052 per 1M input tokens and $0.345 per 1M output tokens. That is the provider price ($0.051 / $0.335) plus a flat 3% fee — nothing else.
What is Llama 3.2 3B Instruct's context window?
Llama 3.2 3B Instruct accepts up to 131K tokens of context and returns up to 80K tokens per request.
Is Llama 3.2 3B Instruct OpenAI-compatible?
Yes. Send requests to OpenKey's /v1/chat/completions endpoint with model "meta-llama/llama-3.2-3b-instruct" using any OpenAI SDK — only the base URL and API key change.
What inputs does Llama 3.2 3B Instruct support?
Llama 3.2 3B Instruct accepts text input and produces text output. Its knowledge cutoff is Dec 31, 2023.

More from Meta AI

All Meta AI models →