flagship · Dec 2024
Llama 3.3 70B
Meta’s reliable workhorse — great quality-to-cost ratio for production.
By Meta · Text · Llama 3.3 Community License
Model details
Specs & substance
Spec sheet
Developed byMeta
Model familyLlama
Categoryflagship
ModalityText
Context window128K tokens
ArchitectureDense FP8
Version3.3
LicenseLlama 3.3 Community License
Pricing$0.22 in$0.50 out · $0.11 cache
ReleasedDec 2024
Endpointparasail-llama-33-70b-fp8
Meta’s reliable workhorse — great quality-to-cost ratio for production.
Llama 3.3 70B is part of the Llama family by Meta, categorized as a flagship model. It supports a 128K tokens context window and is built on a Dense FP8 architecture.
Key strengths: general, production. Parasail serves Llama 3.3 70B on a global fleet of current-gen GPUs behind a single OpenAI-compatible endpoint — with per-token pricing, no minimums, and dedicated capacity options when you need guaranteed throughput.
Integrate
Drop-in via the OpenAI SDK
Point any OpenAI-compatible chat client at Parasail and change the model name. That's it.
pythonparasail · Llama 3.3 70B
from openai import OpenAI
client = OpenAI(
api_key="YOUR_API_KEY",
base_url="https://api.parasail.io/v1"
)
response = client.chat.completions.create(
model="parasail-llama-33-70b-fp8",
messages=[
{"role": "user", "content": "Hello, what can you do?"}
],
stream=True,
stream_options={"include_usage": True},
top_p=1,
max_tokens=1000,
temperature=1
)
for chunk in response:
if chunk.choices and chunk.choices[0].delta.content is not None:
print(chunk.choices[0].delta.content, end="", flush=True)bashparasail · Llama 3.3 70B
curl https://api.parasail.io/v1/chat/completions \
-H "Authorization: Bearer $PARASAIL_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "parasail-llama-33-70b-fp8",
"messages": [{"role": "user", "content": "Hello, what can you do?"}],
"stream": true,
"max_tokens": 1000
}'More models