Quick Start

Sign up at app.aethon.ai/register. You'll receive an API key immediately.

Already have an account? Find your key at Dashboard > Settings.

pip install openai

from openai import OpenAI

client = OpenAI(
    api_key="your-aethon-api-key",
    base_url="https://api.aethon.ai/v1",  # one-line switch
)

response = client.chat.completions.create(
    model="llama3.1:8b",
    messages=[{"role": "user", "content": "Hello!"}],
)

print(response.choices[0].message.content)

The only change from OpenAI is base_url. Your existing code works as-is.

Add stream=True for token-by-token output:

from openai import OpenAI

client = OpenAI(
    api_key="your-aethon-api-key",
    base_url="https://api.aethon.ai/v1",
)

stream = client.chat.completions.create(
    model="llama3.1:8b",
    messages=[{"role": "user", "content": "Write a haiku about GPUs"}],
    stream=True,
)

for chunk in stream:
    if chunk.choices[0].delta.content:
        print(chunk.choices[0].delta.content, end="")