Anvia Docs

Novita AI exposes OpenAI-compatible LLM endpoints under https://api.novita.ai/openai.

Create the Client

import { AgentBuilder } from "@anvia/core";
import { OpenAIClient } from "@anvia/openai";

const client = new OpenAIClient({
  baseUrl: "https://api.novita.ai/openai",
  apiKey: process.env.NOVITA_API_KEY,
});

const model = client.completionModel("meta-llama/llama-3.1-8b-instruct");

const agent = new AgentBuilder("support", model)
  .instructions("Answer support questions clearly.")
  .build();

const response = await agent.prompt("Hello!").send();

console.log(response.output);

Get the Model List

Novita AI documents model listing as part of its OpenAI-compatible LLM API. Because the client was created with baseUrl, listModels() calls Novita AI's configured models endpoint.

const models = await client.listModels();

console.table(models.data.map((model) => ({ id: model.id, owner: model.ownedBy })));

Notes

Novita AI also offers image, audio, and video APIs. This page focuses only on the OpenAI-compatible LLM endpoint used by OpenAIClient.
Check the specific model for tool calling, structured output, streaming, and multimodal support before enabling those features.

For current Novita AI API details, see the Novita API reference and LLM API introduction.