Inference Concepts

Generated on 3 Jul 2026

Inference provides a single control plane for managing inference workflows. It includes a Model Catalog where you can view available foundation models, including both DigitalOcean-hosted and third-party commercial models, compare model capabilities and pricing, use routing to match inference requests to the best-fit model, and run inference using serverless or dedicated deployments.

digitalocean-product-icon-available-standalone-service
Best Practices for Context Management when Generating Code with AI Agents

Improve AI output quality by carefully managing LLM context.

digitalocean-product-icon-available-standalone-service
Agent Instructions Best Practices for DigitalOcean Inference

Write effective agent instructions to align responses with your goals, minimize hallucinations, and enhance performance.

digitalocean-product-icon-available-standalone-service
Function Instructions Best Practices for DigitalOcean Inference

Write concise and actionable function instructions by defining purpose, specifying outputs, ensuring concise descriptions, and addressing constraints with structured examples.

digitalocean-product-icon-available-standalone-service
DigitalOcean Evaluations Best Practices

Write effective system prompts, save reusable presets, and define custom metrics for DigitalOcean Evaluations.

digitalocean-product-icon-available-standalone-service
Prompt Writing Best Practices

Write effective prompts to maintain a neutral tone, ask focused questions, simplify complexity, and enhance clarity with examples or screenshots.

digitalocean-product-icon-available-standalone-service
Effectively Group Agents in Workspaces for DigitalOcean Inference

Learn to how you can effectively group agents in workspaces for various purposes.

digitalocean-product-icon-available-standalone-service
Chunking Best Practices for DigitalOcean Knowledge Base Indexing

Choose and configure chunking strategies to improve retrieval accuracy, reduce hallucinations, and optimize token usage when indexing knowledge bases.

digitalocean-product-icon-available-standalone-service
System Instructions Best Practices for DigitalOcean Knowledge Bases

Write effective system instructions for knowledge base responses by defining the model’s role, limits, communication style, and source requirements.

digitalocean-product-icon-available-standalone-service
DigitalOcean Knowledge Base Retrieval Best Practices

Guidance for improving knowledge base retrieval with hybrid search, chunking, filters, and reranking.

We can't find any results for your search.

Try using different keywords or simplifying your search terms.