What Building the Shippy Agent Taught Us: How to Build Reliable AI Agents for Operational Tasks
The Skylight (Ai2) team shared their experience developing Shippy, an AI agent for maritime awareness. The main challenge is ensuring reliability under high-stakes conditions. Shippy's architecture includes a "soul" (system prompt), skills (markdown files), and configuration. For determinism, the agent uses a CLI instead of direct API calls. Each user works in an isolated session via the Mothership platform. Agent evaluation is conducted on live data using custom scenarios; Shippy is open for testing by early users.
Allen Institute for AI
Anthropic











