multimodal

The Ruby-native AI framework. Chats, agents, tools, images, audio, and video through one consistent API, in plain Ruby or Rails.

Let Claude (or any LLM) actually watch a video — scene-aware, deduplicated frames + transcript, from a URL or local file. Runs locally, MIT.

Open source SDK for building multimodal data-quality, processing, enrichment, and curation pipelines for robotics and Physical AI.