Daft

Daft

High-performance data engine for AI workloads

Description

Multimodal data like images, audio and video strains traditional dataframes, and scaling out means new tools. Daft is a Rust high-performance data engine for AI and multimodal workloads, processing images, audio, video and structured data at any scale.

It has a Python API, supports Arrow, Parquet and Iceberg, and scales with Ray.

Features



Multimodal:Images, media and tables.

Fast:Rust engine.

Distributed:Ray.

Formats:Arrow, Parquet and Iceberg.