# Daft > Daft is a high-performance data engine providing simple and reliable data processing for any modality and scale, from local to petabyte-scale distributed workloads. The core engine is written in Rust and exposes both SQL and Python DataFrame interfaces as first-class citizens. ## Guide - [Classify](https://docs.daft.ai/en/stable/ai-functions/classify.txt) - [Embed](https://docs.daft.ai/en/stable/ai-functions/embed.txt) - [Overview](https://docs.daft.ai/en/stable/ai-functions/overview.txt) - [Prompt](https://docs.daft.ai/en/stable/ai-functions/prompt.txt) - [Providers](https://docs.daft.ai/en/stable/ai-functions/providers.txt) - [Architecture](https://docs.daft.ai/en/stable/architecture/index.txt) - [Benchmarks](https://docs.daft.ai/en/stable/benchmarks/index.txt) - [Sessions, Catalogs, and Tables](https://docs.daft.ai/en/stable/configuration/sessions-usage.txt) - [AWS S3](https://docs.daft.ai/en/stable/connectors/aws.txt) - [Azure Blob Store](https://docs.daft.ai/en/stable/connectors/azure.txt) - [Bigtable](https://docs.daft.ai/en/stable/connectors/bigtable.txt) - [ClickHouse](https://docs.daft.ai/en/stable/connectors/clickhouse.txt) - [COS (Tencent Cloud)](https://docs.daft.ai/en/stable/connectors/cos.txt) - [Custom Catalogs](https://docs.daft.ai/en/stable/connectors/custom-catalogs.txt) - [Custom Connectors](https://docs.daft.ai/en/stable/connectors/custom.txt) - [Delta Lake](https://docs.daft.ai/en/stable/connectors/delta_lake.txt) - [Files](https://docs.daft.ai/en/stable/connectors/files.txt) - [Google Cloud Storage](https://docs.daft.ai/en/stable/connectors/gcs.txt) - [Generic File Source Options](https://docs.daft.ai/en/stable/connectors/generic-file-source-options.txt) - [AWS Glue](https://docs.daft.ai/en/stable/connectors/glue.txt) - [GooseFS](https://docs.daft.ai/en/stable/connectors/goosefs.txt) - [Apache Gravitino](https://docs.daft.ai/en/stable/connectors/gravitino.txt) - [Apache Hudi](https://docs.daft.ai/en/stable/connectors/hudi.txt) - [Hugging Face Datasets](https://docs.daft.ai/en/stable/connectors/huggingface.txt) - [Apache Iceberg](https://docs.daft.ai/en/stable/connectors/iceberg.txt) - [Overview](https://docs.daft.ai/en/stable/connectors/index.txt) - [Apache Kafka](https://docs.daft.ai/en/stable/connectors/kafka.txt) - [Lance](https://docs.daft.ai/en/stable/connectors/lance.txt) - [MCAP](https://docs.daft.ai/en/stable/connectors/mcap.txt) - [Apache Paimon](https://docs.daft.ai/en/stable/connectors/paimon.txt) - [Postgres](https://docs.daft.ai/en/stable/connectors/postgres.txt) - [AWS S3 Tables](https://docs.daft.ai/en/stable/connectors/s3tables.txt) - [SQL Databases](https://docs.daft.ai/en/stable/connectors/sql.txt) - [Text Files](https://docs.daft.ai/en/stable/connectors/text.txt) - [Turbopuffer](https://docs.daft.ai/en/stable/connectors/turbopuffer.txt) - [Unity Catalog (Databricks)](https://docs.daft.ai/en/stable/connectors/unity_catalog.txt) - [Classes & Methods](https://docs.daft.ai/en/stable/custom-code/cls.txt) - [Functions](https://docs.daft.ai/en/stable/custom-code/func.txt) - [Working with GPUs](https://docs.daft.ai/en/stable/custom-code/gpu.txt) - [Overview](https://docs.daft.ai/en/stable/custom-code/index.txt) - [Legacy UDF Migration Guide](https://docs.daft.ai/en/stable/custom-code/migration.txt) - [Aggregate UDFs](https://docs.daft.ai/en/stable/custom-code/udaf.txt) - [Legacy UDFs](https://docs.daft.ai/en/stable/custom-code/udfs.txt) - [Common Crawl](https://docs.daft.ai/en/stable/datasets/common-crawl.txt) - [DROID](https://docs.daft.ai/en/stable/datasets/droid.txt) - [LeRobot v3](https://docs.daft.ai/en/stable/datasets/lerobot.txt) - [Distributed Execution](https://docs.daft.ai/en/stable/distributed/index.txt) - [Running on Kubernetes](https://docs.daft.ai/en/stable/distributed/kubernetes.txt) - [Running on Ray](https://docs.daft.ai/en/stable/distributed/ray.txt) - [Authoring Guide](https://docs.daft.ai/en/stable/extensions/authoring.txt) - [Community Extensions](https://docs.daft.ai/en/stable/extensions/community.txt) - [Overview](https://docs.daft.ai/en/stable/extensions/overview.txt) - [Built on Daft](https://docs.daft.ai/en/stable/extensions/projects.txt) - [Overview](https://docs.daft.ai/en/stable/index.txt) - [Installation](https://docs.daft.ai/en/stable/install.txt) - [Audio](https://docs.daft.ai/en/stable/modalities/audio.txt) - [Custom Modalities](https://docs.daft.ai/en/stable/modalities/custom.txt) - [Documents](https://docs.daft.ai/en/stable/modalities/documents.txt) - [Embeddings](https://docs.daft.ai/en/stable/modalities/embeddings.txt) - [Files and URLs](https://docs.daft.ai/en/stable/modalities/files.txt) - [Images](https://docs.daft.ai/en/stable/modalities/images.txt) - [JSON and Nested Data](https://docs.daft.ai/en/stable/modalities/json.txt) - [Overview](https://docs.daft.ai/en/stable/modalities/overview.txt) - [Tensors](https://docs.daft.ai/en/stable/modalities/tensors.txt) - [Text](https://docs.daft.ai/en/stable/modalities/text.txt) - [Videos](https://docs.daft.ai/en/stable/modalities/videos.txt) - [Dashboard](https://docs.daft.ai/en/stable/observability/dashboard.txt) - [Logging](https://docs.daft.ai/en/stable/observability/logging.txt) - [Progress Indicators](https://docs.daft.ai/en/stable/observability/progress-indicators.txt) - [Telemetry](https://docs.daft.ai/en/stable/observability/telemetry.txt) - [Join Strategies](https://docs.daft.ai/en/stable/optimization/join-strategies.txt) - [Managing Memory Usage](https://docs.daft.ai/en/stable/optimization/memory.txt) - [Partitioning and Batching](https://docs.daft.ai/en/stable/optimization/partitioning.txt) - [Shuffle Algorithms](https://docs.daft.ai/en/stable/optimization/shuffle.txt) - [Quickstart](https://docs.daft.ai/en/stable/quickstart.txt) - [Roadmap](https://docs.daft.ai/en/stable/roadmap.txt) - [Usage Telemetry](https://docs.daft.ai/en/stable/telemetry.txt) - [Batch Inference](https://docs.daft.ai/en/stable/use-case/batch-inference.txt) - [Checkpointing](https://docs.daft.ai/en/stable/use-case/checkpointing.txt) ## Examples - [Audio Transcription](https://docs.daft.ai/en/stable/examples/audio-transcription.txt) - [Working with Common Crawl Data](https://docs.daft.ai/en/stable/examples/common-crawl-daft-tutorial.txt) - [Document Processing](https://docs.daft.ai/en/stable/examples/document-processing.txt) - [Hand Tracking for Physical AI](https://docs.daft.ai/en/stable/examples/hand-tracking-physical-ai.txt) - [Generate Images from Text with Stable Diffusion](https://docs.daft.ai/en/stable/examples/image-generation.txt) - [Examples](https://docs.daft.ai/en/stable/examples/index.txt) - [Running LLMs on the Red Pajamas Dataset](https://docs.daft.ai/en/stable/examples/llms-red-pajamas.txt) - [Web Text Deduplication](https://docs.daft.ai/en/stable/examples/minhash-dedupe.txt) - [Multimodal Structured Outputs: Evaluating Image Understanding](https://docs.daft.ai/en/stable/examples/mm_structured_outputs.txt) - [MNIST Digit Classification](https://docs.daft.ai/en/stable/examples/mnist.txt) - [Querying Image Data](https://docs.daft.ai/en/stable/examples/querying-images.txt) - [Reward Scoring for Physical AI](https://docs.daft.ai/en/stable/examples/reward-scoring-physical-ai.txt) - [Generate Text Embeddings for Turbopuffer](https://docs.daft.ai/en/stable/examples/text-embeddings.txt) - [UDF Patterns](https://docs.daft.ai/en/stable/examples/udf-patterns.txt) - [Voice AI Analytics with Faster-Whisper and embed_text](https://docs.daft.ai/en/stable/examples/voice-ai-analytics.txt) - [Window Functions](https://docs.daft.ai/en/stable/examples/window-functions.txt) ## Python API - [Aggregations](https://docs.daft.ai/en/stable/api/aggregations.txt) - [AI](https://docs.daft.ai/en/stable/api/ai.txt) - [Catalogs & Tables](https://docs.daft.ai/en/stable/api/catalogs_tables.txt) - [Configuration](https://docs.daft.ai/en/stable/api/config.txt) - [DataFrame](https://docs.daft.ai/en/stable/api/dataframe.txt) - [Datasets](https://docs.daft.ai/en/stable/api/datasets.txt) - [DataType](https://docs.daft.ai/en/stable/api/datatypes/all_datatypes.txt) - [Casting](https://docs.daft.ai/en/stable/api/datatypes/casting.txt) - [File Types](https://docs.daft.ai/en/stable/api/datatypes/file_types.txt) - [Type Conversions](https://docs.daft.ai/en/stable/api/datatypes/type_conversions.txt) - [Expressions](https://docs.daft.ai/en/stable/api/expressions.txt) - [Functions](https://docs.daft.ai/en/stable/api/functions/) - [Python API](https://docs.daft.ai/en/stable/api/index.txt) - [I/O](https://docs.daft.ai/en/stable/api/io.txt) - [Miscellaneous](https://docs.daft.ai/en/stable/api/misc.txt) - [Schema](https://docs.daft.ai/en/stable/api/schema.txt) - [Series](https://docs.daft.ai/en/stable/api/series.txt) - [Sessions](https://docs.daft.ai/en/stable/api/sessions.txt) - [User-Defined Functions](https://docs.daft.ai/en/stable/api/udf.txt) - [Window](https://docs.daft.ai/en/stable/api/window.txt) ## SQL Reference - [Data Types](https://docs.daft.ai/en/stable/sql/datatypes.txt) - [Identifiers](https://docs.daft.ai/en/stable/sql/identifiers.txt) - [SQL Reference](https://docs.daft.ai/en/stable/sql/index.txt) - [DESCRIBE](https://docs.daft.ai/en/stable/sql/statements/describe.txt) - [SELECT](https://docs.daft.ai/en/stable/sql/statements/select.txt) - [SHOW](https://docs.daft.ai/en/stable/sql/statements/show.txt) - [USE](https://docs.daft.ai/en/stable/sql/statements/use.txt) - [Window Functions](https://docs.daft.ai/en/stable/sql/window_functions.txt)