Daft Engineering Blog

We Raised $30M to Fix Multimodal Data

Building the future of multimodal/AI data with Daft

Jun 24 • 

Sammy Sidhu

 and 

Jay

4

1

April 2025

We cloned over 15,000 repos to find the best developers

An adventure in AI and data engineering to analyze developers across Github

Apr 22 • 

Colin

12

March 2025

DeepSeek smallpond, 3FS and data processing for AI

A closer look beyond the AI hype

Mar 18 • 

Jay

 and 

Sammy Sidhu

11

2

December 2024

Enable Swordfish for Local Execution, Tracing for Daft Distributed Queries, and Pre-Shuffle Merge Strategy

The latest November updates on visualizing Daft distributed, completing TPC-H and TPC-DS Benchmarks, and highlighting our open source contributors!

Dec 5, 2024 • 

ChanChan Mao

3

November 2024

Fast Parallel CSV Reader, Better Daft Launcher UX, and Support for Stateful UDFs

A look into October’s SQL developments, Hive-partitioned reads, Apache Iceberg Community Meetup, and more!

Nov 8, 2024 • 

ChanChan Mao

5

From v0.2 to v0.3: Harder, Better, Faster, Stronger

Join us on the journey from Daft v0.2 to v0.3!

Nov 4, 2024 • 

Kevin Wang

 and 

Sammy Sidhu

13

1

October 2024

Introducing Daft-SQL

A SQL API enabling users to interact with their data in a new but familiar way!

Oct 23, 2024 • 

Cory Grinstead

7

2k+ GitHub Stars, Partition Writes, and a Sneak Peek at Daft Launcher!

Kicking off the 1st edition of the Daft Newsletter

Oct 8, 2024 • 

ChanChan Mao

1

April 2024

Reading Delta Lake with Daft

Announcing the launch of Daft's Delta Lake read support

Apr 10, 2024 • 

Jay

5

March 2024

Adversarial file reading: from 10,000 small CSVs to massive Parquet files

How Daft optimizes the reading of real-world data which is often a mix of "many small files" and "few large files"

Mar 6, 2024 • 

Kevin Wang

11

December 2023

Announcing Daft 0.2: 10x faster IO from S3

Reading data from S3 just got 10x faster!

Dec 13, 2023 • 

Jay

6

July 2023

Working with the Apache Parquet file format

Quick notes written from 200 meters down the Parquet rabbit hole

Jul 12, 2023 • 

Jay

10

1