Daft Engineering Blog
Subscribe
Sign in
Home
Archive
About
Latest
Top
Discussions
We cloned over 15,000 repos to find the best developers
An adventure in AI and data engineering to analyze developers across Github
Apr 22
•
Colin
10
Share this post
Daft Engineering Blog
We cloned over 15,000 repos to find the best developers
Copy link
Facebook
Email
Notes
More
March 2025
DeepSeek smallpond, 3FS and data processing for AI
A closer look beyond the AI hype
Mar 18
•
Jay
and
Sammy Sidhu
9
Share this post
Daft Engineering Blog
DeepSeek smallpond, 3FS and data processing for AI
Copy link
Facebook
Email
Notes
More
2
December 2024
Enable Swordfish for Local Execution, Tracing for Daft Distributed Queries, and Pre-Shuffle Merge Strategy
The latest November updates on visualizing Daft distributed, completing TPC-H and TPC-DS Benchmarks, and highlighting our open source contributors!
Dec 5, 2024
•
ChanChan Mao
2
Share this post
Daft Engineering Blog
Enable Swordfish for Local Execution, Tracing for Daft Distributed Queries, and Pre-Shuffle Merge Strategy
Copy link
Facebook
Email
Notes
More
November 2024
Fast Parallel CSV Reader, Better Daft Launcher UX, and Support for Stateful UDFs
A look into October’s SQL developments, Hive-partitioned reads, Apache Iceberg Community Meetup, and more!
Nov 8, 2024
•
ChanChan Mao
4
Share this post
Daft Engineering Blog
Fast Parallel CSV Reader, Better Daft Launcher UX, and Support for Stateful UDFs
Copy link
Facebook
Email
Notes
More
From v0.2 to v0.3: Harder, Better, Faster, Stronger
Join us on the journey from Daft v0.2 to v0.3!
Nov 4, 2024
•
Kevin Wang
and
Sammy Sidhu
12
Share this post
Daft Engineering Blog
From v0.2 to v0.3: Harder, Better, Faster, Stronger
Copy link
Facebook
Email
Notes
More
1
October 2024
Introducing Daft-SQL
A SQL API enabling users to interact with their data in a new but familiar way!
Oct 23, 2024
•
Cory Grinstead
6
Share this post
Daft Engineering Blog
Introducing Daft-SQL
Copy link
Facebook
Email
Notes
More
2k+ GitHub Stars, Partition Writes, and a Sneak Peek at Daft Launcher!
Kicking off the 1st edition of the Daft Newsletter
Oct 8, 2024
•
ChanChan Mao
1
Share this post
Daft Engineering Blog
2k+ GitHub Stars, Partition Writes, and a Sneak Peek at Daft Launcher!
Copy link
Facebook
Email
Notes
More
April 2024
Reading Delta Lake with Daft
Announcing the launch of Daft's Delta Lake read support
Apr 10, 2024
•
Jay
5
Share this post
Daft Engineering Blog
Reading Delta Lake with Daft
Copy link
Facebook
Email
Notes
More
March 2024
Adversarial file reading: from 10,000 small CSVs to massive Parquet files
How Daft optimizes the reading of real-world data which is often a mix of "many small files" and "few large files"
Mar 6, 2024
•
Kevin Wang
10
Share this post
Daft Engineering Blog
Adversarial file reading: from 10,000 small CSVs to massive Parquet files
Copy link
Facebook
Email
Notes
More
December 2023
Announcing Daft 0.2: 10x faster IO from S3
Reading data from S3 just got 10x faster!
Dec 13, 2023
•
Jay
5
Share this post
Daft Engineering Blog
Announcing Daft 0.2: 10x faster IO from S3
Copy link
Facebook
Email
Notes
More
July 2023
Working with the Apache Parquet file format
Quick notes written from 200 meters down the Parquet rabbit hole
Jul 12, 2023
•
Jay
9
Share this post
Daft Engineering Blog
Working with the Apache Parquet file format
Copy link
Facebook
Email
Notes
More
1
June 2023
Introducing Daft: A High-Performance Distributed Dataframe Library for Multimodal Data
The challenges of processing multimodal data, including images, embeddings, and nested structures, have always posed a significant hurdle for…
Jun 6, 2023
•
Sammy Sidhu
17
Share this post
Daft Engineering Blog
Introducing Daft: A High-Performance Distributed Dataframe Library for Multimodal Data
Copy link
Facebook
Email
Notes
More
4
Share
Copy link
Facebook
Email
Notes
More
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts
