Open-source ETL Duckle loads 20M rows in 15.69s, beats Airbyte
JafarNajafov · x · 2026-08-17
SlothFlowLabs released Duckle, an open-source ETL tool that loads 20 million rows of CSV data into DuckDB in just 15.69 seconds, significantly outperforming competitors like Airbyte and dlt. Duckle compiles visual pipelines to SQL and runs on DuckDB, supporting Python, a visual canvas, or natural language descriptions. It features a local AI assistant, Duckie, running Qwen 2.5 Coder 1.5B via llama.cpp without API keys. It supports 103 data sources, 130 transforms, and vector database sinks, packaged in a 65 MB binary.
More from Infra
- Omarchy: DHH-endorsed, agent-first Linux operating system — vista8 · 2026-08-17
- Llama-3.0-Flash Leaked to Run End-to-End on a Single DGX Spark — Affectionate-File-26 · 2026-08-17
- AWS Trainium 4 Projected to Deploy 5M Units by 2H27, 12M by 2028 — zephyr_z9 · 2026-08-17
- IBM Open Sources Docling-Graph: Converting PDFs to Knowledge Graphs — aigleeson · 2026-08-17
- How to choose an LLM API? Developers weigh cost, speed, and reliability — Puzzleheaded-Fig1589 · 2026-08-17
- llama.cpp Adds Support for Ling 3.0 Models — parepeg · 2026-08-17