Profile
Back to NewsBack
GitHub Trending 2 min
Reader Mode
hugues31/duckpad: The data transformation tool the open-source community deserves.

hugues31/duckpad: The data transformation tool the open-source community deserves.

Duckpad

Tests</a> PyPI version</a> Python versions</a> License: MIT</a>

See the flow. Trust the result.

An open-source SQL workspace powered by DuckDB 2.0. Turn scattered data into visual pipelines, explore the results and trace a number all the way back to its source.

Visit the website</a>

Watch Duckpad in one minute: build visual pipelines and version your work</a>

  • Compose visually. Connect sources, joins and reusable components. Use guided
forms to prepare columns and values, or write your own SQL nodes.
  • Explore and check your data. Sample and filter results, save views, compute
column statistics, and keep data tests and execution messages next to your SQL.
  • Explain a number. Follow a result cell back to its contributing source
values, with
explicit lineage coverage.
  • Review changes. Saves create Git commits. Work on separate branches, compare
changes visually and review a merge before applying it.
  • Run repeatable work. Share typed variables across nodes and environments,
then launch Jobs against reviewed versions from the interface, CLI or a scheduler.
  • Ask for help in context. Use the AI assistant to explain a flow, inspect
its edits and confirm executions with your existing project permissions.
  • Keep control. Run on your infrastructure, configure connections per
environment, manage team access and import extensions for offline use.

Try it

On a supported host with Python 3.11+ and Git installed (see platform requirements):

pip install duckpad
duckpad start

Your browser opens Duckpad: choose the administrator password, and you are in. Follow Duckpad in 15 minutes to build your first pipeline from scratch, write SQL and explain a result. Lost the password later? Run duckpad reset-password.

Prefer a ready-made project? Choose New project → Start from an example, enter a name, then Create → Run all to explore Northstar.

Find the right guide

| I want to… | Guide | | --- | --- | | Install Duckpad or join a team instance | Installation and accounts | | Learn the basics with a small example | Duckpad in 15 minutes | | Upload my data and download a result | Use your own data | | Navigate, save and run a pipeline | Workspace | | Write SQL or prepare data with forms | SQL syntax · Data preparation | | Check or explain a result | Results · Data tests · Lineage | | Review changes and automate a version | Git · Jobs · CLI and automation | | Fix a startup, source or execution problem | Troubleshooting |

The documentation index also covers connections, variables, components, Python, the assistant and instance administration. Reference material includes project files, architecture, validation, releases and security.

Want to contribute? Start with CONTRIBUTING.md.

Chat with me