Feature Requests

IMHO opinion there is no need to use polars anymore. I would suggest to use polars. Saves memory, allows for larger files and is just faster.

Vortex is an up- and coming file format supported by the linux foundation that has some interesting features and could become a serious contender to parquet. https://vortex.dev/

Would be nice to be able to upload and examine XML files. XML files are basically structred as different connected tables, so i think the SQL backend could handle it quitewell. Would be nice to show the relation between tables then aswell.

Quick Q, when you download a queried table, is it also possible to download the full dataset here instead of just the 100 to 50000 rows?

As a data consumer I want to see a view of the columns, their types and comments of a table. So that I can understand the table I am working with (similar to databricks > catalog > Overview > Description )

I think datakit-page can be the perfect local frontend for working with data in a ducklake.

Being able to manipulate excel/google sheet files. Move data from file 1 to file 2, etc Can be explored for sure Also the ability to download the result file afterwards