Hum, the duckdb + lambda benchmark seems to very slow with python. From my (limited) experience using Rust with Duckdb is quite fast and a lot cheaper.
Loved this post. Would be awesome if you did more cost / performance comparisons with ETL tools and data transformation / integration libraries for pipelines ( dlthub, polars, airbyte ) for example.
Hum, the duckdb + lambda benchmark seems to very slow with python. From my (limited) experience using Rust with Duckdb is quite fast and a lot cheaper.
Great benchmark!
Made me think about recent discussions I had with Kestra users which are using Kubernetes + DuckDB (and a bit of Kestra) to manage such problem.
Not the serverless way indeed, but same idea of using DuckDB as the query engine for low latency requests ✅
Loved this post. Would be awesome if you did more cost / performance comparisons with ETL tools and data transformation / integration libraries for pipelines ( dlthub, polars, airbyte ) for example.
Are people using duck db in production?
I have not used it so far, but hesrd great things about it.
Been using MPP like Spark.