Data Eng & Infrastructure
Building InfluxDB 3.0 with Apache Arrow, DataFusion, Flight and Parquet
In this talk, we will describe the design of InfluxDB 3.0's new high performance timeseries database engine using Apache Arrow, DataFusion, Parquet and Rust. This design provides a fast and highly interoperable analytic system without a tightly integrated codebase built from scratch. It is part of a larger trend in database system design, so called deconstructed databases, where high performance interchange standards and high quality open source components form the foundation for high performance and highly interoperable specialized analytic systems.