Why we used open source Apache projects to build InfluxDB 3.0
To the unfamiliar, building with open source tools may seem like the kind of chaos that leads to Boaty McBoatface-like decisions.
Andrew Lamb, staff engineer at InfluxData and PMC for the Apache DataFusion project, provides insight from a developer and a PMC perspective about what it's like to build with, and manage a major open source project.
InfluxData recently rebuilt its core database using Apache projects: Flight, DataFusion, Arrow, and Parquet, dubbed the FDAP stack.
Lamb discusses how the open source process differs from the traditional model of developing enterprise software, the advantages open source provides, InfluxData's up-stream contributions to Apache projects, and how common open source software is in our daily lives.
Resources:
For more information on the FDAP stack, visit https://www.influxdata.com/blog/flight-datafusion-arrow-parquet-fdap-architecture-influxdb/
InfluxData: https://www.influxdata.com/
InfluxDB Slack Community: http://influxdata.com/slack
InfluxDB Forum: https://community.influxdata.com
InfluxDB Docs: https://docs.influxdata.com
InfluxDB University: https://university.influxdata.com
0:00 Intro
0:24 What is the Apache Software Foundation?
1:06 Emphasis on open communication
1:24 Shifting from classic development to open source (It's not just Boaty McBoatface)
2:31 InfluxData commitment to and relationship with open source
2:53 Advantage of using Apache open source projects to build InfluxDB 3.0
3:40 Getting started with Apache Arrow. Available libraries and contributing to the Rust library
4:16 Helping to mature Apache Arrow, DataFusion, and Parquet implementations in Rust
4:51 Prevalence of open source powering our daily lives
5:19 Open source prevents the need to 'reinvent the wheel'
#influxdb #apache #opensource #software #softwaredevelopment #softwareengineer