Data Aggregation OpenSource List

• 2021-Airbyte : Data integration platform for ELT pipelines from APIs, databases & files to databases, warehouses & lakes.

Data Pipeline

• 2020-Pipelinewise : PipelineWise is a Data Pipeline Framework using the Singer.io specification to ingest and replicate data from various sources to various destinations.

• 2022-mage-ai : Give your data team magical powers. Integrate and synchronize data from 3rd party sources. Build real-time and batch pipelines to transform data using Python, SQL, and R. Run, monitor, and orchestrate thousands of pipelines without losing sleep.

• 2023-cloudquery : The open source high performance data integration platform built for developers. 数据整合