Data Aggregation OpenSource List

  • 2021-Airbyte : Data integration platform for ELT pipelines from APIs, databases & files to databases, warehouses & lakes.

Data Pipeline

  • 2020-Pipelinewise : PipelineWise is a Data Pipeline Framework using the specification to ingest and replicate data from various sources to various destinations.

  • 2022-mage-ai : Give your data team magical powers. Integrate and synchronize data from 3rd party sources. Build real-time and batch pipelines to transform data using Python, SQL, and R. Run, monitor, and orchestrate thousands of pipelines without losing sleep.

  • 2023-cloudquery : The open source high performance data integration platform built for developers. 数据整合