ETL tools
Airbyte
Airbyte can be used to import and update data into your Hydra data warehouse from a wide variety of sources. You can choose how often Airbyte should update your data in Hydra, from one-time, weekly, daily, or hourly.
Setup
Setting up Airbyte is easy and takes only a few minutes.
Create an Airbyte account at https://cloud.airbyte.io/signup.
Add Hydra as a "Destination" by adding a "Postgres" destination.
Add your existing data sources as a "Source." Airbyte supports a long list of sources, including SaaS providers and databases.
Syncing Data
Create a "Connection" for each Source you wish to connect to Hydra. Choose what data you want to sync, at what frequency, and what sync mode to use. Make sure to enable Airbyte's basic normalization feature.
Recommendations
Schema changes are difficult when a data source is connected through Airbyte. When possible, connect and insert data into Hydra directly after completing an initial import with Airbyte.
If you are uncertain how to design your data warehouse, reach out to Hydra for advice.
Last updated