OneWeb utilizes DataOps.live for all their Snowflake infrastructure management and to run their data pipelines. OneWeb Data Cloud infrastructure runs on AWS infrastructure. The support for both Snowflake and AWS from within DataOps.live is key for this to be successful.
To ensure the handling of such data and instances, DataOps.live has built an AWS Orchestrator that can support a wide range of AWS services to:
- Allow the deployment of any Snowflake instances on AWS,
- Allow user to select any warehouse size available out of the box from Snowflake database,
- Have all the SQL models executed seamlessly via 3rd party connectors/providers,
- Have a stage ingestion orchestrator that further enables ingestion into the database without any limitations, where often a use case is to have raw data (parquet, csv) from an S3 bucket ingested directly into a Snowflake table.