Add support for Snowflake Streaming Loader to AWS (#92)

This release introduces the SLULA license to all of the Community modules along with updates to all of the modules for newer versions of the recommended Snowplow stack.

This patch release fixes a fatal bug in the underlying AWS Service module with Amazon Linux 2 and Docker installations. See the following Discourse thread for details: https://discourse.snowplow.io/t/collector-server-failing-health-check/9581/2

Bump versions of ec2-based modules (#85)
Remove postgres_db_publicly_accessible tfvar from secure file (#86)

This release revamps the GCP quick-start to work in the same way as Azure and AWS in that all destinations can be deployed concurrently as well as bringing all of the provider versions and applications version back up to date with our latest recommendations.

Ensure that Iglu Server inputs contain a http/s prefix (#76)
Add ability to use Confluent Cloud Kafka Cluster in Azure (#79)

This release adds support for Databricks and Azure Synapse as supported platforms to load data into via the Azure pipeline.

This patch removes a deprecated SKU from the Azure quick-start to allow new subscriptions to deploy the pipeline.

• Validate that non-empty list of SSH CIDR ranges is based to Azure modules (#72)
• Use non-deprecated SKU for Azure Load Balancer modules (#71)

A critical vulnerability was surfaced in the RDB Loader project version which the Azure quick-start was leveraging. This has now been patched and the latest module versions do not contain this issue anymore.

• Update Azure quickstart Snowflake modules to v0.1.1 (#69)

This release brings Azure Open Source to the quick-start with a quick and easy way to get an end-2-end pipeline running on top of Azure and loading into SnowflakeDB.

For further details checkout the release post: https://snowplow.io/blog/announcing-open-source-azure-support/

This is a fairly major refactor of the AWS quick-start which brings several security fixes, deprecation fixes and adds support for Redshift and Databricks (and a simplified flow for Snowflake).

• You can now deploy all available destinations concurrently if you want to be able to test and evaluate everything available.
• AWS S3 Bad Loader now correctly partitions data for use with Athena queries
• All EC2 deployments now enforce the use of IMDSv2
• All EC2 deployments now use Launch Templates instead of Launch Configurations
• All AWS services are given a far larger memory share to ensure better through-put and performance with small instance types
• All AWS default instance types have been moved to the t3a family to achieve ~10% reduction in run costs for EC2

Tickets

Extend .gitignore to allow for local testing (#58)
Refactor aws/pipeline module to support more destinations (#56)
Remove aws/snowflake module as deprecated (#59)
Add support for Redshift & Databricks to aws/pipeline module (#57)
Update aws/iglu_server modules to use latest versions (#55)
Update aws/pipeline modules to use latest versions (#61)