Meltano’s Post

In this blog, we explore the innovative journey of our Business Intelligence team in enhancing collaborative efforts and productivity through two pivotal tools: an organisational GitHub account and a custom R package. Dive into the purpose, development, and impact of these tools, reflecting our dedication to adopting a culture of shared knowledge and efficient workflows in data science. Read more here: https://lnkd.in/e2Rfh9mT #Rpackage #GitHub #DataScience

In this video we take a look at Fivetran. Specifically, we look at how you can configure Fivetran to execute dbt transformations by integrating it with Github. We also look at Snowflake zero copy cloning. https://lnkd.in/gmBwW3av

Big thanks to Cybersyn for sharing some killer data on GitHub repos. Found using Snowflake Data Marketplace and visualized it all with Astrato. The insights? Mind-blowing! 🤯 The process? Smooth as silk! 😎 Created by Elizabeth T. 👩🎨 #DataViz #GitHub #SnowflakeDataMarketplace #NoCode #DataApps

🚀 Exciting news! You can now trigger multiple Dataiku flows separately or in parallel using Apache Airflow! 🎉 Simply create scenarios for each flow in Dataiku, grab their scenario IDs, and initiate the desired flows directly from your Airflow DAGs. Learn more about this powerful integration in my latest Medium article: https://lnkd.in/gXk5WDrV #DataScience #WorkflowAutomation #ApacheAirflow #DataikuIntegration ✨#DataEngineer

At Summit my favorite session outlined Snowflake's vision for data pipelines: simple, declarative, and the best part - the ability to choose where on the freshness vs cost spectrum you want with a simple LAG setting. Dynamic tables are great but get even better combined with other new features such as Snowpipe Streaming, Direct DB Connect, or Iceberg for a simple end to end data flow.

🚀 Elevate your data game with Bluemetrix Data Manager! ⚡ With the powerful automated feature in BDM, you can now easily implement ETL or ELT using the Spark Data Transformation library for seamless data pipeline design and construction. Learn more: https://bit.ly/46uFWwf ⭐

ICYMI: STREAMS ARE OUT!! Streams connects 17 chains and 26 networks to multiple destinations, including webhooks, S3-compatible storage, SQL, and Snowflake. It's the foundation of our ETL pipeline vision. Check out the video, and then start building with our guide below https://lnkd.in/gnwk9w5x

Get the data science spark over in our Awesome oneAPI GitHub repository, where we’ve curated a trio of excellent projects for you to dive into right now. Remember to bookmark it for future use as well! https://lnkd.in/gG5dNNBm #Developer #oneAPIv#ArtificialIntelligence #DataScience

Transform your data workflows with Matillion ETL! 🚀 In today's #TechnicalTuesday post, Chris Hastie walks you through how Matillion ETL’s powerful GUI-based orchestration and transformation tool simplifies querying external data via API. Read the full post to learn more below. https://lnkd.in/gJhn5cHC