Francesco Tisiot’s Post

Really excited about the release of OpenSearch 2.12. Lots of great stuff in here including major performance improvements (concurrent segment search, 10-50x boost to histogram aggregations, new match-only text field type and more), new semantic search and AI/ML capabilities (new conversational search APIs [note: thanks Aryn for the great contribution!], built-in chunking through nested vector fields, default processors for Amazon Bedrock text embedding connectors) and Apache Spark integration to make it easy to interact with less frequently accessed data in object stores directly with OpenSearch APIs and through OpenSearch Dashboards. OpenSearch Project Learn more here:

Let's have a chat with BigQuery.  In this technical demonstration, we will explore the functionalities of the native connectivity features of Application Integration. We will demonstrate how we can utilize BigQuery data to enhance AI applications and empower users in their daily tasks. Another great post.

Breaking down the dams between data lakes and keeping it Open Source. As of yesterday OneTable is Open Source. As a generator and consumer of data (aren't we all in some form) I'm simply ecstatic about what this means...especially for AI. 🔧 #OneTable is not a new table format, but a toolset for efficient metadata conversion. . 🔄 It facilitates omni-directional conversion between Hudi, Delta, and Iceberg metadata. . 🔄 Omni-directional: Start from any format and convert to any other. Round-trip or round-robin across them in any combination. . ⚡ Minimal performance overhead: No data copying or rewriting, just a small metadata change. . 📁 Using OneTable allows metadata from all 3 projects (Delta, Hudi, Iceberg) to be stored side-by-side in the same directory. . 🔍 This makes the same "table" available to be queried as a native Delta, Hudi, or Iceberg table. #onetable #opensource #opensourcecommunity #data #datalake #ai #artificialintelligence #hudi #deltalake #iceberg

Recently I had published an article about building efficient Multi-agent workflows (link - https://lnkd.in/dcq9DMde). Continuing on the same thread, here is another blog which talks about MongoDB agents. Essentially it enables you to use AI and talk to your semi-structured JSON formatted API data. 🔍 Why This Matters? - Empowerment for Everyone: Business users, marketers, and product managers can now get the answers they need without technical intermediaries like ML/DS teams. This democratization of data access accelerates decision cycles and fosters a data-driven culture across your organization. - Uncover Hidden Insights: AI-powered exploration goes beyond basic queries, spotting trends, anomalies, and correlations that might have remained hidden. Imagine discovering untapped opportunities or risks before your competitors even know to look for them. - Agility and Innovation: With real-time answers, you can adapt strategies on the fly. Test hypotheses, validate assumptions, and iterate quickly – all based on solid data analysis. Dive into the full blog and explore how AI is transforming business intelligence: https://lnkd.in/dvMBvYX5 Keep the conversation going! Feel free to reach out. #AI #DataDrivenDecision #AIinBusiness #Agents

🚨 [AI] How To Log Databricks Workflows with the Elastic (ELK) Stack 👉 A practical example of setting up observability for a data pipeline using best practices from SWE worldPhoto by ThisisEngineering on UnsplashIntroductionAt the time of this writing (July 2024) Databricks... #NoHackMe_news #NoHackMe_news_ai https://lnkd.in/da5_Hw9H

BREAKING 🚨 : #Openai acquires #Rockset https://lnkd.in/eyC2y3XN Plenty of benefits to be seen : • Implement powerful #semantic search with OpenAI #embeddings and Rockset's #vectorsearch. • Create real-time, AI-powered #analytics #dashboards with natural language queries. #realtime analytics could be huge for businesses where fast decisions could lead to fast - adaptability and unlock new revenue • Build highly personalized, real-time recommendation systems. • Enable efficient similarity searches across large #datasets using vector search. • Develop #scalable #AI applications that handle high data volumes and query loads. • Reduce development time with Rockset's schemaless ingestion and OpenAI's user-friendly APIs. • Lower compute and storage costs for AI-powered applications. • Power diverse use cases from #anomaly #detection to real-time reporting. • Combine traditional and AI-powered search for comprehensive search solutions. • Apply AI to the most current data with real-time ingestion and indexing.

88% of organizations agree that open source is critical to innovation in data science and machine learning. Data science tools, like KNIME, that embrace openness as their core principle will always be among the first to integrate any innovation. From big data to autoML and now GenAI! Stay ahead of the game. Read this blog post for a dive deep into how open-source tools can sharpen your competitive edge. 🚀 💡 https://lnkd.in/gxZEgjn8 #KNIME #opensource #datascience

The Scalable SQL, Full-Text and Vector Platform for Gen AI #vectordb #genai #fulltext #dataplatform #superfast #singlestore #llm #rag #agenticRAG #agentic

Unification + Simplicity + Open + Data + AI = #DATABRICKS Databricks moving strong on the path of unification of data formats and making it simple and open by developing interoperability Announced support for Hive metastore API through #Unity in June 2023 - https://lnkd.in/dnHVbWmZ Announced support for #uniform (a step to unify #delta with #iceberg and hudi) in June 2023 - https://lnkd.in/dUNvDvZP Acquisition of #Tabular in a bid to unify delta and iceberg June 2024 - https://lnkd.in/dAx6rCus More big announcements to come in coming week during Data and AI summit!! #DAIS

Imagine spending hours poring over datasets, only to come up empty-handed or with insights that barely scratch the surface of what's possible. The challenge of deriving meaningful insights from data can be daunting, hindering your ability to make informed decisions and drive business growth. Fortunately, there's a solution that can transform your data analysis experience from daunting to delightful. Our latest blog on the power of Gemini in BigQuery unveils the key to unlocking a treasure trove of insights with ease. Written by our data expert, Fassil Y., this blog delves deep into how Gemini, powered by AI, can revolutionize your approach to data analysis. https://lnkd.in/dqi2-ZyK Dive into our latest blog on the power of Gemini in BigQuery and discover how you can harness its full potential. After reading, don't forget to share your thoughts and insights on this transformative topic. Together, let's unlock the true power of data with Gemini! #datascience #dataanalysis #businessintelligence #bigquery #datadice