®Przemysław Hugh Kaznowski’s Post

Are you a software engineer fascinated by the power of Rust and the magic of time series data? I am supporting a team that is leveraging the power of Rust, Apache Arrow and DataFusion to build robust, high-performance storage systems for managing and querying time series data. 🕔 What is time series data? Time series data is a type of data where each data point is associated with a specific timestamp. Time series data is the heartbeat of many modern applications, driving insights and analytics in various fields; some examples include data monitoring & observability metrics, sensor readings, and energy consumption. 🦀 Why Rust, Apache Arrow and DataFusion? Using Rust, Apache Arrow, and DataFusion offers a robust stack for efficient time-series data querying. Rust's performance focus ensures fast, safe execution. Apache Arrow's columnar storage enhances memory efficiency and facilitates cross-language compatibility. DataFusion, built on Arrow, supports parallelized, columnar processing, ideal for analytical queries on large datasets. Feel free to connect and drop me a message if this sounds like an opportunity you'd like to pursue or if you're searching for engineering talent in this area. #rust #timeseriesdata #apachearrow #datafusion

Rust's error handling is centered around the Result<T, E>, where E typically extends std::error::Error. Here we share our experience organizing variant types of Errors in a complex system, from how an error is defined to how to log the error or present it to end-users. Read here: https://lnkd.in/gUefGbG5 #errorhandling #rustlang #opensource #database #tech

Just like bees tirelessly work together to maintain the hive's operations, CockroachDB's highly available design ensures that your mission-critical applications stay online, even during regional outages or database upgrades. It's like having a swarm of dedicated workers ensuring uninterrupted service for your customers. Learn how you can #ScaleWithCockroachDB and keep your business buzzing 👉 www.cockroachlabs.com Cockroach Labs #CockroachDB #Database

Embarking on a security journey inspired by a pivotal project at work! 🚀 Delving into the intricacies of encrypting Room database with SQLCipher to safeguard sensitive data. Join me in exploring this journey into encrypting Room databases with SQLCipher! https://lnkd.in/ekjvfu6M 🛡️💻 #AndroidDev #DataEncryption #SQLCipher

Explore "DuckDB, is The Hype Train Behind it Real?" by Gentrit Mehmeti, which delves into the unique adaptability of DuckDB. He explains how DuckDB integrates seamlessly into your applications with a simple installation. The blog highlights DuckDB's fast performance, easy deployment, and compatibility with other databases. Curious about when and how to effectively use DuckDB in your projects? Read the full blog here: https://lnkd.in/deMpRyZB

🚀 Navigating new dependencies in job clusters: Unlike all-purpose compute, where we use a 'lib' tab, setting up a new job cluster requires editing tasks in workflows. 🔄 In the "dependent libraries" in tasks section, add wheel files effortlessly from S3, PyPI, or DBFS. 📦 These dependencies automatically attach to the cluster on launch, streamlining integration. 🚀 I recently explored and found out how to do this, and considering the scarcity of online resources, I wanted to share this valuable insight. Master this process to empower your job clusters with the right tools. 💻✨ #Databricks #JobClusters #TechTips #WorkflowOptimization #Databricksworkflow

There are other databases in the market, but Greycat is designed to operate over massive datasets efficiently. We’ve tested Greycat v.7’s storage efficiency against Greycat v6 and Postgres. Greycat v7, with its new type decorator @precision, cuts down the dataset’s final disk size in half compared to v6, and down 75% compared to Postgres. Check all details in our Medium post about it here: https://lnkd.in/eTTXqmUU Greycat is a compelling choice for applications requiring efficient storage of large datasets with numerous floating-point values. #DataStorage #BigData #Database #GreyCat #TechInnovation #DataEfficiency #StorageSolutions #TechNews #DataManagement #Medium #Postgres

“[ScyllaDB is] a much more efficient database — we’re going from running 177 Cassandra nodes to just 72 #ScyllaDB nodes. Each ScyllaDB node has 9 TB of disk space, up from the average of 4 TB per Cassandra node.” Bo Ingram, senior software engineer at Discord. See how combining #Rustlang-based data services and ScyllaDB allowed Discord to build a system that can handle trillions of messages. http://bit.ly/3YLoSwN #NoSQL #NoSQLdatabase

Tried Writing my first blog regarding Data Science Servers.

Let's figure out how we can improve the loading of Postgres extensions (aka PG_FUNCTION_INFO_V2): https://lnkd.in/gd3XJ_dR