Andrew Davidson’s Post

Do you know Stripe processed $1T in payments with 99.999% uptime in 2023 using DocDB, built on MongoDB Community? 💡 Handling 5M+ queries/sec, MongoDB ensures real-time data management at scale. Discover more from Stripe’s Engineering blog! ⬇️ https://lnkd.in/ggJD599r #mongodb #stripe

Customers and businesses now expect payments to be processed immediately! 💳 In 2023 Stripe processed $1 trillion in payments—all while maintaining 99.999% uptime with zero-downtime data migrations. Check out this blog post that explores how Stripe’s DocDB, an extension of MongoDB Community, expertly manages enormous amounts of real-time data at scale. ⬇️ https://lnkd.in/gbDsDXYH #database #documents #data

🚀 Recently, I read an incredible blog post by the engineering team at Stripe that dives deep into how they maintain a stunning 99.999% uptime while processing $1 trillion in payments in 2023! 🚀 Here’s a glimpse into their approach: The blog provides a detailed look at their in-house Database-as-a-Service (DBaaS), known as DocDB, which is built on MongoDB Community. DocDB handles over 5 million queries per second, ensuring seamless operations for Stripe's diverse applications. This system's flexibility and scalability allow it to efficiently manage petabytes of critical financial data spread across thousands of database shards. One of the most impressive aspects of their infrastructure is the Data Movement Platform. This platform enables client-transparent data migrations across thousands of database shards with zero downtime. It ensures continuous availability by merging underutilized shards for improved efficiency and splitting them during traffic surges. This ability to adapt to changing traffic patterns is crucial for maintaining optimal performance. Stripe's infrastructure is designed with scalability and reliability at its core. They use a multi-layered architecture that includes in-house developed database proxy servers. These servers handle query routing, combining results from various shards, and enforcing concerns of reliability and scalability. Advanced replication mechanisms ensure data consistency and availability, even during peak times, meeting the highest performance and reliability standards. The blog also touches on future developments, such as a heat management system to balance data across shards and shard autoscaling to respond to traffic changes dynamically. Read the full blog post for an in-depth look at their journey and technical innovations. 👉 https://lnkd.in/ef7QTuu3 #TechInnovation #EngineeringExcellence #SoftwareEngineering #TechTrends #DatabaseEngineering #SystemsEngineering #DatabaseEngineering #DataManagement #DatabaseDesign #DatabaseScalability #DatabasePerformance #DataMigration

Customers and businesses now expect payments to be processed immediately! 💳 In 2023 Stripe processed $1 trillion in payments—all while maintaining 99.999% uptime with zero-downtime data migrations. Check out this blog post that explores how Stripe’s DocDB, an extension of MongoDB Community, expertly manages enormous amounts of real-time data at scale. ⬇️ https://lnkd.in/dMVBMuf5

It is impressive to learn how Stripe leverages the capabilities of MongoDB Community Edition to power its in-house DocDB. Stripe’s DocDB is an extension of MongoDB Community—a popular open-source database—and consists of a set of services that they have built in-house. It serves over five million queries per second from Stripe’s product applications. The deployment is also highly customized to provide low latency and diverse access, with 10,000+ distinct query shapes over petabytes of important financial data that lives in 5,000+ collections distributed over 2,000+ database shards. https://lnkd.in/dVa-CXVd #databases #dbms #sharding #replication #distributedcomputing #technology #management #news #facts #technologyfacts #aiml #cloud #cloudcomputing #cloudengineer #databasedevelopment #databasedeveloper #dataengineer #manageddatabases #startups #business #tech #coder #developer #developlife #systemdesign #solutionsarchitecture #solutionselling #programminglife #mongodb #nosql #documentdb

Dynamic Infra Launch Week wraps up today at Timescale, showing amazing infra to scale #PostgreSQL performance for demanding workloads. Scale your applications whenever and wherever you need. This week included a major launch of Dynamic PostgreSQL, in the works for over a year, which means no more overprovisioning to handle peak load or worrying about unpredictably high bills.  For all your Postgres workloads, not just time-series or analytics. 👉 Read more on our blog - https://lnkd.in/gyfn3X4r 👉 Read more on The New Stack - https://lnkd.in/eGmQ9eEn But it was also back-to-back launches every day.  Here’s the complete list of Dynamic Infra goodness: ⚡Dynamic Postgres:  Buy the Base, Rent the Peak ⚡Usage-based storage for all PG workloads ⚡Terraform provider 1.0 ⚡Cloudflare Hyperdrive integration ⚡Regions: Singapore, Ohio ⚡More PG extensions ⚡Bonus AI Keep your eye out next week, where it’s Launch Week 3-of-3 here at Timescale. 🚀

Customers and businesses now expect payments to be processed immediately! 💳 In 2023 Stripe processed $1 trillion in payments—all while maintaining 99.999% uptime with zero-downtime data migrations. Check out this blog post that explores how Stripe’s DocDB, an extension of MongoDB Community, expertly manages enormous amounts of real-time data at scale. ⬇️ https://lnkd.in/gGjZQKh6

Customers and businesses now expect payments to be processed immediately! 💳 In 2023 Stripe processed $1 trillion in payments—all while maintaining 99.999% uptime with zero-downtime data migrations. Check out this blog post that explores how Stripe’s DocDB, an extension of MongoDB Community, expertly manages enormous amounts of real-time data at scale. ⬇️ https://lnkd.in/gpQw_BUe

A good case study of how to improve customer user experience (UX) by investing in resiliency. Especially in FinTech where any outages will slump user and business confidence resulting in significant losses. Thanks for sharing this Wan Rong Khoo .

Customers and businesses now expect payments to be processed immediately! 💳 In 2023 Stripe processed $1 trillion in payments—all while maintaining 99.999% uptime with zero-downtime data migrations. Check out this blog post that explores how Stripe’s DocDB, an extension of MongoDB Community, expertly manages enormous amounts of real-time data at scale. ⬇️ https://lnkd.in/ePpHRyH7