Abhishek Bhardwaj’s Post

View profile for Abhishek Bhardwaj, graphic

Engineering @ Replit | Past: Google, Microsoft, Carnegie Mellon

A long time ago I was fortunate enough to take the "Advanced Storage Systems" class at Carnegie Mellon University. https://lnkd.in/gkEaTKz8 An amazing class taught by Greg Ganger and Garth Gibson. The 2nd half of this class focused on Distributed File Systems. I remember how the "log" was a core building block across all these systems. More recently, I stumbled upon this excellent 2013 post that talks about Logs from first principles in Distributed Systems. https://lnkd.in/gRJyh6N3 Well worth the read for any systems builder. Also, a great example of complete mastery leading to extremely easy to understand technical writing.

The Log: What every software engineer should know about real-time data's unifying abstraction

The Log: What every software engineer should know about real-time data's unifying abstraction

engineering.linkedin.com

The best part is the band team thought up of a log file system and I'm pretty sure none of had read any papers on the concept! Maybe if we had we wouldn't have made a mess of timestamps and the start/end event fields, oops!

Evergreen post about distributed systems. Does a great job of connecting the dots around a lot of the tools and workflows around modern big data processing. Thanks for resurfacing this!

See more comments

To view or add a comment, sign in

Explore topics