I spent some time reading about “Durable Execution Engines” (eg: Temporal) and explored possible connections to earlier concepts like database transactions, distributed transactions, and building RPC/Microservice based systems in a fault tolerant manner. In this post I’ll try to summarize some of my learnings. How useful it is will depend on how much of this […]
I decided to re-read this impactful paper about data lakehouse from 2021 which talks about the “lakehouse” architecture within data warehousing. Below are my notes about it. Novelty Data warehousing can/should be built on direct access to open data format files, preferably on the cloud This will help with reliability and cost (cheap storage on […]
The book Java Generics and Collections (O’Reilly 2007) by Maurice Naftalin and Philip Wadler provides a grand tour of generics as available within Java. I feel I have a much better handle on the topic now. I only read the first part of the book (the rest is about Collection classes). What the book lacks […]
This was a nice and understandable introduction to ChatGPT, by the noted scientist Stephen Wolfram who is also the creator of Mathematica software. Given that there would be a lot of maths underpinning the workings of ChatGPT, Wolfram does a good job not overloading you with the details. He uses simplified models and lots of […]
I’ve been a casual user of annotations in code for many years but had never bothered to understand how exactly they work, or why they even exist. I would pop in the requisite Hibernate, Spring or Lombok annotations where necessary and get on with it. If the answer to the question “Why do annotations exist?” […]
My summary of some of the talks at Modern Data Stack Conf 2021
This is actually two books masquerading as one. The first is full of great advice on how to identify a genuine customer need and validate it before creating a company around it. In my opinion, you should absolutely read this part, ideally 1-2 years before setting up shop. The second half is largely standard advice […]
After attending a conference called The Makers Summit a couple of weeks back where I saw two founders talk about “10x” products, I figured there must be experts who have looked for patterns in how they emerge and written about them? And sure enough, as I started reading, I discovered there is a market phenomenon […]
Note: This blog post was a first draft. You can read my full article based on it at Inc42’s website: Key Takeaways From Gaurav Munjal And Bhavin Turakhia’s Fireside Chat At #TMS2021 My brief paraphrased notes on the Fireside chat between Gaurav Munjal and Bhavin Turakhia, at the end of Day 1 of The Makers […]
The AWS Firecracker paper is fascinating because Amazon has implemented a new Virtual Machine Monitor (VMM) which closely matches the requirements of their AWS Lambda service. While doing so, they carefully navigated the space of existing virtualization options, reused the best parts where they could, and implemented the rest. They also describe how they successfully […]