Big Tech Digest #4
2023-07-13: Tuning Flink Clusters for Stability and Efficiency at Pinterest, The Cost Of JavaScript, Designing Uber's Automated Audit Framework, How the Cloudflare Handles System Reboots and more!
Hi there 👋! Thanks for reading Big Tech Digest. Subscribe to receive a new issue directly to your inbox every two weeks.
Please don’t forget to spread the word if you found this digest interesting!
// 📫 Engineering blogs digest
Recent, selectively picked blog posts from tech companies’ engineering blogs.
[Pinterest] Tuning Flink Clusters for Stability and Efficiency shares different optimisation strategies, ultimately leading to a 40% cost reduction by Pinterest SRE team
[Uber] Automated Audit Framework For Internet Scale Financial Transactions discusses an interesting story of building a highly-scalable financial auditing system by multiple authors
[Airbnb] Chronon — A Declarative Feature Engineering Framework introduces a framework for developing production-grade features for machine learning model by Nikhil Simha
[Databricks] Introducing English as the New Programming Language for Apache Spark presents English SDK for Apache Spark by multiple authors
[Uber] Fast Copy-On-Write within Apache Parquet for Data Lakehouse ACID Upserts discusses an interesting story of building a highly-scalable financial auditing system by multiple authors
[Cloudflare] How the Cloudflare global network optimizes for system reboots during low-traffic periods by Opeyemi Onikute and Nicholas Rhodes
[Gradle] How Gradle cut AWS storage costs by 75% using S3 by Oliver White
// ⭐️ Misc
a.k.a. the nerd section 🧑💻!
The Cost Of JavaScript - 2023 explains how to optimise JavaScript bundles to improve download and loading speeds by Addy Osmani
CQRS pitfalls and patterns from NDC Oslo 2023 by Udi Dahan
300ms Faster: Reducing Wikipedia's Total Blocking Time by Nicholas Ray
GitHub merge queue is generally available by Dustin Yin
Thanks for reading Big Tech Digest! Don’t forget to spread the word if you like it!
Delivered bi-weekly to your inbox, this manually-curated newsletter brings you a collection of links to the latest engineering blog posts from +100 Big Tech companies and startups like Airbnb, Uber, Netflix or Meta. Aimed at all Software Engineers (backend, frontend, data, DevOps, mobile) and AI/ML folks at any level, Big Tech Digest is focused on engineering problems and their proposed solutions at tech companies that I find particularly interesting. No marketing or non-tech stuff. Subscribe now to join our community and keep learning!