Sahil Tanwar👨‍💻🐍

Data Engineering & Infrastructure | Likes the Boring Stuff

[Sahil Tanwar👨‍💻🐍 @sahiltanwar]

The day Facebook unplugged itself from the internet. 🔌

October 4, 2021. Facebook, Instagram and WhatsApp all vanish for about 6 hours. No hacker. No hardware failure. One maintenance command.

[Sahil Tanwar👨‍💻🐍 @sahiltanwar]

A deploy missed 1 server out of 8. It cost $460 million in 45 minutes. 💸

https://t.co/2k9i9EQzgO

https://t.co/UzMlI3zi8b

[Sahil Tanwar👨‍💻🐍 @sahiltanwar]

The Typo That Took Down AWS S3: How One Command Broke the Internet

https://t.co/2k9i9EQzgO

https://t.co/UzMlI3zi8b

[Sahil Tanwar👨‍💻🐍 @sahiltanwar]

The Regex That Took Down Cloudflare: Catastrophic Backtracking Explained
#TechExplained

https://t.co/2k9i9EQzgO

https://t.co/UzMlI3zi8b

[Sahil Tanwar👨‍💻🐍 @sahiltanwar]

The Typo That Took Down AWS S3: How One Command Broke the Internet

https://t.co/2k9i9EQzgO

https://t.co/UzMlI3zi8b

[Sahil Tanwar👨‍💻🐍 @sahiltanwar]

https://t.co/2k9i9EQzgO

https://t.co/UzMlI3zi8b

[Sahil Tanwar👨‍💻🐍 @sahiltanwar]

How One Command Deleted GitLab's Production Database (And Every Backup Failed)

In 2017 a GitLab engineer ran rm -rf on the wrong server and wiped 300 GB of production data in seconds. Then the team found out none of their backups worked.

[Sahil Tanwar👨‍💻🐍 @sahiltanwar]

https://t.co/GPqcRInKrg

[Sahil Tanwar👨‍💻🐍 @sahiltanwar]

Youtube channel : https://t.co/GPqcRInKrg

[Sahil Tanwar👨‍💻🐍 @sahiltanwar]

Production Postmortem - Biggest issues in Tech Industry

[Sahil Tanwar👨‍💻🐍 @sahiltanwar]

Page link https://t.co/UzMlI3zi8b

[Sahil Bloom @SahilBloom]

You need to hear this…

[Sahil Tanwar👨‍💻🐍 @sahiltanwar]

@WeekendInvestng 📉 India VIX Update: India VIX dropped ~6.9% to 15.00, signaling reduced market fear as investor sentiment stabilizes. Recent pullback from near 20 shows strong resistance, likely due to profit-booking. Bearish reversal hints at lower volatility ahead if levels hold steady.

[Sahil Tanwar👨‍💻🐍 @sahiltanwar]

@WeekendInvestng Shows India's struggle with inflation and rising US interest rates, while China's managed a tighter trade and monetary policy. Global shifts hit currencies differently.

[Alex Xu @alexxubyte]

Top 5 common ways to improve API performance.

Result Pagination:
This method is used to optimize large result sets by streaming them back to the client, enhancing service responsiveness and user experience.

Asynchronous Logging:
This approach involves sending logs to a lock-free buffer and returning immediately, rather than dealing with the disk on every call. Logs are periodically flushed to the disk, significantly reducing I/O overhead.

Data Caching:
Frequently accessed data can be stored in a cache to speed up retrieval. Clients check the cache before querying the database, with data storage solutions like Redis offering faster access due to in-memory storage.

Payload Compression:
To reduce data transmission time, requests and responses can be compressed (e.g., using gzip), making the upload and download processes quicker.

Connection Pooling:
This technique involves using a pool of open connections to manage database interaction, which reduces the overhead associated with opening and closing connections each time data needs to be loaded. The pool manages the lifecycle of connections for efficient resource use.

Over to you: What other ways do you use to improve API performance?

--
Subscribe to our weekly newsletter to get a Free System Design PDF (158 pages): https://t.co/uc5M7CdXXC

[Andrew Brown @andrewbrown]

My free GitHub Actions certification course is now out on @freeCodeCamp

https://t.co/NLhhr27Rok

[TestDriven.io @testdrivenio]

Speeding Up Python with Concurrency, Parallelism, and asyncio

https://t.co/1P4LGNeGqH

🔸What are concurrency and parallelism?
🔸Examples of concurrent.futures and asyncio in Python
🔸How async/await are implemented in .NET, JavaScript, and Rust

#Python #Programming

[TestDriven.io @testdrivenio]

Python Clean Code Tip:

Use retries when calling 3rd party API

They are not responsive/down/unavailable much more frequently than anticipated

👇

[Rowan Cheung @rowancheung]

A mysterious new AI model called “gpt2-chatbot” is going viral.

It was released without official documentation, and there is speculation that it could be OpenAI's next model.

Here's everything we know so far (and how to try it for free):

[Alex Xu @alexxubyte]

My Favorite 10 Books for Software Developers

General Advice
1 - The Pragmatic Programmer by Andrew Hunt and David Thomas
2 - Code Complete by Steve McConnell: Often considered a bible for software developers, this comprehensive book covers all aspects of software development, from design and coding to testing and maintenance.

Coding
1 - Clean Code by Robert C. Martin
2 - Refactoring by Martin Fowler

Software Architecture
1 - Designing Data-Intensive Applications by Martin Kleppmann
2 - System Design Interview (our own book :))

Design Patterns
1 - Design Patterns by Eric Gamma and Others
2 - Domain-Driven Design by Eric Evans

Data Structures and Algorithms
1 - Introduction to Algorithms by Cormen, Leiserson, Rivest, and Stein
2 - Cracking the Coding Interview by Gayle Laakmann McDowell

Over to you: What is your favorite book?

–
Subscribe to our weekly newsletter to get a Free System Design PDF (158 pages): https://t.co/uc5M7CdXXC