Venkat's Blog

Venkat Raman

Venkat Raman

3 followers

🧑‍💻 Staff Engineer – Distributed Systems, Machine Learning |📍Berlin 🇩🇪 | 📚 https://venkat.eu | 💬 https://twitter.com/Venkat2811

Essential Math & Concepts for LLM Inference

May 31, 202412 min read

Back of the envelope calculations to estimate model's GPU memory requirements & insights into HW/SW optimizations · (Image Credit: HF TGI...

Essential Math & Concepts for LLM Inference

The power of Mechanical Sympathy in Software Engineering

Apr 18, 202422 min read

Exploring Locality of Reference, LMAX Disruptor & Flash Attention · Introduction Modern software programming languages, compilers, and frameworks...

The power of Mechanical Sympathy in Software Engineering

CPU & GPU - The Basics

Apr 8, 202416 min read

A digestible high-level overview of what happens in The Die · Introduction In this article, we'll go through some fundamental low level details to...

CPU & GPU - The Basics

OS Error: Too many open files. Understanding file and socket descriptors.

Mar 26, 20247 min read

Debugging resource leakage and optimizing server configuration · Intro Engineers who've built, deployed and operated backend services would've...

OS Error: Too many open files. Understanding file and socket descriptors.

HTTP Load Balancer on Top of WSO2 Gateway — Part 2: Performance Benchmarks

Aug 19, 20163 min read

In my previous post, I discussed Load Balancer Engine Architecture and its features. In this post, I’ll be discussing on performance...

HTTP Load Balancer on Top of WSO2 Gateway — Part 2: Performance Benchmarks

HTTP Load Balancer on Top of WSO2 Gateway — Part 1: Project Repository, Architecture and Features

Aug 18, 201611 min read

It’s almost four months and it has been an amazing journey! At this point, I would like to thank my mentors Isuru Ranawaka and Kasun Indrasiri and...

HTTP Load Balancer on Top of WSO2 Gateway — Part 1: Project Repository, Architecture and Features