Open in app

Sign In

Write

Sign In

Shubhomoy Biswas
Shubhomoy Biswas

114 Followers

Home

About

Published in FAUN Publication

·Pinned

Application Log Management for Serverless solutions using AWS OpenSearch and Cloudformation

The logs simply keep coming in! In this post, I tried to document my experience in writing a complete E2E application log management system as IaC for a serverless setup in AWS. In my previous post - Logging Architectures, EFK Stack and Kubernetes Having a robust logging system is a must. A read on various types of logging architectures one can implement using EFK…faun.pub we looked at different log management strategies that can be implemented with Kubernetes…

Cloudformation

7 min read

Application Log management for Serverless solutions using AWS OpenSearch and Cloudformation
Application Log management for Serverless solutions using AWS OpenSearch and Cloudformation
Cloudformation

7 min read


Published in FAUN Publication

·Pinned

Writing custom metrics exporter for Kubernetes HPA

Autoscaling Kubernetes pods have never been more straightforward with Horizontal Pod Autoscaler (HPA). HPA added an intuitive abstraction to effortlessly scale up or down pods dynamically based on some target metrics. However, according to the documentation, the HPA fetches these target metrics from the aggregated APIs, namely metrics.k8s.io, custom.metrics.k8s.io, and…

Kubernetes

4 min read

Writing custom metrics exporter for Kubernetes HPA
Writing custom metrics exporter for Kubernetes HPA
Kubernetes

4 min read


Aug 12, 2021

The endless hymn

Disclaimer: This read is for the “Medium Writer Challenge” and thus deviates from my usual technical reads and tutorials that you may otherwise find in my Medium profile. “Hurry up! We will be late for the evening aarti prayer”. My mother used to bring me along with her to this…

Mwc Reentry

5 min read

The endless hymn
The endless hymn
Mwc Reentry

5 min read


Published in Analytics Vidhya

·Mar 12, 2021

Running Apache Spark with HDFS on Kubernetes cluster

Why on Kubernetes? From the numerous advantages that Kubernetes offers, I particularly find it beneficial to deploy HDFS on K8s because of the ease of scalability K8s provides and requires fewer management tasks. Data is ever-increasing, and one needs to have a stable and easy horizontal scalable architecture to accommodate terabytes of data…

Apache Spark

5 min read

Running Apache Spark with HDFS on Kubernetes cluster
Running Apache Spark with HDFS on Kubernetes cluster
Apache Spark

5 min read


Published in FAUN Publication

·Feb 18, 2021

MongoDB Aggregation vs MapReduce in a Sharded setup on Docker containers.

Exploring the world of MapReduce, I landed on the MapReduce documentation page of MongoDB. The first thing that is mentioned there is An aggregation pipeline provides better performance and usability than a map-reduce operation. So here I am thinking - “should I carry-on exploring the MapReduce method of MongoDB or…

Mongodb

5 min read

MongoDB Aggregation vs MapReduce in a Sharded setup on Docker containers.
MongoDB Aggregation vs MapReduce in a Sharded setup on Docker containers.
Mongodb

5 min read


Aug 21, 2020

Diffie-Hellman key exchange in End-to-End Encryption (E2EE)

When it comes to data encryption, there are mainly two types — Symmetric and Asymmetric. Popular encryption methods like AES uses symmetric key encryption whereas RSA uses an asymmetric approach. Nowadays, chat applications use end-to-end encryption to protect users’ chat messages from getting compromised by hackers or by the organization…

Cryptography

5 min read

Diffie-Hellman key exchange in End-to-End Encryption (E2EE)
Diffie-Hellman key exchange in End-to-End Encryption (E2EE)
Cryptography

5 min read


Published in FAUN Publication

·Aug 14, 2020

Logging Architectures, EFK Stack and Kubernetes

LOGS. When it comes to logging, developers have to go an extra mile by inserting those log lines in their application code and also make sure their infrastructure can handle huge log ingestion to maintain scalability. The benefits? …

Log Management

6 min read

Logging Architectures, EFK Stack and Kubernetes
Logging Architectures, EFK Stack and Kubernetes
Log Management

6 min read


Published in FAUN Publication

·Aug 9, 2020

Auto-Remediation systems — A thought and an Overview

Systems fail. Code breaks. Responses get delayed, your Prod environment sets itself on fire and a developer resigns. This and many more of these “minor” hiccups together make a software engineer’s life complete. We, as humans, always embrace changes and so does a guy working in the IT industry. We…

DevOps

5 min read

Auto-Remediation systems — A thought and an Overview
Auto-Remediation systems — A thought and an Overview
DevOps

5 min read


Mar 22, 2020

Shadow of the Colossus — a different approach towards gaming experience

Disclaimer: This is not a game review but my thoughts after playing Shadow of the Colossus. Please do not read this article if you’re planning to play the game as it contains spoilers. “Shadow of the Colossus” quickly became an influential title after its release on Playstation 2 consoles back…

PS4

5 min read

Shadow of the Colossus — a different approach towards gaming experience
Shadow of the Colossus — a different approach towards gaming experience
PS4

5 min read


Published in FAUN Publication

·Mar 8, 2020

How we built a Kubernetes as a Service Platform from scratch

Few months back we started containerising our application’s micro-services and planned to do deployment on Kubernetes rather than on traditional Virtual Machines. Deploying apps on a managed Kubernetes service like Amazon EKS or Google’s GKE is relatively easy as the cluster setup and housekeeping are taken care by them and…

Kubernetes

5 min read

How we built a Kubernetes as a Service Platform from scratch
How we built a Kubernetes as a Service Platform from scratch
Kubernetes

5 min read

Shubhomoy Biswas

Shubhomoy Biswas

114 Followers

Artist | Software Developer | DevOps. Visit me at https://shubhomoy.github.io

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech