Engineering Blog

Operation

From Containers to Pipelines: How Dagger Builds on Docker’s Legacy

From Containers to Pipelines: How Dagger Builds on Docker’s Legacy

Remember Docker? The revolutionary containerization platform that transformed software development? Solomon Hykes, its creator, is back with a new venture – Dagger. This time, he’s tackling a different challenge: the complexity of CI/CD pipelines. Why Pipelines Matter (and Why They’re a Mess) In a recent interview, Hykes dives into the frustrations developers face with inflexible…

CNCF Survey Reveals: Half of Companies Overspend with Kubernetes, Primarily Due to Overprovisioning

CNCF Survey Reveals: Half of Companies Overspend with Kubernetes, Primarily Due to Overprovisioning

CNCF’s recent microsurvey on cloud-native FinOps and CFM revealed insights into Kubernetes’ impact on cloud spending. Nearly half of respondents reported increased costs, while others saw no change or savings post-migration. The main factors contributing to overspending include overprovisioning, lack of awareness, and resource sprawl. The survey sought details on Kubernetes spending and overall cloud…

Kubernetes Load Balancer – On-Premises & Bare Metal

Kubernetes Load Balancer – On-Premises & Bare Metal

Managing a Kubernetes Load Balancer has always been challenging. In the past, setting it up involved a time-consuming process of submitting tickets and collaborating between network and Linux engineers. Now, with cloud technology, on-demand load balancer services are available instantly for Kubernetes, simplifying tasks for DevOps engineers. However, replicating this ease of use in on-premises…

Introducing ingress2gateway; Simplifying Upgrades to Gateway API

Introducing ingress2gateway; Simplifying Upgrades to Gateway API

In the dynamic realm of Kubernetes, networking is crucial for effective service exposure. The Ingress API, familiar to many Kubernetes users, is key for managing external access to services within the cluster. Despite its usefulness, Ingress has limitations, which can become bottlenecks as applications grow in complexity and Kubernetes clusters face increased demands. Here are…

Booking.com improved its delivery speed by using DORA metrics and Micro Frontends, doubling its performance.

Booking.com improved its delivery speed by using DORA metrics and Micro Frontends, doubling its performance.

Booking.com’s fintech team improved both backend and frontend, doubling delivery performance per DORA metrics. They also utilized Micro Frontends to divide the monolithic frontend into separate deployable apps. In mid-2022, Booking.com formed a new engineering team to manage finance processes. This team inherited architecture with a monolithic frontend (Perl/Javascript with Vue Framework) and a Java…

PinCompute: Pinterest’s Kubernetes-Backed Platform for Versatile Computing Needs

Overview Pinterest is enhancing its compute platform with PinCompute, a fully managed compute API designed for various use cases. Built on Kubernetes, PinCompute simplifies infrastructure management and embraces cloud-native principles. This article explores its architecture and impact on innovation and efficiency at Pinterest. Architecture PinCompute is a regional Platform-as-a-Service (PaaS) on Kubernetes, with a host…

Railyard: Accelerating Machine Learning Model Training Using Kubernetes

Stripe leverages machine learning in services like Radar and Billing, handling millions of daily predictions across diverse models trained with billions of data points. To simplify model training, they developed Railyard, an API and job manager on Kubernetes, enabling independent team training with scalability. Railyard’s API prioritizes flexibility and ease of use, supporting Python workflows…

Introducing StableBuild – freeze and pin all dependencies for enhanced stability.

Launching StableBuild – freeze and pin all your dependencies StableBuild has introduced a new set of tools aimed at assisting developers in creating reliable and deterministic builds. This is achieved by providing the ability to effortlessly freeze and pin Docker images, operating system packages, Python packages, and other essential build dependencies. ‍Docker and deterministic builds…

Does containerization affect the performance of databases?

The trend of containerizing databases is growing, as seen in Fig.1. With databases and analytics playing a significant role in technology, a common question arises: Does containerization affect database performance? If so, what factors are involved, and how can we address performance and stability challenges caused by containerization? Advantages and technical principles of containerization​ Containerization…

AWS Lambda Under the Hood

AWS Lambda Under the Hood

Mike Danilov covers how Lambda is built and how they had to modify the architecture to support 10GiB payloads⁠. AWS Lambda Overview Lambda is a serverless computing system where you can run your code on-demand without managing servers. It supports various programming languages, scales rapidly to match demand, and is used by millions of users…