Engineering Blog

Blog – 2 Column

PinCompute: Pinterest’s Kubernetes-Backed Platform for Versatile Computing Needs

Overview Pinterest is enhancing its compute platform with PinCompute, a fully managed compute API designed for various use cases. Built on Kubernetes, PinCompute simplifies infrastructure management and embraces cloud-native principles. This article explores its architecture and impact on innovation and efficiency at Pinterest. Architecture PinCompute is a regional Platform-as-a-Service (PaaS) on Kubernetes, with a host…

Railyard: Accelerating Machine Learning Model Training Using Kubernetes

Stripe leverages machine learning in services like Radar and Billing, handling millions of daily predictions across diverse models trained with billions of data points. To simplify model training, they developed Railyard, an API and job manager on Kubernetes, enabling independent team training with scalability. Railyard’s API prioritizes flexibility and ease of use, supporting Python workflows…

Introducing StableBuild – freeze and pin all dependencies for enhanced stability.

Launching StableBuild – freeze and pin all your dependencies StableBuild has introduced a new set of tools aimed at assisting developers in creating reliable and deterministic builds. This is achieved by providing the ability to effortlessly freeze and pin Docker images, operating system packages, Python packages, and other essential build dependencies. ‍Docker and deterministic builds…

Free ClickHouse training

Free ClickHouse training

ClickHouse is offering free courses tailored to help you master its capabilities. Whether you are an experienced data professional or just embarking on your journey, these courses provide the necessary skills and expertise for your success. Event Details Date: Feb 28 & 29Time: 6:30 AM IST / 9 AM SGT / 11 AM AEDT Register…

Dapr Day 2024 – VIRTUAL

Dapr Day 2024 – VIRTUAL

Participate in Dapr Day to learn all about Dapr APIs for building distributed applications and best practices to run your apps in production. 21 February 2024 | 4:00-9:00 PM (CET) / 7:00 AM -12:00 PM (PST) The event targets both developers and users of Dapr, offering a range of activities including keynote addresses, technical sessions,…

Does containerization affect the performance of databases?

The trend of containerizing databases is growing, as seen in Fig.1. With databases and analytics playing a significant role in technology, a common question arises: Does containerization affect database performance? If so, what factors are involved, and how can we address performance and stability challenges caused by containerization? Advantages and technical principles of containerization​ Containerization…

AWS Lambda Under the Hood

AWS Lambda Under the Hood

Mike Danilov covers how Lambda is built and how they had to modify the architecture to support 10GiB payloads⁠. AWS Lambda Overview Lambda is a serverless computing system where you can run your code on-demand without managing servers. It supports various programming languages, scales rapidly to match demand, and is used by millions of users…

Generative AI Tools for Infrastructure as Code

Generative AI Tools for Infrastructure as Code

Learn how to use generative AI to generate, interpret and debug code and accelerate your workflows. Infrastructure as Code (IaC) aids engineers in managing data, applications, and infrastructure in dynamic IT environments. Through a GitOps-driven approach, it ensures standardization, security, and operational consistency across various environments. Generative artificial intelligence (AI) has emerged as a game-changer…