Cloudflare Ditches Nginx For In-House, Rust-Written Pingora

Written by Michael Larabel in Linux Networking on 15 September 2022 at 02:56 PM EDT. 99 Comments
LINUX NETWORKING --
Cloudflare has long relied upon Nginx as part of its HTTP proxy stack but now has replaced it with their in-house, Rust-written Pingora software that is said to be serving over one trillion requests per day and delivering better performance while only using about a third of the CPU and memory resources.

Cloudflare has "outgrown" Nginx and ended up creating their own HTTP proxy stack. Cloudflare found that Nginx's worker process architecture was hitting drawbacks, particularly around CPU resources. Nginx also proved to be difficult to extend to their needs.

Cloudflare engineers have been developing Pingora from scratch as an in-house solution. The Rust programming language was chosen for its memory safety while still delivering C-like performance. Cloudflare also implemented their own HTTP library for Rust in order to suit all of their different needs. Pingora employs a multi-threaded architecture rather than multi-process.


Cloudflare Pingora diagram.


As for the performance benefits with Pingora:
In production, Pingora consumes about 70% less CPU and 67% less memory compared to our old service with the same traffic load.

Beyond the staggering performance wins, Pingora is also deemed safer thanks in large part to the use of Rust.

Those wishing to learn more about Cloudflare's Pingora project can do so via the Cloudflare blog. The only downside is that Pingora isn't yet open-sourced -- Cloudflare says they are working out the plans to, but as of right now this HTTP proxy isn't yet public.
Related News
About The Author
Author picture

Michael Larabel is the principal author of Phoronix.com and founded the site in 2004 with a focus on enriching the Linux hardware experience. Michael has written more than 20,000 articles covering the state of Linux hardware support, Linux performance, graphics drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated benchmarking software. He can be followed via Twitter, LinkedIn, or contacted via MichaelLarabel.com.

Popular News This Week