Google Opens Patches For "METRICFS" That They Have Used Since 2012 For Telemetry Data

Written by Michael Larabel in Linux Storage on 5 August 2020 at 08:35 PM EDT. 25 Comments
LINUX STORAGE
The METRICFS file-system has been in use internally at Google since 2012 for exporting system statistics to their telemetry systems with around 200 statistics being exported per machine. They are now posting the METRICFS patches as open-source for review and possible upstreaming.

A "request for comments" on METRICFS was sent out today on the Linux kernel mailing list. Their motives for now finally publishing these patches is as a result of the recent Statsfs proposal by a Red Hat engineer for a RAM-based file-system for exposing kernel statistics to user-space. METRICFS has a similar aim to Statsfs.

The posted METRICFS code has been cleaned up and modernized compared to Google's internal production version. These statistics reside under DebugFS and each metric being exposed in its own directory and contained within there are files for the annotations, fields, values, and version.

"Google has found a lot of value in having a generic interface for adding these kinds of statistics with reasonably low overhead (reading them is O(number of statistics), not number of objects in each statistic)," commented Google's Jonathan Adams.

More details on the METRICFS implementation via this mailing list thread.
Related News
About The Author
Michael Larabel

Michael Larabel is the principal author of Phoronix.com and founded the site in 2004 with a focus on enriching the Linux hardware experience. Michael has written more than 20,000 articles covering the state of Linux hardware support, Linux performance, graphics drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated benchmarking software. He can be followed via Twitter, LinkedIn, or contacted via MichaelLarabel.com.

Popular News This Week