Announcement

Collapse
No announcement yet.

DatArcs Is Aiming For Dynamically-Tuned, Self-Optimizing Linux Servers

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • DatArcs Is Aiming For Dynamically-Tuned, Self-Optimizing Linux Servers

    Phoronix: DatArcs Is Aiming For Dynamically-Tuned, Self-Optimizing Linux Servers

    DatArcs is a new software start-up aiming to provide software to dynamically tune Linux servers for maximum performance and energy efficiency in the data-center. The DatArcs optimizer analyzes the server's workload over time and optimizes the server "several times per minute" to achieve better performance or lower power use...

    Phoronix, Linux Hardware Reviews, Linux hardware benchmarks, Linux server benchmarks, Linux benchmarking, Desktop Linux, Linux performance, Open Source graphics, Linux How To, Ubuntu benchmarks, Ubuntu hardware, Phoronix Test Suite

  • #2
    So basically its doing what a scheduler should be doing just in a wider area? Could it not be contributed as module into the kernel?

    Comment


    • #3
      Originally posted by cj.wijtmans View Post
      So basically its doing what a scheduler should be doing just in a wider area? Could it not be contributed as module into the kernel?
      Unlikely they would contribute it as a module to the kernel since it appears they are building a commercial organization around it. Additionally, it also looks like they do some application-level tweaking too, so isn't just all kernel tuning being done.
      Michael Larabel
      https://www.michaellarabel.com/

      Comment


      • #4
        Ah cool, we needed some "your pc is slow, install $random_bs" on Linux too. /sarcasm


        More seriously, this is very interesting even if closed source, as the config changes are still readable and being automated it can do much more accurate testing than a human can.

        Comment


        • #5
          Relatedly, Google's DeepMind project was used to cut cooling costs via machine learning. This makes me hopeful that one might be able to use ML to optimize energy use and performance across the board, at many layers of the stack.

          Reducing energy usage has been a major focus for us over the past 10 years: we have built our own super-efficient servers at Google, invented more efficient ways to cool our data centres and...

          Comment


          • #6
            Ubuntu 16.40
            5chars

            Comment


            • #7
              Originally posted by cj.wijtmans View Post
              So basically its doing what a scheduler should be doing just in a wider area? Could it not be contributed as module into the kernel?
              No, what I think it's doing is closer to Bayesian optimization of hyperparameters. A bit like Spearmint, but applied to Linux systems rather than some machine learning model.

              You run an experiment with settings S[t]. You observe the outcome O[t]. Based on the outcome you tweak the settings a bit and start another time period with settings S[t+1]. Repeat. Eventually you can converge on a solution that's near-optimal according to the chosen criteria (e.g. throughput, latency, energy use, cost, ...)

              Comment


              • #8
                rhel7 has a tuned daemon.

                Comment


                • #9
                  They got nothing on Windows Optimizer

                  Comment


                  • #10
                    Originally posted by Idonotexist View Post

                    No, what I think it's doing is closer to Bayesian optimization of hyperparameters. A bit like Spearmint, but applied to Linux systems rather than some machine learning model.

                    You run an experiment with settings S[t]. You observe the outcome O[t]. Based on the outcome you tweak the settings a bit and start another time period with settings S[t+1]. Repeat. Eventually you can converge on a solution that's near-optimal according to the chosen criteria (e.g. throughput, latency, energy use, cost, ...)
                    So i assume you have to make profiles yourself or do they make them for you.

                    Comment

                    Working...
                    X