Announcement

Collapse
No announcement yet.

Mac OS X 10.5 vs. Ubuntu 8.10 Benchmarks

Collapse
X
  • Filter
  • Time
  • Show
Clear All
new posts

  • #16
    Originally posted by Pesho View Post
    In the filesystem and SQLite tests, the Ext3 filesystem gave Ubuntu a huge disadvantage. It's generally slow, and its default journalling mode is seriously buggy. You should have tested using a better filesystem, for example JFS.
    About the SQLite benchmarks - if they used stock SQLite (shipped with Leopard), they may be faster with 10.5 because default SQLite options are "cheating":

    On Mac OS X v10.4, there are only two settings to control the way in which data in a SQLite-based store is written to disk. In order to provide finer granularity of control over the tradeoff between performance and reliability, on Mac OS X v10.5 Core Data uses two independent pragmas to control these options.

    Note that the default fsync behavior on Tiger was fcntl(F_FULLFSYNC) but on Leopard it is now a standard fsync . (This affects all SQLite databases on Leopard, not just Core Data.) The pragma allows you to toggle this value. See “Configuring a SQLite Store’s Save Behavior” in Persistent Stores for a full discussion.
    10.4 behaviour was:

    fsync on Mac OS X: Since on Mac OS X the fsync command does not make the guarantee that bytes are written, SQLite sends a F_FULLFSYNC request to the kernel to ensures that the bytes are actually written through to the drive platter. This causes the kernel to flush all buffers to the drives and causes the drives to flush their track caches. Without this, there is a significantly large window of time within which data will reside in volatile memory—and in the event of system failure you risk data corruption.
    On 10.5 it's no longer F_FULLFSYNC, which means that SQLite does not do full fsync by default on Leopard, which might be the case on Ubuntu, which might be the reason why it is much slower there.

    Comment


    • #17
      Originally posted by Pesho View Post
      In the filesystem and SQLite tests, the Ext3 filesystem gave Ubuntu a huge disadvantage. It's generally slow, and its default journalling mode is seriously buggy. You should have tested using a better filesystem, for example JFS.
      About the SQLite benchmarks – if they used stock SQLite (shipped with Leopard), they may be faster because that default Leopard SQLite is "cheating":

      On Mac OS X v10.4, there are only two settings to control the way in which data in a SQLite-based store is written to disk. In order to provide finer granularity of control over the tradeoff between performance and reliability, on Mac OS X v10.5 Core Data uses two independent pragmas to control these options.

      Note that the default fsync behavior on Tiger was fcntl(F_FULLFSYNC) but on Leopard it is now a standard fsync . (This affects all SQLite databases on Leopard, not just Core Data.) The pragma allows you to toggle this value. See “Configuring a SQLite Store’s Save Behavior” in Persistent Stores for a full discussion.
      10.4 behaviour was:

      fsync on Mac OS X: Since on Mac OS X the fsync command does not make the guarantee that bytes are written, SQLite sends a F_FULLFSYNC request to the kernel to ensures that the bytes are actually written through to the drive platter. This causes the kernel to flush all buffers to the drives and causes the drives to flush their track caches. Without this, there is a significantly large window of time within which data will reside in volatile memory—and in the event of system failure you risk data corruption.
      So maybe it's just faster on OS X because by default SQLite there does not issue full fsync, which may be the case on Ubuntu.

      Comment


      • #18
        Originally posted by valgonzarp View Post
        So maybe it's just faster on OS X because by default SQLite there does not issue full fsync, which may be the case on Ubuntu.

        Yes, that's probably the main cause.

        Comment


        • #19
          Originally posted by valgonzarp View Post
          About the SQLite benchmarks – if they used stock SQLite (shipped with Leopard), they may be faster because that default Leopard SQLite is "cheating":
          PTS compiles it from scratch.

          Comment


          • #20
            I'm disappointed for linux
            still, Ubuntu is one of the slower linux distro's.

            I wish there was hype behind some of these benchmarks, like there is on Acid tests for web rendering engines, or javascript stuff.
            If there was such hype, I could see some linux people improving these a lot.

            I agree with the post about lag since the 2.6.22 kernel in gutsy. I think it had to do with the scheduler. not convinced the CFS is completely fair

            When i copy big files between HDs, my PC becomes unusable (quad core 4GB ram) seriously, I see no need for this.

            Comment


            • #21
              I'm going to test SQLite benchmark on my gentoo. This terribly poor SQLite performance in Ubuntu is shocking, something must be broken - I don't believe ext3 is that slow (I'm using reiserfs so I can't really judge though).

              Edit:
              sqlite benchmark results on P4 640 Prescott 3.2GHz (HT) on WDC 250GB/reiserfs (with KDE4-live with compositing and some other apps running but rather being idle)
              - nearly 68s (12500 inserts)
              still slower than Mac OS X, it must be FULL_SYNC related as someone stated before.
              Last edited by reavertm; 11-06-2008, 12:58 PM.

              Comment


              • #22
                ext3 is much slower with small files, you can gain more than 5% when you compile a kernel on reiserfs.

                Comment


                • #23
                  Real world comparisons good too

                  Thanks for these comparisons, really interesting to see. I'd love to see more real world timing comparisons also. Main things I'm thinking about are.
                  1. Boot speed
                  2. Launch Firefox from cold boot
                  3. Power consumption (active and idle)
                  4. Battery life
                  5. Finder vs. Nautilus for large directories and operations

                  Comment


                  • #24
                    Originally posted by SyXbiT View Post
                    I'm disappointed for linux
                    still, Ubuntu is one of the slower linux distro's.

                    I wish there was hype behind some of these benchmarks, like there is on Acid tests for web rendering engines, or javascript stuff.
                    If there was such hype, I could see some linux people improving these a lot.

                    I agree with the post about lag since the 2.6.22 kernel in gutsy. I think it had to do with the scheduler. not convinced the CFS is completely fair

                    When i copy big files between HDs, my PC becomes unusable (quad core 4GB ram) seriously, I see no need for this.
                    Something must be really, really bad for IO operations in Ubuntu, then... I just bought a new HDD and moved around about 300Gb worth of data, from various sources to various destinations, some times simultaneously. And on my Fedora 8 x86_64 2.6.26.5 the system was just as snappy as always, while these moves were being done (and I use EXT3 as filesystem, mind you) I was doing some other stuff like reading e-mail, browsing the web and using OOo (until I had to move my /home data, which meant I didn't want to disturb the process by adding cache files to FF, new mails to TB, etc).

                    I don't mean this to be Ubuntu bashing or "mine is better than yours" kind of comment, rather that something has gone seriously wrong somewhere... Are there any bug reports about this? Are there any kind of reports about whether this slow down is with P-ATA/S-ATA drives? Which operations are slower? what's the CPU usage of commands like cp/mv/du/etc? Maybe a regression in a patch from Ubuntu to libata?

                    Comment


                    • #25
                      I'd love to see benchmarks of other distros (Arch Linux, Gentoo), because it looks like there's something really bad in the newest Ubuntu. It's strange, but Intrepid seems to be faster than previous versions, so the problem may be in something else. And I'd love to see benchmarks using NVIDIA card.

                      Comment


                      • #26
                        Originally posted by joffe View Post
                        I know, this is what mine looks like (http://www.isarapix.org/pix35/1225188868.png). My point is that if I'm going to customize it extensively I might as well use something like Arch where I get to trim away all the crap I don't need and where I am spared from the Debian package management system - Ubuntu is supposed to be a turnkey distro, and I would just love for it to be turnkey beautiful instead of turnkey 1995. Not just for myself but the image and the adoption rates that would lead to. Lots of people bought Vista purely on the eye candy. Many people who buy Macs buy them because the OS (and the hardware) is pretty. The GUI is the face of the OS, doesn't matter how solid it is, if users are met with grey task bars and some ugly brown splatter they're going to be less positive about it. I'm looking at this from a 'competing with Win/OSX' perspective which Shuttleworth claims is his goal.
                        I'm sorry, but I like Gnome because it's easy on the eye and has a strong layout. Furthermore, I know more people who change the vista/xp default theme to 'classic' then people who actually keep these shiny themes. Maybe the world consists of different people, who knows?

                        Also, if people want it shiny, they can use KDE4: Shiny by default --> problem solved.

                        The speed is very fast compared to XP/Vista and I have faith in the teams working on the kernel/distro's.
                        Last edited by MaestroMaus; 11-06-2008, 01:46 PM.

                        Comment


                        • #27
                          ...those benchmarks against MS Vista SP1 & OpenSolaris 2008.11

                          Comment


                          • #28
                            Originally posted by joffe View Post
                            I know, this is what mine looks like (http://www.isarapix.org/pix35/1225188868.png). My point is that if I'm going to customize it extensively I might as well use something like Arch where I get to trim away all the crap I don't need and where I am spared from the Debian package management system - Ubuntu is supposed to be a turnkey distro, and I would just love for it to be turnkey beautiful instead of turnkey 1995. Not just for myself but the image and the adoption rates that would lead to. Lots of people bought Vista purely on the eye candy. Many people who buy Macs buy them because the OS (and the hardware) is pretty. The GUI is the face of the OS, doesn't matter how solid it is, if users are met with grey task bars and some ugly brown splatter they're going to be less positive about it. I'm looking at this from a 'competing with Win/OSX' perspective which Shuttleworth claims is his goal.
                            What's wrong with the Debian package manager btw?
                            I found it to be one of the main reasons to switch to Ubuntu really.

                            Comment


                            • #29
                              Just one point and I don't know how important it is...
                              OS-X and the mac-mini are spescifically designed for each other where as ubuntu has to support as much hardware as possable out of the box. So any general OS that comes with drivers built in will have to carry a lot of 'dead weight' and avoid over optimisation, where as an OS for very few hardware platforms can be highly optimised and shed all unnecessary components.

                              Comment


                              • #30
                                Originally posted by Prosthetic Head View Post
                                Just one point and I don't know how important it is...
                                OS-X and the mac-mini are spescifically designed for each other where as ubuntu has to support as much hardware as possable out of the box. So any general OS that comes with drivers built in will have to carry a lot of 'dead weight' and avoid over optimisation, where as an OS for very few hardware platforms can be highly optimised and shed all unnecessary components.

                                With the modular nature of linux this is of no concern. It loads what it needs to support the hardware found.

                                Comment

                                Working...
                                X