Announcement

Collapse
No announcement yet.

Portal & HL2 Lost Coast Linux Benchmarks Added

Collapse
X
  • Filter
  • Time
  • Show
Clear All
new posts

  • #11
    Originally posted by Pajn View Post
    Can't you use a single Steam game library that you keep on a harddrive or similar.
    Then you just can tell Steam to not update those games.
    No, that's only good for local testing... What happens if User D or Company X wants to reproduce the results remotely?
    Michael Larabel
    http://www.michaellarabel.com/

    Comment


    • #12
      Originally posted by molecule-eye View Post
      Exactly: who cares about benchmarks run on old, crusty ass unpatched versions of software? Suppose there's some poor ass performance in some game X where you're getting 16fps on card Y. It's patched so that one now gets 48fps on the same card. Would anyone care that the same card performs just as miserably on a newer kernel on the crusty old version of the game as it did back then? Or that some newer card Z on the same architecture (e.g. Pitcairn) performs also miserably on the crusty old version of the game? I doubt it! I sure as hell don't!
      It's all a matter of reproducibility, not a matter of wanting to intentionally run older versions of software. With PTS testing, all tests are version controlled, configurations saved, etc. Any independent user or company can reproduce the exact tests I did (or any other party did for that matter). With Steam, you lose that ability due to having the game version handling being outside of my control. It also matters when running constant Mesa/Linux kernel benchmarks and wanting to keep the version constant -- and then when adding new test systems to that harness, you lose the ability unless manually copying files from one system to the next.
      Michael Larabel
      http://www.michaellarabel.com/

      Comment


      • #13
        Excellent news!

        If the version of the games can be automatically retrieved, then maybe appending it to the game’s name could sort of fix the problem of comparing different versions… If the version is different you know you can’t 100% trust the comparision, but you still know the current performance, which is after all quite important .

        One thing missing from the benchmarks is the game’s settings.

        Comment


        • #14
          Originally posted by stqn View Post
          Excellent news!

          If the version of the games can be automatically retrieved, then maybe appending it to the game’s name could sort of fix the problem of comparing different versions… If the version is different you know you can’t 100% trust the comparision, but you still know the current performance, which is after all quite important .

          One thing missing from the benchmarks is the game’s settings.
          Unfortunately I am not even aware of any universal Steam commands or files storing a game's revision/version information... Short of just trying to MD5 the main binary or something to get some sort of identifier that would only be rather useless.
          Michael Larabel
          http://www.michaellarabel.com/

          Comment


          • #15
            Originally posted by AJSB View Post
            What driver did you used with 7790 , the OSS RADEON ?
            IF so, it wasn't a fair comparison....or complete...you should have done it with Catalyst also....
            The NVIDIA 770 is a much more powerful card than the 7790, even if the drivers were equal. In fact it's about twice as fast, looking at Passmark's MS Windows results (probably not the best benchmark in the world from what I've heard, but a reasonable comparison point). That difference is even larger in these benchmarks, but not really surprising given the additional performance hit of the FOSS drivers. Catalyst benchmarks would be interesting, but I don't blame him for not testing as the driver is mostly a pain in my experience.

            Finally, there are some system differences that could be affecting things, such as a somewhat stronger CPU in the 770 system. Probably not enough to dramatically skew the results but something to take into account.
            Last edited by AnonymousCoward; 03-31-2014, 12:13 PM.

            Comment


            • #16
              Test fails:

              Code:
              $ phoronix-test-suite debug-run portal
              
              Portal:
              pts/portal-1.0.0
              Graphics Test Configuration
              1:  800 x 600
              2:  1024 x 768
              3:  1280 x 800
              4:  1280 x 960
              5:  1440 x 900
              6:  1280 x 1024
              7:  1600 x 900
              8:  1400 x 1050
              9:  1680 x 1050
              10: 1600 x 1200
              11: 1920 x 1080
              12: Test All Options
              Resolution: 11
              
              
              ========================================
              Phoronix Test Suite v5.0.1
              System Information
              ========================================
              
              Hardware:
              Processor: AMD Phenom II X6 1090T @ 3.20GHz (6 Cores), Motherboard: Gigabyte GA-MA780G-UD3H, Chipset: AMD RS780 + SB7x0/SB8x0/SB9x0, Memory: 8192MB, Disk: 2 x 1000GB Western Digital WD1001FALS-0 + 3001GB Seagate ST3000DM001-9YN1 + 3001GB Seagate ST3000DM001-1CH1, Graphics: ASUS AMD Radeon HD 7800 2048MB (1000/1200MHz), Audio: Realtek ALC889A, Monitor: VX2235wm-3 + P244W, Network: Realtek RTL8111/8168/8411
              
              Software:
              OS: Ubuntu 12.04, Kernel: 3.2.0-60-generic-pae (i686), Desktop: GNOME 3.2.1, Display Server: X Server 1.11.3, Display Driver: fglrx 13.35.5, OpenGL: 4.3.12798, Compiler: GCC 4.6.3, File-System: ext4, Screen Resolution: 2970x1680
              
              
              ========================================
              Portal (Run 1 of 3)
              ========================================
              
              
              Test Run Command: cd /home/dennis/.phoronix-test-suite/installed-tests/pts/portal-1.0.0/ && ./portal -w 1920 -h 1080 2>&1
              
              SDL video target is 'x11'
              SDL video target is 'x11'
              AppFramework : Unable to load module vguimatsurface.so!
              Unable to load interface VGUI_Surface030 from vguimatsurface.so
              This system supports the OpenGL extension GL_EXT_framebuffer_object.
              This system supports the OpenGL extension GL_EXT_framebuffer_blit.
              This system supports the OpenGL extension GL_EXT_framebuffer_multisample.
              This system DOES NOT support the OpenGL extension GL_APPLE_fence.
              This system DOES NOT support the OpenGL extension GL_NV_fence.
              This system supports the OpenGL extension GL_ARB_sync.
              This system supports the OpenGL extension GL_EXT_draw_buffers2.
              This system supports the OpenGL extension GL_EXT_bindable_uniform.
              This system DOES NOT support the OpenGL extension GL_APPLE_flush_buffer_range.
              This system supports the OpenGL extension GL_ARB_map_buffer_range.
              This system supports the OpenGL extension GL_ARB_vertex_buffer_object.
              This system supports the OpenGL extension GL_ARB_occlusion_query.
              This system DOES NOT support the OpenGL extension GL_APPLE_texture_range.
              This system DOES NOT support the OpenGL extension GL_APPLE_client_storage.
              This system DOES NOT support the OpenGL extension GL_ARB_uniform_buffer.
              This system supports the OpenGL extension GL_ARB_vertex_array_bgra.
              This system supports the OpenGL extension GL_EXT_vertex_array_bgra.
              This system supports the OpenGL extension GL_ARB_framebuffer_object.
              This system DOES NOT support the OpenGL extension GL_GREMEDY_string_marker.
              This system supports the OpenGL extension GL_ARB_debug_output.
              This system supports the OpenGL extension GL_EXT_direct_state_access.
              This system DOES NOT support the OpenGL extension GL_NV_bindless_texture.
              This system supports the OpenGL extension GL_AMD_pinned_memory.
              This system DOES NOT support the OpenGL extension GL_EXT_framebuffer_multisample_blit_scaled.
              This system supports the OpenGL extension GL_EXT_texture_sRGB_decode.
              This system DOES NOT support the OpenGL extension GL_NVX_gpu_memory_info.
              This system supports the OpenGL extension GL_ATI_meminfo.
              This system supports the OpenGL extension GL_EXT_texture_compression_s3tc.
              This system DOES NOT support the OpenGL extension GL_EXT_texture_compression_dxt1.
              This system DOES NOT support the OpenGL extension GL_ANGLE_texture_compression_dxt3.
              This system DOES NOT support the OpenGL extension GL_ANGLE_texture_compression_dxt5.
              This system DOES NOT support the OpenGL extension GLX_EXT_swap_control_tear.
              GL_NV_bindless_texture: DISABLED
              GL_AMD_pinned_memory: DISABLED
              GL_EXT_texture_sRGB_decode: AVAILABLE
              
              Test Result Value: 
              
              
              The test run did not produce a result.
              
              ...etc
              Fix?

              Comment


              • #17
                Originally posted by RecceDG View Post
                Test fails:

                Code:
                $ phoronix-test-suite debug-run portal
                
                Portal:
                pts/portal-1.0.0
                Graphics Test Configuration
                1:  800 x 600
                2:  1024 x 768
                3:  1280 x 800
                4:  1280 x 960
                5:  1440 x 900
                6:  1280 x 1024
                7:  1600 x 900
                8:  1400 x 1050
                9:  1680 x 1050
                10: 1600 x 1200
                11: 1920 x 1080
                12: Test All Options
                Resolution: 11
                
                
                ========================================
                Phoronix Test Suite v5.0.1
                System Information
                ========================================
                
                Hardware:
                Processor: AMD Phenom II X6 1090T @ 3.20GHz (6 Cores), Motherboard: Gigabyte GA-MA780G-UD3H, Chipset: AMD RS780 + SB7x0/SB8x0/SB9x0, Memory: 8192MB, Disk: 2 x 1000GB Western Digital WD1001FALS-0 + 3001GB Seagate ST3000DM001-9YN1 + 3001GB Seagate ST3000DM001-1CH1, Graphics: ASUS AMD Radeon HD 7800 2048MB (1000/1200MHz), Audio: Realtek ALC889A, Monitor: VX2235wm-3 + P244W, Network: Realtek RTL8111/8168/8411
                
                Software:
                OS: Ubuntu 12.04, Kernel: 3.2.0-60-generic-pae (i686), Desktop: GNOME 3.2.1, Display Server: X Server 1.11.3, Display Driver: fglrx 13.35.5, OpenGL: 4.3.12798, Compiler: GCC 4.6.3, File-System: ext4, Screen Resolution: 2970x1680
                
                
                ========================================
                Portal (Run 1 of 3)
                ========================================
                
                
                Test Run Command: cd /home/dennis/.phoronix-test-suite/installed-tests/pts/portal-1.0.0/ && ./portal -w 1920 -h 1080 2>&1
                
                SDL video target is 'x11'
                SDL video target is 'x11'
                AppFramework : Unable to load module vguimatsurface.so!
                Unable to load interface VGUI_Surface030 from vguimatsurface.so
                This system supports the OpenGL extension GL_EXT_framebuffer_object.
                This system supports the OpenGL extension GL_EXT_framebuffer_blit.
                This system supports the OpenGL extension GL_EXT_framebuffer_multisample.
                This system DOES NOT support the OpenGL extension GL_APPLE_fence.
                This system DOES NOT support the OpenGL extension GL_NV_fence.
                This system supports the OpenGL extension GL_ARB_sync.
                This system supports the OpenGL extension GL_EXT_draw_buffers2.
                This system supports the OpenGL extension GL_EXT_bindable_uniform.
                This system DOES NOT support the OpenGL extension GL_APPLE_flush_buffer_range.
                This system supports the OpenGL extension GL_ARB_map_buffer_range.
                This system supports the OpenGL extension GL_ARB_vertex_buffer_object.
                This system supports the OpenGL extension GL_ARB_occlusion_query.
                This system DOES NOT support the OpenGL extension GL_APPLE_texture_range.
                This system DOES NOT support the OpenGL extension GL_APPLE_client_storage.
                This system DOES NOT support the OpenGL extension GL_ARB_uniform_buffer.
                This system supports the OpenGL extension GL_ARB_vertex_array_bgra.
                This system supports the OpenGL extension GL_EXT_vertex_array_bgra.
                This system supports the OpenGL extension GL_ARB_framebuffer_object.
                This system DOES NOT support the OpenGL extension GL_GREMEDY_string_marker.
                This system supports the OpenGL extension GL_ARB_debug_output.
                This system supports the OpenGL extension GL_EXT_direct_state_access.
                This system DOES NOT support the OpenGL extension GL_NV_bindless_texture.
                This system supports the OpenGL extension GL_AMD_pinned_memory.
                This system DOES NOT support the OpenGL extension GL_EXT_framebuffer_multisample_blit_scaled.
                This system supports the OpenGL extension GL_EXT_texture_sRGB_decode.
                This system DOES NOT support the OpenGL extension GL_NVX_gpu_memory_info.
                This system supports the OpenGL extension GL_ATI_meminfo.
                This system supports the OpenGL extension GL_EXT_texture_compression_s3tc.
                This system DOES NOT support the OpenGL extension GL_EXT_texture_compression_dxt1.
                This system DOES NOT support the OpenGL extension GL_ANGLE_texture_compression_dxt3.
                This system DOES NOT support the OpenGL extension GL_ANGLE_texture_compression_dxt5.
                This system DOES NOT support the OpenGL extension GLX_EXT_swap_control_tear.
                GL_NV_bindless_texture: DISABLED
                GL_AMD_pinned_memory: DISABLED
                GL_EXT_texture_sRGB_decode: AVAILABLE
                
                Test Result Value: 
                
                
                The test run did not produce a result.
                
                ...etc
                Fix?
                Is the game installed in the default location? Default settings? etc...
                Michael Larabel
                http://www.michaellarabel.com/

                Comment


                • #18
                  Yup. It runs just fine from Steam.

                  $ locate vguimatsurface.so
                  /home/dennis/Steam/SteamApps/common/Half-Life 2/bin/vguimatsurface.so
                  /home/dennis/Steam/SteamApps/common/Portal/bin/vguimatsurface.so
                  /home/dennis/Steam/SteamApps/common/Portal 2/bin/vguimatsurface.so
                  /home/dennis/Steam/SteamApps/common/Team Fortress 2/bin/vguimatsurface.so

                  Comment


                  • #19
                    Similar problem with TF2:

                    Code:
                    $ phoronix-test-suite debug-run tf2
                    
                    [NOTICE] pts/tf2: The latest test profile version available for upgrade is 1.0.1 but version 1.0.0 is the latest currently installed.
                    
                    
                    Team Fortress 2:
                    pts/tf2-1.0.0
                    Graphics Test Configuration
                    1:  800 x 600
                    2:  1024 x 768
                    3:  1280 x 800
                    4:  1280 x 960
                    5:  1440 x 900
                    6:  1280 x 1024
                    7:  1600 x 900
                    8:  1400 x 1050
                    9:  1680 x 1050
                    10: 1600 x 1200
                    11: 1920 x 1080
                    12: Test All Options
                    Resolution: 11
                    
                    
                    ========================================
                    Phoronix Test Suite v5.0.1
                    System Information
                    ========================================
                    
                    Hardware:
                    Processor: AMD Phenom II X6 1090T @ 3.20GHz (6 Cores), Motherboard: Gigabyte GA-MA780G-UD3H, Chipset: AMD RS780 + SB7x0/SB8x0/SB9x0, Memory: 8192MB, Disk: 2 x 1000GB Western Digital WD1001FALS-0 + 3001GB Seagate ST3000DM001-9YN1 + 3001GB Seagate ST3000DM001-1CH1, Graphics: ASUS AMD Radeon HD 7800 2048MB (1000/1200MHz), Audio: Realtek ALC889A, Monitor: VX2235wm-3 + P244W, Network: Realtek RTL8111/8168/8411
                    
                    Software:
                    OS: Ubuntu 12.04, Kernel: 3.2.0-60-generic-pae (i686), Desktop: GNOME 3.2.1, Display Server: X Server 1.11.3, Display Driver: fglrx 13.35.5, OpenGL: 4.3.12798, Compiler: GCC 4.6.3, File-System: ext4, Screen Resolution: 2970x1680
                    
                    
                    ========================================
                    Team Fortress 2 (Run 1 of 3)
                    ========================================
                    
                    
                    Test Run Command: cd /home/dennis/.phoronix-test-suite/installed-tests/pts/tf2-1.0.0/ && ./tf2 -fullscreen -novideo -w 1920 -h 1080 2>&1
                    
                    ./hl2_linux: error while loading shared libraries: libtcmalloc_minimal.so.4: cannot open shared object file: No such file or directory
                    
                    Test Result Value: 
                    
                    
                    The test run did not produce a result.

                    Comment


                    • #20
                      Aha!

                      The "portal" shell script is pointing to a weird spot.

                      Fixed by manually editing the script.

                      Comment

                      Working...
                      X