Originally posted by bug77
View Post
Announcement
Collapse
No announcement yet.
AMD Releases Brotli-G For GPU-Accelerated Brotli Compression
Collapse
X
-
- Likes 2
-
Originally posted by bug77 View Post
If you use brotli with big files, it compresses less than gzip.
Parallelism may be a thing, but I'm not sure how that would work. Clouds do not rent GPU for web traffic compression offloading, afaik. Maybe for custom deployments?
Comment
-
Originally posted by Artim View Postcloud and CDN providers might switch to just using GPU acceleration
B.t.w. this is a completly "new" format from a practical point of view as:
One thing for developers to note is that assets that have already been compressed with Brotli cannot be decompressed with Brotli-G decompressor implementations. To take advantage of Brotli-G, assets must be recompressed using a Brotli-G compatible compressor (also supplied in the SDK).
as you can´t pass a brotli compresse bitstream to the Brotli-G decoder.. So essentially the current ecosystem is almost 0.Last edited by Spacefish; 22 November 2022, 06:36 PM.
- Likes 1
Comment
-
-
Originally posted by bug77 View PostI thought brotli was designed to be easy on hardware (being able to run on phones and such). What am I missing here? Why does it need to run on GPUs now?
this is designed for various assets, but this should work for anything that needs to be utilized on the gpu, we need to compress resouces going to gpus, because the stuff we punt onto the gpus is far out pacing the amount of vram that increases as time goes on.
compression is necessary for this, but since you are under the assumption that decompression needs to happen real time, and that this will also that this will be used in gpu intense scenarios, so you want the performance impact to be as little as possible, brotli is easily the best choice for this.
this could be used for direct storage, but its not necessarily only useful for that, this could be useful for compute, this could be useful to trim that 8.5gb of vram usage to 8. but more importantly, we don't really have a good way to crossplatform supported, losslessly compress assets, as far as I know, I'm not sure if we even have any good lossless texture formats for gpu.
- Likes 1
Comment
-
Originally posted by Spacefish View PostNah, they just store the file compressed in the first place, so they don´t have to compress on-the-fly
B.t.w. this is a completly "new" format from a practical point of view as:
This essentially means, that one has to introduce a new format in the HTTP header like Content-Encoding: br-g
as you can´t pass a brotli compresse bitstream to the Brotli-G decoder.. So essentially the current ecosystem is almost 0.
- Likes 1
Comment
-
Originally posted by bug77 View Post
What would you keep in VRAM that would benefit from brotli? Brotli is good with small files, it sucks with something as large as a texture. Maybe this is aimed at some sort of compute scenario?
Maybe there are gpgpu scenarios where the dataset is highly crompressible (where saving pcie bandwidth savings are enough to offset the additional compute overhead).Last edited by brucethemoose; 23 November 2022, 01:37 PM.
- Likes 2
Comment
-
Nvidia has it it's own library for GPU accelerated compression for deflate, LZ4, zstd, etc.. The latest versions are not open source thought.
- Likes 1
Comment
-
Originally posted by abu_shawarib View PostNvidia has it it's own library for GPU accelerated compression for deflate, LZ4, zstd, etc.. The latest versions are not open source thought.
https://github.com/NVIDIA/nvcomp
- Likes 1
Comment
Comment