Linux Foundation To Host PaSh For Automatic Parallelizing Of Shell Scripts

[phoronix]

Phoronix: Linux Foundation To Host PaSh For Automatic Parallelizing Of Shell Scripts

The Linux Foundation announced today they will be hosting the PaSh project that is focused on automatically parallelizing POSIX shell scripts...

https://www.phoronix.com/scan.php?page=news_item&px=Linux-Foundation-PaSh

[uid313]

I don't know if this is so useful, shell scrips are good when they're a few lines long, once you outgrow that maybe it is time to go over to Python instead.

[skeevy420]

This seems useful.

I wonder how many people are gonna try this and discover how many non-POSIX Bash or ZSH commands they're using

[skeevy420]

ROFL

Post 1: I don't know if this is so useful

Post 2: This seems useful

I'm glad we're all on the same page about this.

[hoohoo]

This is a fantastic idea!

[ssokolow]

I'll have to look into this. At first glance, it seems like something that would require each subprocess invocation to be annotated with information on whether it has side-effects that need to be observable by later steps.

[Developer12]

It'd be really interesting I bet to look into how they're doing it. My first expectation was that this would be a racey bug-ridden mess. Raw POSIX shell can already be a PITA.

[discordian]

Wow, now I seen everything. How does the optimizer know side effects of instantiated tools, what are the kinds of use cases?
I did just generate and run makefiles if I had multiple task, but given how most shell logic is dynamic string expansion, I find this really hard to break up in a good way without specific input.

[ssokolow]

Wow, now I seen everything. How does the optimizer know side effects of instantiated tools, what are the kinds of use cases?
I did just generate and run makefiles if I had multiple task, but given how most shell logic is dynamic string expansion, I find this really hard to break up in a good way without specific input.

Judging by a quick glance, it uses definition files like TypeScript uses to add type declarations to third-party Javascript.

[sdack]

I don't know if this is so useful ...

It probably won't be useful to many, because it will likely not be 100% compatible and will likely only serve itself - and crazy people who refuse to use anything but shell scripts to implement their software.

Most shell scripts, which require parallelisation already use xargs. Then there is GNU Make, which has been used for decades to implement parallelisation around shell commands, not to mention GNU Parallel itself, and distcc, which serve similar purposes. So it is not like one could not already have parallelisation.