Thread: xargs psql

Hello , it works for me.
 I remember some difficulties with quote escaping. That's while  I'm using $$ quoting for the sql aguments.

here is how ma commands look like:

psqlexec="psql -h$pghost -p$pgport -U$pguser -d${pgdb} -1 -P  format=u -tqX";

$psqlexec -c "SELECT relname FROM pg_class WHERE ..." \
| xargs -n 1 -P 8 -I{} bash -c "$psqlexec -c 'select * from foo(\$\${}\$\$)' > ouputdir/{}.out"

HTH,

Marc Mamin
________________________________________
Von: Shaozhong SHI <shishaozhong@gmail.com>
Gesendet: Donnerstag, 28. April 2022 13:32:42
An: pgsql-sql
Betreff: xargs psql

Running lots of postgres commands in parallel | Mark's blog
(markandruth.co.uk)<https://markandruth.co.uk/2016/05/26/running-lots-of-postgres-commands-in-parallel>

Has anyone made success with this?

How to put xargs command line correctly?

Regards,

David

> On Apr 28, 2022, at 6:10 AM, Marc Mamin <M.Mamin@intershop.de> wrote:
>
> Hello , it works for me.
> I remember some difficulties with quote escaping. That's while  I'm using $$ quoting for the sql aguments.
>
> here is how ma commands look like:
>
> psqlexec="psql -h$pghost -p$pgport -U$pguser -d${pgdb} -1 -P  format=u -tqX";
>
> $psqlexec -c "SELECT relname FROM pg_class WHERE ..." \
> | xargs -n 1 -P 8 -I{} bash -c "$psqlexec -c 'select * from foo(\$\${}\$\$)' > ouputdir/{}.out"
>
> HTH,
>
> Marc Mamin
> ________________________________________
> Von: Shaozhong SHI <shishaozhong@gmail.com>
> Gesendet: Donnerstag, 28. April 2022 13:32:42
> An: pgsql-sql
> Betreff: xargs psql
>
> Running lots of postgres commands in parallel | Mark's blog
(markandruth.co.uk)<https://markandruth.co.uk/2016/05/26/running-lots-of-postgres-commands-in-parallel>
>
> Has anyone made success with this?
>
> How to put xargs command line correctly?
>
> Regards,
>
> David
>
You might be better off with gnu parallel
>

> On Apr 28, 2022, at 7:05 AM, Shaozhong SHI <shishaozhong@gmail.com> wrote:
> 
> Some suggested using no_hup.   Would that work?
> 
> Regards,
> 
> David
No not like gnu parallel.