-
Notifications
You must be signed in to change notification settings - Fork 0
/
NEWS
4681 lines (3012 loc) · 161 KB
/
NEWS
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
20210322
* Bug fixes and man page updates.
News about GNU Parallel:
* The very first version of Parallel dated 2002-01-06 was found in an
old backup:
#!/usr/bin/perl
$processes=shift;
chomp(@jobs=<>);
for (@jobs) {
$jobnr++;
push @makefile,
(".PHONY : job$jobnr\n",
"job$jobnr :\n",
"\t$_\n");
}
unshift @makefile, "all : ",(map { "job$_ " } 1 .. $jobnr),"\n";
open (MAKE, "| make -k -f - -j $processes") || die;
print MAKE @makefile;
close MAKE;
* Introduction to GNU Parallel
https://www.youtube.com/watch?v=Kj-6JkAqw-8
* Using GNU Parallel with GooseSLURM
https://readthedocs.org/projects/gooseslurm/downloads/pdf/latest/#chapter.7
* Why GNU-parallel?
https://github.com/lijingbu/omics/blob/main/why_gnu_parallel.md
20210222
* --filter only run jobs where the filter is true. The filter can
contain replacement strings and Perl code such as: '{1} < {2}+1'
* --template takes a text file as a template with replacement
strings. Then it replaces the replacement strings and saves it
under a new filename.
* --plus implements {0%} {0#} replacement string for zero padded slot
and sequence.
* Warn that you probably mean -d '\r\n' if the first 3 values end in
\r\n (DOS newline).
* {= perlexpression =} must return the same value, if run twice on the
same input.
* Man pages available as .rst-format.
* Bug fixes and man page updates.
News about GNU Parallel:
* A short tutorial on Gnu Parallel
https://www.polarmicrobes.org/a-short-tutorial-on-gnu-parallel/
* 5 reasons why I love coding on Linux
https://opensource.com/article/21/2/linux-programming
* Simple Tutorial to install & use GNU Parallel
https://medium.com/analytics-vidhya/simple-tutorial-to-install-use-gnu-parallel-79251120d618
* LiDO3 - first contact
https://www.lido.tu-dortmund.de/cms/de/LiDO3/LiDO3_first_contact_handout.pdf
* Rill Stage 2-1: Ways of command-line data analysis
https://blog.jastix.biz/post/rill-stage-2-1-cli-data-analysis/
* Introduction to GNU Parallel
https://blog.knoldus.com/introduction-to-gnu-parallel/
* GNU Parallel https://www.hahwul.com/cullinan/parallel/
20210122
* --memsuspend suspends jobs when there is little memory free. This
way you can run jobs in parallel that added up potentially will take
up more RAM than is available.
* $PARALLEL_ARGHOSTGROUPS and the replacement string {agrp} will give
the hostgroup given on the argument when using --hostgroup.
* Handy time functions for {= =}: yyyy_mm_dd_hh_mm_ss()
yyyy_mm_dd_hh_mm() yyyy_mm_dd() yyyymmddhhmmss() yyyymmddhhmm()
yyyymmdd() hash($str)
* Bug fixes and man page updates.
News about GNU Parallel:
* Software Engineering For Scientists
https://canvas.stanford.edu/courses/133091
* Optional Individual Submission 4 Job Handling - GNU Parallel
https://www.youtube.com/watch?v=-tX0bFAYAxM
* 关于gnu parallel：GnuParallel：在集群上并行化脚本，脚本将文件写入主
节点https://www.codenong.com/25172209/
* すぐ忘れてしまう、仕事で使う技
https://qiita.com/hana_shin/items/53c3c78525c9c758ae7c
20201222
* --pipe engine changed making --pipe alpha quality.
* --results -.json outputs results as JSON objects on stdout (standard
output).
* --delay 123auto will auto-adjust --delay. If jobs fail due to being
spawned too quickly, --delay will exponentially increase.
* --plus sets {hgrp} that gives the intersection of the hostgroups of
the job and the sshlogin that the job is run on.
* Bug fixes and man page updates.
News about GNU Parallel:
* Best practices for accelerating data migrations using AWS Snowball
Edge
https://aws.amazon.com/blogs/storage/best-practices-for-accelerating-data-migrations-using-aws-snowball-edge/
* Pass the Output of a Command as an Argument for Another
https://www.baeldung.com/linux/pass-cmd-output-as-an-argument
* Warwick RSE Drop-in - Workflow Management Part 2 - GNU Parallel
https://www.youtube.com/watch?v=t_v2Otgt87g
20201122
* Bug fixes and man page updates.
News about GNU Parallel:
* https://bash-prompt.net/guides/gnu-parallel-multi-server/
20201022
* --termseq now works for jobs running remotely.
* parsort: Performance optimized for 64-core machines.
* Bug fixes and man page updates.
News about GNU Parallel:
* Juan Sierra Pons has made a testimonial:
http://www.elsotanillo.net/wp-content/uploads/GnuParallel_JuanSierraPons.mp4
* 「翻译」在生物信息学中使用 GNU-Parallel
https://cloud.tencent.com/developer/article/1705499
20200922
* New CPU detection for GNU/Linux.
* Bug fixes and man page updates.
News about GNU Parallel:
* Aug 21, 2020 - More Unix tools
https://floki.blog/2020/08/more_unix_tools
20200822
New in this release:
* Max command line length is changed for MacOS - making this version
beta quality for MacOS.
* Bug fixes and man page updates.
20200722
New in this release:
* No new functionality
* Bug fixes and man page updates.
News about GNU Parallel:
* Tips for Running Jobs on your VM
https://support.ehelp.edu.au/support/solutions/articles/6000089713-tips-for-running-jobs-on-your-vm#parallel
* Introduction to GNU Parallel: Parallelizing Massive Individual Tasks
https://www.youtube.com/watch?v=QSFLTEyCKvo
* Slides for same
http://www.hpc.lsu.edu/training/weekly-materials/2020-Spring/GNUParallel_Spring_2020.pdf
* Linux-Fu: Parallel Universe
https://hackaday.com/2020/06/29/linux-fu-parallel-universe/
* Resumable batch jobs with gnu parallel https://igor.io/parallel/
* Introducing Parallel into Shell
https://www.petelawson.com/post/parallel-in-shell/
* AV1 encoding parallelization with GNU Parallel
https://www.reddit.com/r/AV1/comments/fjvqp9/av1_encoding_parallelization_with_gnu_parallel/
* Beschleunigte Befehlsbearbeitung mit GNU Parallel
https://www.linux-community.de/ausgaben/linuxuser/2013/06/beschleunigte-befehlsbearbeitung-mit-gnu-parallel/
20200622
New in this release:
* No new functionality
* Bug fixes and man page updates.
News about GNU Parallel:
* GNU Parallel is used at NERSC:
https://www.nersc.gov/assets/Uploads/08-Workflows-20200616.pdf
* Resumable batch jobs with GNU Parallel https://igor.io/parallel/
* Lab Meeting technical talk
https://www.slideshare.net/hoffmanlab/gnu-parallel-194030490
* Open Sky Software Website Credits
https://www.openskysoftware.com/site-credits.htm
* Speed up your Python Scripts using Ubuntu and GNU Parallel
https://ecce.esri.ca/wpecce/2019/12/24/speed-up-your-python-scripts-using-ubuntu-and-gnu-parallel/
* Indispensable command-line tools
https://negfeedback.blogspot.com/2020/05/indispensable-command-line-tools.html
* GNU Parallel for simulations
http://pdebuyl.be/blog/2020/gnu-parallel-for-simulations.html
* Introduction to GNU parallel
https://bioinformaticsworkbook.org/Appendix/GNUparallel/GNU_parallel_examples.html
20200522
New in this release:
* While running a job $PARALLEL_JOBSLOT is the jobslot of the job. It
is equal to {%} unless the job is being retried. See {%} for
details.
* While running a job $PARALLEL_SSHLOGIN is the sshlogin line with
number of cores removed. E.g. '4//usr/bin/specialssh user@host'
becomes: '/usr/bin/specialssh user@host'
* While running a job $PARALLEL_SSHHOST is the host part of an
sshlogin line. E.g. '4//usr/bin/specialssh user@host' becomes:
'host'
* --plus activates the replacement strings {slot} = $PARALLEL_JOBSLOT,
{sshlogin} = $PARALLEL_SSHLOGIN, {host} = $PARALLEL_SSHHOST
* Bug fixes and man page updates.
News about GNU Parallel:
* Portable Batch System (PBS) & GNU Parallel - Running a Program
Multiple Times in Parallel
https://www.youtube.com/watch?v=6ccbWu6Befo
* GNU Parallel przykład https://www.youtube.com/watch?v=gs_wG4Kt2G4
* Demo of LINUX APP - GNU PARALLEL - running multiple Gstreamer webcam
.sh scripts with only 1 command
https://www.youtube.com/watch?v=trQuA_wmWjg
20200422
This release celebrates GNU Parallel's 10 years as a GNU tool:
> commit ed2dfb1043768154d4e7678e01e10287155fa834
> Author: Ole Tange <[email protected]>
> Date: Thu Apr 22 01:23:00 2010 +0200
>
> Name change: Parallel is now GNU Parallel.
> Basic structure for sshlogin and sshloginfile.
New in this release:
* parsort makes GNU sort run faster for files with more than 1M lines.
* Bug fixes and man page updates.
News about GNU Parallel:
* Several clusters have updated their documentation of GNU Parallel:
https://www.grid5000.fr/w/GNU_Parallel
https://research-it.berkeley.edu/virtual-training-running-jobs-parallel-savio
http://www.hpc.lsu.edu/training/archive/tutorials.php
* add_pho uses GNU Parallel: https://github.com/SeedlingsBabylab/add_pho
* GNU parallel使用笔记https://zhuanlan.zhihu.com/p/37340011
* Virtual Workshop: Running Jobs in Parallel on Savio
https://ais.berkeley.edu/events/virtual-workshop-running-jobs-parallel-savio/2020-04-20
* Free Concurrency with GNU Parallel
https://phili.pe/posts/free-concurrency-with-gnu-parallel/
20200322
* Bug fixes and man page updates.
News about GNU Parallel:
* The GNU Parallel course in Copenhagen is cancelled
https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-med-ole-tange/
* The GNU Parallel course in Århus is cancelled
https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-og-parallelisering-i-unix-shellen/
* The 10 year anniversary may be cancelled, see
https://www.gnu.org/software/parallel/10-years-anniversary.html
* Running shell commands in parallel, via GNU Parallel
https://dev.to/saveriomiroddi/running-shell-commands-in-parallel-via-gnu-parallel-3a72
* Faster nmap scanning with the help of GNU parallel
https://badshah.io/experiment/faster-nmap-scanning-with-the-help-of-gnu-parallel/
20200222
* Bug fixes and man page updates.
20200122
* --blocktimeout dur - Time out for reading block when using
--pipe. If it takes longer than dur to read a full block, use the
partial block read so far.
* Bug fixes and man page updates.
News about GNU Parallel:
* GNU Parallel course in Copenhagen
https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-med-ole-tange/
* GNU Parallel course in Århus
https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-og-parallelisering-i-unix-shellen/
* GNU Parallel pour accélérer vos process sous Linux
https://www.yvonh.com/gnu-parallel-pour-accelerer-vos-process-sous-linux/
* How to copy a file to multiple directories in Linux
https://net2.com/how-to-copy-a-file-to-multiple-directories-in-linux/
* Running linux commands in parallel https://dev.to/voyeg3r/runing-linux-commands-in-parallel-4ff8
20191222
* GNU Parallel course in Copenhagen
https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-med-ole-tange/
* GNU Parallel course in Århus
https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-og-parallelisering-i-unix-shellen/
* GNU Parallel is used in
https://github.com/JeffersonLab/rfw_tsf_extractor
* Bug fixes and man page updates.
20191122
* GNU Parallel was presented at Driving IT. Slides:
cloud.prosa.dk/s/drivingit
* Restarting supervisord processes in parallel
https://blog.naderman.de/2019/11/14/restarting-supervisord-processes-in-parallel/
* Using GNU Parallel to Create Archives Faster
https://www.reddit.com/r/DataHoarder/comments/dsgmhc/parallel_archiving_techniques/
* Bug fixes and man page updates.
20191022
* --tee will use --output-error=warn-nopipe if supported by tee.
* GNU Parallel will be presented at Driving IT 2019:
https://ida.dk/arrangementer-og-kurser/konferencer/driving-it/tools
* UMN Duluth: Job parallelization with task arrays and GNU parallel
https://www.msi.umn.edu/tutorials/umn-duluth-job-parallelization-task-arrays-and-gnu-parallel
* Genome updater uses GNU Parallel
https://github.com/pirovc/genome_updater
* Using GNU-Parallel for bioinformatics
https://www.danielecook.com/using-gnu-parallel-for-bioinformatics/
* Speeding up PostgreSQL ETL pipeline with the help of GODS
https://cfengine.com/company/blog-detail/speeding-up-postgresql-etl-pipeline-with-the-help-of-gods/
* Runing linux commands in parallel
https://dev.to/voyeg3r/runing-linux-commands-in-parallel-4ff8
* Research Computing University of Colorado Boulder contains an intro
to GNU Parallel
https://readthedocs.org/projects/curc/downloads/pdf/latest/
* 如何使用Parallel在Shell中并行执行命令
https://www.myfreax.com/gnu-parallel/
* 如何测试 Amazon Elastic File System
https://aws.amazon.com/cn/blogs/china/how-to-test-drive-amazon-elastic-file-system/
* Bug fixes and man page updates.
20190922
* --nice is now inherited by the nice level that GNU Parallel is
started at. So 'nice -n10 parallel' will also cause remote jobs to
be run at nice level 10.
* --delay is now accurate to within 10 ms
* GNU Parallel will be presented at Driving IT 2019:
https://ida.dk/arrangementer-og-kurser/konferencer/driving-it/tools
* Greenland Ice Sheet solid ice discharge from 1986 through 2017
https://www.earth-syst-sci-data.net/11/769/2019/essd-11-769-2019.pdf
* App Center Cloud Build Machines > Installed Software > Utilities
https://docs.microsoft.com/en-us/appcenter/build/software
* Curryfinger - SNI & Host header spoofing utility
https://dualuse.io/blog/curryfinger/
* Hyak parallel-sql
https://wiki.cac.washington.edu/display/hyakusers/Hyak+parallel-sql
* A meditation on analysing data with Perl in parallel using GNU Parallel
https://www.reddit.com/r/perl/comments/cyo2qc/a_meditation_on_analysing_data_with_perl_in/
* Accélérer ses tâches avec GNU Parallel et les lots de tâches (UL)
https://www.eventbrite.ca/e/inscription-accelerer-ses-taches-avec-gnu-parallel-et-les-lots-de-taches-ul-71412840729
* RMACC Summit GNU Parallel
https://curc.readthedocs.io/en/latest/software/GNUParallel.html
* Introducing Parallel into Shell
https://petelawson.com/post/parallel-in-shell/
* Linux Productivity Tools
https://www.usenix.org/conference/lisa19/presentation/maheshwari
* Gnu/parallel + Nfs 实现共享文件网络的并发计算等操作
http://atomicer.cn/2018/01/18/gnu-parallel-nfs-%E5%AE%9E%E7%8E%B0%E5%85%B1%E4%BA%AB%E6%96%87%E4%BB%B6%E7%BD%91%E7%BB%9C%E7%9A%84%E5%B9%B6%E5%8F%91%E8%AE%A1%E7%AE%97%E7%AD%89%E6%93%8D%E4%BD%9C/#more
* Bug fixes and man page updates.
20190822
* GNU Parallel will be presented at Driving IT 2019:
https://ida.dk/arrangementer-og-kurser/konferencer/driving-it#beskrivelse
* Linux Productivity Tools
https://www.usenix.org/conference/lisa19/presentation/maheshwari
* Improve your reconnaissance performance by using GNU Parallel
https://mailchi.mp/3f46ceb46357/improve-your-reconnaissance-performance-by-using-gnu-parallel
* Paralel İşler / İşlemler / Programlar Bash’de Nasıl Çalıştırılır?
https://kaleinfo.com/2019/07/29/paralel-isler-islemler-programlar-bashde-nasil-calistirilir-2/
* Use POLYBAR to change WALLPAPER with GNU Parallel
https://www.youtube.com/watch?v=rjYg-b_eiRU
* Finding the Balance Between Speed & Accuracy During an Internet-wide
Port Scanning
https://captmeelo.com/pentest/2019/07/29/port-scanning.html
* GNU Parallel Ryugu released
https://linuxreviews.org/GNU_Parallel_Ryugu_released
* CO2017 - CW1 - Operating Systems & Networks - Shell scripting
http://www.7daixie.com/2019071646302396.html
* Bug fixes and man page updates.
20190722
* {= uq; =} causes the replacement string to be unquoted. Example:
parallel echo '{=uq;=}.jpg' ::: '*'
* --tagstring {=...=} is now evaluated for each line with --linebuffer.
* Use -J ./profile to read a profile in current dir.
* Speedup of startup by 40%: Find the parent shell differently on
GNU/Linux, cache information about the CPU and which setpgrp method
to use to make GNU Parallel start 40% faster.
* $PARALLEL_SSHLOGIN can be used in the command line.
* Occasionally sane: Simple usage of GNU parallel
https://vfoley.xyz/parallel/
* How to run multiple bash scripts in parallel
https://techieroop.com/how-to-run-multiple-bash-scripts-in-parallel/
* Announcing Oracle Solaris 11.4 SRU10
https://blogs.oracle.com/solaris/announcing-oracle-solaris-114-sru10
* Руководство по использованию GNU Parallel https://zalinux.ru/?p=2623
* Bug fixes and man page updates.
20190622
* --shard can now take a column name and optionally a perl
expression. Similar to --group-by and replacement strings.
* Using AWK and R to parse 25tb
https://livefreeordichotomize.com/2019/06/04/using_awk_and_r_to_parse_25tb/
* Parallel and Visual testing with Behat
http://parallelandvisualtestingwithbehat.blogspot.com/p/blog-page.html
* 维基百科，自由的百科全书https://zh.wikipedia.org/wiki/GNU_parallel
* Bug fixes and man page updates.
20190522
* --group-by groups lines depending on value of a column. The value
can be computed.
* How to compress (bzip / gzip) a very large text quickly?
https://medium.com/@gchandra/how-to-compress-bzip-gzip-a-very-large-text-quickly-27c11f4c6681
* Simple tutorial to install & use GNU Parallel
https://medium.com/@gchandra/simple-tutorial-to-install-use-gnu-parallel-79251120d618
* Introducing Parallel into Shell
https://petelawson.com/post/parallel-in-shell/
* Bug fixes and man page updates.
20190422
* Invitation to the 10 years anniversary next year.
* Bug fixes and man page updates.
20190322
* SIGTERM is changed to SIGHUP, so sending SIGHUP will make GNU
Parallel start no more jobs, but wait for running jobs to finish.
* SIGTERM SIGTERM is changed to SIGTERM, so sending SIGTERM will make
GNU Parallel kill all running jobs.
* GNU Parallel now includes a cheat sheet: parallel_cheat.pdf
* High Throughput Computing on RMACC Summit and Beyond
https://calendar.colorado.edu/event/high_throughput_computing_on_rmacc_summit_and_beyond#.XH2NBhB7mV4
* GNU Parallel Cheat Sheet by cpriest
https://www.cheatography.com/cpriest/cheat-sheets/gnu-parallel/
* Use Multiple CPU Cores(Parallelize) with Single Threaded Linux
Commands
http://xensoft.com/use-multiple-cpu-cores-parallelize-with-single-threaded-linux-commands/
* Bug fixes and man page updates.
20190222
* --shard makes it possible to send input to a the same jobslot based
on the value in one column of the input. It is similar to sharding
in databases.
* --shellquote --shellquote will shell quote the input twice.
* GNU Parallel is available in Termux
https://github.com/termux/termux-packages/tree/master/packages/parallel
* Linux, command line & MetaCentrum
https://trapa.cz/sites/default/files/linux_bash_metacentrum_course_4.pdf
* How to supercharge your bash workflows with GNU parallel
https://medium.freecodecamp.org/how-to-supercharge-your-bash-workflows-with-gnu-parallel-53aab0aea141
* GNU Parallel Spring 2017 https://www.youtube.com/watch?v=LHb29uW_KyI
* Parallelizing Freesurfer blog.cogneurostats.com/?p=148
* FreeSurfer #4: Running recon-all in Parallel https://www.youtube.com/watch?v=XHN2tm3tNaw
* FreeSurfer: recon-all https://www.neurotrivial.com/2019/01/24/freesurfer-recon-all/
* Come ridimensionare 10k foto con la riga di comando
https://pigrecoinfinito.wordpress.com/2018/12/22/come-ridimensionare-10k-foto-con-la-riga-di-comando/
* 并行处理 – Gnu Parallel：嵌套并行
https://codeday.me/bug/20190122/552902.html
* シェルスクリプトでコマンドを並列実行する方法
https://www.kwbtblog.com/entry/2019/01/12/020423
* Bug fixes and man page updates.
20190122
* 'env_parallel --end-session' makes it possible to nest 'env_parallel
--session'
* Using GNU Parallel in pentesting https://youtu.be/mZ0OUJmkIlA?t=873
* Supercomputer Workshop: Feb 1&7
http://www.ece.unm.edu/featured-students/supercomputer-workshop-feb-17.html
* Bug fixes and man page updates.
20181222
* Better /proc/cpuinfo parser.
* Simpler job scheduling flow.
* MPGI Workshop: Job Parallelization with Task Arrays and GNU Parallel
https://www.msi.umn.edu/tutorials/mpgi-workshop-module-4
* CONCOCT uses GNU Parallel
https://media.readthedocs.org/pdf/concoct/latest/concoct.pdf
* If you use SLURM read
https://wiki.hpc.uconn.edu/index.php/Advanced_SLURM
* すぐ忘れてしまう、仕事で使う技
https://qiita.com/hana_shin/items/53c3c78525c9c758ae7c
* Bug fixes and man page updates.
20181122
* Experimental simpler job flow control.
* 時間がかかるコマンドを GNU parallel で 並列実行する
https://qiita.com//grohiro/items/4db3fa951a4778c5c479
* Bug fixes and man page updates.
20181022
* env_parallel.fish: --session support (alpha quality)
* GNU Parallel was cited in: High-throughput sequencing of murine
immunoglobulin heavy chain repertoires using single side unique
molecular identifiers on an Ion Torrent PGM
https://doi.org/10.18632/oncotarget.25493
* GNU parallel in Japanese Wikipedia
https://ja.wikipedia.org/wiki/GNU_parallel
* Outils de paramétrisation des tâches: lots de tâches, GNU Parallel
https://www.eventbrite.ca/e/inscription-outils-de-parametrisation-des-taches-lots-de-taches-gnu-parallel-et-bqtools-midi-conference-de-50271076142
* Bug fixes and man page updates.
20180922
* Minix is supported again.
* Updated graph showing GNU Parallel's overhead per job for each
version. https://www.gnu.org/software/parallel/process-time-j2-1700MHz-3000-1000.pdf
* Intro to Computing at CARC includes introduction to GNU Parallel
http://carc.unm.edu/education--training/workshops-and-seminars.html
* Fast-GBS uses GNU Parallel https://bitbucket.org/jerlar73/fast-gbs/wiki/Home
* Belgium at 10 m resolution in July 2018 http://www.cesbio.ups-tlse.fr/multitemp/?p=14116
* Bug fixes and man page updates.
20180822
* parset sets exit code.
* How to install GNU Parallel
https://www.techrepublic.com/videos/how-to-install-gnu-parallel/
* Bug fixes and man page updates.
20180722
* The quoting engine has been changed. Instead of using \-quoting GNU
Parallel now uses '-quoting in bash/ash/dash/ksh. This should
improve compatibility with different locales. This is a big change
causing this release to be alpha quality.
* The CPU calculation has changed. By default GNU Parallel uses the
number of CPU threads as the number of CPUs. This can be changed to
the number of CPU cores or number of CPU sockets with
--use-cores-instead-of-threads or --use-sockets-instead-of-threads.
* The detected number of sockets, cores, and threads can be shown with
--number-of-sockets, --number-of-cores, and --number-of-threads.
* env_parallel now support mksh using env_parallel.mksh.
* GNU Parallel is distributed as part of Snippy
https://github.com/tseemann/snippy
* GNU Parallel: Ejecutar comandos simultáneamente en Linux
https://esgeeks.com/gnu-parallel-ejecutar-comandos-simultaneo-linux/
* Parallel download genomic data with GNU-Parallel
https://digibio.blogspot.com/search/label/GNU-Parallel
* Bug fixes and man page updates.
20180622
* Deal better with multibyte chars by forcing LC_ALL=C.
* GNU Parallel was introduced in Pincount Podcast:
https://pincountpodcast.com/episodes/29.html
* GNU Parallel was shown on Danish national news for 1.7 seconds: dr.dk
* How to run Linux commands simultaneously with GNU Parallel
https://www.techrepublic.com/article/how-to-run-commands-simultaneously-with-gnu-parallel/#ftag=RSS56d97e7
* Easy parallelization with GNU parallel
http://mpharrigan.com/2016/08/02/parallel.html
* GNU Parallel for mutlithreaded tasks
http://slhogle.github.io/2016/gnu-parallel/
* A GNU Parallel Clustering Demo
https://www.crowdsupply.com/ground-electronics/circumference/updates/a-gnu-parallel-clustering-demo
* 使用 GNU Parallel 提高 Linux 命令行执行效率
https://linux.cn/article-9718-1.html
* Ejecutando tareas desde consola simultáneamente con GNU Parallel
https://poesiabinaria.net/2018/06/ejecutando-tareas-desde-consola-simultaneamente-gnu-parallel/
* Cómo ejecutar varias tareas simultáneamente en el terminal con GNU
Parallel
https://www.ubuntizando.com/como-ejecutar-varias-tareas-simultaneamente-en-el-terminal-con-gnu-parallel/
* GNU Parallel 활용 가이드 http://genoglobe.kr/kribb/gnu_parallel
* Bug fixes and man page updates.
20180522
* --tty allows for more programs accessing /dev/tty in parallel. Some
programs require tty access without using it.
* env_parallel --session will record names in current environment in
$PARALLEL_IGNORED_NAMES and exit. It is only used with env_parallel,
and can work like --record-env but in a single session.
* 35 day course: Linux shell scripting and text processing for big
data https://comquest.in/training
* How To Use Your Entire CPU In Bash With Parallel
https://bash-prompt.net/guides/parallell-bash/
* An easy way to run parallel jobs on Stampede2
https://blog.uta.edu/xus/2017/09/29/an-easy-way-to-run-parallel-jobs-on-stampede2/
* Get more done at the Linux command line with GNU Parallel
https://opensource.com/article/18/5/gnu-parallel
* Save Time with Modern Search Techniques
https://www.sans.org/summit-archives/file/summit-archive-1524582079.pdf
* GNU Parallel: haz más cosas simultáneamente en el terminal
https://blog.desdelinux.net/gnu-parallel-haz-mas-cosas-simultaneamente-en-el-terminal/
* 「今日から使い切る」ための GNU Parallelによる並列処理入門
https://www.slideshare.net/koji_matsuda/gnu-parallel
* Bug fixes and man page updates.
20180422
* --csv makes GNU Parallel parse the input sources as CSV. When used
with --pipe it only passes full CSV-records.
* Time in --bar is printed as 1d02h03m04s.
* Optimization of --tee: It spawns a process less per value.
* The GNU Parallel 2018 book is now available:
http://www.lulu.com/shop/ole-tange/gnu-parallel-2018/paperback/product-23558902.html
* Modern pentest tricks for faster, wider, greater engagement (15)
https://conference.hitb.org/hitbsecconf2018ams/materials/D1%20COMMSEC%20-%20Thomas%20Debize%20-%20Modern%20Pentest%20Tricks%20for%20Faster,%20Wider,%20Greater%20Engagements.pdf
* Running many serial jobs efficiently
https://userinfo.surfsara.nl/documentation/running-many-serial-jobs-efficiently
* GNU Parallel: как сохранить результаты нескольких команд для
переменной? http://fliplinux.com/gnu-parallel-6.html
* Running Multiple Commands in Parallel on a GNU Linux
https://www.youtube.com/watch?v=sHpTywpb4_4
* Klaatu covers the documentation of GNU parallel in episode 12x15
http://gnuworldorder.info/
* Bug fixes and man page updates.
20180322
* niceload -p can now take multiple pids separated by comma
* --timeout gives a warning when killing processes
* --embed now uses the same code for all supported shells
* --delay can now take arguments like 1h12m07s
* Parallel. Straight from your command line
https://medium.com/@alonisser/parallel-straight-from-your-command-line-feb6db8b6cee
* GNU Parallel was used in POAP-Parallelized Open Babel & Autodock
suite Pipeline https://github.com/inpacdb/POAP
* Pi Cluster Parallel Script First Fire
https://chiefio.wordpress.com/2018/02/23/pi-cluster-parallel-script-first-fire/
* How to Restore MySQL Logical Backup at Maximum Speed
https://www.percona.com/blog/2018/02/22/restore-mysql-logical-backup-maximum-speed/
* Bug fixes and man page updates.
20180222
* --embed makes it possible to embed GNU parallel in a shell
script. This is useful if you need to distribute your script to
someone who does not want to install GNU parallel.
* Parallelize Your Large Batches of Small Jobs
https://amito.me/2018/02/Parallelize-Your-Large-Batches-of-Small-Jobs/
* Klaatu expounds upon xargs and talks GNU parallel in episode 12x6
http://gnuworldorder.info/
* How to use parallel to speed up your work
https://mike42.me/blog/how-to-use-parallel-to-speed-up-your-work
* Transient compute clustering with GNU Parallel and sshfs
https://dennismungai.wordpress.com/2018/02/06/transient-compute-clustering-with-gnu-parallel-and-sshfs/
* Useful Examples of ffmpeg and GNU parallel on the command-line
https://dennismungai.wordpress.com/2018/02/06/useful-examples-of-ffmpeg-and-gnu-parallel-on-the-command-line/
* Data Science at the Command Line (Chapter 8.3)
https://www.datascienceatthecommandline.com/
* Bug fixes and man page updates.
20180122
* bash / 병렬 https://code.i-harness.com/ko/docs/bash/2a1a
* 15分钟神器gnu parallel 入门观止
http://www.ezilin.com/2018/01/15gnu-parallel.html
* How To Run Multiple Commands In Parallel on Linux
https://www.slashroot.in/how-run-multiple-commands-parallel-linux
* Bug fixes and man page updates.
20171222
* env_parset for ash, dash, ksh, sh, zsh
* Automatically create hostgroups if argument ends in @sshlogin
* Tips for running jobs on your VM
https://support.ehelp.edu.au/support/solutions/articles/6000089713-tips-for-running-jobs-on-your-vm#parallel
* Node-local scheduling
https://mogonwiki.zdv.uni-mainz.de/dokuwiki/node_local_scheduling
* GNU Parallel https://docs.computecanada.ca/wiki/GNU_Parallel
* GNU Parallel のエラー処理 https://qiita.com/inouet/items/bfc208668c86caf8ff74
* Using GNU Parallel
https://wiki.ncsa.illinois.edu/display/ROGER/Using+GNU+Parallel
* Bug fixes and man page updates.
20171122
* Using GNU Parallel to speed up Google Cloud Infrastructure
management
https://medium.com/@pczarkowski/using-gnu-parallel-to-speed-up-google-cloud-infrastructure-management-53e5c555ec05
* What is gnu parallel
http://wiki.chpc.ac.za/howto:bioinformatics:gnu-parallel
* Parallel, Scripts, Clusters, & Easy Use
https://chiefio.wordpress.com/2017/11/10/parallel-scripts-clusters-easy-use/
* Bug fixes and man page updates.
20171022
* Initial support for XDG Base Directory $XDG_* environment variables.
* Validating half a million TIFF files. Part
Two
https://www.dpoc.ac.uk/2017/08/17/validating-half-a-million-tiff-files-part-two/
* Turing data science class: Cluster computing
https://www.turing.ac.uk/events/masterclass-cluster-computing/
* Butlin:Unix for Bioinformatics - advanced tutorial
https://openwetware.org/wiki/Butlin:Unix_for_Bioinformatics_-_advanced_tutorial
* พยายามใช้ CPU ให้ครบทุก CORE
https://veer66.wordpress.com/2017/09/02/use-multi-core/
* Examples on using GNU Parallel
https://gist.github.com/drmalex07/de8ff1379a560f6d84a0d863e60ae378
* Bug fixes and man page updates.
20170922
* Use '--limit myprog' to make a dynamic job limit. Just return 0 to
spawn another job, 1 to not spawn another job, and 2 to kill the
youngest job.
* PARALLEL_RSYNC_OPTS and --rsync-opts sets the options for rsync
(Default: -rlDzR).
* Download all of humble bundle books in parallel
https://til.hashrocket.com/posts/ggt1jaes4y-download-all-of-humble-bundle-books-in-parallel
* Bug fixes and man page updates.