• Status New
  • Percent Complete
    0%
  • Task Type Improvement
  • Category tools → pkgutils
  • Assigned To
    crux
  • Operating System CRUX
  • Severity Low
  • Priority Very Low
  • Reported Version 3.3
  • Due in Version Undecided
  • Due Date Undecided
  • Votes
  • Private
Attached to Project: CRUX
Opened by fun - 24.02.2018
Last edited by pedja - 18.03.2019

FS#1597 - pkgmk: faster strip_files() function

I've attached a patch to run 'file' in parallel (using xargs -P$(nproc)).

The time spent changed from 30 seconds to .2 seconds on a 5500 files port (most of them 'data') with a faster drive. I didn't test more ports.

   0001-faster-strip_files-funct... (2.8 KiB)
fun commented on 24.03.2018 17:36

The last xargs should be run without -P$N, because the strip command (without -o) creates a temporary file with a "pseudo-random" name. These names can overlap when stripping multiple files from the same directory in parallel (e.g. mesa3d).

frinnst commented on 25.03.2018 01:10

testing now

fun commented on 21.04.2018 16:01

Fredrik, you really want to change the last patch line from "| xargs -r -L1 -P$N strip" to "| xargs -r -L1 strip".
https://crux.nu/gitweb/?p=tools/pkgutils.git;a=commitdiff;h=ece7f90bf8b1fb747e4607cdfb054ef5d22a13e5

Also, the previous commit https://crux.nu/gitweb/?p=tools/pkgutils.git;a=commitdiff;h=d51cdd1c8f24ef6f53cb87a0d06f4066cd91af8c removed 'bz2' from documentation (see  FS#1638 ).

Loading...

Available keyboard shortcuts

Tasklist

Task Details

Task Editing