☰

处理大量 tar.gz 档案的 bash 工作流程

tag-icon • tag-icon bash tar
处理大量 tar.gz 档案的 bash 工作流程

我正在使用由 4 个子目录组成的目录

ls -t
pnmrnp40_to_69  pnmrnp9028_to_9100  pnmrnp00_to_39  pnmrnp70_to_9028

每个 prmnp* 子目录里面都有许多属于 *.tar.gz 档案或 *.md5sub 的文件（我不知道它是什么，所以应该将其删除）。

charlie@Precision-7920-Tower:~/Documents/script/mega_data/pnmrnp/pnmrnp40_to_69$ ls -t
ligands57_dir_results.tar.gz.md5sum  ligands40_dir_results.tar.gz.md5sum
ligands57_dir_results.tar.gz         ligands69_dir_results.tar.gz
ligands69_dir_results.tar.gz.md5sum  ligands68_dir_results.tar.gz
ligands68_dir_results.tar.gz.md5sum  ligands67_dir_results.tar.gz
ligands67_dir_results.tar.gz.md5sum  ligands66_dir_results.tar.gz
ligands66_dir_results.tar.gz.md5sum  ligands65_dir_results.tar.gz

我需要一个简单的 bash 工作流，它将移动到每个子目录

  1. 删除所有 *.md5sub
  2. 将所有 *.tar.gz 解压到同一个子文件夹（保留原始档案的名称）。

这是我在 Bash 中的工作流程：

#!/bin/bash
# assuming that the script is in the folder contained all subdirectories
dir="$PWD"

# loop each subdirectory
for subdir in ${dir}
cd ${subdir}
# unzip each archive to the same place
for tar in *.tar.gz; do
tar xzvf $tar
done
# return to initial dir
cd ..
done

有没有什么可能使这个脚本更高效，以便它可以适应大量的档案？

答案1

find(1)：

...
       -execdir command ;

       -execdir command {} +
              Like -exec, but the specified command is run from the
              subdirectory containing the matched file, which is not normally
              the directory in which you started find.  As with -exec, the {}
              should be quoted if find is being invoked from a shell.  This a
              much more secure method for invoking commands, as it avoids race
              conditions during resolution of the paths to the matched files.
              As with the -exec action, the `+' form of -execdir will build a
              command line to process more than one matched file, but any
              given invocation of command will only list files that exist in
              the same subdirectory.  If you use this option, you must ensure
              that your $PATH environment variable does not reference `.';
              otherwise, an attacker can run any commands they like by leaving
              an appropriately-named file in a directory in which you will run
              -execdir.  The same applies to having entries in $PATH which are
              empty or which are not absolute directory names.  If any
              invocation with the `+' form returns a non-zero value as exit
              status, then find returns a non-zero exit status.  If find
              encounters an error, this can sometimes cause an immediate exit,
              so some pending commands may not be run at all.  The result of
              the action depends on whether the + or the ; variant is being
              used; -execdir command {} + always returns true, while
              -execdir command {} ; returns true only if command returns 0.
...

find -type f -name '*.tar.gz' -execdir tar xvf {} \;

相关内容