复制大文件失败

复制大文件失败

我一直在超级计算机上运行模拟,经常以 h5 格式写入大型输出文件(约 750MB)。为了将模拟后的数据备份到本地计算机,我使用了rsync命令。

一开始,命令解析文件列表并启动复制过程。在此过程中,大文件(h5 格式)不知为何消失了(我猜它们是在超级计算机本身中删除的)。复制日志如下;

sathish@HP-EliteBook:~/Documents/Research/journal/results/oblate2.5$ rsync -av --exclude '*.xdr' [email protected]:/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang* .
receiving incremental file list
Re0.1ang0/
Re0.1ang0/angle.sh
Re0.1ang0/chk_uid-info
Re0.1ang0/init.cfg
Re0.1ang0/input-default
Re0.1ang0/input-default.md
Re0.1ang0/myjob.cmd
Re0.1ang0/slurm-2430487.out
Re0.1ang0/Production/
Re0.1ang0/Production/init.cfg
Re0.1ang0/Production/input-default
Re0.1ang0/Production/input-default.md
Re0.1ang0/Production/md-cfg-desc_out_t00000000-0882612060.txt
Re0.1ang0/Production/md-cfg_out_p********-0882612060.asc
Re0.1ang0/Production/md-summary_out_t00030000-0882612060.txt
Re0.1ang0/Production/od_out_t00030000-0882612060.h5
Re0.1ang0/Production/velx_out_t00030000-0882612060.h5
Re0.1ang0/Production/vely_out_t00030000-0882612060.h5
WARNING: Re0.1ang0/Production/vely_out_t00030000-0882612060.h5 failed verification -- update discarded (will try again).
rsync: read errors mapping "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang0/Production/vely_out_t00030000-0882612060.h5": Stale file handle (116)
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang0/Production/velz_out_t00030000-0882612060.h5"
Re0.1ang10/
Re0.1ang10/angle.sh
Re0.1ang10/chk_uid-info
Re0.1ang10/init.cfg
Re0.1ang10/input-default
Re0.1ang10/input-default.md
Re0.1ang10/myjob.cmd
Re0.1ang10/slurm-2430488.out
Re0.1ang10/Production/
Re0.1ang10/Production/init.cfg
Re0.1ang10/Production/input-default
Re0.1ang10/Production/input-default.md
Re0.1ang10/Production/md-cfg-desc_out_t00000000-0882624620.txt
Re0.1ang10/Production/md-cfg_out_p00000000-0882624620.asc
Re0.1ang10/Production/md-summary_out_t00030000-0882624620.txt
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang10/Production/od_out_t00030000-0882624620.h5"
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang10/Production/velx_out_t00030000-0882624620.h5"
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang10/Production/vely_out_t00030000-0882624620.h5"
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang10/Production/velz_out_t00030000-0882624620.h5"
Re0.1ang30/
Re0.1ang30/angle.sh
Re0.1ang30/chk_uid-info
Re0.1ang30/init.cfg
Re0.1ang30/input-default
Re0.1ang30/input-default.md
Re0.1ang30/myjob.cmd
Re0.1ang30/slurm-2430489.out
Re0.1ang30/Production/
Re0.1ang30/Production/init.cfg
Re0.1ang30/Production/input-default
Re0.1ang30/Production/input-default.md
Re0.1ang30/Production/md-cfg-desc_out_t00000000-0882622039.txt
Re0.1ang30/Production/md-cfg_out_p********-0882622039.asc
Re0.1ang30/Production/md-summary_out_t00030000-0882622039.txt
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang30/Production/od_out_t00030000-0882622039.h5"
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang30/Production/velx_out_t00030000-0882622039.h5"
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang30/Production/vely_out_t00030000-0882622039.h5"
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang30/Production/velz_out_t00030000-0882622039.h5"
Re0.1ang45/
Re0.1ang45/angle.sh
Re0.1ang45/chk_uid-info
Re0.1ang45/init.cfg
Re0.1ang45/input-default
Re0.1ang45/input-default.md
Re0.1ang45/myjob.cmd
Re0.1ang45/slurm-2430490.out
Re0.1ang45/Production/
Re0.1ang45/Production/init.cfg
Re0.1ang45/Production/input-default
Re0.1ang45/Production/input-default.md
Re0.1ang45/Production/md-cfg-desc_out_t00000000-0882629804.txt
Re0.1ang45/Production/md-cfg_out_p00000000-0882629804.asc
Re0.1ang45/Production/md-summary_out_t00030000-0882629804.txt
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang45/Production/od_out_t00030000-0882629804.h5"
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang45/Production/velx_out_t00030000-0882629804.h5"
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang45/Production/vely_out_t00030000-0882629804.h5"
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang45/Production/velz_out_t00030000-0882629804.h5"
Re0.1ang60/
Re0.1ang60/angle.sh
Re0.1ang60/chk_uid-info
Re0.1ang60/init.cfg
Re0.1ang60/input-default
Re0.1ang60/input-default.md
Re0.1ang60/myjob.cmd
Re0.1ang60/slurm-2430491.out
Re0.1ang60/Production/
Re0.1ang60/Production/init.cfg
Re0.1ang60/Production/input-default
Re0.1ang60/Production/input-default.md
Re0.1ang60/Production/md-cfg-desc_out_t00000000-0882627357.txt
Re0.1ang60/Production/md-cfg_out_p********-0882627357.asc
Re0.1ang60/Production/md-summary_out_t00030000-0882627357.txt
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang60/Production/od_out_t00030000-0882627357.h5"
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang60/Production/velx_out_t00030000-0882627357.h5"
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang60/Production/vely_out_t00030000-0882627357.h5"
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang60/Production/velz_out_t00030000-0882627357.h5"
Re0.1ang80/
Re0.1ang80/angle.sh
Re0.1ang80/chk_uid-info
Re0.1ang80/init.cfg
Re0.1ang80/input-default
Re0.1ang80/input-default.md
Re0.1ang80/myjob.cmd
Re0.1ang80/slurm-2430492.out
Re0.1ang80/Production/
Re0.1ang80/Production/md-cfg-desc_out_t00000000-0882622795.txt
Re0.1ang80/Production/md-cfg_out_p00000000-0882622795.asc
Re0.1ang90/
Re0.1ang90/angle.sh
Re0.1ang90/chk_uid-info
Re0.1ang90/init.cfg
Re0.1ang90/input-default
Re0.1ang90/input-default.md
Re0.1ang90/myjob.cmd
Re0.1ang90/slurm-2430493.out
Re0.1ang90/Production/
Re0.1ang90/Production/init.cfg
Re0.1ang90/Production/input-default
Re0.1ang90/Production/input-default.md
Re0.1ang90/Production/md-cfg-desc_out_t00000000-0882623909.txt
Re0.1ang90/Production/md-cfg_out_p********-0882623909.asc
Re0.1ang90/Production/md-summary_out_t00030000-0882623909.txt
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang90/Production/od_out_t00030000-0882623909.h5"
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang90/Production/velx_out_t00030000-0882623909.h5"
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang90/Production/vely_out_t00030000-0882623909.h5"
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang90/Production/velz_out_t00030000-0882623909.h5"
file has vanished: "/home/ncteh317/Desktop/lb3d/drag_test/test/bouzidi/Oblate_2.5/Re0.1ang0/Production/vely_out_t00030000-0882612060.h5"

基本上,带有 的行file has vanished:是我想要备份的大文件。我猜它们是在命令开头编入索引的rsync。但在复制过程中,文件不知何故被删除了。我在论坛中搜索了类似的主题。但是,提到的问题是文件在复制过程中被删除。

我尝试使用基于 GUI 的文件传输软件进行相同的复制过程FileZilla,经过新的模拟后,问题仍然存在 - 大文件在超级计算机本身的复制过程中消失。

就我的情况而言,模拟已完成,复制过程中没有对文件进行任何操作/修改。既然如此,有人能解释一下到底出了什么问题吗?

相关内容