☰

两个文件的并集并且在新文件中是唯一的

tag-icon • tag-icon shell awk
两个文件的并集并且在新文件中是唯一的

我有两个文件，其中有一些相似的第一列、第二列和第三列，变化很小，其他列很少，如下所示。

文件1：

AT1  AT22  24  1 ATAGATA ATTATAT
AT2  AT24  22  0 ATAGATA ATTATAT
AT3  AT23  263 3 ATAGATA ATTATAT
AT4  AT28  252 6 ATAGATA ATTATAT

同样在文件2中：

AT1  AT22  22  1 ATAGATA ATTATAT
AT3  AT23  265  1 ATAGATA ATTATAT
AT4  AT28  253  1 ATAGATA ATTATAT

输出应该是这些文件的并集和唯一，第三列的+或-2放宽，如果前三列与这些条件匹配，则必须从两个文件中添加第四列，其他文件应照常打印就好像

AT1  AT22  24  2 ATAGATA ATTATAT
AT2  AT24  22  0 ATAGATA ATTATAT
AT3  AT23  263 4 ATAGATA ATTATAT
AT4  AT28  252 7 ATAGATA ATTATAT

答案1

awk '
    NR==FNR {
        a[$1,$2] = $3
        val[$1,$2] = $4
        next
    } 
    ($1,$2) in a {
        for (n=$3-2; n<=$3+2; n++)
            if (a[$1,$2] == n) {
                $4+=val[$1,$2]
                break
            }
    } 
    {print}
' file2 file1

AT1 AT22 24 2 ATAGATA ATTATAT
AT2  AT24  22  0 ATAGATA ATTATAT
AT3 AT23 263 4 ATAGATA ATTATAT
AT4 AT28 252 7 ATAGATA ATTATAT

答案2

这应该满足您的要求（就我的测试用例而言）

#!/bin/bash

# Concatenating the 2 files and sorting entries

SRC=`cat file1 file2 | sort `
FLAG="OFF"
i=1

while read a b c d e

do
 # Need an initial array to start comparing
 if [ "$i" -eq "1"  ];then
  init_vals=( "$a" "$b" "$c" "$d" "$e" )
  FLAG="ON"
 else
  # Start comparing
  vals=( "$a" "$b" "$c" "$d" "$e" )
  if [[ ${vals[0]} ==  "${init_vals[0]}" && ${vals[1]} == "${init_vals[1]}" ]]
   then
    # First and second column are identical, checking in delta on third meet the requirements
    delta=`expr ${vals[2]} - ${init_vals[2]}`
    if [ "$delta" -ge "-2" -a "$delta" -le "2" ]
    then
      # It does, adding values on column 4 and keeping other columns
      sum_col4=`expr ${vals[3]} + ${init_vals[3]}`
      vals=( "${init_vals[0]}" "${init_vals[1]}" "${init_vals[2]}" "$sum_col4" "${init_vals[4]}" )
      #This is a tracker, we don't print result until conditions are not met
      FLAG="ON"
    else
      #Delta on column 3 is not met
      FLAG="OFF"
    fi
  else
    #Column 1 and 2 are different
    FLAG="OFF"
  fi
#    echo "$FLAG"

   if [[ $FLAG != "ON" ]];then
     echo ${init_vals[@]}
     FLAG="ON"
   fi
   init_vals=( "${vals[@]}" )

 fi
 (( i++ ))
done <<< "$SRC"
#Printing last lastline
echo ${init_vals[@]}

相关内容