list the difference and overlap between two plain data set

Question

Possible Duplicate:
Linux tools to treat files as sets and perform set operations on them

I have two data sets, A and B. The format for each data set is one number per line. For instance,

Some of the data in A are not included in data set B. How to list all of these data in A, and how to list all of those data shared by A and B. How can I do that using Linux/UNIX commands?

Possible duplicate: "Linux tools to treat files as sets and perform set operations on them" — sr_, Jan 11 '12 at 16:23

score 16 · Accepted Answer · answered Jan 11 '12 at 16:49

16

Use the comm command.

If you lists are in files listA and listB:

comm listA listB

By default, comm will return 3 columns. Items only in listA, items only in listB, and items common to both lists.

You can suppress individual columns, with a -1, -2, or -3 arg.

answered Jan 11 '12 at 16:49

Tim Kennedy

19,697

8

The answer assumes listA and listB are already sorted. A more general solution: comm <(sort listA) <(sort listB) – HongboZhu Sep 19 '14 at 07:33
Very simple solution. Is the comm command deployed in all linux distro? – рüффп Jul 06 '15 at 08:07

score 1 · Answer 2 · answered Jan 11 '12 at 17:29

1

This will give you the unique items that exist in A but not in B:

cat A|perl -ne '$z=$_;chomp($z);$y=`grep $z B`;if ($y== "") {print "\n$z";}'|sort -u

This will give you the list of common items in both A and B:

cat A |xargs -i grep {} B|sort -u

answered Jan 11 '12 at 17:29

neuron34

1,276

list the difference and overlap between two plain data set

2 Answers2