In Gentoo there is the file /var/lib/portage/world that contains packages that I explicitly installed. By explicit I mean, packages that I choose, not including anything installed by default, or pulled in by the dependencies.
Is there a similar file or a command to find that information in Ubuntu?
aptitude search '~i !~M' -F '%p' --disable-columns | sort -u > currentlyinstalled.txt
wget -qO - http://mirror.pnl.gov/releases/precise/ubuntu-12.04.3-desktop-amd64.manifest \
| cut -f1 | sort -u > defaultinstalled.txt
comm -23 currentlyinstalled.txt defaultinstalled.txt
One way to think about this problem is to break this into three parts:
The following command seems to work on my system:
$ aptitude search '~i !~M' -F '%p' --disable-columns | sort -u > currentlyinstalled.txt
Similar approaches can be found in the links that Gilles posted as a comment to the question. Some sources claim that this will only work if you used aptitude to install the packages; however, I almost never use aptitude to install packages and found that this still worked. The --disable-columns prevents aptitude from padding lines of package names with blanks that would hinder the comparison below. The | sort -u sorts the file and removes duplicates. This makes the final step much easier.
Note: This section starts out with a 'wrong path' that I think is illustrative. The second piece of code is the one that works.
This is a bit trickier. I initially thought that a good approximation would be all of the packages that are dependencies of the meta-packages ubuntu-minimal, ubuntu-standard, ubuntu-desktop, and the various linux kernel related packages. A few results on google searches seemed to use this approach. To get a list of these dependencies, I first tried the following (which didn't work):
$ apt-cache depends ubuntu-desktop ubuntu-minimal ubuntu-standard linux-* | awk '/Depends:/ {print $2}' | sort -u
This seems to leave out some packages that I know had to come by default. I still believe that this method should work if one constructs the right list of metapackages.
However, it seems that Ubuntu mirrors contain a "manifest" file that contains all of the packages in the default install. The manifest for Ubuntu 12.04.3 is here:
http://mirror.pnl.gov/releases/precise/ubuntu-12.04.3-desktop-amd64.manifest
If you search through this page (or the page of a mirror closer to you):
http://mirror.pnl.gov/releases/precise/
You should be able to find the ".manifest" file that corresponds to the version and architecture you are using. To extract just the package names I did this:
wget -qO - http://mirror.pnl.gov/releases/precise/ubuntu-12.04.3-desktop-amd64.manifest | cut -f1 | sort -u > defaultinstalled.txt
The list was likely already sorted and unique, but I wanted to be sure it was properly sorted to make the next step easier. I then put the output in defaultinstalled.txt.
This is the easiest part since most Unix-like systems have many tools to do this. The comm tool is one of many ways to do this:
comm -23 currentlyinstalled.txt defaultinstalled.txt
This should print the list of lines that are unique to the first file. Thus, it should print a list of installed packages not in the default install.
You can use either of these two one-liners. Both yield the exact same output on my machine and are more precise than all solutions proposed up until now (July 2014) in this question. They are a combination of the two answers (1) and (2). Note that I originally posted this answer here.
Using apt-mark:
comm -23 <(apt-mark showmanual | sort -u) <(gzip -dc /var/log/installer/initial-status.gz | sed -n 's/^Package: //p' | sort -u)
Using aptitude:
comm -23 <(aptitude search '~i !~M' -F '%p' | sed "s/ *$//" | sort -u) <(gzip -dc /var/log/installer/initial-status.gz | sed -n 's/^Package: //p' | sort -u)
Very few packages still fall through the cracks, although I suspect these are actually installed by the user, either right after the installation through the language localization setup or e.g. through the Totem codec installer. Also, the linux-header versions also seem to accumulate, even though I've only installed the non version-specific metapackage. Examples:
libreoffice-help-en-gb
openoffice.org-hyphenation
gstreamer0.10-fluendo-mp3
linux-headers-3.13.0-29
How does it work
sed strips out remaining whitespace at the end of the line.Other possibilities don't work as well:
ubuntu-14.04-desktop-amd64.manifest file (here for Ubuntu 14.04) instead of /var/log/installer/initial-status.gz. More packages are shown as manually installed even though they are not.apt-mark showauto instead of /var/log/installer/initial-status.gz. apt-mark for example doesn't include the xserver-xorg package, while the other file does.Both list more packages than the above solution.
mindeps.py minimum dependencies vertex solver script. I was able to slim down a set of 1118 packages down to 589 through relying on the package dependencies to pull in the rest.
– TrinitronX
Jul 21 '20 at 06:11
According to man apt-mark:
apt-mark showauto
apt-mark showmanual
showmanual is showing things like xserver-xorg-video-vesa, which I swear I didn't install manually.
– phunehehe
Sep 22 '12 at 03:18
Here's some sample output of cat /var/log/apt/history.log:
Start-Date: 2011-01-22 00:43:38
Commandline: apt-get --target-release experimental install libdbus-1-dev
Upgrade: libdbus-1-3:i386 (1.4.0-1, 1.4.1-1), libdbus-1-dev:i386 (1.4.0-1, 1.4.1-1)
End-Date: 2011-01-22 00:43:48
Start-Date: 2011-01-23 01:16:13
Commandline: apt-get --auto-remove purge webcheck
Purge: python-utidylib:i386 (0.2-6), python-beautifulsoup:i386 (3.1.0.1-2), libtidy-0.99-0:i386 (20091223cvs-1), webcheck:i386 (1.10.3)
End-Date: 2011-01-23 01:16:31
As for your question, filter the stuff with grep (cat /var/log/apt/history.log | grep Commandline).
Note that these files are rotated, so check for others so you don't miss anything:
$ ls /var/log/apt/history.log*
-rw-r--r-- 1 root root 69120 2011-01-23 18:58 /var/log/apt/history.log
-rw-r--r-- 1 root root 19594 2011-01-01 02:48 /var/log/apt/history.log.1.gz
NOTE:
Commandline, so the grep trick won't work with them.
aptitude and other package managers. If your logs have rotated away, well then you are out of luck.
– Steven D
Jan 23 '11 at 22:27
I came across this beautiful oneliner while I was searching for this query
The one liner is
comm -13 \
<(gzip -dc /var/log/installer/initial-status.gz | sed -n 's/^Package: //p' | sort) \
<(comm -23 \
<(dpkg-query -W -f='${Package}\n' | sed 1d | sort) \
<(apt-mark showauto | sort) \
)`
This oneliner filters packages installed by system using logs from /var/log/installer/initial-status.gz
I will post the link to the original thread when I found it, as this oneliner is not mine and and I can't seem to remember where I saw it.
You would want to have a look at this article.
At the end of the article, there is a python script that should do what you want.
It was written for (k)ubuntu. but should work for Ubuntu aswell.
This is an addition to Steven D's answer.
The following line truncates package names at 32 characters:
aptitude search '~i !~M' | cut -d" " -f4 | sort -u > currentlyinstalled.txt
This seems to work:
aptitude search '~i !~M' -F "%p" | sort -u > currentlyinstalled.txt
see this answer
Check out /var/log/apt/term.log
You may also look at the file /var/lib/apt/extended_states.
cat /var/lib/apt/extended_states | grep -B2 'Auto-Installed: 0'
This is useful if you want to know what was installed on an old partition.
Big thanks and congratulations to those who came up with that gem of a script !!!
I wanted to add my 2¢ and I tacked the installation date I deduce from $info.
I did not master the details why $info files are updated or not and when, but it works in practice.
My script lists the latest updates of non dependency packages added after installation.
Giving it a periodic check, I was seeing what I would have manually logged without a single miss.
That is, batches of packets installed for the same reason. Unfortunately, updates break that order.
After a system upgrade, I had a list of my added packages that the upgrade did not update followed by those that it did.
Neat! Enjoy.
info='/var/lib/dpkg/info/'
comm -13 > /tmp/packages \
<(gzip -dc /var/log/installer/initial-status.gz | sed -n 's/^Package: //p' | sort) \
<(comm -23 \
<(dpkg-query -W -f='${Package}\n' | sed 1d | sort) \
<(apt-mark showauto | sort) \
)
while read n; do
echo $(ls -ltr --time-style=long-iso $info$n.* $info$n:i386.* $info$n:amd64.* 2>/dev/null \
| tail -n 1 | perl -pe 's/.*([0-9]{4}?-.*:[0-9]{2}?).*/\1/') $n
done < /tmp/packages | sort
aptitude search '~i!~M' -F %pdoesn't? – ephemient Oct 30 '10 at 04:57| sed "s/ *$//"to the pipeline. – Emil Styrke May 23 '14 at 17:38http://releases.ubuntu.com/releases/trusty/ubuntu-14.04-desktop-amd64.manifestand the additional| sed "s/ *$//"but still no dice. – jmiserez Jul 06 '14 at 14:14sedand the correct manifest file for my system. – jmiserez Jul 08 '14 at 13:06Some sources claim that this will only work if you used aptitude to install the packages; however, I almost never use aptitude to install packages and found that this still worked.that's because that hasn't been true for several years now. It used to be the case that aptitude and apt-get used different databases to record which packages were installed automatically but this has not been the case for a number of stable Debian versions ie many years. Old advice tends to stick around after it's no longer true. – trr Oct 22 '14 at 08:36apt-mark showmanual | sort -u, as shown in other answers. Simpler, and does not rely onaptitudewhich is not installed by default. – skagedal May 03 '15 at 06:44wget -qO - https://releases.ubuntu.com/$(grep -oP 'VERSION_CODENAME=\K.+' /etc/os-release)/ubuntu-$(grep -oP 'VERSION= "\K[0-9\.]+' /etc/os-release)-desktop-amd64.manifest | cut -f1 | cut -d: -f1 | sort -u > defaultinstalled.txt(replace theamd64as needed). – Tyn Apr 08 '20 at 07:17VERSION=needs to be removed).Otherwise, convenient one-liner:
– Tyn Apr 08 '20 at 07:28comm -23 <(apt-mark showmanual | sort -u) <(curl -s -- https://releases.ubuntu.com/$(grep -oP 'VERSION_CODENAME=\K.+'/etc/os-release)/ubuntu-$(grep -oP 'VERSION="\K[0-9\.]+' /etc/os-release)-desktop-amd64.manifest | cut -f1 | cut -d: -f1 | sort -u)