How do I count all the files recursively through directories

Question

I want to see how many files are in subdirectories to find out where all the inode usage is on the system. Kind of like I would do this for space usage

du -sh /*

which will give me the space used in the directories off of root, but in this case I want the number of files, not the size.

Answer 1

find . -maxdepth 1 -type d | while read -r dir
do printf "%s:\t" "$dir"; find "$dir" -type f | wc -l; done

Thanks to Gilles and xenoterracide for safety/compatibility fixes.

The first part: find . -maxdepth 1 -type d will return a list of all directories in the current working directory.  (Warning: -maxdepth is a GNU extension and might not be present in non-GNU versions of find.)  This is piped to...

The second part: while read -r dir; do (shown above as while read -r dir(newline)do) begins a while loop – as long as the pipe coming into the while is open (which is until the entire list of directories is sent), the read command will place the next line into the variable dir. Then it continues...

The third part: printf "%s:\t" "$dir" will print the string in $dir (which is holding one of the directory names) followed by a colon and a tab (but not a newline).

The fourth part: find "$dir" -type f makes a list of all the files inside the directory whose name is held in $dir. This list is sent to...

The fifth part: wc -l counts the number of lines that are sent into its standard input.

The final part: done simply ends the while loop.

So we get a list of all the directories in the current directory. For each of those directories, we generate a list of all the files in it so that we can count them all using wc -l. The result will look like:

./dir1: 234
./dir2: 11
./dir3: 2199
...

Answer 2

Try find . -type f | wc -l, it will count of all the files in the current directory as well as all the files in subdirectories. Note that all directories will not be counted as files, only ordinary files do.

Answer 3

Here's a compilation of some useful listing commands (re-hashed based on previous users code):

List folders with file count:

find -maxdepth 1 -type d | sort | while read -r dir; do n=$(find "$dir" -type f | wc -l); printf "%4d : %s\n" $n "$dir"; done

List folders with non-zero file count:

find -maxdepth 1 -type d | sort | while read -r dir; do n=$(find "$dir" -type f | wc -l); if [ $n -gt 0 ]; then printf "%4d : %s\n" $n "$dir"; fi; done

List folders with sub-folder count:

find -maxdepth 1 -type d | sort | while read -r dir; do n=$(find "$dir" -type d | wc -l); let n--; printf "%4d : %s\n" $n "$dir"; done

List folders with non-zero sub-folder count:

find -maxdepth 1 -type d | sort | while read -r dir; do n=$(find "$dir" -type d | wc -l); let n--; if [ $n -gt 0 ]; then printf "%4d : %s\n" $n "$dir"; fi; done

List empty folders:

find -maxdepth 1 -type d | sort | while read -r dir; do n=$(find "$dir" | wc -l); let n--; if [ $n -eq 0 ]; then printf "%4d : %s\n" $n "$dir"; fi; done

List non-empty folders with content count:

find -maxdepth 1 -type d | sort | while read -r dir; do n=$(find "$dir" | wc -l); let n--; if [ $n -gt 0 ]; then printf "%4d : %s\n" $n "$dir"; fi; done

Answer 4

Try:

find /path/to/start/at -type f -print | wc -l

as a starting point, or if you really only want to recurse through the subdirectories of a directory (and skip the files in that top level directory)

find `find /path/to/start/at -mindepth 1 -maxdepth 1 -type d -print` -type f -print | wc -l

Answer 5

du --inodes

I'm not sure why no one (myself included) was aware of:

du --inodes

--inodes
      list inode usage information instead of block usage

I'm pretty sure this solves the OP's problem. I've started using it a lot to find out where all the junk in my huge drives is (and offload it to an older disk).

Further info

If you DON'T want to recurse (which can be useful in other situations), add

-S, --separate-dirs

Answer 6

If you have ncdu installed (a must-have when you want to do some cleanup), simply type c to "Toggle display of child item counts". And C to "Sort by items".

Answer 7

The following solution counts the actual number of used inodes starting from current directory:

find . -print0 | xargs -0 -n 1 ls -id | cut -d' ' -f1 | sort -u | wc -l

To get the number of files of the same subset, use:

find . | wc -l

For solutions exploring only subdirectories, without taking into account files in current directory, you can refer to other answers.

Answer 8

Give this a try:

find -type d -print0 | xargs -0 -I {} sh -c 'printf "%s\t%s\n" "$(find "{}" -maxdepth 1 -type f | wc -l)" "{}"'

It should work fine unless filenames include newlines.

Answer 9

OS X 10.6 chokes on the command in the accepted answer, because it doesn't specify a path for find. Instead use:

find . -maxdepth 1 -type d | while read -r dir; do printf "%s:\t" "$dir"; find "$dir" -type f | wc -l; done

Answer 10

I know I'm late to the party, but I believe this pure bash (or other shell which accept double star glob) solution could be much faster in some situations:

shopt -s globstar    # to enable ** glob in bash
for dir in */; do a=( "$dir"/**/* ); printf "%s\t%s\n" "$dir:" "${#a[*]}"; done

output:

d1/:    302
d2/:    24
d3/:    640
...

Answer 11

Use this recursive function to list total files in a directory recursively, up to a certain depth (it counts files and directories from all depths, but show print total count up to the max_depth):

#!/bin/bash
# set -x

export max_depth="2"
export found_files="/tmp/found_files.txt"

function get_all_the_files()
{
    depth="$1";
    base_directory="$2";

    if [[ "$depth" -ge "$max_depth" ]];
    then
        return;
    fi

    find "$base_directory" -maxdepth 1 -type d | while read -r inner_directory
    do
        printf "%s\t%s\n" "$(find "$inner_directory" | wc -l)" "$inner_directory" | tee -a "$found_files";
        if [[ "w$(realpath "$base_directory")" != "w$(realpath "$inner_directory")" ]];
        then
            get_all_the_files "$(( depth + 1 ))" "$inner_directory";
        fi;
    done;
}

rm -f "$found_files"
get_all_the_files 0 /tmp/

printf '\nFinished searching files, sorting all:\n'
sort --version-sort "$found_files"

Answer 12

Inside the folder (directory) you want to count (cd /my/dir) you can do the following:

1. To count all folders and files: find . | wc -l
2. To count only folders (directories): find . -type d | wc -l
3. To count only files: find . -type f | wc -l

This way you are able to verify that: folders (2) + files (3) = total (1)

---

Some explanation:

• The command find . will print each of all the folders (directories) and files line by line.
  • The parameter: -type d says to print only directories (folders)
  • The parameter: -type f says to print only files.
• The command wc -l should mean something like: word count with the parameter: lines.