Is there a way to use the cp command to copy a directory and exclude certain files/sub-directories within it?
- 12,964
- 10
- 49
- 77
- 899
- 3
- 9
- 10
5 Answers
Use rsync:
rsync -av --exclude='path1/to/exclude' --exclude='path2/to/exclude' source destination
Note that using source and source/ are different. A trailing slash means to copy the contents of the folder source into destination. Without the trailing slash, it means copy the folder source into destination.
Alternatively, if you have lots of directories (or files) to exclude, you can use --exclude-from=FILE, where FILE is the name of a file containing files or directories to exclude.
-av means archive mode and verbose.
--exclude may also contain wildcards, such as --exclude=*/.svn*.
Copied From: https://stackoverflow.com/a/2194500/749232
If you want to use cp itself:
find . -type f -not -iname '*/not-from-here/*' -exec cp '{}' '/dest/{}' ';'
This assumes the target directory structure is the same as the source's.
Copied From: https://stackoverflow.com/a/4586025/749232
-
1The word "contents" in "copy the contents of the folder..." is a major keyword to understand the sentence. It should be bolded and highlighted. – M J Mar 01 '21 at 01:33
Late into the game but here is a very different solution using plain Bash and cp: you can use a global file specification while having some files ignored.
Assume the directory contains the files:
$ ls *
listed1 listed2 listed3 listed4 unlisted1 unlisted2 unlisted3
Using the GLOBIGNORE variable:
$ export GLOBIGNORE='unlisted*'
$ ls *
listed1 listed2 listed3 listed4
Or with more specific exclusions:
$ export GLOBIGNORE='unlisted1:unlisted2'
$ ls *
listed1 listed2 listed3 listed4 unlisted3
Or using negative matches:
$ ls !(unlisted*)
listed1 listed2 listed3 listed4
This also supports several unmatched patterns:
$ ls !(unlisted1|unlisted2)
listed1 listed2 listed3 listed4 unlisted3
- 12,964
- 10
- 49
- 77
- 5,376
- 2
- 16
- 34
-
3For negative matches you need to have extended globs enabled: `shopt -s extglob`, also you don't need to export `GLOBIGNORE`: it's supposed to modify the behaviour of the current shell, most child programs wouldn't care about it. – muru Jun 13 '16 at 22:14
-
Quick Start
Run:
rsync -av --exclude='path1/in/source' --exclude='path2/in/source' [source]/ [destination]
Notes
-avrwill create a new directory named[destination].sourceandsource/create different results:source/— copy the contents of source into destination.source— copy the folder source into destination.
- To exclude many files:
--exclude-from=FILE—FILEis the name of a file containing other files or directories to exclude.
--excludemay also contain wildcards:- e.g.
--exclude=*/.svn*
- e.g.
Modified from: https://stackoverflow.com/a/2194500/749232
Example
Starting folder structure:
.
├── destination
└── source
├── fileToCopy.rtf
└── fileToExclude.rtf
Run:
rsync -av --exclude='fileToExclude.rtf' source/ destination
Ending folder structure:
.
├── destination
│ └── fileToCopy.rtf
└── source
├── fileToCopy.rtf
└── fileToExclude.rtf
-
I generally use -avh --progress as a rule, add --ignore-existing if copying to a destination that gets regular backups and want to skip files that match created/modified time and size, and add --delete-after if deleted files in source and destination should reflect those deletions. -z is compression and can help make the transfer a little faster if backing up to a remote location (fairly unnecessary on LAN). --bwlimit=10000 (rate given in KB/s) will limit speed to 10MB/s and is helpful for long backup if concerned about hampering total bandwidth. – AveryFreeman Aug 21 '20 at 05:54
You can use cp with the ! character.
For example, to exclude the file or files file.txt, test.jpg and the directory nodir, while copying all others from the source directory to the destination directory, you may run:
cp source/!(file.txt|test.jpg|nodir) destination
If you have, for example, a file structure as this one:
.
├── destination
└── source
├── file.rtf
├── file.txt
├── test.jpg
├── yes
| └── test.jpg
└── nodir
└── other.jpg
The result after running the above command is:
.
└── source (not modified)
└── destination
├── file.rtf
└── yes
└── test.jpg
Here is an article with information on rsync and cp with exclude: How to cp copy and exclude internal files or directories (equivalent to rsync –exclude)
- 12,964
- 10
- 49
- 77
- 121
- 3
-
if you use this script in bash file, add #!/bin/bash shopt -s extglob for remove error on ( – Cadot.eu Mar 22 '22 at 12:15
Everyone seems to answering with "Use rsync", while I agree that is a very powerful tool its also overkill and presents some risks. The OP asked how to do it with cp and I found this worked combining some of the recommendations others made.
cp -rf !(backup) backup/
This was a simple experiment in copying all the files in a directory to a file called backup in the same directory without cp worrying about skipping a recursive call. Hope this helps.
- 101
- 2