Is there a Bash command to convert \r\n to \n?

Question

When I upload my scripts from Windows to Linux, I need a utility like this to make things work.

`dos2unix` is usually available, otherwise `sed -e 's/\r$//'` — falstro, Jun 24 '10 at 14:17
No, there's no Bash command for that, but there's `dos2unix` which is a Unix/Linux program to do what you want. — Dennis Williamson, Jun 24 '10 at 14:27
Why don't you just use a sane text editor that lets you choose newline style when saving files? — vtest, Jun 25 '10 at 05:39

score 31 · Answer 1 · answered Jun 24 '10 at 14:17

31

There is:

dos2unix

answered Jun 24 '10 at 14:17

RaYell

1,134
1
12
17

1

This is the historically correct answer, though dos2unix is not always available these days. – Jared Jul 01 '14 at 18:07

score 6 · Answer 2 · edited Apr 16 '16 at 22:28

6

There is a Unix utility called conv that can convert line endings. It is often invoked with softlinks to u2d or d2u or unix2dos or dos2unix.

Additionally there are utilities called fromdos and todos.

edited Apr 16 '16 at 22:28

Zombo

1
24
120
163

answered Jun 24 '10 at 14:17

score 6 · Answer 3 · edited May 01 '12 at 08:41

6

Translate (tr) is available in all Unixes:

tr -d '\r'  # From \r\n line end (DOS/Windows), the \r will be removed so \n line end (Unix) remains.

edited May 01 '12 at 08:41

Peter Mortensen

12,090
23
70
90

answered Jun 25 '10 at 11:56

1

Has a side-effect of removing any other `\r`'s too. They're highly uncommon though. – ivan_pozdeev Jul 11 '13 at 13:53

score 5 · Answer 4 · answered Nov 28 '12 at 01:38

5

With sed and find that end with .txt, .php, .js, .css:

 sed -rie 's/\r\n/\n/' \
 $(find . -type f -iregex ".*\.\(txt\|php\|js\|css\)")

answered Nov 28 '12 at 01:38

fitorec

59
1
1

Zombo · Answer 5 · 2018-03-20T00:56:14.250

Doing this with POSIX is tricky:

POSIX Sed does not support \r or \15. Even if it did, the in place option -i is not POSIX
POSIX Awk does support \r and \15, however the -i inplace option is not POSIX
d2u and dos2unix are not POSIX utilities, but ex is
POSIX ex does not support \r, \15, \n or \12

To remove carriage returns:

awk 'BEGIN{RS="\1";ORS="";getline;gsub("\r","");print>ARGV[1]}' file

To add carriage returns:

awk 'BEGIN{RS="\1";ORS="";getline;gsub("\n","\r&");print>ARGV[1]}' file

score 2 · Answer 6 · answered Jun 24 '10 at 17:26

2

Using man 1 ed (which edits files in-place without any previous backup - unlike: sed .. -i ".bak" ...):

ed -s file <<< $'H\ng/\r*$/s///\nwq'

answered Jun 24 '10 at 17:26

I diden't even know ed,but it does the job (old but gold) – dwana Sep 09 '15 at 14:01
This command worked for me when commands from other answers did not exist on the shared hosting I am using. Thanks :) – FK- Aug 18 '19 at 10:45

score 0 · Answer 7 · answered Jun 24 '10 at 14:17

0

Yes, use dos2unix. For example:

[justin@mybox ~]$ dos2unix myfile

answered Jun 24 '10 at 14:17

Justin Ethier

1,521
2
15
14

score 0 · Answer 8 · answered Jun 25 '10 at 01:27

0

$ recode dos.. FILE
$ flip -u FILE

(Each also exists for non-Ubuntu systems, but these links are handy.)

answered Jun 25 '10 at 01:27

score 0 · Answer 9 · answered Sep 24 '20 at 15:37

0

cat input.csv | sed 's/\r/\n/g' > output.csv

answered Sep 24 '20 at 15:37

Fahim

101
1

Some explanation and formatting would make this an answer. Right now it's just a comment. – music2myear Sep 25 '20 at 03:13

Is there a Bash command to convert \r\n to \n?

9 Answers9