Sed – Replace Text Between Specific Patterns

linuxsedstringtext processing

I've been trying with sed, and googling for the whole morning, and I can't seem to get this to work.

Is it possible with sed to lowercase text between two specific characters:

i.e.

SOMENAME=WOODSTOCK,
SOMEOTHERNAME=JIMMY,

can I lowercase WOODSTOCK and JIMMY (to woodstock and jimmy) on the basis they are between = and ,?

Best Answer

It is possible with GNU sed. Choose one of these two forms based on the greediness of the replacement.

sed 's|=.*,|\L&|' file
sed 's|=[^,]*,|\L&|' file

As the manual states, "\L turns the replacement to lowercase until a \U or \E is found". & is the text matched by the regex.

I have modified the sample file to show that you should wisely choose between the geedy =.*, and the non-greedy =[^,]*, regexes:

$ cat file
SOMENAME=WOODSTOCK,
SOMEOTHERNAME2=JIMMY,WOODSTOCK,FINISH
$ sed 's|=.*,|\L&|' file
SOMENAME=woodstock,
SOMEOTHERNAME2=jimmy,woodstock,FINISH
$ sed 's|=[^,]*,|\L&|' file
SOMENAME=woodstock,
SOMEOTHERNAME2=jimmy,WOODSTOCK,FINISH

How it works

-n

This tells sed not to print anything unless we explicitly ask it to.
s/.*{$.*$}.*/\1/p

This substitute command captures as group 1 everything between two curly braces. The whole line is replaced with group 1, denoted \1. The p at the end tells sed that, if a match was made, it should print the result.

Sed/awk replace a specific pattern under another pattern

Sed can handle this quite easily. It's a single "substitute" command, prefixed with an address range. I've added extra spacing for better readability:

sed -e '/^\[ABC\]$/ , /^\[.*\]$/     s/^\(value1=\).*$/\1notbla/'

Without the extra spacing, it's:

sed -e '/^\[ABC\]$/,/^\[.*\]$/s/^\(value1=\).*$/\1notbla/'

You don't really need anchored regexes, but they may be safer in some cases of unusual inputs. A slightly shorter version with unanchored regexes is:

sed -e '/\[ABC\]/,/^\[/s/^\(value1=\).*$/\1notbla/'

Explanation:

You asked for each flag or option to be explained, and I've got the time, so here you go. I'm explaining the final (shortest) version out of the three Sed commands listed above.

The first part of the line is an address range: /startregex/,/stopregex/ The substitute command which follows the address range is only applied to lines from startregex to stopregex (inclusive).

In this case the start regex is /\[ABC\]/. Square brackets are usually special characters within a regex, so we put a backslash before each to signify literal square bracket characters.

The stop regex is /^\[/, which uses the special regex character ^ to signify the start of a line. This pattern will match any line that starts with a literal left square bracket ([).

The substitute command is basically quite simple; the general format is s/findregex/replacetext/. It can also have special flags placed after the final / to modify its behavior, but I'm not using any such flags here.

The "find regex" is ^$value1=$.*$.

The caret (^) matches the start of the line, as mentioned earlier, and the dollar sign ($) matches the end of the line. So this whole pattern must match an entire line, not merely part of one.

The parentheses (()), unlike square brackets, are non-special by default in regexes, so we put the backslashes before them to give them their special meaning. They allow parts of the matched text (the text matched by the "find regex") to be used in the replacement text. Specifically, the \1 in the replacement text means, "The text matched within the first set of parentheses in the regex." In this case, that is always just "value1=".

The final element in the "find regex" is .*. The dot (.) means "any single character," and the asterisk (*) means "any number of times (zero or more)." So the dot star (.*) matches the entire rest of the line, after the equals sign.

"notbla" in the replacement text is just static text, nothing special about it.

To really learn Sed properly, I highly recommend the Grymoire Sed tutorial, which is free online.

Best Answer

Related Solutions

Shell – sed regex for capture group between delimeters

How it works

Sed/awk replace a specific pattern under another pattern

Explanation:

Related Question