Newest 'bash awk' Questions - Unix & Linux Stack Exchange

2

votes

3answers

143 views

Easy way to parse syslog date format

I'd like to write a script that analyses the last week's syslog. But my syslog logs in a stupid date format, e.g. "May 22". If it logged as 2013-05-22, this task would be trivial. Is there a way ...

asked May 22 at 11:00

artfulrobot
1705

3

votes

2answers

55 views

Automated partition selection in bash script

I'm trying to write a bash script to run from Linux on a CD or flashdrive that can mount Windows and change stuff, but I don't know how to go about detecting which partition/drive is Windows. My best ...

bash awk windows devices

asked Apr 22 at 14:39

Peace Blaster
913

2

votes

2answers

90 views

Using bash shell function inside AWK

Is it possible to use bash function inside AWK somehow? Example file (string, int, int, int) Mike 247808 247809 247810 Trying to convert values from decimal to hexadecimal. Function defined ...

bash awk

asked Apr 18 at 19:46

tiny
914

3

votes

1answer

156 views

Pass colors from ls through pipe to awk 'print' statement

This is a follow-up to my question from yesterday, Show sum of file sizes in directory listing. Thanks to Zero Piraeus and a point in the right direction by Mauritz Hansen, I now have function ...

bash awk ls pipe colors

asked Apr 17 at 17:47

MattDMo
372214

5

votes

4answers

184 views

Show sum of file sizes in directory listing

The Windows dir directory listing command has a line at the end showing the total amount of space taken up by the files listed. For example, dir *.exe shows all the .exe files in the current ...

bash shell-script awk ls

asked Apr 16 at 18:38

MattDMo
372214

1

vote

1answer

87 views

Safely convert unicode strings to printable characters

I have many HTML files containing mixed unicode strings like \303\243 and printable characters like %s. What I'd like to do is converting the unicode strings into printable characters in a safe way. ...

bash shell command-line awk python

asked Apr 14 at 3:05

Teresa e Junior
662411

1

vote

2answers

53 views

How do I get a field in bash's job list using awk?

I wanted to write a function to retrieve a field from the list of background jobs in bash. For example to get a specific argument. Let's say I send vim to the background, so "jobs" displays this ...

bash awk jobs

asked Apr 10 at 14:17

bug
647

2

votes

3answers

197 views

Bash commands/script to remove a line from CSV with duplicate in column

I have a lot CSV files that I have combined. However, there are duplicates, but the entire line is not duplicated. I do have a column that I want to use as the criteria to search for a duplicate. ...

bash sed awk

asked Mar 22 at 16:02

Peaceful_Warrior
111

1

vote

0answers

145 views

Processing shell script options with awk

I'm looking for way to process shell script arguments that is cleaner and more "self documenting" than getopt/getopts. It would need to provide... Full support of long options with or without a ...

bash command-line awk options getopts

asked Feb 18 at 9:06

DocSalvage
1376

1

vote

0answers

141 views

Conky - string formatting

I have conky the record: ${color lightblue} Down: ${downspeed wlan0} Up: ${upspeed wlan0} Conky prints link speed, but the text moves: Down: OB Up: OB Down: 60B Up: 60B Down: 148B Up: 148B ...

bash awk c conky lua

asked Jan 29 at 11:20

nowy1
766

1

vote

1answer

284 views

Validate Unix Timestamp using BASH

My google-fu has failed me so I'm hoping someone here can point me in the right direction. I'm in the middle of doing some data validation efforts and I suspect the system is recording some invalid ...

bash awk timestamps

asked Jan 10 at 22:07

FloppyDisk
24818

2

votes

1answer

406 views

Bash variable in Awk script

I have this flat file database(ff_servers.db) with following contents: 192.168.154.2 Alaska hp 192.168.157.3 Colorado dell 192.168.156.3 hawaii hp From command line, I could run: awk ...

bash shell-script awk

asked Dec 27 '12 at 7:29

icasimpan
1699

1

vote

1answer

84 views

how to add a description in footer

I enjoy learning how to modify files with awk, sed, and bash. However, I know it could cause issues down the road and I would like to be prepared with a log inside the file. I was thinking about how ...

bash sed awk html

asked Dec 20 '12 at 18:57

Matt_2.0
2919

2

votes

3answers

272 views

Awk to output read file

I havent stepped into awk yet but it is on my plate for learning this coming year. I asked a previous question that led me to awk and it works. However, I am unsure how to input all file types and ...

bash awk

asked Dec 18 '12 at 16:34

Matt_2.0
2919

1

vote

3answers

697 views

Print lines where first field has only four characters using regex in awk?

John Goldenrod:(916) 348-4278:250:100:175 Chet Main:(510) 548-5258:50:95:135 Tom Savage:(408) 926-3456:250:168:200 Elizabeth Stachelin:(916) 440-1763:175:75:300 output should contain the lines ...

bash shell-script awk regular-expression

asked Nov 24 '12 at 6:31

munish
792417

1

vote

1answer

108 views

renaming diverse files

I store files named like this: word-word2-word3-word4.txt . The number of "words" varies from file to file. I want to replace certain of the dashes with pluses e.g word+word2-word3+word4.txt I want ...

bash awk

asked Nov 20 '12 at 11:55

Tom
253

0

votes

2answers

160 views

Easiest way to find/replace in a file using a list?

I have a file, foo.txt, and a regexp I want to find in that file. Each time I find the regexp, I want to take a line from another file, bar.txt, and substitute it in for the regexp match I found in ...

bash shell-script text-processing sed awk

asked Nov 12 '12 at 20:47

Joseph Garvin
31425

1

vote

2answers

239 views

List info about files/directories with spaces

I am trying to use ls to get information about files and directories. My current command fails to properly get the name whenever a file/directory has a space. I am using this to list all ...

bash shell shell-script awk ls

asked Oct 10 '12 at 7:23

Rich
82

5

votes

2answers

177 views

Use a script parameter in awk

Here is my script (to find the files that contain a specified pattern) : find . -type f -exec awk -v vawk="$1" '/'"$vawk"'/ {c++} c>0 {print ARGV[1] ; exit 0 } END { if (! c) {exit 1}}' \{\} \; ...

bash awk

asked Oct 5 '12 at 18:26

Nicolas
1705

1

vote

3answers

691 views

bash merge 2 lists removing duplicated

I have an embedded linux system using Busybox (OpenWRT) - so commands are limited. I have two files that look like: first file aaaaaa bbbbbb cccccc mmmmmm nnnnnn second file mmmmmm nnnnnn ...

bash grep sed awk busybox

asked Oct 2 '12 at 18:42

slthomason

4

votes

6answers

252 views

What is the easiest way to check if column A and B values goes both ways with AWK? [closed]

What is the easiest way to check if column A and B values goes both ways? Output to check: Mike John John Mike Pamela Barbara Barbara Pamela Mike Paul Roger Paul Desired output Mike <-> ...

bash text-processing awk python perl

asked Sep 12 '12 at 6:39

tiny
914

5

votes

1answer

829 views

Fast elimination of duplicate lines across multiple files

I have a huge amount of data in which each (data-)line should be unique. There are a lot of files in one folder in which this is already true. It is about 15GB splitted into roughly 170 files with ...

bash files awk performance

asked Sep 11 '12 at 10:29

stefan
300111

15

votes

3answers

966 views

Piping from grep to awk not working

I am trying to grep the ongoing tail of file log and get the nth word from a line. Example file: $ cat > test.txt <<EOL Beam goes blah John goes hey Beam goes what? John goes forget it Beam ...

bash grep rhel awk tail

asked Aug 30 '12 at 12:04

Beaming Mel-Bin
478414

1

vote

3answers

599 views

how to sum output of awk or other expression with xargs

Suppose i have the following bash shell script: #!/bin/bash export count=0; for i in `ls ./mydoc` ;do pdfinfo ./mydoc/$i | egrep Pages |awk {'print $2'} |xargs -+ $count ; ...

bash shell awk xargs

asked Aug 29 '12 at 21:27

Mohsen Pahlevanzadeh
600113

11

votes

1answer

1k views

Making a progressbar with “dialog” from rsync output

I'm looking for a way to filter/redirect rsync output in a manner where it can be fed to the "dialog --gauge" command, so I can get a nice looking progressbar during file sync. Currently I have only ...

linux bash scripting awk rsync

asked Aug 6 '12 at 11:40

chr1573r
585

3

votes

2answers

1k views

Working with columns - awk and sed

I am trying to parse a text file that is generated by an expec script that pulls down some information from a switch. Here is a sample output: 192 0000.0000.0000 1/g23 Dynamic ...

bash sed awk

asked Jul 25 '12 at 22:34

bourne
186

4

votes

2answers

210 views

How can I get awk to print both matches and non-matches?

Basically, all I want to do is alter outputs if the input matches a filter, but the part being altered isn't what is being filtered (or I would use sed). The problem so far is that my awk is only ...

bash awk

asked Jun 29 '12 at 4:27

Ken Oh
524

8

votes

3answers

819 views

How to sort the string which combined with string + numeric using bash script?

This is the data what I want to sort. But sort treats the numeric to string, the data it no sorted as I expected. /home/files/profile1 /home/files/profile10 /home/files/profile11 ...

bash shell-script sed awk sort

asked Jun 26 '12 at 10:27

user760548
432

3

votes

6answers

883 views

Text file look-up by column

I have a file in this format: [#] OWNER_NAME NAME SIZE [6] Robottinosino Software 200 [42] Robottinosino Ideas worth zero 188 [12] ...

bash shell-script sed awk filter

asked Jun 25 '12 at 7:22

Robottinosino
600111

3

votes

1answer

475 views

Make awk use bash with the system() command

Is there a way to make awk use bash instead of sh when running system commands using the system() call? I want to use some bash-specific features such as [[ ]] and < > string comparison operators: ...

bash shell awk command

asked Jun 16 '12 at 18:02

haelix
1383

16

votes

9answers

1k views

Remove duplicate $PATH entries with awk command

I am trying to write a bash shell function that will allow me to remove duplicate copies of directories from my path environment. I was told that it is possible to achieve this with a one line ...

bash shell awk path

asked Jun 14 '12 at 4:22

Johnny Williem
885

1

vote

1answer

525 views

Extract marked strings from text file using Bash

I have files which are of the following style - these are parametrised configuration files; the values within the #characters are replaced with real values from a database depending on environment. ...

bash awk

asked Jun 11 '12 at 9:33

Rich
545515

2

votes

2answers

159 views

How do I ad an if statement (regarding punctuation in a word) to this bash script

I have this bash script #!/bin/bash cat $@ | while read line do for word in $line do echo $word | circling-the-square # here's where i need to add the if statement: ...

bash shell-script sed awk

asked May 24 '12 at 17:28

ixtmixilix
2,643837

2

votes

2answers

385 views

How can I turn ugly output into pretty, useful information?

How can I turn this ugly output into pretty, useful data? The output: /* ---------- TA#box#AbC_p ---------- */ insert_job: TA#box#AbC_p job_type: a #owner: bob permission: gx date_conditions: 1 ...

bash awk perl csv text

asked May 18 '12 at 21:41

Joe A
255

0

votes

2answers

769 views

Using awk to process ls output with spaces in filenames/paths

All, I have a script in which I use find command to filter out all png files in a given folder and list them along with their size. I want the output in the following format: someFile.png => 1.2K ...

bash shell awk

asked Apr 25 '12 at 21:31

smokinguns
13114

3

votes

3answers

264 views

swapping fields in columns by fixed pattern (yes, no, no, yes)

I want to produce a following list of pages (for imposition work); (number of pages is variable, but I make a sample of my needs using a list of 16 pages, logic is the same for longer lists) 1,16 8,9 ...

bash awk numbering

asked Apr 15 '12 at 22:07

Dingo
1304

0

votes

1answer

278 views

Using Awk To Parse Individual Lines

Here is the output from qacct -o Total : OWNER WALLCLOCK UTIME STIME CPU MEMORY IO IOW ...

bash awk

asked Apr 4 '12 at 17:31

Jeff
1547

1

vote

3answers

497 views

Combining Awk with Curl

How would I set my curl statement so that it puts the value of each $3 in for the username, and the value of each $4 for the wallclock information? Some further information I am trying to take the ...

bash awk curl

asked Mar 29 '12 at 14:34

Jeff
1547

3

votes

2answers

491 views

simple script rotating table

I'm trying to write a simple script, that just rotates csv table. I mean I have some file: head1;head2;head3 field11;field12;field13 and so on. All I want, just to make my file ...

bash sed awk

asked Mar 26 '12 at 15:08

rush
8,9721440

5

votes

3answers

568 views

Is there a more elegant way to count words and assign that count to variables?

I have a script: #!/bin/bash /root/xiotech status > xiostatus.tmp SyncCount=$(grep -c Sync xiostatus.tmp) PauseCount=$(grep -c paused xiostatus.tmp) CopyingCount=$(grep -c Copying xiostatus.tmp) ...

bash shell-script awk

asked Feb 8 '12 at 0:48

LVLAaron
3432312

4

votes

2answers

345 views

Replace one line with STDIN in a Makefile

One Makefile target is supposed to be in charge of: grabbing the output of $ perl Markdown.pl src/index.md (markdown to html) using that string to replace one line, something like CONTENT ...

bash sed awk make

asked Jan 29 '12 at 19:24

chelmertz
1235

2

votes

3answers

416 views

How to truncate the second column from a dot (.)?

INPUT: 10.175.192.16 vgxyxgf.de.foo.net asdf 34efg 10.175.192.17 sdtds.de.foo.net xyyxv e5432 10.175.243.20 asdfycfb.us.foo.net dfvasf 34525 OUTPUT: 10.175.192.16 vgxyxgf ...

bash awk

asked Jan 26 '12 at 4:13

LanceBaynes
1,165538129

3

votes

4answers

294 views

Align a hex text file at 9 bytes each line

I want to align the selected portion of a text file at 9 bytes each column. For example suppose my text file looks like below. 00 2f c6 b8 29 fd 02 37 11 00 9f 74 34 0b 60 72 38 20 00 9e 61 33 8e ...

bash sed awk python

asked Jan 25 '12 at 21:25

liv2hak
1185

4

votes

3answers

3k views

Delete range of lines above pattern with sed (or awk)

I have the following code that will remove lines with the pattern banana and 2 lines after it: sed '/banana/I,+2 d' file So far, so good! But I need it to remove 2 lines before banana, but I can't ...

bash sed awk

asked Jan 24 '12 at 16:09

Teresa e Junior
662411

2

votes

3answers

833 views

Trouble getting awk output in for loop

I'm trying to create a script that will check a website for a word. I have a few to check so I'm trying to input them via another file. The file is called "testurls". In the file I list the keyword ...

bash shell text-processing awk

asked Nov 24 '11 at 21:52

jetgerbil
132

10

votes

6answers

2k views

How to print the longest line in a file?

I'm looking for the simplest method to print the longest line in a file. I did some googling and surprisingly couldn't seem to find an answer. I frequently print the length of the longest line in a ...

bash awk filter

asked Nov 13 '11 at 0:58

dr.bunsen
20916

2

votes

2answers

382 views

Adding 2 lines in text file stanza

I have a text file divided in stanzas. Each stanza starts with a [keyword] and ends with a blank line. Something like this: [keyword1] param1 = value1 param2 = value2 param3 = value3 [keyword2] ...

bash shell-script sed awk

asked Nov 9 '11 at 11:39

ztank1013
63419

-2

votes

2answers

229 views

How to delete the second column from this input?

INPUT bix.hu. 42433 IN A 193.239.149.1 bix.hu. 42433 IN MX 10 deneb.iszt.hu. bix.hu. 42433 IN NS ns.iszt.hu. bix.hu. 42433 IN NS ns.iszt.hu. bix.hu. ...

bash awk

asked Oct 30 '11 at 13:51

LanceBaynes
1,165538129

5

votes

2answers

249 views

How would I sort these directory names numerically?

I'm aware that I can somehow sort this output numerically (so cpu1/ follows cpu0/) ... I could probably get something to work eventually by splitting up the string various ways with awk, but is there ...

bash sed awk sort

asked Oct 27 '11 at 5:31

twblamer
19218

1

vote

4answers

1k views

Increment number in bash variable string

VERSION="4.0beta12" NEXT_VERSION=????? Writing an automatic release script, I have the current version in a variable $VERSION, and I would like to calculate the next version as $NEXT_VERSION. Rule: ...

bash awk arithmetic

asked Oct 24 '11 at 4:43

Nicolas Raoul
582314

Tagged Questions

Related Tags