Trying to generate a spreadsheet of .yaml files within a folder including args

Question

I have a folder full of .yaml files. in each yaml file i have a url arg among other things. im just trying to get a spreadsheet that has the name of the file in the first column and have the value of the url arg in the second column. is there a simple console command that can do this?

in the yaml file it looks essentially like this

args:

- {arg: file_name, value: "testfile"}

- {arg: url, value: "fakesite.com"}

the goal is to have a spreadsheet were those two values are listed side by side for each yaml file in the folder.

Answer 1

Have a look at yq, which is YAML-wrapper for jq.

Answer 2

For one file:

res=$(echo 'args:

- {arg: file_name, value: "testfile"}

- {arg: url, value: "fakesite.com"}' | egrep "file|url")
echo $res
- {arg: file_name, value: "testfile"} - {arg: url, value: "fakesite.com"}

You might need to narrow the grep pattern, to reduce false positives:

egrep -- "- \{arg: (file_name|url), value: ")

So collecting the filenames could be done with find, or with a flat directory just with a for loop. You don't have blanks in filenames or funky characters?

for f in *.yaml; do res=$(egrep -- "- \{arg: (file_name|url), value: " $f); echo $res; done > yaml.csv 
cat yaml.csv 
- {arg: file_name, value: "testfile"} - {arg: url, value: "fakesite.com"}
- {arg: file_name, value: "testfile"} - {arg: url, value: "fakesite.com"}

Or better readable

for f in *.yaml
do 
  res=$(egrep -- "- \{arg: (file_name|url), value: " $f)
  echo $res
done > yaml.csv 

From there, it should just be a step.