Selecting rows in a CSV file based on column value that contains an embedded comma

Question

I have a CSV file (CSV UTF-8 (Comma delimited) (.csv)) with 5 columns: customer data, customer first name, customer email, cancel reason, cancel reason comments

How would I filter the rows that have "Wanted item later, choose not to get it later" in the cancel reason column and then read it into a new file called input1.csv?

Below is what I tried, but input1.csv came out blank:

awk -F , '$4 == "Wanted item later, choose not to get it later" { print }' input.csv > input1.csv

Here is a sample input from input.csv file:

cancellation date,customer first name,customer email,cancel reason,cancel reason comments
1/22/17,aaaa,xxxxx@xxxxx.com,"Wanted item later, choose not to get it later", test

Answer 1

In line with my answer to your earlier question, using csvkit, and assuming the CSV is properly quoted and uses commas as delimiters:

$ csvgrep -c "cancel reason" \
    -m "Wanted item later, choose not to get it later" input.csv >input1.csv

or

$ csvgrep -c 4 -m "Wanted item later, choose not to get it later" input.csv >input1.csv

Answer 2

It looks like you are expecting to have 5 fields. This will identify lines with more fields:

awk -F, 'NF > 5' input > output

This does not specifically look for a comma in the fourth field.

Answer 3

grep -E ',"[^"]*,[^"]*"|"[^"]*,[^"]*",' input.csv > input1.csv