Forks/freemail
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

sort/uniq after lines are cleaned up.

Browse Source
This commit is contained in:
Will White 2015-02-07 17:16:11 -08:00
parent 83a52fadf0
commit d1893885b2
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
update
View File

@ -9,11 +9,11 @@ for source in $sources; do
done; done;
cat data/free.txt tmp \ cat data/free.txt tmp \
| sort \
| uniq \
| sed '/./,$!d' \ | sed '/./,$!d' \
| sed -e 's/^ *//' -e 's/ *$//' \ | sed -e 's/^ *//' -e 's/ *$//' \
| awk '{print tolower($0)}' \ | awk '{print tolower($0)}' \
| sort \
| uniq \
| comm -23 - ./data/blacklist.txt \ | comm -23 - ./data/blacklist.txt \
| comm -23 - ./data/disposable.txt > ./data/free.txt | comm -23 - ./data/disposable.txt > ./data/free.txt