Remove possible duplicates found in lower-quality adlists

Signed-off-by: DL6ER <dl6er@dl6er.de>
This commit is contained in:
DL6ER 2019-12-12 10:13:51 +00:00
parent 5457b2c6ea
commit bd1b004d94
No known key found for this signature in database
GPG key ID: 00135ACBD90B28DD

View file

@ -160,10 +160,11 @@ database_table_from_file() {
fi fi
done done
fi fi
inputfile="${tmpFile}" inputfile="${tmpFile}"
# Remove possible duplicates found in lower-quality adlists
uniq -u "${inputfile}" "${inputfile}"
# Store domains in database table specified by ${table} # Store domains in database table specified by ${table}
# Use printf as .mode and .import need to be on separate lines # Use printf as .mode and .import need to be on separate lines
# see https://unix.stackexchange.com/a/445615/83260 # see https://unix.stackexchange.com/a/445615/83260