[...]
WARNING: file pg992.txt.utf8 skipped due to duplication
WARNING: file pg993.txt.utf8 skipped due to duplication
WARNING: file pg9931.txt.utf8 skipped due to duplication
WARNING: file pg9938.txt.utf8 skipped due to duplication
WARNING: file pg994.txt.utf8 skipped due to duplication
WARNING: file pg9959.txt.utf8 skipped due to duplication
WARNING: file pg996.txt.utf8 skipped due to duplication
WARNING: file pg9960.txt.utf8 skipped due to duplication
WARNING: file pg997.txt.utf8 skipped due to duplication
WARNING: file pg9970.txt.utf8 skipped due to duplication
WARNING: file pg9974.txt.utf8 skipped due to duplication
WARNING: file pg998.txt.utf8 skipped due to duplication
WARNING: file pg999.txt.utf8 skipped due to duplication
WARNING: file pg9998.txt.utf8 skipped due to duplication
All pg files have warning issues. Are these warnings caused by files appearing in dups_list being skipped and not copied to the raw_dir directory? How can I deal with this problem and successfully download all files?
[...]
WARNING: file pg992.txt.utf8 skipped due to duplication
WARNING: file pg993.txt.utf8 skipped due to duplication
WARNING: file pg9931.txt.utf8 skipped due to duplication
WARNING: file pg9938.txt.utf8 skipped due to duplication
WARNING: file pg994.txt.utf8 skipped due to duplication
WARNING: file pg9959.txt.utf8 skipped due to duplication
WARNING: file pg996.txt.utf8 skipped due to duplication
WARNING: file pg9960.txt.utf8 skipped due to duplication
WARNING: file pg997.txt.utf8 skipped due to duplication
WARNING: file pg9970.txt.utf8 skipped due to duplication
WARNING: file pg9974.txt.utf8 skipped due to duplication
WARNING: file pg998.txt.utf8 skipped due to duplication
WARNING: file pg999.txt.utf8 skipped due to duplication
WARNING: file pg9998.txt.utf8 skipped due to duplication
All pg files have warning issues. Are these warnings caused by files appearing in dups_list being skipped and not copied to the raw_dir directory? How can I deal with this problem and successfully download all files?