BUG | Found 2 rare glitches with whois.csv + Found ways for users to fix those 2 glitches. #435

What is the problem you are experiencing?

Note that quite a bit of this is based on circumstantial evidence, as I was more focused on seeing if the errors could be fixed instead of documenting the exact error messages in deep detail; I did however feel it'd be worth it to share advices about them to this repo. They apply to both the native Windows versions of Python 3.13.7 (Tested with the Microsoft Store version of Python) and (from what I could tell) to the Cygwin python312 package version 3.12.9.

1. During a session, after scanning around 100 domains or so, PyFunceble can begin to throw increasingly more errors about _csv.Error: field larger than field limit (131072), before crashing after 200 domains or so.

The fix I found for it was that whois.csv had increased to around 7.3 MB at the time, which seems to have been more than Python 3 could handle. Deleting the whole whois.csv file prevented that error, but does not fix the 2nd error listed below if that one is also encountered.

2. During a session, whois.csv can throw a different error that I remember involves being about (epoch), but I've completely forgot the exact name and syntaxing of the error message, I have not been able to reproduce it after I first fixed it, and cases of it elsewhere seems to be non-existent in online searches.

Both of the 2 errors also complained about Error 13: Permission denied (...), so I went to the file → right-click → "Properties" → "Security" → "Edit" → "Add..." → Type "All" (Very likely different in non-English Windows versions) → "OK" → Give "All" all available permissions → "Apply". This fixed the 2nd error; it can likely fix the 1st error too but I can't prove it for that one.

How can we reproduce the problem?

Good question, to be honest.

To at least replicate the 1st error:

1. Have a bafflingly large whois.csv file in %appdata%/PyFunceble (if using a native Windows version of Python)
2. Run pyfunceble -f https://raw.githubusercontent.com/DandelionSprout/adfilt/refs/heads/master/Sensitive%20lists/TabloidRemover.txt
3. After scanning something between 100〜300 domains, it can begin throwing the error around once every 20 domains, before crashing on approximately the 4th error occurence.

How to replicate the 2nd error is anyone's guess.

Do you have a screenshot?

I really wish I had any screenshots to provide, but I don't seem to have any.

What did you expect to happen?

PyFunceble completes scan sessions without users needing to handle the whois.csv file.

Is there a workaround?

All of the working ones are listed further above.

How did you configure PyFunceble?

The .PyFunceble.overwrite.yaml file is empty on my end, as fas as I can tell.

Which Operating System did you use?

Windows 11

Which Python Version did you use?

3.13

Which PyFunceble Version did you use?

4.3.0

Additional context

Among the things I tried to fix them with, but which didn't work:

• Changed some entries in whois.csv whose listed ISPs were shown with as many as 6 quotation marks, so that no ISPs in the file were listed with more than 2 quotation marks.
• Change the default opener app for .csv files in Windows from Excel (Office 365's version) to Sublime Text 4.