How to permanently disable Windows Defender

By default in Windows 10, Windows defender will turn back on again after being disabled after some time. However, if you are doing something that requires not having a AV (like creating a honeypot VM). You might find this handy.

Run the command gpedit.msc
This will bring up local group policy handling.
Navigate to:
Administrative templates - Windows components - Windows defender - Turn off Windows defender

Hit 'enable', and Windows defender should be turned off indefinently.