Usually this is one of 2 things: on a cheap &/or older system it is possibly earth leakage from power supply or HDD etc (earth loops don't help either), but the most common reason for this remains (as it always has been) crappy shielding on cheap cables - in this case the ones that connect your headset to the computer.
You could also check the connector from your sound hardware (probably onboard MOBO) to the panel that houses your phone/mic jacks if that is seperate (i.e. front panel of a tower PC) ... replug it a few times and try some contact cleaner... but it's probably just a cheap headset with crappy shielding.
don't judge me
It's ok tk, we all gave up judging you years ago lol