Maybe make a rule like you need to be top 15 or 20 on ladder to challenge .. but clearly knitter should have every right to challenge.. and refusal to accept/dodge should have consequences. Otherwise it's just going to be a tag that rarely gets challenged.