'You can't accuse them of not working when we don't let them work'