Permanent secretary sent on leave following arrest