Perry blames territorial boards for WI's decline in recent years