No referendum for anti-buggery law, says Lord Gifford