Granville Leveson-Gower, 2. Earl Granville