The analysis is based on re-running the prediction, using both different models and different regional breakdowns. We will start be describing the models and breakdowns considered.
The sections are:
For an overview assessment of the 2010 election result, go to 2010 Track Record.
The defect of this model is that the predicted vote share can go negative, or above 100%.
For details, see section 2 of Transition Model description.
For details, see section 3 of Transition Model description.
Strong voters need to be identified seat-by-seat. By adding up strong votes over all the seats in the area, we can then calculate the AreaStrongShare. Note that this is the (turnout-weighted) average of the excess of SeatVoteShare over the threshold, which is larger than the excess of AreaVoteShare over the threshold [by Jensen's inequality].
This model keeps the advantages of the Transition Model, but produces more realistic behaviour for declining parties.
This is the current official prediction model. For details see Strong Transition Model description.
Best fit coeffs | Slope | Offset |
Con < 25% | 1.09 | +1.8% |
Con > 25% | 0.90 | +8.1% |
Best fit coeffs | Slope | Offset |
Lab < 25% | 0.59 | +0.9% |
Lab > 25% | 1.04 | -8.5% |
Best fit coeffs | Slope | Offset |
LibDem < 25% | 0.87 | +3.4% |
LibDem > 25% | 0.83 | +5.9% |
We fit a best straight line independently in two regions: from 0% to 25%, and from 25% to 100%. We see that:
We also have six different ways of breaking down the country into separate pieces. Each piece is predicted separately, using the actual election vote shares for that particular piece. For finer breakdowns, the results will naturally be more accurate, but it is harder to estimate the vote shares before the election.
This is the simplest case, where we treat the whole country (excluding Northern Ireland) as a single entity. The prediction is based on the national vote share of the parties, using whichever model is selected.
In this breakdown, seats are categorised as either "Scotland" (East and West Scotland regions), or "Not Scotland". The Scottish seats are predicted on the basis of actual Scottish vote share, and the non-Scottish seats are predicted on the basis of the actual non-Scotland vote share.
This is the breakdown which is generally used by Electoral Calculus, though not in the election campaign. The predicted vote shares are calculated from the Scotland-only polls and the national polls.
In this breakdown, seats are placed into their "area" categorisation. The definitions of the eleven areas are shown here. Each area is predicted on the basis of the vote share in that area.
This is the breakdown which was used by Electoral Calculus during the election campaign. The predicted area vote shares were calculated from YouGov regional polling. The quality of this was a bit patchy, see the regional section of the 2010 track record for details.
For this, we divide seats into three geographic categories which describe how rural or urban the seat is. The categories are:
Semi-urban seats (173): Aberavon, Airdrie and Shotts, Aldridge-Brownhills, Altrincham and Sale West, Alyn and Deeside, Amber Valley, Ashfield, Aylesbury, Ayrshire Central, Barnsley East, Barrow and Furness, Basildon South and East Thurrock, Beaconsfield, Bedfordshire South West, Blaenau Gwent, Blaydon, Bolsover, Bolton West, Bracknell, Burnley, Burton, Caerphilly, Calder Valley, Cannock Chase, Carlisle, Charnwood, Cheadle, Chester, City of, Chipping Barnet, Chorley, Christchurch, Clacton, Coatbridge, Chryston and Bellshill, Colne Valley, Crewe and Nantwich, Cumbernauld, Kilsyth and Kirkintilloch East, Cynon Valley, Dagenham and Rainham, Dartford, Derbyshire Mid, Derbyshire North East, Dewsbury, Don Valley, Doncaster North, Dorset Mid and Poole North, Dunbartonshire East, Dunbartonshire West, Dundee East, Dunfermline and West Fife, Durham North, Durham, City of, Easington, Eastleigh, Ellesmere Port and Neston, Elmet and Rothwell, Enfield North, Epping Forest, Erewash, Esher and Walton, Falkirk, Fareham, Filton and Bradley Stoke, Fylde, Garston and Halewood, Glenrothes, Gower, Gravesham, Great Yarmouth, Guildford, Harrogate and Knaresborough, Hastings and Rye, Hayes and Harlington, Hazel Grove, Hemel Hempstead, Hemsworth, Hendon, Hertford and Stortford, Hertfordshire South West, Hertsmere, Heywood and Middleton, Hornchurch and Upminster, Houghton and Sunderland South, Hyndburn, Inverclyde, Islwyn, Jarrow, Keighley, Kirkcaldy and Cowdenbeath, Knowsley, Lancashire West, Leigh, Llanelli, Loughborough, Makerfield, Meriden, Merthyr Tydfil And Rhymney, Middlesbrough South and Cleveland East, Milton Keynes North, Milton Keynes South, Morley and Outwood, Neath, Newport East, Newport West, Newton Abbot, Normanton, Pontefract and Castleford, Nuneaton, Ogmore, Oldham East and Saddleworth, Orpington, Oxford West and Abingdon, Paisley and Renfrewshire North, Paisley and Renfrewshire South, Pendle, Penistone and Stocksbridge, Peterborough, Pudsey, Rayleigh and Wickford, Redcar, Redditch, Reigate, Renfrewshire East, Ribble South, Rochdale, Rochester and Strood, Rochford and Southend East, Rossendale and Darwen, Rother Valley, Ruislip, Northwood and Pinner, Runnymede and Weybridge, Scunthorpe, Sefton Central, Shipley, St Helens North, St Helens South and Whiston, Staffordshire South, Stalybridge and Hyde, Stockton North, Stockton South, Stretford and Urmston, Surrey Heath, Sussex Mid, Sutton Coldfield, Swindon North, Swindon South, Tamworth, Thanet North, Thanet South, Torfaen, Tynemouth, Tyneside North, Vale of Clwyd, Wakefield, Wansbeck, Warrington North, Warrington South, Warwick and Leamington, Washington and Sunderland West, Waveney, Weaver Vale, Welwyn Hatfield, Wentworth and Dearne, Weston-Super-Mare, Wigan, Windsor, Wirral South, Wirral West, Woking, Wokingham, Worsley and Eccles South, Wrexham, Wycombe, Wyre and Preston North, York Outer.
Rural seats (203): Aberconwy, Aberdeenshire West and Kincardine, Angus, Arfon, Argyll and Bute, Arundel and South Downs, Ashford, Ayr Carrick and Cumnock, Ayrshire North and Arran, Banbury, Banff and Buchan, Bassetlaw, Bedfordshire Mid, Bedfordshire North East, Berwick-upon-Tweed, Berwickshire, Roxburgh and Selkirk, Beverley and Holderness, Bexhill and Battle, Bishop Auckland, Boston and Skegness, Bosworth, Braintree, Brecon and Radnorshire, Brentwood and Ongar, Bridgwater and West Somerset, Broadland, Bromsgrove, Buckingham, Bury St Edmunds, Caithness Sutherland and Easter Ross, Camborne and Redruth, Cambridgeshire North East, Cambridgeshire North West, Cambridgeshire South, Cambridgeshire South East, Canterbury, Carmarthen East and Dinefwr, Carmarthen West and Pembrokeshire South, Ceredigion, Chesham and Amersham, Chichester, Chippenham, Cleethorpes, Clwyd South, Clwyd West, Congleton, Copeland, Corby, Cornwall North, Cornwall South East, Cotswolds, The, Daventry, Delyn, Derbyshire Dales, Derbyshire South, Devizes, Devon Central, Devon East, Devon North, Devon South West, Devon West and Torridge, Dorset North, Dorset South, Dorset West, Dover, Dumfries and Galloway, Dumfriesshire, Clydesdale and Tweeddale, Durham North West, Dwyfor Meirionnydd, East Kilbride, Strathaven and Lesmahagow, East Lothian, Eddisbury, Faversham and Kent Mid, Fife North East, Folkestone and Hythe, Forest of Dean, Gainsborough, Gordon, Grantham and Stamford, Haltemprice and Howden, Hampshire East, Hampshire North East, Hampshire North West, Harborough, Harwich and North Essex, Henley, Hereford and South Herefordshire, Herefordshire North, Hertfordshire North East, Hexham, High Peak, Hitchin and Harpenden, Horsham, Huntingdon, Inverness Nairn Badenoch and Strathspey, Isle of Wight, Kenilworth and Southam, Kettering, Kilmarnock and Loudoun, Lanark and Hamilton East, Lancaster and Fleetwood, Leicestershire North West, Leicestershire South, Lewes, Lichfield, Linlithgow and East Falkirk, Livingston, Louth and Horncastle, Ludlow, Macclesfield, Maidenhead, Maidstone and The Weald, Maldon, Meon Valley, Midlothian, Mole Valley, Monmouth, Montgomeryshire, Moray, Morecambe and Lunesdale, Na h-Eileanan An Iar (Western Isles), New Forest East, New Forest West, Newark, Newbury, Norfolk Mid, Norfolk North, Norfolk North West, Norfolk South, Norfolk South West, Northamptonshire South, Ochil and South Perthshire, Orkney and Shetland, Penrith and The Border, Perth and North Perthshire, Preseli Pembrokeshire, Ribble Valley, Richmond, Romsey and Southampton North, Ross Skye and Lochaber, Rugby, Rushcliffe, Rutland and Melton, Saffron Walden, Salisbury, Scarborough and Whitby, Sedgefield, Selby and Ainsty, Sevenoaks, Sherwood, Shrewsbury and Atcham, Shropshire North, Sittingbourne and Sheppey, Skipton and Ripon, Sleaford and North Hykeham, Somerset North, Somerset North East, Somerton and Frome, South Holland and The Deepings, St Austell and Newquay, St Ives, Stafford, Staffordshire Moorlands, Stirling, Stone, Stratford-on-Avon, Stroud, Suffolk Central and Ipswich North, Suffolk Coastal, Suffolk South, Suffolk West, Surrey East, Surrey South West, Tatton, Taunton Deane, Tewkesbury, Thirsk and Malton, Thornbury and Yate, Tiverton and Honiton, Tonbridge and Malling, Totnes, Truro and Falmouth, Tunbridge Wells, Vale of Glamorgan, Wantage, Warwickshire North, Wealden, Wellingborough, Wells, Westmorland and Lonsdale, Wiltshire North, Wiltshire South West, Winchester, Witham, Witney, Worcestershire Mid, Worcestershire West, Workington, Wrekin, The, Wyre Forest, Yeovil, Ynys Mon, Yorkshire East.
This is a coarse version of a breakdown by both location and urban/rural type. Seats are divided into four types, depending on whether it is Scottish and its geography (if it is not Scottish):
This finely-sliced breakdown of the country categorises seats according to both their area and their urban/rural geography. Since there are 11 areas and 3 geographic types, there are up to 33 separate pieces. (In fact there are exactly 32 pieces, because there are no rural seats in the London area, but all other combinations are possible.)
This should give very good predictions, because of the fine level of detail. But it may be impractical before an election because of the difficulty in getting the predicted vote share in each of the 32 types of seat.
For any prediction, a simple measure of success is the number of seats which are mis-predicted. The final Electoral Calculus pre-election prediction mis-predicted 80 seats, and some of those were due to polling error. Adjusting for polling error, the remaining number of mis-predicted seats would have been 63. The number of mis-predicted seats for our thirty different model/breakdown combinations are shown in the table below:
Additive | Transition | ST 20% | ST 25% | ST 30% | |
GB | 76 | 65 | 73 | 70 | 68 |
Scotland | 65 | 65 | 63 | 62 | 60 |
Areas | 57 | 64 | 57 | 54 | 55 |
Geography | 73 | 65 | 70 | 70 | 65 |
Scot/Geog | 60 | 67 | 61 | 61 | 64 |
Area/Geog | 56 | 54 | 55 | 55 | 55 |
The best result is shown in bright green (54 mis-predicted seats), and predictions within 10 seats of that are shown in light green.
We note some conclusions:
A different measure of a prediction's success is just to look at the seat totals by party, and take the sum of the absolute differences with the actual result. Our final prediction scored 66 on this measure. Adjusting for polling error, this drops to 20. The table of error scores over all the combinations is:
Additive | Transition | ST 20% | ST 25% | ST 30% | |
GB | 32 | 24 | 26 | 26 | 26 |
Scotland | 24 | 40 | 20 | 20 | 24 |
Areas | 20 | 17 | 19 | 19 | 15 |
Geography | 30 | 22 | 22 | 22 | 24 |
Scot/Geog | 14 | 24 | 16 | 16 | 14 |
Area/Geog | 16 | 13 | 13 | 11 | 13 |
The conclusions above remain valid, although the urban/rural geography now is shown to cause a modest increase in accuracy.
Following these conclusions, we are overall content to keep using the Strong Transition Model, but with a revised threshold of 25%.