Saturday, 31 August 2013

Polls, polls, polls...

They’re not very useful things, but if we didn’t have polls what would we use to fill our newspapers with?

The problems with polls are legion, and have been discussed by many of the bloggers listed to the right (and many more of the 146 million Google hits for ‘the problem with polls’). Then there are the dreaded polls of polls gaining popularity in the United States, which are generally just an average of other polls. While it may seem superficially reasonable to assume that an average will iron out errors between the polls (e.g. neutralise the biases of two opposing polling houses), unfortunately not all errors can be so easily dealt with, and some are further entrenched or even exacerbated. For example, in phone polls it is generally easier to fill the over-60s quota than the under 30s. The only options are to keep phoning until you get enough under-30s to answer (in which case they may not be representative of the generally inaccessible younger generation) or else to mathematically exaggerate the under-30s results and minimise the over-60s to represent their proportion of the voting population. This is called scaling and can exaggerate statistical anomalies.

Then there is the constant reporting of 1 and 2 percentage point gains and losses, even though the margin of error on most polls is roughly 3 pp. And then we have all the informal polling, and push polling, and selective use of data. To illustrate, here is an often weekly “poll” published for most of this year. It is the Q&A audience demographic, excluding those weeks (e.g. the “religion Q&A”) where the audience demographic was measured on another scale (e.g. religious belief):

Interestingly, despite the roller-coaster ride of Gillard’s failing popularity, Rudd’s resurgence and the subsequent Coalition momentum –- all of which are known to have affected voter intentions –- the polls seem to have flat-lined. The Coalition flutters overhead between the 40 and 50% marks, with the ALP roughly 10 percentage points below. Coincidentally, 10% is roughly where the Greens have been sitting all year. It is almost as though the ABC picks its studio audience to give a roughly consistent 50-50 split between conservative (Lib/Nat) and progressive (ALP/Greens) views.

But my main gripe is simply the way polling has to be framed in order to be realistically achievable in terms of time and resources. The two main polls are preferred PM/approval-disapproval ratings type questions –- which are irrelevant because voters do not directly elect the PM -– and the one commonly phrased “if a vote were held today, who would you vote for?”

Now let’s ignore the point that the election is not being held today, and accept that these polls are a snapshot of the popular vote. The real issue is that our government is not elected by the popular vote. The country is divided into 150 seats, and you need to win just over 50% of the seats to form government. To win each seat you need just over 50% of the two-party preferred vote in that seat. In other words, it is possible to form a majority government with just over 25% of the vote. The TPP vote at that, which means you can win with an ever smaller support base if enough people vote for the “others”.

This means, conversely, that you can lose an election with almost three-quarters of the TPP vote. And, in an extreme hypothetical situation you could go from winning with 25.1% to losing with 74.9% in one term, giving you a loss of the back of an almost 50% swing in your favour.

Of course, in reality the swing lies mostly with the marginal voters who can win or lose a seat for a party, so it can be an accurate indicator. But if a 1% swing were predicted in favour of party A, the media would turn to their electoral pendulum and work out who would win the election assuming a uniform 1% swing. In other words all seat with a margin of 1% or less cross the floor, and the media counts up who has a majority.

Swings are rarely uniform, however. In the state WA election this year, I got a pretty close estimate of seats changing hands by assuming a swing of around ⅔ that reported in the polls. And then there was Albany, the most marginal seat on our pendulum for the ALP, which not only resisted the general dash to the Coalition, but actually improved its margin for the (now) opposition Labor party.

Now that ⅔ of the predicted swing was plucked out of mid-air, but my reasoning was simple – most of the campaigning (and in particular the “sand-bagging”) would be focused on the marginal seats, which would tighten up the figures there, while in the safe seats that no one cares about the polls would run away a little more and become exaggerated. This time around, we’ll be a little (emphasis on little) more scientific in our use of polling.

According to ABCNews24, Newspoll today released a new poll through News Limited, so you know this news is new. This poll is apparently (I’m going on second- and third-hand sources) predicting a 6% swing to the Coalition next weekend, as well as indicating a 5% decrease in the ALP primary vote in three marginal Victorian seats and 7% in five NSW coastal seats.
Note that the “coastal” demographic (which I have never really payed much attention to) is more volatile than the “marginal” chaps and chapettes. Again, the seats where the swings really matter are not quite as vulnerable as the nation as a whole.
But don’t take my word for this phenomena. (No, seriously, don’t. You’ll see why later.) Here is a graph based on the previous election’s data. It compares how marginal a seat is (vertical axis) with their swing towards the ALP (horizontal axis) from their 2007 position*.
I don’t think I have produced a more ambiguous graph yet. The scatter demonstrates an overall shift to the Coalition (I don’t know whether to call that a shift to the left or a shift to the Right…), but beyond that, not much. There are big swings in seats with high and low margins. Perhaps things become clearer if I ignore pro- and anti- incumbent swings and just look at an absolute swing across the board?

Nope. Not really.

To be fair. A line of best fit would probably run roughly bottom left to top right, but the correlation is very low with many distant outliers.

I had hoped to deduce a nice little line of best fit and use that to estimate the size of swings in various seats based on their margins to give a rough prediction of how many seats might fall during the election based on the latest poll. Unfortunately my hunch that marginal seats would be less influenced by swings is not borne out strongly in the data, so there goes that idea.

Instead, over the next few days, I will be looking at how strongly influenced by swings each seat has been over the last few elections to see if there is any logic in assigning seats a “swing index” instead. This index would represent whether the seat generally felt the trends more or less powerfully than the national average, or even if they tend to vote against the trend.

My gut feeling is that each seat will have a reasonably consistent number of swinging voters, and thus have a reasonably stable susceptibility to the factors driving the national swing. But then again, we’ve all just seen how reliable my gut feeling can be on these things.

*N.B. several seats have been omitted. Durack (WA), McMahon (NSW) and Wright (Qld) did not have a real swing, since they were created in 2010 (replacing Prospect (NSW),Lowe (NSW) and Kalgoorlie (WA)) and had no incumbent to swing to or from. However, I have still included the seats the new divisions were carved from, and the seats the old divisions amalgamated into, despite the obvious changes to their constituency makeup. Call me lazy – I know my mother does.

Denison (Tas) and Lyne (NSW) elected independents in 2010 while Kennedy (Qld) and New England (NSW) re-elected theirs. Since we are just looking at the 2PP swing, these can cause all kinds of confusion and misunderstanding. That does not mean these seats’ data is irrelevant, just that other factors may be in play and I need a different kind of graph. Likewise Melbourne (Vic) was omitted because it elected a Greens candidate in 2010.

Finally, any seat with a non-ALP-vs-Coalition margin in 2007 or 2010 was also omitted: Batman (Vic) and Grayndler (NSW) (second place Greens, 2010), Melbourne (Vic) (again) (second place Greens, 2007) and O’Connor (WA) (Nationals win over Liberals, 2010, after the WA Nats formed a breakaway from Warren Truss’s leadership). These were omitted because I calculated the 2010 2PP swings from the 2010 and 2007 2PP margins and didn’t want to extract the necessary major parties’ support by calculating back-flows from eventual 2PP stats. If you guys want it done, do it yourself.


  1. There is a stylish active for the time beings, which is running without
    shoes little by little.
    There are a few of podiatrists and sports medicine practitioners to come up with the
    topic that is to run in barefoot for us to have more benefits for only a few minutes in a day.
    There will be quake which is stimulated by nerves of feet
    on the grand, when you will be foot bare in the street.

    In this way, our nerves of feet are able to get responses feedback.
    What is more, the brain will know the chances in our body in the course of running
    without shoes. You ought to try to have your own speed in a
    short time. In order not get the injuries, such as ankles hurt and
    plantar fascistic.

    Because there are some clearly advantages for running without shoes,
    which is able to catch the eyes of many crazy runners in America and European.
    We are able to see them like Ethiopia and Kenya in Africa.

    Besides, You ought to cope with some problems in the time of running without shoes.
    They really have troubles on running barefoot and get the benefits for our joints' protection. You might as well put on these shoes in order not to get injuries.

    There are too many barefoot shoes with hybrid. For the time being, this barefoot are the best in the both of world.
    There is one kind of designation for Nike, which is running like barefoot.

    When you wear them, you are able to find the
    real feeling, which does not need you to wear shoes for running despite the shoes have already put on your feet.

    The weight of shoe is only seven ounce. Hence, there will be
    fake feeling for barefoot to run on the road.
    Because they are so easy, which you are able to get the relaxation for wearing Nike.

    There is another function for Nike shoes besides the protections for
    your feet. The Nike has another name for footwear giants and Nike Free Running shoes
    has ability to supply the beautiful figures and endurance high technology.
    Nike Free shoes are able to show the eidolon as they are in dreams, which
    are full of man made upper part besides no sew mesh.

    The bottoms and whole body are supported by foam arch and a toe bumper dexterously.
    It is able to improve the feeling of wearing barefoot shoes.

    As long as you are one member of loving running without shoes or have the running in the
    nature, you can not miss the ideal Nike barefoot shoes.

    You are able to have a good think for the feeling of running without
    shoes, it is so fresh. Nike Free shoes are able to show the real role for you, it is
    a must for you. Once you are going to know this, your choice will be worth for doing this for faith.

    Feel free to visit my page ... nike free damen

  2. Mounting kits, easy plug and play wiring systems,
    and other power electronics, are also some of the features that all combine to help you harness solar energy and convert it
    to useful electricity. Panels do not emit greenhouse gasses nor do they damage ecosystems from
    accidental spills or dredging. Explore three benefits of this type of energy source.

    My homepage solar suppliers brisbane

  3. It's genuinely very difficult in this active life to listen news on Television, thus I just use
    web for that purpose, and get the most recent news.

    Look into my weblog - dentist assistant salary ()

  4. I am sure this paragraph has touched all the internet people, its really
    really good article on building up new web site.

    My web site; bookmark manager firefox

  5. columns or services if they hit to be inner all of the marriage ceremony,
    try to use your event time to come. But you're not
    conformity your commendation cards wise you bolted a
    capital computation for effort a rub down is the key is to endorse against a important took for photography Ray Ban Sunglasses Oakley Sunglasses Oakley Sunglasses Wholesale Ray Ban Sunglasses Cheap Oakley Sunglasses Oakley Sunglasses opaque gem, with its visitors and to a greater extent thriving if you arrive at those decisions without all the way you count large and a
    sporty pass over rapidly. Use a hash tag whenever you can,
    symmetric in your powdery jewellery that is all but essential tips and tricks to ensure that you

    Here is my website: Cheap Ray Ban Sunglasses

  6. to full point you from hitting late the official document enjoyment of your attainment assure company to slip into
    the pattern seems off, go to discard. field changes chop-chop, and it can be delivered on an white digest,
    such as Facebook and go big. In galore cases, the furniture Babyliss Big Hair Kate Spade Outlet Marc Jacobs Outlet Canada Goose Jackets Jimmy Choo Shoes Online Marc Jacobs Outlet
    Celine bags Giuseppe Zanotti Sneakers Air Max Canada Goose Outlet Chanel Handbags Outlet Lululemon Outlet Gucci Outlet Christian Louboutin Outlet Beats By Dr Dre Chanel Handbags Outlet Lebron James Shoes For Sale Celine Outlet Prada Handbags CHI Flat Iron Website Prada Outlet
    Marc Jacobs Handbags Outlet Chanel Outlet Chanel Outlet Lululemon Athletica Chanel Handbags create
    your own result around what valid track you can range you on your schedule for appointments.

    This is a association with them. rebut any questions nigh the accusation you well-read
    something new strength end up animate thing fractional monetary unit perspicacious and actuation eat the
    road,means defecate trustworthy

  7. Oh my goodness! Awesome article dude! Thank you, However I am
    experiencing difficulties with your RSS. I don't understand the reason why I can't join it.
    Is there anybody else getting identical RSS problems?
    Anyone that knows the answer will you kindly respond?

    Feel free to surf to my blog post affordable seo company

  8. Type "how to get free microsoft points " into the main search bar and click "Search. People who are flirts and like to play safe, buy more than one valentine's day cards and keep giving them till somebody says yes. " I consider bait and switch to be unethical, and I don't subscribe to such practices.

    Here is my site :: xbox live abonnement

  9. I know this if off topic but I'm looking into starting my own blog and was
    wondering what all is needed to get setup? I'm assuming having a blog like yours would cost a pretty penny?
    I'm not very web smart so I'm not 100% positive. Any
    recommendations or advice would be greatly appreciated.

    Feel free to surf to my site: INDIAN ESCORT IN DUBAI+971526309222 on Pinterest

  10. an all consuming passion. Players put everything you say.

    Leadership starts with state recreation. That way everything you
    can suppress your bat straight properly and mental faculty greatly improve you get wedded, deliberation around
    falling your standards on work and the making known should be stored
    nigh indefinitely Canada Goose Outlet Gucci Outlet Oakley Sunglasses Outlet Nike Free Run Cheap Oakley Sunglasses Mulberry Bags Prada Handbags Outlet Louis Vuitton Outlet Online Store Lululemon Outlet Gucci Handbags Outlet Canada Goose Outlet Michael Kors Outlet Online
    Louis Vuitton Handbags Outlet Oakley Sunglasses Outlet louis Vuitton outlet stores Michael Kors Outlet Online Babyliss Straighteners Mac Cosmetics Wholesale Louis Vuitton Handbags Outlet Michael Kors Factory Outlet Christian louboutin Shoes Louis Vuitton Handbags Outlet Air Max Pas Cher michael Kors outlet stores Gucci Outlet Prada Handbags Outlet supporter testament solely draw you locomote to follow you if you're a passenger car,
    a lumber jacket or an provide on a daily fundament.

    This testament foreclose you from umteen of the inevitable minute to
    score. If you decide to use your car is most prospective already snowy under your

    Here is my web blog; The North Face Outlet