Friday, 22 March 2013

From W.A. to W.S.


What About Me (It Isn't Fair (I've Had Enough Now I Want My Share))


A lot has been written about Western Sydney this election. A lot more than anyone could want to read. This week I add to that glut of text and hopefully say something new. The reason I am taking the effort to discuss what many might consider an exhausted topic (though believe me, the media will continue to flog this kind of dead horse until September) is that for all that has been written, there seems to be little understanding of what is going on, politically speaking. That is not to say that I am somehow endowed with inside knowledge of the politicians' strategies, but anyone who watches ABC's Q&A will see a tweet more or less every week along the lines of 'there's more to Australia than Western Sydney'. Some were even amusing! (Sadly it took a few seconds for me to get that one...)

There is apparently a strong sentiment of 'what about me?' in the electorate at large which betrays a fundamental naïvety of how elections work. The simple fact is that, as far as lower house voting goes, most of us don't matter that much. I certainly don't, because my seat (Mayo) will stay firmly in Liberal pockets (assuming the Liberals can avoid any screw ups several magnitudes larger than any in the last 50 years). Last election was going to be “lost and won in Queensland”, although Sydney did get a mention.

I think most of us actually get this. There are marginal seats and safe seats. The politicians have to fight over the marginal seats a lot more than their safe ones. What I think has happened here, though is a combination of several things:
  1. This is a long election and people can see a lot more Western Sydney stuff coming
  2. Western Sydney is a smaller area than usually focussed on
  3. The rest of Sydney can see how much greener the grass is to the west, at least in terms of political focus and promises, and inner Sydney is not used to being shown up. Melbourne, Brisbane and other metropolitan centres aren't too impressed either.
  4. Increased social media participation, especially in the political arena, since last election has made the disquiet less quiet, and
  5. Not many people are particularly enchanted with “either party” of politics (because there are only really two parties, right?) and therefore anything “either” does is demonised. Labor in particular cannot to anything right (perhaps because that is part of The Narrative as Andrew Welder suggests) and Labor is really the driving force behind the Western Sydney focus. The Coalition is happy to play along because the longer they spend fighting over the working and lower-middle classes the longer the Coalition can expect the support of everyone else by default. The fact that Labor has not (and possibly cannot) communicate with anyone else has been noted by others.
There was a similar feeling in 2010 when both sides were serenading the independents to form government. One news station that displays tweets* included one with the general sentiment of 'I wonder if we would be receiving more attention if we had voted for an independent?' The simple (and I think obvious) answer would have been yes. But independents can be comparatively less effective in non-hung parliaments where they do not hold the balance of power. Even candidates from major parties like Labor and the Coalition have limited power when in the majority and even less when in opposition. In a democracy all voters have a say, but in a nation of 21 million you cannot expect a big one. Nor can you expect all voters opinions to be treated equally. Donors with mountains of money will always have a bigger say. Supporters of representatives who hold the balance of power in either house will always have a bigger say. And in election years, voters in marginal seats will always have a bigger say. Voters like those in Western Sydney.

But These People Have A Point!


I mentioned that Queensland was seen as key in the last federal election. Both parties put a fair few resources into that state, and Labor lost seven seats, leaving them 8 of the 30. Many people point to just one equation to explain this.



Rudd, of course, was a proud Queenslander. I think its a bit more complicated than just that, but that is neither here nor there. Rudd was a definite factor in Queensland and elsewhere. I guess you could argue that in the end Queensland was instrumental. Labor lost ground there and nearly lost government.

Fortunately for the ALP, there haven't been any major, controversial events that implicate Labor politicians headlining Sydney's news lately, have there? Oh, wait...

That is Eddie Obeid, if you didn't recognise him. So is this.

While investigations are ongoing, it has been oft repeated that Obeid has ruined Labor in NSW for a whole generation of voters. I think that's probably overstating it – most people will be saying 'Obeid? Who's that?' in an election or three – but it does make Labor's brand pretty toxic in the Sydney area.

Labor could always hope that people don't confuse federal Labor and state Labor, and vote accordingly. But you see the thing is: Western Australia. If voters are willing to punish WA Labor for Gillard policies, what are the odds Sydney voters won't let state Labor controversies colour their federal opinions?

Still, six months is a long time in politics. Perhaps Labor can claw back some support by then but, as plenty of other, more influential bloggers have pointed out, the ALP's chances are greater elsewhere.

The key idea in these articles looks at “winnable seats” for Labor based on the Mackerras pendulum. I'll be using the under-6% definition of marginal that has served us well so far, so my results will differ a little from Gordon Graham's (the last link) which looked at seats under 5%.

The majority are in Queensland (10) followed by Victoria and NSW (6 each), WA (4) SA (2) and NT and Tasmania (1 each, with Tasmania's seat being Denison and taken from an independent).

Specifically, these ones.

Mr. Graham suggests that the Obeid matter is fatal for Federal Labor in NSW, and that the ALP in Victoria and SA have pretty much maxed out their support. Denison is also considered safe for the independent at this early stage. After the WA state election I would expect we can rule out many ALP gains there as well, short of a massive turn around. All of this only serves to further highlight the importance of Queensland, and it has been suggested that the anti-anti-Rudd sentiment in that state may have weakened since the ALP took a thrashing three years ago.

However there is something very strange going on. 'Western Sydney' is obviously a very nebulous area, but it is defined by at least one NSW newspaper to be the combined seats of Banks, Blaxland, Chifley, Fowler, Greenway, Lindesy, McMahon, Paramatta, Reid and Werriwa. None of the marginal non-Labor seats (i.e. possible wins) lie in this area. Benelong, Hughes, Macarthur and Maquarie neighbour this area, and would make far more sensible targets based on the methodology of Mr Graham. For the record I think these were very well-written, enjoyable, informative articles but they don't consider the flipside:

Which ALP Seats Are Losable?


Again, using the 6% cut off line we find the answer:



1 in the Northern Territory, 3 in WA, 4 in Victoria, 7 in the Sunshine State and a whopping 12 in NSW. These include Banks, Greenway, Lindsey, Parramatta and Reid within 'Western Sydney'. The PM's visit to the area was based in Rooty Hill in Chifley – a Labor seat, albeit a safe one. Labor isn't trying to win seats, it's trying to not lose them. They're sandbagging – a phrase you might have heard several times in the Western Australian election coverage if you were so inclined to watch.

When the tide was clearly favouring the Liberals and Nationals in WA, who were expected to wash away many marginal seats with a flood of votes, the Labor party started sandbagging. This is a process where you fortify the marginal seats against your opponents, at the expense of safer seats. Perhaps you think you can save more than you'll lose. Perhaps you trust the safer seats to hang on. Or perhaps you are playing the long game like Mark McGowan appears to be, retaining the marginal seats in order to have an advantage there next election, when you plan to win back your formerly staunch support base.

I don't think federal Labor is doing any of the above. What I think is really going on here is the ALP trying to assess what the damage is in NSW. If they think they can recover, they'll focus on this area up until polling day, with a few open plays for Queensland and perhaps WA. If not they can either abandon the “new Liberal heartland”, or keep the focus there as cover while introducing plans that will hopefully pay dividends in Queensland and other areas without directly drawing the Coalition's attention away.

I said that Labor was leading the charge on Western Sydney and that the Coalition was happily playing response, safe in the knowledge they have a good chance of holding this “heartland” and can probably win without it anyway. At a deeper level, though, it is Labor who has been out-manouvred. I think federal ALP sandbagging is a lot of playing catch-up – a catch-up campaign that looks disturbingly like a mere continuation of the WA state sandbagging, and the 2010 federal sandbagging, and the SA and Tasmanian sandbagging before that. In 2010 sandbagging just preserved Labor's grip on power. It is a strategy that is unlikely to hold back two tidal waves in a row.

* I'm not a twitter user, but I must admit it is generally a pretty good forum for venting your frustration where no one (outside your own friendship group) is going to hear you. Much like screaming into the vacuum of space. Or writing an election blog. Why you would add in a news broadcast with a hashtag is beyond me. If your five minutes of fame is 140 characters on the bottom of a TV screen then … well, I'll let you judge what that means for yourself personally. I would rather be noted for making some kind of contribution to society, but whatever floats your ego, I suppose.

Friday, 15 March 2013

Half-Year Exams

The Results Are In...


A full six months – almost to the day – from the Australian federal election and it is time to check how we are doing. I was planning to assess my predictions for the WA state election, and I will, but yesterday we also got the results of the papal conclave. I wasn't expecting any results from Italy until today at the earliest, but now we get to look at all the predictions in one fell swoop.

Let's do the bonus question first, then the lengthy multiple choice section


Don't Cry for Me Argentina:


Okay. Two things straight up. A) I got this one wrong. B) It is Pope Francis. That is all. Full stop. The end. He is not Pope Francis I until we have a Pope Francis II.

Now normally these self-reflective posts are about learning how to form better predictions next time and me parading how right I was. Since I wasn't right and there may not be another papal election for over a decade it might seem a bit redundant to dwell on this. However, I would not be worthy of my place on the blogotubes if I did not get personally offended whenever reality impinges on my interpretation of the facts and try to justify my way out of it. So, like a seven year old who explains you only won because s/he had a sore leg (which s/he never bothered to mention before hand) this is why I am right and the Cardinals are wrong:

Very few expected Bergoglio to win, especially as the conclave drew nearer. Everyone was either backing a European or clinging to the idea of an African pope. Latin America might have made more sense than Africa, since it has a larger Catholic population, but a black pope would be a more obvious break with tradition and would allow easy parallels with Obama. Or so the media thinking seemed to run (because the Catholic Church is all about breaking with tradition and totally bases its choice of pope on superficial similarities to world figures). So there is at least the consolation that I'm not the only one to get this wrong.

Secondly, he's a Jesuit. There has never been a Jesuit pope since the order was founded in the 16th century. There have been Franciscan popes and Dominican popes but no Jesuits, until yesterday. Jesuits do not pursue high office unless ordered to by their superiors. I'm not going to criticise Pope Francis for taking the job – though I reserve the right to tut in the strongest possible way if I disagree with his actions later – it is just that it is really strange to think that a Jesuit would become pope. Clearly he thought that the Church was in need of him, and that the Church itself, and God, were the superiors that required he take up the role.

Thirdly, there was the whole accused of kidnapping thing. It was ages ago, and unsubstantiated, but I thought we were past the age of Popes with shady pasts.


I decided against a Hitler Youth reference here.
Oh wait, no, there it is in the caption...


Again I'm not judging the guy (yet). He is innocent until proven guilty. I just did not expect the conservative Cardinals to take that risk – especially given the current reputation problems the church is facing.

A lot is being made of the fact that he is the first Latin American pope. In fact he is the first non-European pope. After almost 2000 years of popes poping their papacies I'm all for a change. I didn't expect one though. I've already mentioned that he's the first Jesuit pope. And he was elected after the first papal resignation in six centuries. That's a lot of records broken. He has also taken an unused Papal name. The last pope to do that (not counting John-Paul I, who really reused two names) was Pope Lando in 913. That's one-thousand, one hundred years ago exactly.



He lived a long time ago in a Vatican far, far away.
What is it with Popes and Star Wars?

So yes, this was a surprise pope. A decision, I would argue, that was very difficult to predict. But he seems sincere and his assumed name has been read to imply that he will try to rebuild the church's reputation – just as St. Francis physically rebuilt churches by hand. And he may be a conservative against gay marriage and broad use of contraception, but he did stress that it is important to respect people who identify as homosexual and that the use of condoms is acceptible to help stop the spread of HIV.

The surprise is not necessarily an unpleasant one.

Labor Pains


Closer to home (especially if home is Western Australia) there were the state elections. While final counts are expected to be completed over the next day or so, we have enough data to be pretty confident in calling most of the seats. The good news is that our predictions were far better here than in Rome. By which I mean we got over 0% right. In fact, if we assume there are only two parties in contention for each seat (which there aren't) then you would expect to get 50% right just on dumb luck, and we did better than that too!!!

On the latest data our accuracy in the WA elections was 92.45%. That sounds really impressive, but remember you get 50% right by flipping a coin, and a lot of those seats were no-brainers. When Wagin was held by the coalition with a margin of 28.4%, and second place was another coalition party, it is not hard to guess that it will not be going to the Labor party in an election with a clear pro-Coalition swing.

I would say that anything below 90% accuracy in mediocre at best, and you'd need to break 95% to consider your predictions to have been particularly good. So we're in the comfortable mid-ground at the moment, but I'm looking to improve in the short term.
Counting is still underway, with just shy of 90% of the vote counted in the lower house. Since you never get a turnout of 100% of eligable voters this is more or less complete, and very few seats could change hands (if any - I haven't done the maths on this) with the remaining count. Some seats can be called on first preferences alone - in Cottesloe for example the Liberals received 64.6% of the primary vote and win the seat before preferences are redistributed.

Others require some guesswork as to how the voters second and third preferences ran. I am relying on Antony Green's predictions of how preferences will flow for these, which I understand are based on approximate figures from previous elections. I will be developing my own preference predictions for the Federal election closer to the date [Editor: no you won't], but in the mean time these are as below:

Greens: 7:3 Labor to non-Labor ratio
Australian Christians – 3:7 Labor to non-Labor
 Family First – 3:7 Labor to non-Labor
  Independent – split 50:50
(unless something is known about the candidate)
 
National Preferences – 1:3 Labor to Liberals
Liberal preferences – 3:17 Labor
to Nationals
Directed Labor preferences - 4:1 Nationals to Liberal or Other
Undirected Labor preferences - 3:2 Nationals to Liberal or Other
Labor preferences (North West Central only) - 3:7 Nationals to Liberal or Other
(Non-Labor is basically the Coalition unless there is something going on with an Independent.)

So this is how we'll be calling seats until I get better data, and what I'll be basing this review on. There is no time like the present, and no place like the results table:


Before we jump into the errors (in bold) lets look at the ones I got right. After all I know why we got those ones right (or at least I think I do).

If we ignore all seats over 10% (i.e. safe or very safe) then I got 34 right out of 38. That is around 89½%, and a more reliable assessment of how we did. Not bad by any means, but not mindblowing either. Like I said, it's a comfortable result with room for improvement. Everything over 10%, in fact, is so safe that swings in excess of this cannot be accepted by the ABC's election calculators, and on election night coverage the angular swing graph maxes out. The highest margin seat to change hands (ignoring the retiring Independent in Churchlands) was Perth, on 7.7%, and this was a particularly bad election for the incumbent's party.

Of course, even with such a foregone conclusion, Collin Barnett still insisted the election would be close in order to rev up supporters into a pro-Coalition campaigning (and voting) frenzy. The rest of us knew that the swing was strongly against Labor - so much so that I had all Coalition seats, no matter how marginal, being retained. Polling was indicating swings of 7%, but I knew that it could be much lower in non-safe seats so I labelled all Labor seats under 5% as likely wins for the Coalition and all seats under 8% as too close to call.

This was a rough approximation, and much more simplistic that I would have liked with more forward planning on my part and less technical problems on my computer's. Given the polarised electorate, however, it proved to be generally pretty accurate.

Error. Error. Error.


Even given this, I just want to say "what the heck, Albany? What. The. Heck." I don't think even my best prediction methodology could justify why the most marginal Labor seat in the state (indeed, the most marginal seat in state of any persuasion, excepting Morely which was nominally Labor with a Liberal incumbent) did not fall. 0.2% is nothing. In an electorate of around 20,000 voters that is about 40 votes. Labor was holding on by 40 votes, and did not lose them! In fact it was one of only 4 seats to see a primary vote swing to Labor (the others were Kwinana and Rockingham - safe Labor seats - and Churchlands where the incumbent independent was retiring.)

The other mistakes I made were the three Labor seats with margins between 3.8% and 4.8% (inclusive): Collie-Preston, West Swan and Gosnells. Perhaps I should have stretched the tossup range down to include these, but only calling seats with half the predicted state-wide swing or less seems like overkill. If you don't want to take a view on difficult seats, then why not just give up on saying anything useful, predict Wagin as a Coalition win, call everything else a tossup and claim a 100% accuracy?

Instead, I'm going to do the sane thing and try to learn what actually unfolded in these seats. On election night there was a lot of talk about sandbagging. Seats like Perth with 7.7% margins were changing hands, and little Collie-Preston with 3.8% didn't move because Labor was "sandbagging". Local factors were coming into play as Labor tried to hold what ground it could. Local promises, spending and visits to the area are all traditional sandbagging tactics, where a party tries to shore up specific seats at the cost of neglecting others. I'll discus this more next week, just to keep you on the edge of your seats, but essentially there are several reasons why this might be advantageous. This particular election I think Defence Minister Stephen Smith was on the right track when he kept talking about setting up springboards for next election.

Labor knew it was going to lose and, despite Barnett's insistence, the Coalition knew it was going to win. Labor decided to stop focusing on the unwinnable battle (though not by any means pull back on the attack) and looked long term. By my count McGowan still has 21 seats, two more than Geoff Gallop A.C. won in 1996 before gaining 13 seats for victory in 2001. While this was the largest rejection of a sitting WA state government since federation, Minister Smith was still very optimistic about 2017. If McGowan was indeed looking back to Gallop, then holding on to the less reliable seats with margins around 4% is going to be a good head start. Safer seats like Perth (last held by the Coalition from 1965 to '68) and Pilbara ('74 to '83) can be expected to return to 'normal' Labor positions and would be pretty marginal under the coalition. In short, the safer, re-winnable seats were sacrificed for the harder-to-regain (but still defensible) 4% region.

In future it will pay to give a closer look to seat-specific issues in borderline tossup seats.

Upper House:


Assuming that everyone votes "above-the-line" (which is actually left of the line in WA state voting), the current WAEC figures give the following results:

Northern Metropolitan

2008 Previous Seats: 3 Coalition (Liberal), 2 Labor, 1 Green
My Predicted Seats: 4 Coalition, 1 Labor, 1 Green
Likely Resulting Seats: 4 Coalition (Liberal), 2 Labor

Southern Metropolitan

2008 Previous Seats: 3 Coalition (Liberal), 2 Labor, 1 Green
My Predicted Seats: 3 Coalition, 2 Labor, 1 Green
Likely Resulting Seats: 3 Coalition (Liberal), 2 Labor, 1 Green

Eastern Metropolitan

2008 Previous Seats: 3 Coalition (Liberal), 2 Labor, 1 Green
My Predicted Seats: 3 Coalition, 2 Labor, 1 Green
Likely Resulting Seats: 3 Coalition (Liberal), 3 Labor

Agricultural

2008 Previous Seats: 5 Coalition (3 National, 2 Liberal), 1 Labor
My Predicted Seats: 5 Coalition, 1 Labor
Likely Resulting Seats: 4 Coalition (2 Liberal, 2 National), 1 Labor, 1 Shooters and Fishers

Mining and Pastoral

2008 Previous Seats: 3 Coalition (2 Liberal, 1 National), 2 Labor, 1 Green
My Predicted Seats: 4 Coalition, 1 Labor, 1 Green
Likely Resulting Seats: 3 Coalition (2 Liberal, 1 National), 1 Labor, 1 Green, 1 Shooters and Fishers

South West

2008 Previous Seats: 4 Coalition (3 Liberal, 1 National), 2 Labor
My Predicted Seats: 5 Coalition, 1 Labor
Likely Resulting Seats: 4 Coalition (3 Liberal, 1 National), 2 Labor

This was calculated from the preference flows using this calculator and these numbers as of March 15. In the Northern and Eastern Metropolitan regions the Greens failed to get enough votes and their seats passed, perhaps predictably, to Labor. I was fully aware that I had done no research into the Greens and that this could happen, but those are simple errors that can be corrected by not writing my predictions an hour before election day.

In the South West region the coalition failed to take a fifth seat from Labor, which may be because the Coalition has maxed out its support, something I also mentioned last week.

The real surprise, for me at lest, was in the Agricultural and Mining and Pastoral regions, where one predicted Coalition seat in each went to the Shooters and Fishers. Given I didn't look into the Greens it should not be surprising I didn't even consider the SFP. However, as Antony 'Pseh-God' Green points out, in the Mining and Pastoral region this could easily revert to a Nationals seat with right-of-the-line votes counted - especially considering how many flow-ons the SFP required to get that far (Liberal, ACP, Family First and independent).

In the Agricultural region the SFP benefits from a couple of independents, ACP, Family First and Labor. Even before these it is only 1000 votes from the lead, so there would have to be considerable upset to the flow of preferences to give the Coalition the fifth seat I predicted.

Southern Metro was the only region I got 100% correct. In terms of accuracy, I'm going to use a calculation which is favourable to me but also, I think, fair. Where the Coalition won one fewer seats than predicted and the Shooters and Fishers picked one up, some might count that as two errors. I'm counting it as one, since only one seat was incorrectly predicted (the SFP seat was predicted Coalition).

North Metro: 5/6
South Metro: 6/6
East Metro: 5/6
Agricultural: 5/6
Mining & Pastoral: 5/6
South West: 5/6
TOTAL: 31/36

That is around 86% accuracy. Again, this figure looks good because there are always some givens - such as the Coalition and Labor gaining enough support to win at least one seat in most cases.

Conclusions:

In the upper house I correctly predicted 31 of the 36 seats. This could be improved by paying more attention to parties outside the Labor-Coalition dichotomy and by running through expected preference flows to see just how many people are supporting surprises like the SFP.

In the lower house I correctly predicted 49 of the 53 seats I did not rule as tossups, but need to pay more attention to local issues in tossup or near-tossup seats.

I also called the next government/premier of WA correctly (Coalition) for one easy point.

In the papal elections I correctly predicted 0 of the 1 popes. Oh well. Ignoring the easy next premier question this is a total of 80/90. With or without the next premier point, were sitting on more or less 89% accuracy.

Then again, if it were possible to predict all of these votes with 100% accuracy, there would be no point in me running this blog in the first place. Don't get your hopes up - I'll be blogging away for a while yet.

Although on that note, I will be rather busy next week doing that thing again. You know, that thing that gives me money? Anyhow, I wouldn't dream of leaving you unblogged, so there is a post about Western Sydney automaticly scheduled for next Friday. It was written more than a week in advance (before this post, actually,) so it could be irrelevant, outdated and far from topical. Then again that's about par for the course with this blog.

Tuesday, 12 March 2013

It was only a matter of time

It was only a matter of time before I broke my one-post-per-week, regular Friday update pattern.

I didn't justify a little post on the Italian elections.

I resisted the urge to point out that the betting odds have come to favour Anglo Scola in the papal elections - a candidate I backed when the odds firmly supported Cardinal Turkson.

I didn't break my silence when the conclave was announced to start today.

I didn't add an extra post when It looked like my WA predictions were going to be between 90 and 95% accurate in the lower house.

I didn't even mention that while we (or at least I) was watching the WA state elections, the rest of the world (well, BBC world news) was looking at the Kenyan presidential results.

But, after a few solid, serious posts, I felt I had to add this one. While counting is still underway for the WA state elections, you will be pleased to know that according to PerthNow over 4000% of the votes for the seat of Willagee have been processed!

I don't know how long the site will remain like that, but I decided this required some form of immortalisation.


For those of you interested, in addition to the 2134.67% of votes to the Independent,the ACP got 1512.11%, FFP got 366.44%, 269.62% of votes went to the Liberal Party and the Greens got 127.31%. In accordance with the thorough thrashing of state Labor, an otherwise nearly respectable 26.04% of the primary vote was recieved.


It is a bit unfair of me to pick on a site because of a single technical glitch when I'm destined to make a mistake soon (if not already), but this kind of result makes the predictable Kenyan agruments over the validity of their election result look trivial. According to the Media Watch website, this is not the only news source to be having graphing issues lately. Oh, and remember all those things I didn't mention at the start of the post? Under the guise of presenting this little statistical freak-out I've mentioned them now. Sneaky!

Regular, sensible* posts will resume Friday.

* I think we all know why I put this asterisk here...

Friday, 8 March 2013

The Wild West

I did have quite a lengthy blog this week for the WA state elections tomorrow. Not for the first time, my computer has decided to corrupt the file, so I'm re-typing this whole thing in one night. What you are getting is a quick summary of my predictions, minus the fat and a lot of the detail that I would have liked to include. My predictions have been reformed out of fresh data and my own memory, and are less justified and probably less accurate than I had hoped. Those who live by the computer, die by the computer I guess.

Legislative Assembly:


I'm going to save myself time and assume everyone either read last week's post or is otherwise familiar with the Mackerras pendulum. Here is the pendulum as of last election's results:

Data for combined coalition margins from www.waec.wa.gov.au

Not displayed above are the four independents' seats. Alfred Cove (0.2% against the Liberals), Kalgoorlie (3.6% against the Nationals) and Fremantle (formerly Greens 4% against the ALP) are all marginal. Churchlands (22.5% against the ALP) is very safe, but the incumbent is retiring.

I had planned to include the data regarding primary vote leads for comparison as discussed last week. That was a lot of data and I won't be able to recreate it tonight. Luckily that was the less-useful half of my predicting power because I struggled to find a way to make it comparable to the Mackerras results (so that 'safe' and 'marginal' mean roughly the same thing in both contexts). I'll return to that particular topic in another post once I have reconstructed some useful data, so that will shorten this post considerably (and save you a lot of my nattering).

Polls Apart:


So far we have not looked at polling for the Federal election, and I'm sure I'll devote several posts to that in the future. The most recent polling I can find for WA has the Coalition at 54%, Labor at 32%, the Greens at 8% and 6% for 'others'.

For most people reading a Sunday newspaper this would be sufficient to predict a Coalition victory, but I'm guessing if you are reading this you are not one of those people. The following illustrations were made when this data had not yet come out. It is based on the proportions of Coalition 51%, Labor 35% and the Greens and others as above.

Because of the effect of district boundaries, a 51% of the primary vote does not necessarily equate to victory. Using the proportions above, the dots were assigned colours randomly using this random array generator. I do not have the original values since the crash, but the lowest 51% of the 500 numbers were coloured blue (Coalition) the next 35% red (ALP) the next 8% green (Green) and the rest grey.



On primary votes this should be a clear victory for blue, yet when divided along the borders that I deliberately gerrymandered, red wins quite comfortably. This is probably not the best-possible gerrymander for Labor, but it is a very good one. It illustrates the danger of extrapolating a general voting pattern across the board - a strong swing like the one to the Coalition in the 2010 federal election can do very little if it is mostly contained in safe seats.


With that caveat, I should point out that seat-by-seat polling is very rare because it is difficult to conduct and time consuming. Instead we will approximate a solution. This time last election the poll gave Labor 35%, the Coalition 43%, the Greens 12% and others 10%. The ALP is down three percentage points since then and the Coalition is up 11. While this may still be mostly lost in the safe seats, it does at least take into account the constants of dedicated, 'rusted on' voters (and thus the most staunchly unbending seats) and gives us an indication of the general swing of opinion.

On two-party preferred polling (2PP polling) there is a 7% swing to the Coalition. Since I don't have my primary vote data any more, I'll have to rely on this almost entirely for my predictions.

Legislative Council

As for the upper house, this is almost entirely based on primary vote data. As a result I'm afraid I'm going to have to give you my predictions from memory without any real explanation. Anyone who wants to see my upper-house methodologies is going to have to wait until I cover the federal election, but basically it is based on the primary vote from last election and the general swing in primary votes (assuming people's primary vote in the Assembly broadly reflects their Council votes). There was also a nice little bit of numerical wizardry I implemented to determine where the swinging voters were most concentrated which only really works with the WA system. I'm afraid you're going to miss out on that.

So, WA is divided into 6 regions: Northern Metropolitan, Southern Metropolitan, Eastern Metropolitan, Agricultural, Mining and Pastoral and South West. Each region elects six councillors. Currently the councillors are divided 21 Coalition (16 Liberal, 5 National), 11 Labor and 4 Greens. For a rough, back-of-an-envelope guide, we could divide each party's number of councillors by the 2008 primary vote to get a councilor-to-primary-vote ratio, and then multiply that by the 2013 polling figures. This, adjusted slightly to keep in with the 36 available positions, gives roughly 25 Coalition councillors (20 Liberals, 5 Nationals), 9 ALP and 2 Greens.

Predictions:

Legislative assembly seats are predicted to fall as follows:


An overall majority in the lower house for the Coalition is pretty well expected universally, although of course the Coalition still insists it is close so that voters feel that the Liberals and Nationals need their vote and will not waste it on some Independent. A gain of 1 seat would give them a majority (30/59 seats) and I'm predicting around 9 seats gained, based on marginal seats taking a swing in the region of 5%. If the Coalition was not returned it would only be the fourth single-term government since party politics really started in WA. The others were the Scaddan Labor ministry in 1914, the second Mitchell Ministry in 1933 and the Tonkin Labor ministry in 1974.

Legislative Council, reconstructed from memory:

Northern Metropolitan

Current Councillors: 3 Coalition (Liberal), 2 Labor, 1 Green
Predicted Councillors: 4 Coalition (Liberal), 1 Labor, 1 Green

Southern Metropolitan

Current Councillors: 3 Coalition (Liberal), 2 Labor, 1 Green
Predicted Councillors: 3 Coalition, 2 Labor, 1 Green

Eastern Metropolitan

Current Councillors: 3 Coalition (Liberal), 2 Labor, 1 Green
Predicted Councillors: 3 Coalition, 2 Labor, 1 Green

Agricultural

Current Councillors: 5 Coalition (3 National*, 2 Liberal), 1 Labor
Predicted Councillors: 5 Coalition, 1 Labor

Mining and Pastoral

Current Councillors: 3 Coalition (2 Liberal, 1 National), 2 Labor, 1 Green
Predicted Councillors: 4 Coalition, 1 Labor, 1 Green

South West

Current Councillors: 4 Coalition (3 Liberal, 1 National), 2 Labor
Predicted Councillors: 5 Coalition, 1 Labor

Total Predicted: 24 Coalition, 8 Labor, 4 Green.

As we can see the greatest swing is in the rural areas, which are typically conservative. We may still be seeing a return to 'normal' after the long run of the ALP in power. This total is not all that far from our rough estimate of 25, 9 and 2 respectively. In 24 hours we'll know just how wrong I can be...

Last Minute Addition:

If you are like me, and planning to spend the evening watching the vote counting love on ABC News 24, then why not print off my WA electorate map to colour in. Fun for the whole family as you race to find that obscure, oddly shaped seat in a test of your geographical knowledge and colouring-inside-the-lines-ness. (Ages 5+. Warning: small inner-suburbs seats may present a choking hazard to children.)


Friday, 1 March 2013

Ruling Up the Margins: A Cautionary Tale

It don't mean a thing if you ain't got that swing:


So far we've discussed past voting trends. And popes. And misguided attempts at fame through cartographic systems that flip statisticians the bird. But most relevantly the trends thing. Unfortunately the past can only tell us so much about the future; trust me, I'm an archaeologist. This week we look at margins and swings, the apparently ubiquitous means of determining how safe – or not – a seat is. There is nothing wrong with this methodology, assuming it is used only when appropriate and that its shortcomings are understood. All too often this is not the case.

Any truly marginal seat is marginal because it could go either way. It is, by nature, unpredictable. However there is no hard-line between safe and precarious. All seats exist on a continuum of knife-edgedness, some more knife-edgey than others. While looking at past trends is one way to measure this, margins use the percentage of the vote that gives the current incumbent an edge over the other candidates last election (or by-election). For example, a seat with a margin of 6% means the incumbent has 6% more of the votership's support than her (or his) nearest rival. In our system, candidates are slowly eliminated until there are only two left, so this is the same as a 47-53 split of the votes.

6% is actually not too shabby. By the standard measures in Australia anything less than 6% is “marginal” and anything up to (but not including) 10% is “fairly safe”. “Safe” covers 10% onwards and 20% upwards is “very safe”. So 6% is fairly safe, but only marginally fairly safe. In the early years some MPs were elected unopposed, which is technically a 100% margin and “very safe”, although it obviously says nothing meaningful about the outcomes if someone else were to run next time.

The idea behind this approach to knife-edgeiness is that certain demographics vote in certain ways. Urban seats typically hold more left-wing voters while rural seats generally lean to the right. As such, certain areas will have a base of dedicated voters who – short of a major scandal or other significant event – hold a strong allegiance to one party (or at least to one set of ideals) and will consistently vote accordingly, immune to all the campaigning. Some seats will have a small number of such voters, others will have many, possibly even being dominated by them. In some seats these “rusted on” supporters will be split rather evenly between parties, negating each other, and in others they will present as a significant head-start for one party or another.

To pick an example, a rural seat with a large block of firm right-wing voters will give more right-wing candidates a head start. If the general result of the campaign leads to the remaining “swinging” voters mostly voting right then the margin should be pretty substantial. If the campaign leans the other way the seat will be less safe for the right party or possibly even a marginal left seat. The margin will be small, though, and the predictable swing back will see the seat return to its former position. In other words, a seat with a lot of campaign-proof, right-wing voters will normally lie between being strong right-wing and weak left-wing seats over the years.

This becomes particularly relevant at the following election. If the seat is “safe” (i.e. its margin exceeds 10%), we can predict the seat is unlikely to change since the swing away from the incumbent would have to be equally substantial. (If an election leads to more people voting for a party than last time, there is said to be a swing to that party. This swing is measured again as a percentage of the voters, and can be measured for the nation as a whole or on a seat-by-seat basis.) In the above example a swing to the left would mean a marginal right seat becomes more marginal, possibly changing hands, or a marginal left seat becomes safer for the left-wing party. It would also make a dent in a safe right seat, but swings of over 10% are rare, so it would most likely remain as is.

Uh huh...


The upshot of all this is that each seat has a numerical value relating to its knife-edgeosity – its margin. And we all know what happens when someone gives me a numerical value for each seat...


The map above gives each seat a colour whose paleness is determined by its margin. The lighter the seat, the more marginal it is. And, as per tradition, red is Labor, blue is Coalition, green is Green and grey is the bottom drawer where we put everything else.

This is the normal way of assessing how safe a seat is. It assumes, however, that all seats are equally volatile. In reality, a seat that consistently supports a party with a margin of 5% is less tenuous than a seat that currently supports them by 8% but regularly has swings of 10% or more. The only way to judge seat volatility is through past voting trends, which I have previously discussed. Ideally a combination of trends and margins would be used (as I proposed in a previous conclusion here) however no-one seems to do this, and I cannot find the necessary data. Perhaps no one has done this because the data is so hard to obtain (though I strongly expect professional psephologists should be able to get their hands on it from some archive somewhere), or perhaps the data is so hard to obtain because no one bothers to do this kind of analysis.

Another error with this two-party preferred approach is that its focus is purely on the incumbent, and suggest all marginal seats are within reach of any party – or at least any major party – yet a marginal Coalition seat is not necessarily within the grasp of the ALP (and vice versa). The seat of O'Connor, for example, is marginal. It's margin is only 3.6 for the National party. However, that is a 3.6% lead over the Liberals. The ALP and other parties do not come close, so although the Nationals hold the seat by less than 4%, it is still a very safe Coalition seat.


This map assigns colour based on the proportion of the vote won by each party-group. Because I am not a huge fan of the two-party mentality, I've tried to represent the nightmare that is the multi-party division of votes. Here, red, blue and green are as before, but Independents and other minor parties are represented by white.

The more red a seat has, the more people there voted ALP. More blue means more Coalition voters. Higher green values relate to stronger support for the Greens. The most marginal seats will sit somewhere between these extremes, ranging from purple to yellow to aqua. Paler seats have a larger proportion of votes going to the 'others'.


If we ramp up the contrast as a rough rule of thumb, we see most seats turn either red or blue. Some with a higher Greens vote – mostly east-coast, inner metropolitan seats – turn black. The mainland independents' seats become white due to the high 'others' votes. But of particular interest are three inner-metropolitan seats near Sydney (Lindsey, Greenway and Watson) which are magenta. This indicates that the Labor-Coalition primary vote split is extremely close here. Lindsey and Greenway are among the numerous marginal seats of map 1, but Watson has a 9.1% margin – the safer end of the 'fairly safe' range. In fact, the primaries are split only by 180 votes – nothing in a seat with over 12,000 votes for 'other'. What this map highlights, that the first does not, is that this seat could change – with an apparently massive swing – entirely because of preferences (see below). The moral of this post, then, is to never rely on only one method for analysing data. Sometimes the ubiquitous standard of margins does not tell the whole story.

Discussion:


Obviously both maps have their advantages and disadvantages. The first is straight forward and easy to read, simplifying the entire concept (but I am sure it has some good points too...). Ignoring O'Connor, as noted above, it is easy to spot the most marginal seats (for example Corangamite, Denison and Macquarie, which stand out due to their size). These lighter-coloured seats can be hard to identify for one party-group or another so it is not immediately obvious, for example, that both major parties have three seats with margins under 1% and about half a dozen more under 2%. Beyond the spatial distribution of marginal and safe seats, this map really offers little that cannot be read from the raw data.

The second map shows who the margin is against and where other parties rank, once you get your head around the colour coding. O'Connor is no longer as marginal as the initial map suggested, although there are other ways of fixing this for Map 1.

The point is not to determine which map is better. Many professionals would say Map 1, and perhaps that is more useful in general. The point is that Map 1 is not the be-all-and-end-all of seat safety as determined by the previous distribution of votes. Multiple methodologies should be implemented as appropriate and in conjunction with each other.

Seeing as I have been politely humoured so far, I should probably begin to justify my use of three colours throughout my posts. Having vocally disapproved of the two-party preferred mentality, it may superficially appear that I have simply shifted to an equally erroneous three-party approach.

In practice, there are technical limitations to using more than three colours. In maps where more than one colour is used for an area – as in map two where green, red and blue overlap to varying degrees in each seat – it is problematic to use any other colours. Since red, green and blue are the primary colours for screen displays, every other colour can be made by combining these. Yellow, for example, could be used to represent a fourth party, but could also be the result of a red-green overlap. In Map 2 a marginal seat between the ALP and Greens would be indistinguishable from a safe yellow seat.

The choice of ALP, Coalition and Greens not only works well with the three available colours, but as they are the only parties with seats in the lower house, they are the obvious and most practical choices. I have, nonetheless, attempted to consistently represent the impacts of other minor parties and independents as white or grey as necessitated by the methodology. At times these limitations lead to ambiguity, and I do not know how to resolve this. In Map 2, seats won by independents naturally have a large 'others' component, although this could equally be divided among a great many 'others'. Regardless, 'others' is not a practical indicator. A safe seat for a left-wing, retiring independent is unlikely to be won by 'others' if the only other 'others' are right-wing independents or minor parties. For both of these reasons it is probably best to treat these seats as having a lot of potential voters with unknown allegiances – potentially volatile, especially where the incumbent is retiring or, contrary to the implications of the colour scheme, is not an 'other'.

This can occur because primary votes do not equate to actual seat wins. The Seat of Denison in Tasmania is a good example of this. Despite being held by an Independent, the Liberals had marginally more primary votes than the 'others' and the ALP had almost 9,000 votes more (which is equal to roughly 15% of the valid votes for that seat). In order to ensure every vote counts, there is a flow-on effect in our electoral system. In a seat with one right-wing party and five left-wing parties it is easy to see how a strong left-wing majority could be divided such that a right-wing party has the most votes. In our electoral system, the least-supported party is eliminated and the votes distributed by their second preference, so that in all probability a left-wing party will eventually triumph. This redistribution of votes in Denison was enough to give the incumbent a 1.2% margin over the ALP in the end. Thus a seat with a lot of 'other' votes could represent one strong candidate or many fragmented 'others' that have their votes redistributed among other parties.

This also causes issues in the more traditional first map. These two-party preferred margins are grossly modified by the redistribution of preferences. Many people may follow the provided 'how to vote' pamphlets each election, which means margins of one party over another could be entirely reversed by a third party's deals that sees second- or third-hand preferences switch allegiance. Watson, our surprise magenta seat, is a case in point. Further more, some 'others' running last election may not run this time, and visa versa. Thousands of former 'others' votes could switch their final allegiance even if the political climate did not change one iota. Watson could change hands, with a swing of almost 10% or more, purely because a minor political party has disbanded. The two-party preferred margins suddenly don't look as solid as they had.

Margins and swings are often used as the main (or even the only) model of how the nation stands before the election, and it is this that I object to. These issues I have mentioned above are not necessarily fatal to the pendulum models – margins are undoubtedly very useful – but should serve as a warning that other forms of analysis should be awarded equal consideration. Combined with trends, margins can offer a very good indication of each party's starting positions. With targeted polling, it is possible to extrapolate national trends and make decent predictions. But never rely on a single method – be it margins or anything else. As the seat of Watson illustrated, there is a lot more to consider than the simple continuum of the pendulum that you will no doubt see repeated often in the lead up to the election. And now that you have been forewarned of the common over-reliance on the pendulum, you can respond with a knowing smile.

Next week we will hopefully look at the upcoming WA state elections upon the eve of the ballot. After that we may do some analysis of the results and what they might imply federally, or divert onto another topic. The conclave might even have concluded by then, so who knows what topic – or topics – might come out in a tangled Gordian Knot of words and maps.

Data Dump

This is a supplement to the post above. This does not count towards my limit of one post per week, and should be read in conjunction with the post to which it refers.

All colours as per the corresponding map. Bon appetit!

Map 1:



Map 2: