LJ Idol Meta -- Voting Trends
Feb. 12th, 2009 03:41 pmLJ Idolists,
There has been some talk lately about suspicion that the polls are behaving strangely. Specifically, people dropping sharply in relation to others on the last day. I've been monitoring the poll data and making and analyzing charts, because thats what I do for fun ;D . There's actually an extremely simple explanation for exactly what is occuring, and lest more people become unnecessarily frustrated and angsty, I thought I'd elucidate the subject.
Before even looking at the data I hypothesized that on the last day people in the bottom six would frantically scramble to get above one another, sending the bottom and sixth-to-last position significantly up in votes. This is, in fact, what occurred.
28.9% of all votes were cast on the final 24 hours, so this allows for a great deal of movement. The bottomplace position jumped 25.7% between 10:00 EST and 1630 EST. During that same time period the sixth-to-last place jumped 21%, and fully 47% in the last 24 hours. To put this into perspective: the final position of sixth-to-last would have been 3rd place 24 hours previously.
What this means is you've gotta keep bringing in the votes or you are going to sink. More on that in a moment, but before that let me explain how the bottomplace people did that.
Method: But first let me explain briefly how I got my data. (feel free to skip this) I tried to cut paste the poll standings once an hour throughout the day. Cut pasting it into microsoft excel and then using sort functions pared this down to only about a minute of my effort each time, and I set up automatic calculations so based on cut pasting it it did the appropriate math and told me fun things like how many people voted total, since last iteration, where people moved in relation to one another, etc. I converted time into "Poll Hours", which, as you can probably guess, is how long the poll had been running at that point. It ran for 72 hours total, which is three 24 hour periods.
How to jump: So the question may occur to you, how did people scramble for votes and succeed? The answer is simply that asking your friends list for votes (or, yes, just posting the link in your lj with "there's a poll up" works just as well) does work. From my data this looks to be a solidly proven fact.
Most people post their link very shortly after the voting opens, which obscures the effect, but where I have identified people that have done it at later times, their jump in the standings has been dramatic and immediate.
HOWEVER, because this is an "artificial" injection of votes not related to the general trend of voting, persons who do this will see their position in the polls gradually go down as they are overtaken by people who either post later, or are simply doing better than them without friends list help.
Case Studies:
Idolist A posted a link to the polls at Hour 44 and immediately shot up 10 votes in the next hour, from 36 to 46, bringing him/her from 32nd place to 24th. They eventually made 18th place before "only" gaining six votes of the last day's flurry and tanking down to the five way tie for 24th place which was just above elimination.
Idolist B posted about the polls some time Sunday morning, and shot from 36 votes at my last check Sat night (Hour 31.5) to 47 votes by Hour 39.1 (which means they got 34% of all votes cast during that time, since only 32 votes were cast overnight). That brought them from 26th place to 15th. They'd hit their highest position of 14th a few hours later, and stay around there for the remainder. The last day they got 10 votes, which seems to be what it took to hold position, ending at 16th.
One more example of a later-in-the-polls posting of link and then I'll do someone who posted immediately and just went down from there (D below). So feel free to skip C if it looks too much like B. I'm just including it because its me. (=
Idolist C is myself. I also posted a link later on in the cycle. There's pros and cons for doing this: Pro: you can see how you were doing without it, how much it effects things; Con: because people expect everyone to be following a trend by then they get freaked out and think you're being sheisty if you shoot up in the polls the second day. Its no different than the boost people get when they do so the first hour, its just more visible.
Anyway, the flip side to all this is that these "artificial" injections of votes effect everyone else. As noted if you do it in the beginning you'll see yourself slide in the end. Conversely, not doing it at first, I was "artificially" low at the start. I went from last at Hour 0.33, fourth-from-last at Hour 1, sixth-from-last at hour 1.33.... (frankly I think its also more satisfying to watch the polls in a manner in which you're constantly risign against everyone else rather than putting yourself at an unteniable position in the beginning and watching with dread as you steadily sink). By saturday morning I was pleased to find I had drifted overnight up to ninth-from-last. However, knowing from previous polls that the bottom of the chart would go completely haywire towards the end, I wanted to give myself some safety, and hey, everyone else is doing it right?
At Hour 20.5 I posted the invitation for my friends-list to visit the polls, read and vote. By Hour 22 I had 10 more votes (38), pulling me from 26th (ninth-to-last) to 14 place. I would hit my high water mark of 11th place at Hours 25-27, and then slowly drift downwards again (again the usual effect after affect of your "summon friends list" spell has worn off) to 16th place Sunday night. I would be fortunate enough to get 12 votes the last day and relatively hold my place (17th place down to 20th).
Idolist D posted the link to the polls minutes after the polls went up, and thus started out in 3rd at my first reading at Hour 0.33. Long story short (and I note this entry is getting pretty dang long), they followed an extremely steady rate of decline from there on out, ending up in 14th by Sunday night. They were then shocked to find the rug pulled out of them when they only got three new votes out of the 142 people who voted in the last 10 hours and plummeted to 24th place.
The explanation, of course, is that just as people posting in the first minutes got an "artificial" boost of votes, and those who did so in the middle did, so did those people in or near the elimination zone who posted or re-posted asking their friends list to go vote on the last day. This caused a major amount of change the last day, and if you didn't get votes from around 7% of those people (ie ten votes) you were going to lose position substantially in the polls.
The good news is that they did NOT merely vote for their friends. Myself and six of eight people I was tracking relatively held position (all without calling in the friends list during or near this time).
alexpgp even gained ground, rising from third to first, and reassuring us that all is right in the world because his entry was excellent and clearly people voting the last day still took the time to vote for it (he gained 18 votes Monday).
Conclusions
So what does all this mean? It means first and foremost you should NOT be shocked when the polls change radically in the last 24 hours, that is to be expected. You should also EXPECT to be at your highest within 2 to 5 hours after making an entry linking to the polls and go down steadily from there thereafter.
It also means that yes, friends-lists matter, and "pimping" (as it apparently has come to be called by many) works.
Some might say this validates their "this is a popularity contest!" wails. I would say yes and no. Yes friends-lists matter, but people still vote for entries that truly deserve it and I notice my own friends list lets me know when my entry sucks by turning out in much lower numbers (I think acid rain was a perfectly good thing to write about hrmph! ;D ). And on any account, in my personal opinion, friends-lists should matter. This is LJ-Idol, and, as I've said "not just a writing contest" (and got jumped all over for and I'm sure will again). What that means to me is that, for example, friends lists are an aspect of LJ. And what makes you popular on LJ anyway? Its not that these "popular" people are the hottest (god knows I'm not) or have cool cars or something -- they have the most people that like to read their entries on a regular basis. They've gotten where they are through writing. So the relative impact of their friends list is kind of the aggregate bonus of months or years of good blogging and being a good citizen of the blogosphere.
I went and read the info for one of the LJ Idol spinoffs (::dodges Gary's shoe::) and decided not to have anything to do with it specifically because it WAS "only" a writing contest. Writing doesn't exist in a vacuum. I want to write where I have to worry about the demographic reading it (my friends-list I'm pretty sure is a totally different demographic than LJ Idol, so I have to carefully balance interest to both1) (and for example, the demographic of people voting in the last 24 hours seems to have had distinct tastes. Given entries by people they presumably didn't know they were much more apt to vote for some entries than others).
All that said, I do think the effect can and SHOULD be mitigated by frequent community only or contestant only (and the burden on Gary of doing that should be much less now that there's fewer of us) votes.
...
And while I'm on a soapbox, I agree with the sentiment expressed by a few others that there should be no more immunities and byes at this point. In the unlikely situation that I am given such a thing I pledge not to use it, and when placed on the jury I look forward to voting "none of the above" each time.
1 Specifically, the demographic of my friends list has signed on for my usual fare of impersonal entries filled with facts, discourse on history, and observations or essays about general things. The Idol demographic seems to really favour personal introspective entries which is something I almost never write. So I'm constantly challenged to make something historical or factual seem "personal" enough for the Idol crowd. This challenge is the real world and I love it.
no subject
Date: 2009-02-13 12:25 am (UTC)You are missing the fact that non-contestants also promote their friends (vote for X over here), and players promote in communities. Both are harder to track; both can have a much larger impact on the contestant's standing than posting a vote request in their own journal.
no subject
Date: 2009-02-13 12:32 am (UTC)no subject
Date: 2009-02-13 12:41 am (UTC)Since I do not know (exactly) who your case studies are, I can not tell you which ones I have confirmed used other resources... but so far as I am aware there are no methods of self-promotion that are "against the rules."
Gary would have to confirm that, of course.
(no subject)
From:(no subject)
From:(no subject)
From:/hijack
From:Re: /hijack
From:Re: /hijack
From:Re: /hijack
From:Re: /hijack
From:Re: /hijack
From:Re: /hijack
From:Re: /hijack
From:no subject
Date: 2009-02-13 01:01 am (UTC)So I think it is fair to say her "profile" is probably higher than many other contestants, as she has a readership base from a larger pool of places. It probably also helps that she is eloquent and more often than not writes exceptional entries.
(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:no subject
Date: 2009-02-14 06:03 pm (UTC)(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:Data
From:no subject
Date: 2009-02-13 12:33 am (UTC)There is always the risk of people thinking I am doing something shady, and last season I was on the other side of that coin almost being eliminated and then being eliminated when voting changed dramatically overnight. At first i thought something unfair was going on, but it's just people searching for votes and then some people on the other side of the world helping them out.
I agree with the various types of voting being needed, and i would assume at some point soon we will have a community only vote again.
I do not agree on the immunities though. I think ljidol is "part writing contest, part reality show, and part popularity contest" and I enjoy the craziness of throwing out immunities and other such things.
The other thing the immunity does is help people who have strong entries but who don't have the friends list or community support to stay in the game. It gives them another week to get more people to read their entries.
no subject
Date: 2009-02-13 12:40 am (UTC)No you weren't one of examples, but I can easily go back and recreate your data because whenever I took the data I cut pasted the poll standings into a notepad document. And recreating a track for someone is just a matter of [search] [name] cut/past to excel (x50), and voila your data is mapped out. (=
(no subject)
From:(no subject)
From:(no subject)
From:no subject
Date: 2009-02-13 01:02 am (UTC)I usually post a link as soon as I can, and see how that pans out. If I feel like I'm slipping a bit more than I'd want, I ask other people (basically friends-of-friends) to consider me.
no subject
Date: 2009-02-13 01:40 am (UTC)At some point you need a friend list to survive. But, for the most part, we're all in the same boat on that. Unless you have 400 more friends than anyone else or your friends are particularly loyal, chances are that nobody is getting a significant amount of extra votes from their list. And if your entry is good, you can go a long time without outside help. I don't know how much you've been asking...I've heard you haven't done it much and I've heard the opposite...but I went until 2 weeks ago without ever asking for a vote. monkeysugarmama still hasn't, I believe.
Immunities have always been part of the game, and while you can point out the personal biases of having someone's sister and someone else's neighbor making the call, the truth is, if it's anything like last season, they won't save anyone. I got immunity from the jury and finished in 3rd or something. It almost always ends up going to one of the people who finish high anyway. But it does neutralize people who are running away with vote totals a bit.
Your italicized part could not be more true. I think it's the gender thing. Also, the fact that most of the people write that stuff and are likely to vote for people who are like them.
depending on which spinoff you're mentioning, all the things they say "don't happen" do happen there. how do you keep someone from revealing their identity or not asking for support for a public entry when they can use filters to do so? there is no way.
I think Gary says in the FAQ specifically "this is not just a writing contest," so nobody should really complain about that.
no subject
Date: 2009-02-13 01:46 am (UTC)Call it foolish, but when I no longer get enough votes to stay, I'm ready to go. I don't want a magic wand to tap me on the head and carry me safely to the next round.
(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:no subject
Date: 2009-02-13 01:57 am (UTC)I went until I think it was three weeks ago without ever linking back to the poll. Since then I've done it once each time.. last day the first time because I found myself one of those panicked people in the elimination zone on game day, and around noon on Saturday the two times since I believe. I like noon on Saturday.
Yeah I'd imagine the immunities would probably go for someone who doesn't need it anyway. Either way I'm boycotting it in principal. I also intentionally didn't use my bye.
At to "the italicized part," I think its a selection effect -- people who like to write and join writing contests tend to like to write about things like that. And thats also what steered me away from the other Idol (it was LJBrenIdol or something weird like that) -- without even looking at the writing I made a wild assumption that based on the way it presented itself it was probably going to be full of people who liked to write things that hinged on personal introspection and personal experience.
(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:no subject
Date: 2009-02-13 01:43 am (UTC)It's a bit like a game of musical chairs. While people are running around rustling up votes, and their entry itself is garnering votes as readers get to them, you'll see a lot of sweeping upsets across the board. For the average contestatn, it's just a matter of who's on top when the poll closes.
no subject
Date: 2009-02-13 01:50 am (UTC)a 60 vote swing between 3 and 8 am put me out last season. (an "i fucking hate him" vote).
(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:Blogosphere Calibration for Moral Compasses
From:Re: Blogosphere Calibration for Moral Compasses
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:You Will Never See A More Wretchen Den of Scum and Villiany
From:Re: You Will Never See A More Wretchen Den of Scum and Villiany
From:Re: You Will Never See A More Wretchen Den of Scum and Villiany
From:Re: You Will Never See A More Wretchen Den of Scum and Villiany
From:Re: You Will Never See A More Wretchen Den of Scum and Villiany
From:Re: You Will Never See A More Wretchen Den of Scum and Villiany
From:Re: You Will Never See A More Wretchen Den of Scum and Villiany
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:no subject
Date: 2009-02-13 02:02 am (UTC)Yeah I'm very intrigued by the fact that the people who voted the last day, who I'm assuming were largely swept in from the people in low positions' friends-lists, seemed to do a good job of voting for people they didnt' know and seemed to as a group be unimpressed with entries that had done pretty well with "other groups" (those voting at other times) of voters.
(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:(no subject)
From:no subject
Date: 2009-02-13 04:25 am (UTC)this post is friends only, and since you open it as a letter to ljidolists, you might want to make it public, just a thought.
no subject
Date: 2009-02-13 04:32 am (UTC)no subject
Date: 2009-02-13 05:01 am (UTC)I was also really interested in people's comments to this post. My friend's list is comparatively not huge, though I certainly think it's awesome. :) I've been surprised to learn how few of my real life friends are actually reading my posts - which may be a comment on how much I talk, rather than a comment on my writing. I can't tell yet. I will also admit that I've been surprised by the number of real life friends on my LJ who tell me that haven't voted. I honestly figured that most of the reason I've done as well as I've done has been due to their support. Bastards, the lot of 'em, leaving me out to dry. (I still think my flist is what has carried me through a lot of the contest, though. I confess that much, too.)
I've kind of given up on figuring out what sorts of posts draw votes - and I can't really focus on LJI dramaz at the moment, because real life dramaz is too much of a priority, but I share interest in watching to see how the top vote getters fare as the end draws near. Often, I am mystified why the top vote getters are so popular, and equally mystified at how some of the bottom vote getters are in the bottom. Generally, though, I'm not surprised to see who is being eliminated. (I suspect this will change in the last weeks.)
Personally, I don't change my votes once I make them. That would seem like slimy politics to me and I've got little patience for that anyway. I vote for the entries I like, try and pimp the entries I really like, and then let the chips fall where they may.
Writing/marketing/popularity - it's all part of the game and I knew that signing up. I didn't add a lot of people when the game first started, because I didn't know them. Over the season, I've made several new friends, and I'm pleased to have done so, but I kind of agree with
Anyway, it's late, and I have to prepare to go to work for the last time tomorrow, so I should go sleep. Really interesting post, though. :)
no subject
Date: 2009-02-13 05:16 am (UTC)Thanks again for your interest. (=
no subject
Date: 2009-02-13 12:36 pm (UTC)For example, in my last week I was dead last Friday night. I received over 30 votes after I posted my voting reminder. I jumped to 7th from last. But, by Monday night I was 3rd from last again.
Theno
no subject
Date: 2009-02-13 02:52 pm (UTC)no subject
Date: 2009-02-13 01:17 pm (UTC)I do last minute voting these days because I don't like being on the internet over the weekend if I don't have to be.
Earlier in the competition, I'd wait until the polls were up a while to vote so I could give the entries I was iffy about another chance to gel with me before I went through the list.
I don't vote for friends unless I like their entries. Hell, 3/4 of the people I vote for don't even know I'm around.
no subject
Date: 2009-02-13 02:59 pm (UTC)no subject
Date: 2009-02-13 07:57 pm (UTC)I thought the statement about the XXX people who were just voting for 1 person was interesting. I wish somewhere between 2K and 2 million people voted. Then it would be so much more fair I think (fair representation of a large array of tastes and such).
no subject
Date: 2009-02-14 08:18 pm (UTC)I guess my experience so far has shown that, while friends list can be a huge factor, they are clearly not the only factor. Otherwise, I would have been playing the home game since sometime in November or December, I think!
no subject
Date: 2009-02-14 08:25 pm (UTC)I believe, if I am not mistaken, you were on one of my first rec lists. I know that you were one of the very first new-to-competing-writers that I added to my regular reading list.
(no subject)
From: