Adam Fields

responding to When Information Overwhelms Facts

This report is also laughably lacking in actual data. There aren’t any numbers about how many laptops were brought in from each brand, and whether that does actually represent a statistically significant number relative to the total number sold (picking 1000 out of a hat as that target is meaningless). They don’t differentiate between different kinds of malfunctions, or even different model lines within the same manufacturer. If HP has a particular model that fails a lot, that would completely skew these numbers, and not say anything at all about whether you should buy one of the hundred other models they make.

I’m ashamed of anyone who would report this as meaningful.

GadgetGav

responding to When Information Overwhelms Facts

Absolutely..! Well said.

The via-via-via linking & blind re-reporting of tech web sites is getting out of control. These bloggers just post stuff without reading it or offering any real analysis. I guess that’s what you get when you pay per post and the site makes money per page view. Much better to have an attention grabbing headline than an informative article. It’s especially helpful to the business model if it is something controversial: “Apple reliability worse than Asus!” or “Apple reliability better than HP”. The more a story gets spread around, the more fractions of a cent the site makes.

Something needs to change if blogging is going to be taken seriously as a form of journalism. This one was particularly bad in my opinion because of the number of ‘serious’ sites, like Ars who jumped in with both feet into the territory usually reserved for the likes of Gizmodo.

Tonio Loewald

responding to When Information Overwhelms Facts

I’m not sure the results published are quite as worthless as you imply. First of all, the “linear projection” is only for accidental damage, not reliability issues, for which they appear to have solid figures. Since accidental damage is usually not covered by extended warranties, they aren’t really incented to lie here, and I would guess that a linear projection would underestimate the real figures since people are more careless with old stuff.

Second, their graph implies that their data are continuous (accumulated failure rate over time — look at the lines, they are squiggly).

The real problem — as you point out — is that we have are that there are no error bars (which would probably render the differences between the first four contenders “statistically insignificant”). But this doesn’t make the information worthless. Even if I have only two values — x = 10 and y = 5, the odds are higher that x is bigger than y than the reverse, I just don’t know by how much.

Laptop failure rates of 20-30% over three years certainly seem pretty accurate based on my experience (and that’s how Ars Technica looked at it), so the “value for money” equation for extended warranties pretty much comes down to 0.15 x purchase cost (since your laptop has about a 15% chance of failing due to reliability issues after its standard warranty expires).

Adam Fields

responding to When Information Overwhelms Facts

Also, I don’t understand why the 3-year failure rates are projections. They’ve been doing this for more than 3 years - don’t they have actual numbers for that?

Engin Kurutepe

responding to When Information Overwhelms Facts

I have to agree with the previous commenter, Tonio Loewald, here. While you are right that the report lacks in scientific rigor, I think this is a little beside the point here since this is not a scientific publication and they are not making any unexpected claims. It seems to be a case of stating the obvious.

Your assumption that their projection is based on two data points might be wrong. They should have data on when the failures occur based on their customer claims. At any rate the curves are not straight and seem to be the cumulative distribution of failures over time. In any case I am willing to give them the benefit of doubt, because otherwise this wouldn’t be empty marketing drivel but outright tampering with data.

Rus

responding to When Information Overwhelms Facts

SquareTrade is very accustom to conflicts if interest - they were formed initially to dispute eBay feedback where one had to PAY to get a comment removed.

Matt Nolker

responding to When Information Overwhelms Facts

Excellent points about the SquareTrade study. That said, I would disagree with your lede: namely, “This situation illustrates what is wrong with a large swath of online reporting.” Online journalists have considerable company in their lack of numeracy. Having spent some time at a large daily paper, I can assure you that it’s also endemic among journalists who still spread ink on dead trees. It would be interesting to see if you could track down some actual data indicating that online journalists have a higher rate of… error? credulity? than their print brethren.

John Corbin

responding to When Information Overwhelms Facts

Sounds exactly like the statistics used by Congress to promote so-called health reform. Useless statistics are worse than lies, forgery and bribery: People might actually buy statistics.

room34

responding to When Information Overwhelms Facts

Excellent post! I had a vague sense of misgiving when I read the article on laptop failure rates the other day on Ars Technica, but in passing I couldn’t quite put my finger on why it seemed… well, just WRONG.

It bears repeating that you can draw ANY curve through two points, essentially using the feeble data to “prove” whatever you want it to. And, if anything, the conflict of interest is even MORE disturbing.

It’s probably too much to hope that being called out like this will lead news sites to be more careful before posting such drivel in the future, but at least maybe this will help make readers more attentive and think to question what they’re being told.

Paul M. Watson

responding to When Information Overwhelms Facts

How effective is the echo chamber in a second wave of correction? Disseminating this article would seem a good thing to do but is the damage done and is the echo chamber unable to correct previous waves?