Monday, August 08, 2005

Dishonest coverage, or just sloppy?

"Canseco said that he injected Rafael Palmeiro with steroids. Palmeiro's performance improved the next year. That proves that Canseco was telling the truth!"

I've seen a lot of this sort of nonsense in the last week, people looking at Palmeiro's raw home run numbers and saying "AHA! This PROVES that Canseco's right!" Here's a typical example, from Skip Bayless at ESPN.com.
Remember, Canseco and Palmeiro were born in Cuba and played youth baseball together in Miami. They were reunited when Canseco was traded to Texas midway through the 1992 season. That season, Palmeiro hit 22 homers.

But from '93 through '03, Palmeiro's homers jumped to 37, 23 (in just 111 games), 39, 39, 38, 43, 47, 39, 47, 39, 47, 43 and 38. Coincidence? I think not.

Pretty damning evidence, huh?

But let's look at it a little bit differently. With some context. For which, we need a couple more pieces of information.
  1. Baseball hitters typically peak at around age 27, reaching basically full physical maturity. Some do it earlier, some later, but that's the average.

  2. Raw home run totals can be skewed by opportunity. We really need to look at HR/PA to determine whether there was some nefarious performance level change.

  3. League performance levels change, too. 20 home runs in 1966 is not the same 20 home runs in 1986 or 1996. Different ballparks, umpires, baseballs, bats - all of these things affect the ease with which HRs are hit.

So here are Palmeiro's rate stats, compared to the leagues in which he was playing:


Rafael Palmeiro HR Rates vs. League HR Rates
YearAgePAHRPalmeiroLeaguePalmeiro Rate/League HR Rate

1986217830.0380.0221.771

198722244140.0570.0262.211

19882362980.0130.0190.686

19892463280.0130.020.635

199025651140.0220.0211.033

199126714260.0360.0221.628

199227701220.0310.021.534

199328686370.0540.0242.277

199429498230.0460.0281.626

199530624390.0630.0272.275

199631732390.0530.0311.74

199732692380.0550.0281.945

199833709430.0610.0282.128

199934674470.070.032.326

200035678390.0580.031.895

200136714470.0660.0292.286

200237663430.0650.0282.28

200338654380.0580.0292.027

200439651230.0350.031.192


Then let's look at it graphically.



Jose Canseco joined the Texas Rangers towards the end of the 1992 season, Palmeiro's 4th season in Texas. During the previous two seasons, Palmeiro's HR rate vs. the league's had taken two large jumps. It drifted down slightly in 1992, then jumped again in 1993, the year which is presumably, according to the storyline, the first "dirty" season for Palmeiro. When we look at the chart, 1993, the age 28 season, does show a big improvement for Palmeiro. That's the increase that people are pointing at and yelling "proof!"

But is it? While there was a big jump in his rate during 1993, it was his age 28 season. It's not unusual for players to have a peak season at age 28. And it was a jump to a rate that he's already demonstrated over 244 plate appearances at age 22. And, furthermore, it was a jump that was relatively smaller than the jumps he'd made in the two seasons before Canseco arrived.

Then, in 1994, his home run rate dropped back to about where it have been in 1991, at age 26. If it was meeting Jose Canseco and getting "juiced" that was responsible for Palmeiro's 1993 performance increase, you'd expect it to have continued, or even improved in 1994. But that's not what happened. While the rates of home runs throughout the Major leagues were increasing from 1993 to 1994, Palmeiro's dropped.

Of course, he wasn't playing with Jose anymore. Maybe it just took him a year to find a supplier in Baltimore, because his numbers went up again in 1995. Then, in 1996, they fell. Then, in 1997, they rose, and in 1998 rose further, not quite back to where they were in 1987, when he was 22, several years before he played with Jose Canseco.

So, is the "spikyness" of his home run rate chart the result of taking and stopping steroids? Or is it the normal kind of random performance variation that you could expect from anyone? And is that jump in 1993 something out of the ordinary, or something that happens to anyone?

Let's look at a few other players for comparison's sake.



There are a couple of things that jump out here.

  1. Palmeiro's peak home run rate, compared to the league, was not as high as any of the others.

  2. The up-and-down of league-normalized home run rates is visible for all 6 hitters. Palmeiro's chart doesn't look any more suspicious than the others.

  3. The 1993 theoretical "Canseco effect" isn't the biggest relative increase on Palmeiro's chart, and several of the others showed increases as big or bigger. Palmeiro's age 28 increase pales in comparison to Yastrzemski's age 29 and Schmidt's age 27, and is smaller than Aaron's age 37 season, just to pick a few.

  4. Palmeiro did have more seasons close to his peak than several of the other hitters. This could be a steroid effect, and it could also be the ramifications of never having that one "great" season.


In other words, it's simple and easy for someone like a Skip Bayless to look at the raw home run numbers and say "Look - Palmeiro's home runs went up when he started playing with Canseco! That PROVES that Palmeiro's dirty!" In reality, it "proves" no such thing. Players numbers bounce up and down, randomly, throughout their careers. There's no sudden spike to a previously unheard of performance level for Palmeiro.

None of this means, of course, that he's not "guilty," that he hasn't used steroids. I didn't believe him in March, I don't believe him now. But the numbers that people are pointing to are not only not proof, they barely qualify as evidence. And it's sloppy and dishonest to trot 'em out the way that people are trotting 'em out...

|

0 Comments:

Post a Comment

Comment?

<< Home