Friday, April 3, 2009

Spring Training Evaluations

Warning: Evaluating players in spring training can be hazardous to your baseball well-being.

Back in the spring of 1997 I was just starting my first season as the advance scout for the Cleveland Indians. Excited to get to the ballpark every day to get some looks at the players I'd be writing about all summer, I didn't let even one day pass without taking copious notes. However, later in the spring Dan O'Dowd, then the Assistant GM of the Indians, told me, "The biggest mistakes we make on player evaluations are in spring training." Suddenly, my neatly designed notebook and game charts didn't elicit so much pride.

The regular season wasn't very old before I realized that Dan was exactly right, as players were doing things I hadn't seen even a glimpse of just a few weeks prior. The fact is that the game is fundamentally different in spring training than it is when the regular season opens. Here is a list, albeit not exhaustive, of the reasons that spring training performance is unreliable:
  • Sample size - always a killer
  • Ballparks - the ball jumps in Arizona almost like pre-humidor Coors Field
  • Game conditions - teams play primarily day games with a "high sky" in Arizona
  • Competition - Major Leaguers play early in games and minor leaguers in the late innings, so someone can pad their stats by playing in the late innings
  • Preparedness - some players are coming off of full winter ball seasons while others are coming off of surgery
  • Game plan - teams don't really try to win spring training games, so players aren't always put in the most advantageous situations
  • Varying objectives - some players are working on adding a new pitch, while others are trying to make a team

For all these reasons and more, spring training is a terrible time to evaluate personnel. Of course, that doesn't stop us from doing it, and by "us" I include fans, field staff, and front office. The fact of the matter is that we must make some evaluations in spring training, because we need to get our roster down to 25 players and some of the players under consideration haven't previously been with the organization. Perilous indeed.

When we (remember, I mean everyone) watch baseball games we are constantly processing who's good, who's bad, who could be better, etc. I'm not even sure that there is an "off" position for that switch, but we have to do everything we can to mute that voice if it appears in the month of March. Taking it one step further, if the player doesn't absolutely need to be evaluated for some irrevocable decision at the conclusion of March, then he probably shouldn't be.

Here's some OPS evidence from this spring for the Padres which should give all of us a little caution:

  • The team leader in OPS was Adrian Gonzalez with a 1.110 - so far so good
  • Coming in 2nd was Kevin Kouzmanoff with a 1.030 - not completely crazy
  • And next, coming in just under 1.000 - David Eckstein with a .996

Folks, if David Eckstein flirts with a 1.000 OPS this year, our offense will be better than we expect. Speaking of our overall offense:

  • Five of our 13 position players had an OPS over .900
  • Nine of our 13 position players had an OPS over .800
  • 11 of our 13 position players had an OPS over the 2008 NL average of .744

Yahtzee! Get ready for the run barrage in Petco in 2009.

With all of these guys raking, who was below the league average and came in last among the Padres in OPS for spring training? Brian Giles with a .636.

I could go into all the pitchers, but I think you get the point. Spring training is a fabulous time of year to enjoy baseball, just don't try to evaluate it. On Monday afternoon all the Padres players will have an OPS of zero and all of the pitchers will have 0.00 ERAs (let's hope the latter lasts longer than the former). Then we'll be able to start evaluating again.

10 comments:

Unknown said...

Paul,

Can you describe the decision making process that decides who's on the 25 man roster. What are the roles of the front office and coaches? What do you consider when making a decision regarding players (performance? Contract situation? Previous year performance? Intuition?)

Tom said...

"if David Eckstein flirts with a 1.000 OPS this year, our offense will be better than we expect."

Eckstein flirting with an 800 OPS would be a sign of the impending apocalypse. 1.000 means 3 of the 4 horsemen have already galloped onto the field of play.

gonzo23 said...

Paul,

Based on what you wrote in this post can you explain to me a couple of decisions that were made towards the end of spring training. One Josh Geer being sent to AAA in favor for Walter Silva, who you have only seen throw to ML hitters 3 times(while 2 of those times were not good results). And two, the release of lhp Justin Hampson. He had two seasons with the Padres, and in his time in sd had a era under 3. I realize that his st numbers were terrible but by what you said in your post it would seem you would go with the larger sample size(95ip in ML). Thanks for the blog, it's great!!!!

AvengingJM said...

It's good to see that the numbers are just about ready to reset to Zeeero...

I thought I was being optimistic by choosing the Padres to win close to 70 games...but 96!?!?

Unknown said...

Paul,

Were you seen as an outsider in the front office, scouts, etc. because you did not report directly to KT?

Hopefully now you get to play with boys in the sandbox.

Unknown said...

I'm pretty meh about spring training evaluations too. I mean, Aaron Rowand's going to put the spring (and the 2nd half of last season, when he was presumably injured) behind him and provide at least league-average production with the bat. Hopefully, anyway

Paul DePodesta said...

Itay,

All of the above... Front office and the coaching staff are involved, and both performance and contracts play a role. The main thing to remember is that the Opening Day roster is just that - a roster for Opening Day. It can change tomorrow.

Paul DePodesta said...

Ok, Tom, that's piling on.

Paul DePodesta said...

gonzo33,

Very fair questions. Sometimes we have to make decisions based on limited information. In Silva's case, if he didn't make the team then he was going back to Mexico. However, if we purchased Silva's contract, then we have both his and Geer's services available to us.

As for Hampson, he was caught up in the fact that we had needs in other roles in our pen that weren't solidified. Basically, if we had set 7th, 8th, and 9th inning guys than Justin would have been in a better position. Unfortunately for him, we still have a number of guys competing for those spots which pushed some other guys out of our pen.

Unknown said...

Hey DePo,

A's fan here. i read the A's and padres made a deal. Chad Reineke for JD Pruitt. any insight on this deal?