APBRmetrics Forum Index APBRmetrics
The statistical revolution will not be televised.
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Usage vs. Efficiency
Goto page Previous  1, 2, 3, 4  Next
 
Post new topic   Reply to topic    APBRmetrics Forum Index -> General discussion
View previous topic :: View next topic  
Author Message
Mike G



Joined: 14 Jan 2005
Posts: 3293
Location: Delphi, Indiana

PostPosted: Tue Aug 30, 2005 8:46 am    Post subject: Reply with quote

WizardsKev wrote:
... we ought not be getting stuck on digging for examples that prove our point, but instead should be looking for broader evidence. Is this efficieny/usage theory accurate, or is it another theory destined for the conventional wisdom bone yard?


How about: There aren't any examples that "prove these points"? Guys usually get more minutes because they are playing better. They take more shots because they are shooting better.

Even players who are apparently thrust suddenly into greater roles as shooters (injury to a star, moving to an expansion team) are competing with teammates for the playing time and shots. Whoever rises to the occasion gets the job.

Bob's sim can 'force' players to take more shots, but doesn't assume anything about their efficiency changing as a result. As in our 'fantasy' thread, we read that some 'leagues' are dominated by 'coaches' who force their best players to play maximum minutes. They, too, aren't adversely affected by minutes.

You can't prove that players shoot better without blindfolds, in actual NBA games. Blindfolds aren't coming along just to disprove the conventional wisdom.

Whether it's a blindfold or a hand in the face, being forced to shoot (by your coach, your teammates, the shotclock, ...) isn't going to improve your shooting.
Back to top
View user's profile Send private message Send e-mail
kjb



Joined: 03 Jan 2005
Posts: 842
Location: Washington, DC

PostPosted: Tue Aug 30, 2005 9:39 am    Post subject: Reply with quote

I understand the limitation of Bob's simulation -- if it is indeed a limitation. I think Bob is right to avoid instituting a "penalty" to efficiency as usage increases absent evidence of an average effect. We can all go back through the record and find examples of guys who increase or decrease efficiency as usage changes, but what's the "normal" effect of a usage change? And how can we predict which guys will maintain (or increase) efficiency as they increase usage and which guys will drop? For example, if we could use statistical data to reliably predict that Hoiberg cannot maintain efficiency at 13 shots per 36 minutes, but that Brent Barry can -- that'd be very valuable information.

It may be that ultimately this is something that exists, but cannot be proven using stats because of how the game is played -- i.e. a guy plays more because he's playing better, a guy shoots less because he's shooting worse. But, I think we could all go through the record and identify players who didn't get playing time despite stats that demonstrate they should be playing, or guys who continue shooting despite consistently poor results.

I personally like Dean's philosophy -- accept the conventional wisdom as valid until we can demonstrate that it's wrong. Most of the coaches I've talked with seem to accept that efficiency tends to decline as usage increases. I haven't discussed these issues specifically -- I'm making an inference from other comments.

One area where I disagree with Bob is that coaches can't influence usage. I think that would surprise a lot of coaches. With some players, that's surely true -- they're going to do what they're going to do regardless. But, well, I'd like to see some evidence to support that claim. Smile
Back to top
View user's profile Send private message AIM Address Yahoo Messenger
bchaikin



Joined: 27 Jan 2005
Posts: 654
Location: cleveland, ohio

PostPosted: Tue Aug 30, 2005 12:12 pm    Post subject: Reply with quote

One area where I disagree with Bob is that coaches can't influence usage.

it's not that they can't influence it, it's just that they do not define it for each player - touches/min are a function of a player's ability. for example if a coach switches a player from full time SG to full time PG (reggie theus, dennis johnson, sleepy floyd, allen iverson), the vast majority of the time that player's touches/min will increase, and increase significantly. by that coaching decision he has indeed influenced a player's usage. but not all players can be switched to PG and increase their touches/min significantly (jerome james, mark blount) and i doubt very much an SG is switched to PG with the thought that it would increase or decrease the other players touches/min by specific amounts...

or by a coach making the conscious decision to replace a low touches/min starter with a high touches/min starter (or vice versa), that too will affect the touches/min of the other starters, so in that way he has influenced usage...

but the specific example used where i stated touches/min is not defined by coaches was why can't you replace amare stoudemire with steven hunter and expect to have hunter score like stoudemire or handle the ball as often as him. hunter has for 4 seasons demonstrated a consistent touches/min of around 0.50, stoudemire has gone from 0.7 to 0.9 to 1.0 in 3 seasons. touches/min is a function of a player's ability or desire to get open, to get the ball, to do something with the ball (shoot, pass, get fouled, or turn it over) and for whatever reasons stoudamire has shown the ability to increase his while hunter has not...

am i saying hunter will never increase his touches/min? no. but historically speaking most players who have demonstrated a low touches/min like 0.50 for 4 straight seasons have not increased that significantly later on in their careers. if his new frontcourt teammates also have low touches/min, odds are his will increase. if not, odds are it will stay close to the same...
Back to top
View user's profile Send private message Send e-mail Visit poster's website
bchaikin



Joined: 27 Jan 2005
Posts: 654
Location: cleveland, ohio

PostPosted: Tue Aug 30, 2005 12:17 pm    Post subject: Reply with quote

And ignoring your simulator for a moment, do you really truly believe that Minnesota would only win 3 less games with Reggie Evans playing Garnett's minutes if 24 minutes of Sprewell were replaced by Hoiberg?

do you really truly believe your player defensive ratings that were posted at 82games.com? do you really truly believe you understand the nba salary cap and all of its ramifications?....
Back to top
View user's profile Send private message Send e-mail Visit poster's website
Dan Rosenbaum



Joined: 03 Jan 2005
Posts: 540
Location: Greensboro, North Carolina

PostPosted: Tue Aug 30, 2005 12:25 pm    Post subject: Reply with quote

bchaikin wrote:
do you really truly believe your player defensive ratings that were posted at 82games.com? do you really truly believe you understand the nba salary cap and all of its ramifications?....

I do not believe that Ben Gordon is one of the best defensive shooting guards, despite the fact that my rating system says that he is. My priors were too strong to move all the way to that position. But I do now believe that he might not be a bad defender, so my results are influencing my beliefs about Gordon.

And I KNOW that I do not understand all of the ramifications of the NBA salary cap. Just a couple weeks ago, I was talking with a general manager and he taught me something about the salary cap. And this is a guy who I am sure thinks of me as much more of an expert on the salary cap than he is.

My undeerstanding of the NBA is fluid and changes quite often when I come across new evidence or when folks point me to errors in my thinking. I am not infallible and neither are the statistical models that I use. At the end of the day those models are just a guide. Nothing more, nothing less. They certainly aren't gospel.
Back to top
View user's profile Send private message Send e-mail Visit poster's website Yahoo Messenger
NickS



Joined: 30 Dec 2004
Posts: 384

PostPosted: Tue Aug 30, 2005 12:44 pm    Post subject: Reply with quote

WizardsKev wrote:
I think the study discussed here is a good start. As a stat analysis community, we ought to be going back to the stats to see what they show. And, (in my opinion) we ought not be getting stuck on digging for examples that prove our point, but instead should be looking for broader evidence. Is this efficieny/usage theory accurate, or is it another theory destined for the conventional wisdom bone yard?


You're correct that we would like to find answers in the stats (and I think Bob is right to press this point as well). The problem is that we don't have a good idea of what questions to ask or how to interpret the answers.

The point of my last couple of posts was to try to address the question of how we read the data. Because the data is so limited and so difficult to abstract away from its context (e.g., that ever team is trying to win based on some combination of the players' natural tendencies and the coach's ideas about each players ability) it's difficult to be able to "listen" for what it has to say.

I know that Dan has proposed his research paper and I'm very curious to see what comes out of that. I think that as a community it's valuable to discuss what sorts of data "count" and how we can use it.
Back to top
View user's profile Send private message
Ben F.



Joined: 07 Mar 2005
Posts: 390
Location: MD

PostPosted: Tue Aug 30, 2005 5:24 pm    Post subject: Reply with quote

Here's a question on the flipside of the argument - rather than a Fred Hoiberg leading a team, what about a star being forced to a smaller role?

I heard today that Nick Van Exel is going to the Spurs. Now Van Exel has never been a particularly efficient player, but apparently they're planning on bringing him in to play the role Beno Udrih played during the playoffs last year (essentially a backup guard to spell Tony Parker). They also like his three point shooting. "We wanted him in our program," Buford said. "We think he'll be a great complement to the team we have" (Source).

Now, the question - will Van Exel increase his efficiency in a reduced role? If he's allowed to pick his spots, allowed to feed off the defense keying on Manu and Duncan, will he be more efficient?
Back to top
View user's profile Send private message
kbche



Joined: 19 Jul 2005
Posts: 51
Location: washington d.c.

PostPosted: Tue Aug 30, 2005 9:03 pm    Post subject: engine efficiency Reply with quote

Hi,

The term efficiency originally applied to an engine. By definition engine efficiency(%) is the actual/theoretical*100. Engine efficiency will increase with usage until a plateau is reached, then efficiency will decrease. This same phenomenon can be applied to basketball. What coaches need to assess is the plateau for each player. This plateau may be based on the position played, the type of shot taken, physical condition, opposing opponents, etc.

KAB
Back to top
View user's profile Send private message Send e-mail
kjb



Joined: 03 Jan 2005
Posts: 842
Location: Washington, DC

PostPosted: Wed Aug 31, 2005 7:52 am    Post subject: Reply with quote

bchaikin wrote:
One area where I disagree with Bob is that coaches can't influence usage.

it's not that they can't influence it, it's just that they do not define it for each player - touches/min are a function of a player's ability. for example if a coach switches a player from full time SG to full time PG (reggie theus, dennis johnson, sleepy floyd, allen iverson), the vast majority of the time that player's touches/min will increase, and increase significantly. by that coaching decision he has indeed influenced a player's usage. but not all players can be switched to PG and increase their touches/min significantly (jerome james, mark blount) and i doubt very much an SG is switched to PG with the thought that it would increase or decrease the other players touches/min by specific amounts...

or by a coach making the conscious decision to replace a low touches/min starter with a high touches/min starter (or vice versa), that too will affect the touches/min of the other starters, so in that way he has influenced usage...

but the specific example used where i stated touches/min is not defined by coaches was why can't you replace amare stoudemire with steven hunter and expect to have hunter score like stoudemire or handle the ball as often as him. hunter has for 4 seasons demonstrated a consistent touches/min of around 0.50, stoudemire has gone from 0.7 to 0.9 to 1.0 in 3 seasons. touches/min is a function of a player's ability or desire to get open, to get the ball, to do something with the ball (shoot, pass, get fouled, or turn it over) and for whatever reasons stoudamire has shown the ability to increase his while hunter has not...

am i saying hunter will never increase his touches/min? no. but historically speaking most players who have demonstrated a low touches/min like 0.50 for 4 straight seasons have not increased that significantly later on in their careers. if his new frontcourt teammates also have low touches/min, odds are his will increase. if not, odds are it will stay close to the same...


Okay, I guess we agree then. Smile The way I understand what you're saying here is that coaches make usage decisions based upon the abilities of the players. Example -- no one's going to ask Michael Jordan to be a 3pt shooting specialist who gets 10 shots per 40 minutes because that'd be frigging nuts. Similarly, no coach will ever ask Michael Ruffin to take 30 shots a night -- he simply can't do it.

FFSBasketball wrote:
I heard today that Nick Van Exel is going to the Spurs. Now Van Exel has never been a particularly efficient player, but apparently they're planning on bringing him in to play the role Beno Udrih played during the playoffs last year (essentially a backup guard to spell Tony Parker). They also like his three point shooting. "We wanted him in our program," Buford said. "We think he'll be a great complement to the team we have" (Source).

Now, the question - will Van Exel increase his efficiency in a reduced role? If he's allowed to pick his spots, allowed to feed off the defense keying on Manu and Duncan, will he be more efficient?


Van Exel's best offensive rating on b-r is a 118 from 1997-98 -- it was the 2nd lowest usage season of his career. This year, he was another possession per 40 minutes lower, though I vaguely recall he was injured a lot this season. http://www.basketball-reference.com/players/v/vanexni01.html That was for a Lakers team with Shaq, Kobe (off the bench), Eddie Jones, etc. that went 61-21. My guess is that Popovich & Co. have a plan for how they'll use him. What I wonder is whether Van Exel's usage will actually drop with the Spurs. If they bring him off the bench, it may be as a main offensive weapon, and his per minute usage could remain relatively constant with his career norms.
Back to top
View user's profile Send private message AIM Address Yahoo Messenger
bchaikin



Joined: 27 Jan 2005
Posts: 654
Location: cleveland, ohio

PostPosted: Wed Aug 31, 2005 5:19 pm    Post subject: Reply with quote

this is not a simulation but just one example from real life of how players touches/min can increase significantly (more than one on the same team) and maintain efficiency not so much because the players have improved on their own but because of the acquisition of a new teammate or teammates whose combination of touches/min and how often they shoot and pass end up modifying the touches/min of their other teammates....

here are the denver nuggets of 95-96 and 96-97 (i only listed players that played 500+ minutes):

95-96 (W-L 35-47)
min - player
2713 dikembe mutombo (0.59)
2280 antonio mcdyess (0.72)
2626 dale ellis (0.75)
2810 bryant stith (0.96)
2029 abdul-rauf (1.63)
1107 don maclean (1.15)
1045 tom hammond (0.52)
1269 laphonso ellis (0.82)
817 reggie williams (0.90)
2134 jalen rose (1.76)
607 doug overton (1.37)

96-97 (W-L 21-61)
min - player
2599 ervin johnson (0.43)
2565 antonio mcdyess (0.89)
2002 laphonso ellis (1.06)
1788 bryant stith (0.93)
2001 mark jackson (2.17)
1758 tom hammond (0.57)
2940 dale ellis (0.84)
1047 brooks thompson (1.47)
654 kenny smith (1.35)
612 anthony goldwire (1.55)
600 ricky pierce (0.92)

and here are the differences in their touches/min for a few of them:

l.ellis (0.82-1.06) +23%
mcdyess (0.72-0.89) +19%
d.ellis (0.75-0.84) +11%
stith (0.96-0.93) -3%

mutombo was replaced at C by ervin johnson and johnson got less touches/min, so that meant a few more touches for other players. the combination of abdul-rauf (chris jackson) and jalen rose at PG being replaced with mark jackson and other low minute PGs was significant because despite rauf and rose both having high touches/min jackson passed ball more per touch than did either of those two players. as a matter of fact jackson passed the ball per touch probably as much as any PG ever (as much as stockton anyway)...

jackson left the team before the next season. laphonso ellis never handled the ball as much as he did this season with jackson either earlier or later in his career. dale ellis had handled the ball more often earlier in his career, but his touches/min with jackson was his highest in 5 seasons (he was 35 years old in 96-97). 96-97 was just mcdyess' 2nd season in the league, and although his touches/min did decrease the next season without jackson it did increase later in his career to greater than what it was with jackson....

in this case the touches/min of players on the same team did not increase because of the acquisition of another player with low touches/min, but because of the acquisition of a player who passed the ball with a very high proportion of his touches...
Back to top
View user's profile Send private message Send e-mail Visit poster's website
HoopStudies



Joined: 30 Dec 2004
Posts: 696
Location: Near Philadelphia, PA

PostPosted: Fri Sep 02, 2005 2:16 pm    Post subject: Reply with quote

bchaikin wrote:

bottom line - do you have any evidence whatsoever showing that players as a whole or even in general experience a decrease in some aspect of player performance with an increase in touches/min or your usage possessions?...


Let me ask whether a specific piece of evidence would be enough. It's not proprietary and it's easy, but in case there is problem with it, I don't want to waste time doing it.

1. Get 2005 boxscore individual offensive ratings and usage percentages for all players who played at least 10 minutes in a game.

2. For each player, subtract off their average offensive rating and average usage. That way, we're looking at individual differences from their norm, which is what we're interested in. A day of 114 ORtg and 0.21 usage for Abdur-Rahim comes out as +1 and -0.01 (fitting my theory), whereas those same #s come out as +17 and +0.05 for Jerome James (not fitting my theory).

3. Regress marginal offensive rating against marginal usage percentage. Look for statistical significance and a negative (inverse) relationship.

This is primitive, but more complex regressions where I've definitely seen the relationship start getting at things I don't want to give away.

But if that shows a negative relationship, will people believe it? Or will they just go on trying to find exceptions? Because of course you can find cases where the relationship isn't as strong. This regression only gets at a league-wide slope, not at skill curves.

If this inverse relationship holds, if it is significant at 95%, will anyone care? Bob? Anyone? Want to add something? Fix something?
_________________
Dean Oliver
Author, Basketball on Paper
The postings are my own & don't necess represent positions, strategies or opinions of employers.
Back to top
View user's profile Send private message Visit poster's website
NickS



Joined: 30 Dec 2004
Posts: 384

PostPosted: Fri Sep 02, 2005 2:30 pm    Post subject: Reply with quote

HoopStudies wrote:

If this inverse relationship holds, if it is significant at 95%, will anyone care? Bob? Anyone? Want to add something? Fix something?


I'm very interested in this sort of data and I suspect most people on this board would be.

I wonder if it would be worth adding a term to reflect the difference between the defensive rating of the oposing team and the leage average.

(actually, thinking it through, we don't need this, it will all average out in the end -- we just need to weight each observation by minutes played. So if someone playes out of their mind for 20 minutes that's only half the value of someone else playing below average for 40 minutes).

Will it convince anyone? It depends on what the results show. I doubt anyone will make up their mind based solely on a study like this, but it would be valuable to have some statistical evidence to discuss.
Back to top
View user's profile Send private message
bchaikin



Joined: 27 Jan 2005
Posts: 654
Location: cleveland, ohio

PostPosted: Fri Sep 02, 2005 3:46 pm    Post subject: Reply with quote

If this inverse relationship holds, if it is significant at 95%, will anyone care?

it would be significant information even if it wasn't significant at 95%...

what i had tried to do years ago but never got very far on was to compare players per game averages for a season to their season bests (most) in a single game for things like MIN, FGA, REBs, AST, ST, TO, PTS, etc, to see if any relationship existed between what was "average" for players and what was maximum for players. i could then come up with "...well the average player takes only 33% more FGA in the single game where they do take their most FGA versus their avg game, 40% more REB in their max game versus their avg game..." etc. i also wanted do to this for their career per game averages and career bests in certain stats in a single game...

the problem was when doing this years ago i couldn't get season bests for all players nor career bests for all players in a single game. but i thought this would have been a place to start. what i had found at one time was that the maximum number of FGA a player took in a single game in a season was on average just 33% more than their average FGA/g for that season (without regard to the variance). however i don't know if this still holds, and i never finished doing this for other stat categories...
Back to top
View user's profile Send private message Send e-mail Visit poster's website
HoopStudies



Joined: 30 Dec 2004
Posts: 696
Location: Near Philadelphia, PA

PostPosted: Fri Sep 02, 2005 4:28 pm    Post subject: Reply with quote

bchaikin wrote:
If this inverse relationship holds, if it is significant at 95%, will anyone care?

it would be significant information even if it wasn't significant at 95%...



OK. I can run this.

Following the procedure I laid out above and getting the usage percentage average based on weighted average by minutes played (though it doesn't matter really as long as the individual averages are approximate), I find the following:

- An inverse relationship shows up between individual offensive rating and percentage of possessions used.
- For every increase of 1% in usage, offensive rating drops by about 0.6 over all the players.
- This coefficient is significant at well over 99%. There is roughly a 1 in 10 to the power of 38 that it's mere luck. According to my old quantum phys professor, that would be roughly the odds of banging your head against the wall and none of the molecules in your head actually hitting any of the molecules in the wall, thus avoiding pain.
- The regression has an r2 of 0.01, a case of low fit to the data being actually a meaningful result. If I were to re-add in the player averages, the r2 goes up to about 0.1.
- If you run the regression on different segments of the data -- high use games or low use games, you get essentially the same results.
- If you run the regression on players averaging high or low use, you see that the low use players (I used 18% as a cut off) are more sensitive to increases than high use players (23%). But both are still very significant. This implies that increasing Hoiberg's possessions 5% causes a bigger decline (about twice the size) than a similar increase in, say, Kevin Garnett. Or, from an optimization perspective, taking Garnett's possessions (who increases in efficiency only a little) and giving them to Hoiberg (who declines in efficiency a lot) has a pretty big cost in even this crude analysis.

This is much cruder than several of the studies I've done, but it generally reproduces the observations I've had in other proprietary studies as well as what I showed in Basketball on Paper. Clearly there is a lot of noise in this kind of analysis, which is why Bob can find examples where things just look to fluctuate around some average. But fluctuating around some average is always a zeroth order assumption. Using this elementary principle not only improves predictions but fits with a very reasonable model of the game of basketball.

What shooting percent do you use, Bob, to make projections for the coming year for, say, Allen Iverson? His career average? Last year's value? Some running average over a few years? Something more sophisticated? Because we know that the value you choose matters in your simulation and guys definitely fluctuate.
_________________
Dean Oliver
Author, Basketball on Paper
The postings are my own & don't necess represent positions, strategies or opinions of employers.
Back to top
View user's profile Send private message Visit poster's website
NickS



Joined: 30 Dec 2004
Posts: 384

PostPosted: Fri Sep 02, 2005 4:35 pm    Post subject: Reply with quote

HoopStudies wrote:
- An inverse relationship shows up between individual offensive rating and percentage of possessions used.
- For every increase of 1% in usage, offensive rating drops by about 0.6 over all the players.
[...]
- If you run the regression on players averaging high or low use, you see that the low use players (I used 18% as a cut off) are more sensitive to increases than high use players (23%). But both are still very significant. This implies that increasing Hoiberg's possessions 5% causes a bigger decline (about twice the size) than a similar increase in, say, Kevin Garnett.


Thanks for running this. Very interesting. I was expecting that there would be a correlation, but I'm slightly surprised it's that large.

Does this mean that you're back from your vacation?
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic   Reply to topic    APBRmetrics Forum Index -> General discussion All times are GMT - 5 Hours
Goto page Previous  1, 2, 3, 4  Next
Page 3 of 4

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB © 2001, 2005 phpBB Group