I wonder if it would be a simple thing to implement on Will's side. Maybe each time the avatar is updated a timestamp is added to the url: &ts=123456.7890 so that it will cache until it's changed again.
No, because then you need to track the timestamp in the db and append it to the image handler url with every request. Which also means third party apps can't easily access the pic based solely on userid. Well, they could but then they have to deal with the caching as well.
The proper fix is to remove the caching headers from the profile pic handler, which will be in the next release.