I am using my own subclass of UIImageView for something like this. It is mainly used for uploading images (for example, avatars and images on a Twitter stream), so NSURLConnection is used to download an image from a URL. URLConnection then calls the delegate method, which is then used to update the UIImageView. I added an additional later static dictionary with cached images, so the images that are used most often do not need to be loaded every time. This is very useful for things like the twitter avatars mentioned above.
I'm not sure if you are trying to download images from the Internet or locally, so this may not be entirely appropriate for your situation, but I hope this helps ...