I noticed this too, Google seems to be using a different algorithm to display this image (in the left pane) on its website, and it is more accurate as in the front shot of the location.
There is no direct way to get this angle with your "Street View API", but you can use the javascript API to calculate this angle and pass it to the Image API.
The question is, how can we know what is in front of the building ?, well, the front is usually where the entrance is from the street. Thus, you can use the DirectionService to get the closest transportation start location, which is usually the road at the entrance to the building using this location, now you can easily calculate the header using geometry geometry methods and pass this to your image API.
manubkk
source share