The implementation of KeyStore depends on the type you are requesting, and for some types it also depends on the provider.
If you are talking about the "JKS" type, you can find a description of the format and algorithms used here.
In the JKS keystore, you cannot specify an encryption algorithm for private keys.
source share