Well, to put this thing at rest, I created a test application to run several scripts and get a visualization of the results. Here's how the tests run:
- Several different sizes of collection were tested: one hundred, one thousand and one hundred thousand records.
- The keys used are instances of the class that are uniquely identified by an identifier. Each test uses unique keys with the addition of integers in the form of identifiers. The
equals method uses only an identifier, so no key mapping overwrites another. - The keys receive a hash code, which consists of the remainder of the module from their identifier to some preset number. We will call this number a hash limit. This allowed me to control the number of hash collisions that were expected. For example, if our collection size is 100, we will have keys with identifiers from 0 to 99. If the hash limit is 100, each key will have a unique hash code. If the hash limit is 50, key 0 will have the same hash code as key 50, 1 will have the same hash code as 51. In other words, the expected number of hash collisions per key is the collection size divided by on the hash limit.
- For each combination of collection size and hash limit, I run a test using hash cards initialized with different settings. These parameters are the load factor and initial power, which is expressed as the collection tuning factor. For example, a test with a collection size of 100 and an initial capacity factor of 1.25 initializes a hash map with an initial capacity of 125.
- The value for each key is just a new
Object . - Each test result is encapsulated in an instance of the Result class. At the end of all tests, the results are ranked from worst overall performance to best.
- The average time for puts and gets is calculated at 10 puts / gets.
- All test combinations are run once to eliminate the impact of JIT compilation. After that, tests are performed for actual results.
Here's the class:
package hashmaptest; import java.io.IOException; import java.util.ArrayList; import java.util.Collections; import java.util.HashMap; import java.util.List; public class HashMapTest { private static final List<Result> results = new ArrayList<Result>(); public static void main(String[] args) throws IOException { //First entry of each array is the sample collection size, subsequent entries //are the hash limits final int[][] sampleSizesAndHashLimits = new int[][] { {100, 50, 90, 100}, {1000, 500, 900, 990, 1000}, {100000, 10000, 90000, 99000, 100000} }; final double[] initialCapacityFactors = new double[] {0.5, 0.75, 1.0, 1.25, 1.5, 2.0}; final float[] loadFactors = new float[] {0.5f, 0.75f, 1.0f, 1.25f}; //Doing a warmup run to eliminate JIT influence for(int[] sizeAndLimits : sampleSizesAndHashLimits) { int size = sizeAndLimits[0]; for(int i = 1; i < sizeAndLimits.length; ++i) { int limit = sizeAndLimits[i]; for(double initCapacityFactor : initialCapacityFactors) { for(float loadFactor : loadFactors) { runTest(limit, size, initCapacityFactor, loadFactor); } } } } results.clear(); //Now for the real thing... for(int[] sizeAndLimits : sampleSizesAndHashLimits) { int size = sizeAndLimits[0]; for(int i = 1; i < sizeAndLimits.length; ++i) { int limit = sizeAndLimits[i]; for(double initCapacityFactor : initialCapacityFactors) { for(float loadFactor : loadFactors) { runTest(limit, size, initCapacityFactor, loadFactor); } } } } Collections.sort(results); for(final Result result : results) { result.printSummary(); } // ResultVisualizer.visualizeResults(results); } private static void runTest(final int hashLimit, final int sampleSize, final double initCapacityFactor, final float loadFactor) { final int initialCapacity = (int)(sampleSize * initCapacityFactor); System.out.println("Running test for a sample collection of size " + sampleSize + ", an initial capacity of " + initialCapacity + ", a load factor of " + loadFactor + " and keys with a hash code limited to " + hashLimit); System.out.println("===================="); double hashOverload = (((double)sampleSize/hashLimit) - 1.0) * 100.0; System.out.println("Hash code overload: " + hashOverload + "%"); //Generating our sample key collection. final List<Key> keys = generateSamples(hashLimit, sampleSize); //Generating our value collection final List<Object> values = generateValues(sampleSize); final HashMap<Key, Object> map = new HashMap<Key, Object>(initialCapacity, loadFactor); final long startPut = System.nanoTime(); for(int i = 0; i < sampleSize; ++i) { map.put(keys.get(i), values.get(i)); } final long endPut = System.nanoTime(); final long putTime = endPut - startPut; final long averagePutTime = putTime/(sampleSize/10); System.out.println("Time to map all keys to their values: " + putTime + " ns"); System.out.println("Average put time per 10 entries: " + averagePutTime + " ns"); final long startGet = System.nanoTime(); for(int i = 0; i < sampleSize; ++i) { map.get(keys.get(i)); } final long endGet = System.nanoTime(); final long getTime = endGet - startGet; final long averageGetTime = getTime/(sampleSize/10); System.out.println("Time to get the value for every key: " + getTime + " ns"); System.out.println("Average get time per 10 entries: " + averageGetTime + " ns"); System.out.println(""); final Result result = new Result(sampleSize, initialCapacity, loadFactor, hashOverload, averagePutTime, averageGetTime, hashLimit); results.add(result); //Haha, what kind of noob explicitly calls for garbage collection? System.gc(); try { Thread.sleep(200); } catch(final InterruptedException e) {} } private static List<Key> generateSamples(final int hashLimit, final int sampleSize) { final ArrayList<Key> result = new ArrayList<Key>(sampleSize); for(int i = 0; i < sampleSize; ++i) { result.add(new Key(i, hashLimit)); } return result; } private static List<Object> generateValues(final int sampleSize) { final ArrayList<Object> result = new ArrayList<Object>(sampleSize); for(int i = 0; i < sampleSize; ++i) { result.add(new Object()); } return result; } private static class Key { private final int hashCode; private final int id; Key(final int id, final int hashLimit) { //Equals implies same hashCode if limit is the same //Same hashCode doesn't necessarily implies equals this.id = id; this.hashCode = id % hashLimit; } @Override public int hashCode() { return hashCode; } @Override public boolean equals(final Object o) { return ((Key)o).id == this.id; } } static class Result implements Comparable<Result> { final int sampleSize; final int initialCapacity; final float loadFactor; final double hashOverloadPercentage; final long averagePutTime; final long averageGetTime; final int hashLimit; Result(final int sampleSize, final int initialCapacity, final float loadFactor, final double hashOverloadPercentage, final long averagePutTime, final long averageGetTime, final int hashLimit) { this.sampleSize = sampleSize; this.initialCapacity = initialCapacity; this.loadFactor = loadFactor; this.hashOverloadPercentage = hashOverloadPercentage; this.averagePutTime = averagePutTime; this.averageGetTime = averageGetTime; this.hashLimit = hashLimit; } @Override public int compareTo(final Result o) { final long putDiff = o.averagePutTime - this.averagePutTime; final long getDiff = o.averageGetTime - this.averageGetTime; return (int)(putDiff + getDiff); } void printSummary() { System.out.println("" + averagePutTime + " ns per 10 puts, " + averageGetTime + " ns per 10 gets, for a load factor of " + loadFactor + ", initial capacity of " + initialCapacity + " for " + sampleSize + " mappings and " + hashOverloadPercentage + "% hash code overload."); } } }
Running this may take some time. Results are printed as standard. You may have noticed that I commented on the line. This line invokes a visualizer that outputs visual representations of the results to png files. The class for this is given below. If you want to run it, uncomment the corresponding line in the above code. Be careful: the visualizer class assumes that you are running Windows and creating folders and files in C: \ temp. When working on a different platform, adjust this.
package hashmaptest; import hashmaptest.HashMapTest.Result; import java.awt.Color; import java.awt.Graphics2D; import java.awt.image.BufferedImage; import java.io.File; import java.io.IOException; import java.text.DecimalFormat; import java.text.NumberFormat; import java.util.ArrayList; import java.util.Collections; import java.util.HashMap; import java.util.HashSet; import java.util.List; import java.util.Map; import java.util.Set; import javax.imageio.ImageIO; public class ResultVisualizer { private static final Map<Integer, Map<Integer, Set<Result>>> sampleSizeToHashLimit = new HashMap<Integer, Map<Integer, Set<Result>>>(); private static final DecimalFormat df = new DecimalFormat("0.00"); static void visualizeResults(final List<Result> results) throws IOException { final File tempFolder = new File("C:\\temp"); final File baseFolder = makeFolder(tempFolder, "hashmap_tests"); long bestPutTime = -1L; long worstPutTime = 0L; long bestGetTime = -1L; long worstGetTime = 0L; for(final Result result : results) { final Integer sampleSize = result.sampleSize; final Integer hashLimit = result.hashLimit; final long putTime = result.averagePutTime; final long getTime = result.averageGetTime; if(bestPutTime == -1L || putTime < bestPutTime) bestPutTime = putTime; if(bestGetTime <= -1.0f || getTime < bestGetTime) bestGetTime = getTime; if(putTime > worstPutTime) worstPutTime = putTime; if(getTime > worstGetTime) worstGetTime = getTime; Map<Integer, Set<Result>> hashLimitToResults = sampleSizeToHashLimit.get(sampleSize); if(hashLimitToResults == null) { hashLimitToResults = new HashMap<Integer, Set<Result>>(); sampleSizeToHashLimit.put(sampleSize, hashLimitToResults); } Set<Result> resultSet = hashLimitToResults.get(hashLimit); if(resultSet == null) { resultSet = new HashSet<Result>(); hashLimitToResults.put(hashLimit, resultSet); } resultSet.add(result); } System.out.println("Best average put time: " + bestPutTime + " ns"); System.out.println("Best average get time: " + bestGetTime + " ns"); System.out.println("Worst average put time: " + worstPutTime + " ns"); System.out.println("Worst average get time: " + worstGetTime + " ns"); for(final Integer sampleSize : sampleSizeToHashLimit.keySet()) { final File sizeFolder = makeFolder(baseFolder, "sample_size_" + sampleSize); final Map<Integer, Set<Result>> hashLimitToResults = sampleSizeToHashLimit.get(sampleSize); for(final Integer hashLimit : hashLimitToResults.keySet()) { final File limitFolder = makeFolder(sizeFolder, "hash_limit_" + hashLimit); final Set<Result> resultSet = hashLimitToResults.get(hashLimit); final Set<Float> loadFactorSet = new HashSet<Float>(); final Set<Integer> initialCapacitySet = new HashSet<Integer>(); for(final Result result : resultSet) { loadFactorSet.add(result.loadFactor); initialCapacitySet.add(result.initialCapacity); } final List<Float> loadFactors = new ArrayList<Float>(loadFactorSet); final List<Integer> initialCapacities = new ArrayList<Integer>(initialCapacitySet); Collections.sort(loadFactors); Collections.sort(initialCapacities); final BufferedImage putImage = renderMap(resultSet, loadFactors, initialCapacities, worstPutTime, bestPutTime, false); final BufferedImage getImage = renderMap(resultSet, loadFactors, initialCapacities, worstGetTime, bestGetTime, true); final String putFileName = "size_" + sampleSize + "_hlimit_" + hashLimit + "_puts.png"; final String getFileName = "size_" + sampleSize + "_hlimit_" + hashLimit + "_gets.png"; writeImage(putImage, limitFolder, putFileName); writeImage(getImage, limitFolder, getFileName); } } } private static File makeFolder(final File parent, final String folder) throws IOException { final File child = new File(parent, folder); if(!child.exists()) child.mkdir(); return child; } private static BufferedImage renderMap(final Set<Result> results, final List<Float> loadFactors, final List<Integer> initialCapacities, final float worst, final float best, final boolean get) {
The visualized output is as follows:
- Tests are divided first by the size of the collection, then by the hash limit.
- For each test, there is an output image relative to the average start time (for 10 stats) and the average receive time (10 gets). Images are two-dimensional "heat maps" that show color for a combination of initial capacity and load factor.
- The colors in the images are based on average time on a normalized scale from best to worst, from saturated green to saturated red. In other words, the best time will be completely green, and the worst time will be completely red. Two different dimensions of time should never have the same color.
- Color maps are calculated separately for puts and gets, but cover all tests for the corresponding categories.
- Visualizations show the initial capacitance along the x axis and the load factor along the y axis.
Without further ado, take a look at the results. I will start with the results for puts.
Put the results
Collection size: 100. Hash limit: 50. This means that every hash code must appear twice, and every other key collides in the hash map.

Well, it does not start very well. We see that there is a large access point for the initial capacity 25% higher than the collection size with a load factor of 1. The lower left corner does not work too well.
Collection size: 100. Hash limit: 90. One out of ten keys has a repeating hash code.

This is a slightly more realistic scenario, lacking a perfect hash function, but still 10% overload. The hot spot is gone, but the combination of low initial capacity with a low load factor obviously does not work.
Collection size: 100. Hash limit: 100. Each key is its own unique hash code. No collisions are expected if there are enough buckets.

An initial capacity of 100 with a load factor of 1 seems fine. Surprisingly, a higher initial capacity with a lower load factor is not always good.
Collection size: 1000. Hash limit: 500. Here it is becoming more serious, with 1000 entries. As in the first test, there is a hash overload from 2 to 1.

The bottom left is still bad. But there seems to be a symmetry between the combined lower initial count / high load ratio and the higher initial count / low load ratio.
Collection size: 1000. Hash limit: 900. This means that one out of ten hash codes will be repeated twice. Intelligent collision scenario.

There, something very funny happens with an unlikely combination of initial power that is too small with a load factor above 1, which is rather inconsistent. Otherwise, it is still pretty symmetrical.
Collection size: 1000. Hash limit: 990. Some collisions, but only a few. In this respect, it is quite realistic.

We have a pretty symmetry. The lower left corner is still not optimal, but the load factor of 1000 power units / 1.0 and the load factor of 1250 / 0.75 load are at the same level.
Collection size: 1000. Hash limit: 1000. There are no duplicate hash codes, but now with a sample size of 1000.

Nothing to say here. The combination of a higher initial capacity with a load factor of 0.75 seems to be slightly superior to the combination of 1000 initial powers with a load factor of 1.
Collection Size: 100_000. Hash Limit: 10_000. Well, now this is getting serious, with a sample size of one hundred thousand and 100 hash codes for each key.

Hop! I think we found our lower range. The initialization capacity of exactly the size of the collection with a load factor of 1 does very well here, but not like in the whole store.
Collection Size: 100_000. Hash limit: 90_000. A little more realistic than the previous test, here we have a 10% overload in hash codes.

The bottom left corner is still undesirable. Higher starting capacities work best.
Collection Size: 100_000. Hash Limit: 99_000. Good script, this. Large collection with 1% hash overload.

Using the exact size of the collection as an init capacity with a load factor of 1 wins here! However, slightly larger initialization capabilities work pretty well.
Collection Size: 100_000. Hash limit: 100_000. Big one. The largest collection with perfect hash function.

Some amazing things here. Initial capacity with 50% additional room with a load factor of 1 victory.
Good thing this is for puts. Now we will check everything. Remember that the cards below are for the best / worst pickup times; start times are no longer taken into account.
Get Results
Collection size: 100. Hash limit: 50. This means that every hash code should appear twice, and every other key should have collided on the hash map.
<T411>
Eh ... What?
Collection size: 100. Hash limit: 90. One out of ten keys has a repeating hash code.

Hey Nelly! This is the most likely scenario that correlates with the survey question, and apparently the initial capacity of 100 with a load factor of 1 is one of the worst things here! I swear I did not fake it.
Collection size: 100. Hash limit: 100. Each key is its own unique hash code. No collisions are expected.

It looks a little calmer. Basically the same results in all directions.
Collection size: 1000. Hash limit: 500. As in the first test, there is a hash overload from 2 to 1, but now with a lot more entries.

It seems that any setting will bring a decent result.
Collection size: 1000. Hash limit: 900. This means that one out of ten hash codes will be repeated twice. Intelligent collision scenario.

And just like using puts for this setting, we get an anomaly in a strange place.
Collection size: 1000. Hash limit: 990. Some collisions, but only a few. In this respect, it is quite realistic.

Decent performance everywhere except for a combination of high initial capacity with a low load factor. I would expect this for puts, as one would expect resizing of two hash cards. But why to receive?
Collection size: 1000. Hash limit: 1000. There are no duplicate hash codes, but now with a sample size of 1000.

Absolutely unpredictable visualization. This seems to work no matter what.
Collection Size: 100_000. Hash Limit: 10_000. Going to 100K again, with a lot of hash code is blocked.

It does not look beautiful, although bad spots are very localized. The performance here, apparently, largely depends on a certain synergy between the settings.
Collection Size: 100_000. Hash limit: 90_000. A little more realistic than the previous test, here we have a 10% overload in hash codes.

Large dispersion, although if you squint, you will see an arrow pointing to the upper right corner.
Collection Size: 100_000. Hash Limit: 99_000. Good script, this. Large collection with 1% hash overload.

Very chaotic. It is hard to find a lot of structure here.
Collection Size: 100_000. Hash limit: 100_000. Big one. The largest collection with perfect hash function.

Does anyone think this is starting to look like Atari graphics? This, apparently, contributes to the initial capacity of the size of the collection, -25% or + 50%.
Well, it's time to draw conclusions ...
- Regarding runtime: you want to avoid initial capacities that are lower than the expected number of entries in the map. If the exact number is known in advance, this number or something a little higher seems to work best. Higher load factors can compensate for lower initial powers due to an earlier hash map change. For higher initial capacities, they do not seem to be so important.
- As for getting time: the results here are a bit chaotic. There is nothing to conclude. It seems like he relies heavily on the subtle relationships between hash overlap, initial capacity, and load factor, with some supposedly bad settings working well, and good settings working terribly.
- I'm apparently full of crap when it comes to assumptions about Java performance. In truth, if you don't configure your settings for the
HashMap implementation, the results will be everywhere. , , 16 , , , , - , . - . 10 1179 5105 . 10 547 3484 . 6 , . , , , .
, . , - , , . , , Java, , . , , , O (n ^ 3).