Each JButton is going to store a list (or an array, or a collection, or, nevertheless, it is implemented) of links to its listeners, unaware of listening to other buttons. When an event occurs, the button calls its listeners. Thus, many listeners for other buttons will not slow down the call of listeners. Thus, there is no slowdown here.
, , - . .
. - -, , .
:
. , . .