Intellij 2017.2
You can disable / deselect the Show in Run Dashboardconfiguration parameter in the dialog box " Run/Debug Configurations", which is accessed through " Run > Edit Configurations.
To do the same in Intellij 2017.3 take a look at this answer .
To do the same in Intellij 2018.3 take a look at this answer