If I understand correctly, as soon as you delete the virtual machine, it will delete the service, but save a copy of the VHD image under Disks. Therefore, go to the Disks tab in the virtual machine and try to delete it.
If this is not the case, add a screenshot with the error message where you are trying to remove the virtual machine.
Abhishekanand
source share