Every user or group in the Administrator list has permission to modify the ISM server configuration.
ism_rm -admin name@hostname
If you remove yourself as an administrative user, you can no longer administer the ISM server.