Just click on the stop button and the alarm will stop and be turned off.
The alarm can be set again by clicking on the “Alarm Set” button again in Utility Belt.