In addition to the undo button, please support Ctrl-Z or Cmd-Z to perform an undo. This is a widely adopted convention.