Add the following to ~/.muttrc to keep a slow GnuPG from automatically starting, while allowing it to be used by typing `S' at the index menu.
~/.muttrc
macro index S ":toggle pgp_verify_sig\n" set pgp_verify_sig=no