If you've already added the action to the sequences, you can open the Sequences view, select the action, and then add REMOVE="ALL" (remember property names are case-sensitive) in the Condition field on the right.
Or, in the Custom Actions view, select the custom action, then fill in the appropriate Install UI Condition or Install Exec Condition field, depending on where you've scheduled the action.