Just drag the FAQ from the 'active' list to the 'inactive' list in the faqtastic admin page.

Hidden FAQs are not deleted, they're just not displayed so you can show them only when you want to.