There is a settings in the settings tab named "Taxing Options". You can chose between taxing all products and taxing only "taxable" products