8 – How to prevent image styles from being applied to certain image file formats?

I would like to allow uploading of SVG images to all the existing image fields. However I would not like the image styles to be applied for SVG images as it is mostly designed for raster images.

Is it possible for image styles to detect the format and avoid applying the styles to certain formats?