Maybe I'm showing my age a bit, but I recall hearing that images should be saved in formats based on their type to save on file size. So, photographs would be JPEGs, illustrations and icons would be PNGs, vector images would be SVGs, etc. But now it feels like no-one does this anymore.
Source: [Hacker News](https://news.ycombinator.com/item?id=49595998)