I fixed a recurring data ingestion bottleneck by working with a vendor to introduce date-partitioned exports and reduce unnecessary file discovery.
Source: [HackerNoon](https://hackernoon.com/how-i-fixed-a-data-ingestion-bottleneck-with-date-partitioning?source=rss)