There are many open-source projects across inference, orchestration, observability, vector search, data pipelines, evaluation, and model management. Most are relatively easy to test, but production operation is a different problem. For those running open-source AI infrastructure in production: ...
Source: [Hacker News](https://news.ycombinator.com/item?id=49163280)