Hey everyone, just added Bedrock and Vertex support to FlexInference. It now can do provider fallback on 429 and 5xx. Plus there is upstream retries you can setup via SDK.
Source: [Hacker News](https://www.flexinference.com)
📰 Read Full Story
This is an aggregated headline summary. For the complete report, visit the original publisher.
Continue Reading at Hacker News ↗