Accessing OpenAI GPT models on Amazon Bedrock with global cross-Region inference in Thailand, Malaysia, Singapore, Indonesia, and Taiwan

Key points

• Single-Region inference can throttle when demand exceeds local capacity.1
• GPT-6 Sol, GPT-6 Luna, and GPT-6 Astra are all available through global cross-Region inference from the preceding Regions, on the bedrock-runtime endpoint.1
• In this post, we introduce the global cross-Region inference profiles and invoke them from Asia Pacific (Singapore) using the Converse API, the OpenAI-compatible APIs, and coding clients.1
• Global cross-Region inference profiles for OpenAI GPT-61

Sources (1)

• [1]Accessing OpenAI GPT models on Amazon Bedrock with global cross-Region inference in Thailand, Malaysia, Singapore, Indonesia, and Taiwan
  AWS Machine Learning Blog · Oct 12, 05:52 PM

  Amazon Bedrock offers OpenAI GPT-6 Sol and GPT-6 Luna through global cross-Region inference from all five AWS Regions, and GPT-6 Astra from Asia Pacific (Singapore).

  Single-Region inference can throttle when demand exceeds local capacity.

Extractive summary: sentences quoted from the sources.