A company is designing a canary deployment strategy for a payment processing API. The system mustsupport automated gradual traffic shifting between multiple Amazon Bedrock models based on real-timeinference metrics, historical traffic patterns, and service health. The solution must be able to graduallyincrease traffic to new model versions. The system must increase traffic if metrics remain healthy anddecrease traffic if the performance degrades below acceptable thresholds.The company needs to comprehensively monitor inference latency and error rates during the deploymentphase. The company must also be able to halt deployments and revert to a previous model version without anymanual intervention.Which solution will meet these requirements?
A medical device company wants to feed reports of medical procedures that used the company’s devices intoan AI assistant. To protect patient privacy, the AI assistant must expose patient personally identifiableinformation (PII) only to surgeons. The AI assistant must redact PII for engineers. The AI assistant mustreference only medical reports that are less than 3 years old.The company stores reports in an Amazon S3 bucket as soon as each report is published. The company hasalready set up an Amazon Bedrock Knowledge Bases. The AI assistant uses Amazon Cognito to authenticateusers.Which solution will meet these requirements?
A financial services institution is building a proprietary 175-billion parameter Foundation Model (FM) to power a real-time fraud detection assistant. The project lifecycle involves two critical phases with distinct infrastructure requirements:Training Phase: The model must be pre-trained on petabytes of encrypted transaction logs. This requires synchronizing gradients across thousands of GPUs with minimal network latency to accelerate convergence.Deployment Phase: The fraud detection assistant must analyze transactions interactively with sub-millisecond latency. The traffic is highly variable, requiring the infrastructure to scale out automatically during market hours and scale in at night.Which combination of architectural strategies should the GenAI Developer implement to meet these requirements?
A financial services institution is building a proprietary 175-billion parameter Foundation Model (FM) to power a real-time fraud detection assistant. The project lifecycle involves two critical phases with distinct infrastructure requirements:Training Phase: The model must be pre-trained on petabytes of encrypted transaction logs. This requires synchronizing gradients across thousands of GPUs with minimal network latency to accelerate convergence.Deployment Phase: The fraud detection assistant must analyze transactions interactively with sub-millisecond latency. The traffic is highly variable, requiring the infrastructure to scale out automatically during market hours and scale in at night.Which combination of architectural strategies should the GenAI Developer implement to meet these requirements?
A company is developing a customer support application that uses Amazon Bedrock foundation models(FMs) to provide real-time AI assistance to the company’s employees. The application must display AIgenerated responses character by character as the responses are generated. The application needs to supportthousands of concurrent users with minimal latency. The responses typically take 15 to 45 seconds to finish.Which solution will meet these requirements?