API Key (Simple Setup)

Introduction

• AWS Bedrock: A comprehensive managed service delivering access to cutting-edge generative AI models (such as Anthropic Claude, Amazon Nova) via AWS infrastructure.
  Learn more about AWS Bedrock.
• Sypha: A Visual Studio Code extension functioning as an AI-powered development companion through AI model integration—enabling developers to produce code, troubleshoot issues, and perform data analysis.
• Developer Orientation: This documentation targets individual developers seeking simplified frontier model access via AWS Bedrock using API Keys.

---

Step 1: Configure Your AWS Infrastructure

1.1 Individual user configuration - Generate a Bedrock API Key

For comprehensive instructions consult the documentation.

1. Authenticate to AWS Management Console:
   AWS Console
2. Navigate to Bedrock Console:
   • Bedrock Console
   • Generate a new Long-Lived API Key. This API Key receives the AmazonBedrockLimitedAccess IAM policy by default View AmazonBedrockLimitedAccess Policy Details

1.2 Generate or Adjust the Policy

To enable Sypha's interaction with AWS Bedrock, your IAM user or role requires designated permissions. The AmazonBedrockLimitedAccess managed policy offers broad access, however for enhanced security following least-privilege principles, these minimal permissions suffice for Sypha's primary model invocation operations:

• bedrock:InvokeModel
• bedrock:InvokeModelWithResponseStream
• bedrock:CallWithBearerToken

You can construct a custom IAM policy containing these permissions and associate it with your IAM user or role.

1. Within the AWS IAM console, initiate new policy creation.
2. Employ the JSON editor to insert the following policy document:

   {
   	"Version": "2012-10-17",
   	"Statement": [
   		{
   			"Effect": "Allow",
   			"Action": ["bedrock:InvokeModel", "bedrock:InvokeModelWithResponseStream", "bedrock:CallWithBearerToken"],
   			"Resource": "*" // For enhanced security, scope this to specific model ARNs if possible.
   		}
   	]
   }

3. Assign a policy name (for instance, SyphaBedrockInvokeAccess) and connect it to the IAM user linked with the key you generated. The IAM user and the API key share the same prefix.

Critical Considerations:

• Model Discovery in Sypha: The minimal permission set (bedrock:InvokeModel, bedrock:InvokeModelWithResponseStream) enables Sypha to utilize a model when you directly specify the model ID in Sypha's configuration. Should you depend on Sypha to automatically discover available Bedrock models, you may require supplementary permissions such as bedrock:ListFoundationModels.
• AWS Marketplace Subscriptions: For third-party model providers (such as Anthropic Claude), the AmazonBedrockLimitedAccess policy provides the required permissions for AWS Marketplace subscription. No explicit access enablement is necessary. However, Anthropic models still require First Time Use (FTU) form submission through the Console. If you encounter the message [ERROR] Failed to process response: Model use case details have not been submitted for this account. Fill out the Anthropic use case details form before using the model. in Sypha chat, access the Playground in the AWS Bedrock Console, choose any Anthropic model and complete the form (you may need to submit an initial prompt)

---

Step 2: Confirm Regional and Model Availability

2.1 Determine and Validate a Region

1. Choose a Region:
   AWS Bedrock operates across numerous regions (including US East, Europe, Asia Pacific). Select the region aligning with your latency requirements and regulatory compliance.
   AWS Global Infrastructure
2. Confirm Model Availability:
   • Note: Certain models require Inference Profile access exclusively. In such situations enable the "Cross Region Inference" option.

---

Step 3: Set Up the Sypha VS Code Extension

3.1 Deploy and Launch Sypha

1. Acquire VS Code:
   Obtain installation files from the VS Code website.
2. Deploy the Sypha Extension:
   • Launch VS Code.
   • Access the Extensions Marketplace (Ctrl+Shift+X or Cmd+Shift+X).
   • Locate Sypha and complete installation.

3.2 Adjust Sypha Configuration

1. Access Sypha Configuration:
   • Select the settings ⚙️ to designate your API Provider.
2. Designate AWS Bedrock as the API Provider:
   • Within the API Provider selector, pick AWS Bedrock.
3. Provide Your AWS API Key:
   • Supply your API Key
   • Indicate the appropriate AWS Region (for instance, us-east-1 or your organization-authorized region).
4. Choose a Model:
   • Pick an on-demand model (such as anthropic.claude-3-5-sonnet-20241022-v2:0).
5. Preserve and Validate:
   • Select Done/Save to commit your configuration.
   • Verify the integration by submitting a straightforward prompt (for example, "Generate a Python function to check if a number is prime.").

---

Step 4: Security, Oversight, and Recommended Practices

1. Strengthen Access Controls:
   • Prioritize AWS SSO/federated roles instead of persistent API Keys when feasible.
   • AWS IAM Best Practices
2. Fortify Network Security:
   • Evaluate implementing AWS PrivateLink for secure Bedrock connectivity.
3. Track and Record Activity:
   • Activate AWS CloudTrail for Bedrock API call logging.
   • Leverage CloudWatch for monitoring indicators including invocation frequency, latency, and token consumption.
   • Configure alerts for unusual patterns.
4. Address Errors and Control Costs:
   • Deploy exponential backoff strategies for rate-limiting errors.
   • Utilize AWS Cost Explorer and configure billing notifications to monitor consumption.
     AWS Cost Management
5. Conduct Regular Reviews and Maintain Compliance:
   • Systematically examine IAM roles and CloudTrail records.
   • Adhere to organizational data privacy and governance protocols.

---

Summary

Following these procedures, you can rapidly integrate AWS Bedrock with the Sypha VS Code extension to enhance development velocity:

1. Configure Your AWS Infrastructure: Generate a Bedrock API Key with the required permissions.
2. Validate Region and Model Availability: Verify your chosen region accommodates necessary models.
3. Configure Sypha in VS Code: Deploy and configure Sypha using your AWS API Key and select a suitable model.
4. Apply Security and Monitoring Practices: Follow recommended approaches for IAM, network protection, monitoring, and cost oversight.

For comprehensive information, reference the AWS Bedrock Documentation. Happy coding!

---

This documentation will receive updates as AWS Bedrock and Sypha advance. Consistently reference current documentation and organizational policies for modern practices.