Question 1

How does UsageGuard work?

Accepted Answer

UsageGuard acts as an intermediary between your application and LLM, handling API calls, applying security policies, and managing data flow to ensure safe and efficient use of AI language models.

Question 2

Which LLM providers does UsageGuard support?

Accepted Answer

UsageGuard supports major LLM providers including OpenAI (GPT models), Anthropic (Claude models), Meta Llama and more. The list of supported providers is continuously expanding, check the docs for more details.

Question 3

Will I need to change my existing code to use UsageGuard?

Accepted Answer

Minimal changes are required. You`ll mainly need to update your API endpoint to point to UsageGuard and include your UsageGuard API key and connection ID in your unified inference requests, see quickstart guide in our docs for more details.

Question 4

Can I use multiple LLM providers through UsageGuard?

Accepted Answer

Yes, UsageGuard provides a unified API that allows you to easily switch between different LLM providers and models without changing your application code.

Question 5

Does using UsageGuard affect performance?

Accepted Answer

UsageGuard introduces minimal latency, typically ranging from 50-100ms per request. For most applications, this slight increase is negligible compared to the added security and features.

Question 6

Can UsageGuard prevent prompt injection attacks?

Accepted Answer

Yes, UsageGuard includes prompt sanitization features to prevent malicious inputs from reaching the LLM provider, protecting against prompt injection attacks.

Question 7

Can I customize security policies for different projects or teams within my organization?

Accepted Answer

Yes, UsageGuard allows you to create multiple connections, each with its own set of security policies, usage limits, and configurations. This enables you to tailor your AI usage policies for different projects, teams, or environments (e.g., development, staging, production) within your organization.

Question 8

How does UsageGuard ensure the privacy of our data?

Accepted Answer

We use data isolation to prevent unauthorized access or use, coupled with end-to-end encryption for all data in transit and at rest. We adhere to minimal data retention practices with customizable policies. We never share your data with third parties.

Question 9

How can I get support if I encounter issues?

Accepted Answer

If you encounter any issues, you can check our troubleshooting guide, status page for known issues, or contact our support team directly.

Articles & Guides

Best Practices for Secure LLM API Integration

Latest Articles

How to Optimize Costs for LLM API Usage

Ensuring Compliance When Using Generative AI Models

Scaling AI Workflows: Challenges and Solutions

Simplifying Integration with UsageGuard: A Developer's Guide