Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feat: portley llm guardrails update #677

Merged
merged 3 commits into from
Oct 11, 2024
Merged

Feat: portley llm guardrails update #677

merged 3 commits into from
Oct 11, 2024

Conversation

VisargD
Copy link
Collaborator

@VisargD VisargD commented Oct 11, 2024 •
edited
Loading

Title:

  • Allow gateway deployments to use Portkey implemented LLM-based guardrails like pii, language detection, etc.

Description: (optional)

  • Pass env object to handler functions so that it can be used to pick up variables.
  • Add is_enabled flag on check level to allow disabling individual checks without removing it from the hooks object.

Motivation: (optional)

  • Enable portkey llm guardrails

Related Issues: (optional)

  • #issue-number

b4s36t4
b4s36t4 suggested changes Oct 11, 2024
View reviewed changes
plugins/portkey/gibberish.ts Show resolved Hide resolved
src/middlewares/hooks/index.ts Show resolved Hide resolved
@VisargD VisargD requested a review from b4s36t4 October 11, 2024 14:17
@VisargD VisargD merged commit b64b8a2 into main Oct 11, 2024
1 check passed
@VisargD VisargD deleted the feat/portley-llm-guardrails branch October 11, 2024 19:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@b4s36t4 b4s36t4 Awaiting requested review from b4s36t4

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@VisargD @b4s36t4