Zum Inhalt springen
Data ProcessingPro — €97

A/B Split Testing

90/100
16 Nodes

Beschreibung

Führt A/B-Tests für die Antworten eines KI-Agenten durch, mit Supabase und Postgres-Speicher. Runs A/B tests for an AI agent's responses, using Supabase for data and Postgres for memory.

Setup-Anleitung

## Split Test Different Agent Prompts with Supabase and OpenAI
### Use Case
Oftentimes, it's useful to test different settings for a large language model in production against various metrics. Split testing is a good method for doing this.
### What it Does
This workflow randomly assigns chat sessions to one of two prompts, the baseline and the alternative. The agent will use the same prompt for all interactions in that chat session.
### How it Works
1. When messages arrive, a table containing information regarding session ID and which prompt to use is checked to see if the chat already exists
2. If it does not, the session ID is added to the table and a prompt is randomly assigned
3. These values are then used to generate a response
### Next Steps
- Modify the workflow to test different LLM settings such as temperature
- Add a method to measure the efficacy of the two alternative prompts

Benötigte Integrationen (6)

If

if

Agent

agent

Supabase

supabase

API Key

Chat Trigger

chatTrigger

Memory Postgres Chat

memoryPostgresChat

Lm Chat Open Ai

lmChatOpenAi

Workflow freischalten

Kaufe das Pro Bundle für €97 — erhalte sofortigen Zugang zu diesem und allen weiteren Starter + Pro Workflows als ZIP-Datei zum Import in n8n.

Sichere Zahlung via Stripe. 7-Tage Geld-zurück-Garantie.
← Zurück zum Marketplace