Users Online

· Guests Online: 16

· Members Online: 0

· Total Members: 285
· Newest Member: Zarfdrilhor

Forum Threads

Newest Threads
No Threads created
Hottest Threads
No Threads created

Latest Articles

AI Evals Test LLM Apps, RAG and Agents Like an Engineer

AI Evals Test LLM Apps, RAG and Agents Like an Engineer
Total Titles: 76
 
Categories Most Recent Top Rated Popular Courses
DEMOS
03_016 - 3.2 Assertions, and Which Ones Actually Hold
03 - promptfoo Fast Iteration - AI Evals Test LLM Apps, RAG and Agents Like an Engineer
12 View(s)
No Rating
From: Superadmin
31.05.17
03_017 - 3.3 Comparing Models Side by Side
03 - promptfoo Fast Iteration - AI Evals Test LLM Apps, RAG and Agents Like an Engineer
13 View(s)
No Rating
From: Superadmin
31.05.17
03_018 - 3.4 Comparing Prompts Side by Side
03 - promptfoo Fast Iteration - AI Evals Test LLM Apps, RAG and Agents Like an Engineer
16 View(s)
No Rating
From: Superadmin
31.05.17
03_019 - 3.5 Diffing Two Prompt Versions
03 - promptfoo Fast Iteration - AI Evals Test LLM Apps, RAG and Agents Like an Engineer
12 View(s)
No Rating
From: Superadmin
31.05.17
03_020 - 3.6 Red-Teaming Probing for the Failure You Did ...
03 - promptfoo Fast Iteration - AI Evals Test LLM Apps, RAG and Agents Like an Engineer
12 View(s)
No Rating
From: Superadmin
31.05.17
03_021 - 3.7 Prompt Injection, Tested Rather Than Feared
03 - promptfoo Fast Iteration - AI Evals Test LLM Apps, RAG and Agents Like an Engineer
16 View(s)
No Rating
From: Superadmin
31.05.17
03_022 - 3.8 Where promptfoo Stops Being the Right Tool
03 - promptfoo Fast Iteration - AI Evals Test LLM Apps, RAG and Agents Like an Engineer
24 View(s)
No Rating
From: Superadmin
31.05.17
04_023 - 4.1 Why You Need a Model to Grade a Model
04 - LLM-as-Judge, and Its Failure Modes - AI Evals Test LLM Apps, RAG and Agents Like an Engineer
12 View(s)
No Rating
From: Superadmin
31.05.17
04_024 - 4.2 Writing a Rubric, Not a Wish
04 - LLM-as-Judge, and Its Failure Modes - AI Evals Test LLM Apps, RAG and Agents Like an Engineer
14 View(s)
No Rating
From: Superadmin
31.05.17
04_025 - 4.3 Position Bias, Measured
04 - LLM-as-Judge, and Its Failure Modes - AI Evals Test LLM Apps, RAG and Agents Like an Engineer
13 View(s)
No Rating
From: Superadmin
31.05.17
04_026 - 4.4 Verbosity Bias, Measured
04 - LLM-as-Judge, and Its Failure Modes - AI Evals Test LLM Apps, RAG and Agents Like an Engineer
14 View(s)
No Rating
From: Superadmin
31.05.17
04_027 - 4.5 Self-Preference, Measured
04 - LLM-as-Judge, and Its Failure Modes - AI Evals Test LLM Apps, RAG and Agents Like an Engineer
12 View(s)
No Rating
From: Superadmin
31.05.17
04_028 - 4.6 Calibrating a Judge Against Human Labels
04 - LLM-as-Judge, and Its Failure Modes - AI Evals Test LLM Apps, RAG and Agents Like an Engineer
13 View(s)
No Rating
From: Superadmin
31.05.17
04_029 - 4.7 When the Judge and the Human Disagree
04 - LLM-as-Judge, and Its Failure Modes - AI Evals Test LLM Apps, RAG and Agents Like an Engineer
15 View(s)
No Rating
From: Superadmin
31.05.17
04_030 - 4.8 Cheap Judge, Expensive Judge What the Money ...
04 - LLM-as-Judge, and Its Failure Modes - AI Evals Test LLM Apps, RAG and Agents Like an Engineer
14 View(s)
No Rating
From: Superadmin
31.05.17
Render time: 6.77 seconds
33,808,919 unique visits