Score production traffic with code checks or LLM judges.
Evals score your real traffic automatically. An eval is a rule that samples
matching traces or spans after they arrive and scores them, either with a fast,
deterministic code check or with an LLM judge. Scores show up on the
trace they came from, feed the
Overview pass-rate card, and can drive
alerts.
Target: what to run on. Choose trace (score the whole run) or span
(score individual steps). Optionally filter by agent, trace name, and for
spans, span type and model.
Check: what to verify. Pick a preset (below).
Score: how to score. For LLM judges, pick a judge model. For checks that
take a parameter, set it (a substring, pattern, or max length). Set a
sample rate (1% to 100%) to control how much matching traffic is
scored.
Judges send the input and output to a model that returns a 0.00 to 1.00 score
or a pass/fail verdict with a reason. Presets cover relevance, helpfulness,
coherence, conciseness, instruction following, completeness, toxicity and
safety, tool selection, and RAG checks (faithfulness, context relevance, and
correctness against a reference).
LLM judges use your own provider keys. Add one (below) before creating a
judge eval. An eval with no usable key shows the status needs key and
doesn’t score until a key is added. The available judge models depend on the
deployment.
The Provider Keys page stores the LLM provider API keys your judges use,
encrypted at rest and scoped per project. Keys are write-only: once saved, the
value is never shown again, and the page only shows which providers are set up.
Add or replace a key, or delete it.
Provider-key encryption requires FOGLAMP_SECRETS_KEY (32+ chars) on the
server. Without it, the page shows “Encryption not configured” and judge
evals can’t run.
Opening an eval shows its recent activity: scored count, average score, pass
rate, and judge spend over the selected range, plus a table of recent scores
(target, pass/fail or numeric score, the reason, and when). Each scored run
also shows which prompt version it used,
so a change in scores can be read against a prompt change. Each enabled eval
also has a status of ok, needs key, or error, and an inline on/off
toggle.
Was this page helpful?
{"docsConfig":{"theme":"mint","$schema":"https://mintlify.com/docs.json","name":"Foglamp","description":"The missing observability layer for AI agents. Costs, latency, tokens, distributed traces, evals, and alerts for every model call - in two lines.","colors":{"primary":"#171717","light":"#FFFFFF","dark":"#171717"},"logo":{"light":"https://mintcdn.com/watchtower-26995943/1sml0kwCw1BNtiz-/images/Frame@2x(2).png?fit=max\u0026auto=format\u0026n=1sml0kwCw1BNtiz-\u0026q=85\u0026s=a7c846a133aa3480dc1e03a2da5fec2b","dark":"https://mintcdn.com/watchtower-26995943/1sml0kwCw1BNtiz-/images/Frame@2x(1).png?fit=max\u0026auto=format\u0026n=1sml0kwCw1BNtiz-\u0026q=85\u0026s=6534218552b79980770f11c40aafd6ec"},"favicon":{"light":"https://mintcdn.com/watchtower-26995943/HBjQlX3rbPIDdyKV/images/icon.png?fit=max\u0026auto=format\u0026n=HBjQlX3rbPIDdyKV\u0026q=85\u0026s=348a0d005fa67b1d7d9ab250780c5021","dark":"https://mintcdn.com/watchtower-26995943/HBjQlX3rbPIDdyKV/images/icon.png?fit=max\u0026auto=format\u0026n=HBjQlX3rbPIDdyKV\u0026q=85\u0026s=348a0d005fa67b1d7d9ab250780c5021"},"background":{"color":{"light":"#FAFAFA","dark":"#0F0F0F"}},"navbar":{"links":[],"primary":{"type":"github","href":"https://github.com/foglamp-labs/foglamp"}},"footer":{"socials":{"github":"https://github.com/foglamp-labs/foglamp"}},"seo":{"indexing":"navigable"},"fonts":{"family":"Inter"},"icons":{"library":"tabler"},"integrations":{"posthog":{"apiKey":"phc_omfZbJqrCPpUndrTXtruEZvMZqde6Vqq8yP4dK6oJbzZ","apiHost":"https://us.i.posthog.com","sessionRecording":true}},"contextual":{"options":["copy","assistant","view","chatgpt","claude","cursor"],"display":"header"},"thumbnails":{"fonts":{"family":"Inter"}},"styling":{"latex":false},"navigation":{"pages":[]}},"deployment":{"deploymentMetadataValue":{"subdomain":"watchtower-26995943","hasAudioNarration":false,"actualSubdomain":"watchtower-26995943","customDomains":["docs.foglamp.dev"],"gitSource":{"type":"github","owner":"foglamp-labs","repo":"foglamp","deployBranch":"master","contentDirectory":"docs","isPrivate":false,"mountPath":"","label":""},"feedback":{"thumbs":true,"agentFeedback":true},"entitlements":{"AI_CHAT":{"status":"ENABLED"},"WEB_MCP":{"status":"ENABLED"},"NARRATION":{"status":"ENABLED"}},"buildId":"6adb787429f87a0e412d81fc","clientVersion":"0.0.4088","searchFilterCounts":[{"language":"default","tag":"Documentation","count":10},{"language":"default","tag":"Dashboard","count":9},{"language":"default","tag":"Explore","count":5},{"language":"default","tag":"SDK","count":5},{"language":"default","tag":"Get started","count":4},{"language":"default","tag":"API reference","count":4},{"language":"default","tag":"Operate","count":4},{"language":"default","tag":"Self-hosting","count":4},{"language":"default","tag":"Ingest","count":2},{"language":"default","tag":"Changelog","count":1}]},"assistantConfig":{"enableAskAiButton":false,"enableStarterQuestions":false,"enableContextualStarterQuestions":false,"enableAskAiSearchBar":true},"basePath":"","hasChatPermissions":true,"hasWebMcpPermissions":true,"toggles":[{"name":"kill-isr","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-mintlify-slack","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-integrations-settings","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"rbac-expansion","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-pr-grouping","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-prefix","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"analytics-v7","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"user-flows-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"no-publish-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-onboarding","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"llms-txt-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving-live","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"stripTemperatureMiddleware","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"support-platform-pylon-zendesk","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"instant-rollback","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications-server","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-fable","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fixed-ai-action-pricing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automation-resolve-merge-conflict","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"scoped-publishing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"mintql","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"page-level-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-version-history-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"billing-page-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"full-page-search","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workspace-projects","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"assistant-v5","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fork-pr-previews","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"revalidation-jwt","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-sso-scim","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"hobby-abuse-scan","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"dashboard-inbox","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-signup","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-dual-write","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-enabled","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"approve-review-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-metadata","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"sso-setup-deadline-banner","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-serve","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"live-agents","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"comment-mode","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false}],"googleFontsInlined":false},"customCss":[],"page":{"pagePath":"dashboard/evals","slug":"/dashboard/evals","pageMetadata":{"title":"Evals","description":"Score production traffic with code checks or LLM judges.","href":"/dashboard/evals"},"description":{"compiledSource":"\"use strict\";\nconst {jsx: _jsx} = arguments[0];\nconst {useMDXComponents: _provideComponents} = arguments[0];\nfunction _createMdxContent(props) {\n const _components = {\n p: \"p\",\n ..._provideComponents(),\n ...props.components\n };\n return _jsx(_components.p, {\n children: \"Score production traffic with code checks or LLM judges.\"\n });\n}\nfunction MDXContent(props = {}) {\n const {wrapper: MDXLayout} = {\n ..._provideComponents(),\n ...props.components\n };\n return MDXLayout ? _jsx(MDXLayout, {\n ...props,\n children: _jsx(_createMdxContent, {\n ...props\n })\n }) : _createMdxContent(props);\n}\nreturn {\n default: MDXContent\n};\n","frontmatter":{},"scope":{}},"pageType":"default","mdx":{"mdxSource":{"compiledSource":"\"use strict\";const{Fragment:_Fragment,jsx:_jsx,jsxs:_jsxs}=arguments[0];const{useMDXComponents:_provideComponents}=arguments[0];function _createMdxContent(props){const _components={a:`a`,code:`code`,li:`li`,ol:`ol`,p:`p`,strong:`strong`,tbody:`tbody`,td:`td`,th:`th`,thead:`thead`,tr:`tr`,..._provideComponents(),...props.components},{Heading,Note,Table,Warning}=_components;if(!Heading)_missingMdxReference(`Heading`,true);if(!Note)_missingMdxReference(`Note`,true);if(!Table)_missingMdxReference(`Table`,true);if(!Warning)_missingMdxReference(`Warning`,true);return _jsxs(_Fragment,{children:[_jsxs(_components.p,{children:[_jsx(_components.strong,{children:`Evals`}),` score your real traffic automatically. An eval is a rule that samples\nmatching traces or spans after they arrive and scores them, either with a fast,\ndeterministic `,_jsx(_components.strong,{children:`code check`}),` or with an `,_jsx(_components.strong,{children:`LLM judge`}),`. Scores show up on the\n`,_jsx(_components.a,{href:`/dashboard/traces#scores`,children:`trace`}),` they came from, feed the\n`,_jsx(_components.a,{href:`/dashboard/overview`,children:`Overview`}),` pass-rate card, and can drive\n`,_jsx(_components.a,{href:`/dashboard/alerts`,children:`alerts`}),`.`]}),`\n`,_jsx(Heading,{level:`2`,id:`creating-an-eval`,children:`Creating an eval`}),`\n`,_jsx(_components.p,{children:`A short wizard walks you through three steps:`}),`\n`,_jsxs(_components.ol,{children:[`\n`,_jsxs(_components.li,{children:[_jsx(_components.strong,{children:`Target: what to run on.`}),` Choose `,_jsx(_components.code,{children:`trace`}),` (score the whole run) or `,_jsx(_components.code,{children:`span`}),`\n(score individual steps). Optionally filter by agent, trace name, and for\nspans, span type and model.`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.strong,{children:`Check: what to verify.`}),` Pick a preset (below).`]}),`\n`,_jsxs(_components.li,{children:[_jsx(_components.strong,{children:`Score: how to score.`}),` For LLM judges, pick a judge model. For checks that\ntake a parameter, set it (a substring, pattern, or max length). Set a\n`,_jsx(_components.strong,{children:`sample rate`}),` (1% to 100%) to control how much matching traffic is\nscored.`]}),`\n`]}),`\n`,_jsx(Heading,{level:`2`,id:`code-checks`,children:`Code checks`}),`\n`,_jsx(_components.p,{children:`Deterministic, free, and run without any external calls:`}),`\n`,_jsxs(Table,{children:[_jsx(_components.thead,{children:_jsxs(_components.tr,{children:[_jsx(_components.th,{children:`Preset`}),_jsx(_components.th,{children:`Checks`})]})}),_jsxs(_components.tbody,{children:[_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`No PII`})}),_jsx(_components.td,{children:`Output has no emails, phone numbers, SSNs, cards, or IPs.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`No secret leak`})}),_jsx(_components.td,{children:`Output has no API-key, token, or private-key shapes.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`Valid JSON`})}),_jsx(_components.td,{children:`Output parses as JSON.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`No refusal`})}),_jsx(_components.td,{children:`Output isn’t a refusal.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`Non-empty`})}),_jsx(_components.td,{children:`Output isn’t empty.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`Max length`})}),_jsx(_components.td,{children:`Output is within a character budget.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`Contains / Excludes text`})}),_jsx(_components.td,{children:`Output does (or doesn’t) contain a substring.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`Regex match`})}),_jsx(_components.td,{children:`Output matches a pattern.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:_jsx(_components.strong,{children:`Tool args valid`})}),_jsx(_components.td,{children:`(spans only) A tool call’s input is a valid JSON object.`})]})]})]}),`\n`,_jsx(Heading,{level:`2`,id:`llm-judges`,children:`LLM judges`}),`\n`,_jsx(_components.p,{children:`Judges send the input and output to a model that returns a 0.00 to 1.00 score\nor a pass/fail verdict with a reason. Presets cover relevance, helpfulness,\ncoherence, conciseness, instruction following, completeness, toxicity and\nsafety, tool selection, and RAG checks (faithfulness, context relevance, and\ncorrectness against a reference).`}),`\n`,_jsx(Note,{children:_jsxs(_components.p,{children:[`LLM judges use your own provider keys. Add one (below) before creating a\njudge eval. An eval with no usable key shows the status `,_jsx(_components.strong,{children:`needs key`}),` and\ndoesn’t score until a key is added. The available judge models depend on the\ndeployment.`]})}),`\n`,_jsx(Heading,{level:`2`,id:`provider-keys`,children:`Provider keys`}),`\n`,_jsxs(_components.p,{children:[`The `,_jsx(_components.strong,{children:`Provider Keys`}),` page stores the LLM provider API keys your judges use,\nencrypted at rest and scoped per project. Keys are write-only: once saved, the\nvalue is never shown again, and the page only shows which providers are set up.\nAdd or replace a key, or delete it.`]}),`\n`,_jsx(Warning,{children:_jsxs(_components.p,{children:[`Provider-key encryption requires `,_jsx(_components.code,{children:`FOGLAMP_SECRETS_KEY`}),` (32+ chars) on the\nserver. Without it, the page shows “Encryption not configured” and judge\nevals can’t run.`]})}),`\n`,_jsx(Heading,{level:`2`,id:`eval-detail`,children:`Eval detail`}),`\n`,_jsxs(_components.p,{children:[`Opening an eval shows its recent activity: scored count, average score, pass\nrate, and judge spend over the selected range, plus a table of recent scores\n(target, pass/fail or numeric score, the reason, and when). Each scored run\nalso shows which `,_jsx(_components.a,{href:`/dashboard/agents#prompt-versions`,children:`prompt version`}),` it used,\nso a change in scores can be read against a prompt change. Each enabled eval\nalso has a status of `,_jsx(_components.strong,{children:`ok`}),`, `,_jsx(_components.strong,{children:`needs key`}),`, or `,_jsx(_components.strong,{children:`error`}),`, and an inline on/off\ntoggle.`]})]})}function MDXContent(props={}){const{wrapper:MDXLayout}={..._provideComponents(),...props.components};return MDXLayout?_jsx(MDXLayout,{...props,children:_jsx(_createMdxContent,{...props})}):_createMdxContent(props)}return{default:MDXContent};function _missingMdxReference(id,component){throw new Error(`Expected `+(component?`component`:`object`)+\" `\"+id+\"` to be defined: you likely forgot to import, pass, or provide it.\")}","frontmatter":{},"scope":{"config":{},"pageMetadata":{"title":"Evals","description":"Score production traffic with code checks or LLM judges.","href":"/dashboard/evals"}}},"mdxSourceWithNoJs":null},"mdxExtracts":{"tableOfContents":[{"title":"Creating an eval","slug":"creating-an-eval","depth":2,"children":[]},{"title":"Code checks","slug":"code-checks","depth":2,"children":[]},{"title":"LLM judges","slug":"llm-judges","depth":2,"children":[]},{"title":"Provider keys","slug":"provider-keys","depth":2,"children":[]},{"title":"Eval detail","slug":"eval-detail","depth":2,"children":[]}],"codeExamples":{}},"jsLinks":[],"subdomain":"watchtower-26995943","siteName":"Foglamp","title":"Evals - Foglamp","navMaps":{"firstHrefInVersion":{},"firstHrefInLanguage":{}},"lastModified":"2026-09-03T00:48:13.763Z","originalFileLocation":"dashboard/evals.mdx"},"headHtml":"\u003cscript data-mint-head>(function(){var d=document.documentElement,p=null;if(!p){try{p=localStorage.getItem(\"isDarkMode\")}catch(e){}if(p==='true')p='dark';else if(p==='false')p='light';if(p!=='light'\u0026\u0026p!=='dark'\u0026\u0026p!=='system')p=\"system\"}var r=p==='system'?(matchMedia(\"(prefers-color-scheme: dark)\").matches?'dark':'light'):p;d.classList.remove(r==='dark'?'light':'dark');d.classList.add(r);d.setAttribute(\"data-theme-preference\",p)})();\u003c/script>\u003cmeta data-mint-head name=\"description\" content=\"Score production traffic with code checks or LLM judges.\">\u003cmeta data-mint-head name=\"application-name\" content=\"Foglamp\">\u003cmeta data-mint-head name=\"generator\" content=\"Mintlify\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/watchtower-26995943/Nsm3YsrkmNDj6QwR/_generated/favicon/android-chrome-192x192.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"apple-touch-icon\" type=\"image/png\" sizes=\"180x180\" href=\"/mintlify-assets/_mintlify/favicons/watchtower-26995943/Nsm3YsrkmNDj6QwR/_generated/favicon/apple-touch-icon.png\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/watchtower-26995943/Nsm3YsrkmNDj6QwR/_generated/favicon/favicon-16x16.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/watchtower-26995943/Nsm3YsrkmNDj6QwR/_generated/favicon/favicon-32x32.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/watchtower-26995943/Nsm3YsrkmNDj6QwR/_generated/favicon/favicon.ico\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/watchtower-26995943/Nsm3YsrkmNDj6QwR/_generated/favicon-dark/android-chrome-192x192.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/watchtower-26995943/Nsm3YsrkmNDj6QwR/_generated/favicon-dark/favicon-16x16.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/watchtower-26995943/Nsm3YsrkmNDj6QwR/_generated/favicon-dark/favicon-32x32.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/watchtower-26995943/Nsm3YsrkmNDj6QwR/_generated/favicon-dark/favicon.ico\" media=\"(prefers-color-scheme: dark)\">\u003cmeta data-mint-head property=\"og:title\" content=\"Evals - Foglamp\">\u003cmeta data-mint-head property=\"og:description\" content=\"Score production traffic with code checks or LLM judges.\">\u003cmeta data-mint-head property=\"og:site_name\" content=\"Foglamp\">\u003cmeta data-mint-head property=\"og:url\" content=\"https://docs.foglamp.dev/dashboard/evals\">\u003cmeta data-mint-head property=\"og:type\" content=\"website\">\u003cmeta data-mint-head property=\"og:image\" content=\"https://watchtower-26995943.mintlify.site/_mintlify/api/og/v2?division=Operate\u0026amp;title=Evals\u0026amp;description=Score+production+traffic+with+code+checks+or+LLM+judges.\u0026amp;theme=e7a6ea588b6f2995e5c09d7f\u0026amp;signature=0af4772e06a66e4bb267f7659aceef0eda50f13f47e507ed0a6b36a51514d8e7\">\u003cmeta data-mint-head property=\"og:image:width\" content=\"1200\">\u003cmeta data-mint-head property=\"og:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"twitter:card\" content=\"summary_large_image\">\u003cmeta data-mint-head name=\"twitter:title\" content=\"Evals - Foglamp\">\u003cmeta data-mint-head name=\"twitter:description\" content=\"Score production traffic with code checks or LLM judges.\">\u003cmeta data-mint-head name=\"twitter:image\" content=\"https://watchtower-26995943.mintlify.site/_mintlify/api/og/v2?division=Operate\u0026amp;title=Evals\u0026amp;description=Score+production+traffic+with+code+checks+or+LLM+judges.\u0026amp;theme=e7a6ea588b6f2995e5c09d7f\u0026amp;signature=0af4772e06a66e4bb267f7659aceef0eda50f13f47e507ed0a6b36a51514d8e7\">\u003cmeta data-mint-head name=\"twitter:image:width\" content=\"1200\">\u003cmeta data-mint-head name=\"twitter:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"msapplication-config\" content=\"/mintlify-assets/_mintlify/favicons/watchtower-26995943/Nsm3YsrkmNDj6QwR/_generated/favicon/browserconfig.xml\">\u003cmeta data-mint-head name=\"apple-mobile-web-app-title\" content=\"Foglamp\">\u003cmeta data-mint-head name=\"msapplication-TileColor\" content=\"#171717\">\u003clink data-mint-head rel=\"canonical\" href=\"https://docs.foglamp.dev/dashboard/evals\">\u003clink data-mint-head rel=\"alternate\" type=\"application/xml\" href=\"/sitemap.xml\">\u003clink data-mint-head rel=\"alternate\" type=\"text/markdown\" href=\"/dashboard/evals.md\">\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https://docs.foglamp.dev/#organization\",\"name\":\"Foglamp\",\"url\":\"https://docs.foglamp.dev\",\"logo\":{\"@type\":\"ImageObject\",\"url\":\"https://mintcdn.com/watchtower-26995943/1sml0kwCw1BNtiz-/images/Frame@2x(2).png?fit=max\u0026auto=format\u0026n=1sml0kwCw1BNtiz-\u0026q=85\u0026s=a7c846a133aa3480dc1e03a2da5fec2b\"}},{\"@type\":\"WebSite\",\"@id\":\"https://docs.foglamp.dev#website\",\"name\":\"Foglamp\",\"url\":\"https://docs.foglamp.dev\",\"publisher\":{\"@id\":\"https://docs.foglamp.dev/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https://docs.foglamp.dev/dashboard/evals#webpage\",\"url\":\"https://docs.foglamp.dev/dashboard/evals\",\"name\":\"Evals\",\"description\":\"Score production traffic with code checks or LLM judges.\",\"dateModified\":\"2026-09-03T00:48:13.763Z\",\"isPartOf\":{\"@id\":\"https://docs.foglamp.dev#website\"},\"breadcrumb\":{\"@id\":\"https://docs.foglamp.dev/dashboard/evals#breadcrumb\"}},{\"@type\":\"BreadcrumbList\",\"@id\":\"https://docs.foglamp.dev/dashboard/evals#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Operate\",\"item\":\"https://docs.foglamp.dev/dashboard/alerts\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Evals\",\"item\":\"https://docs.foglamp.dev/dashboard/evals\"}]},{\"@type\":[\"Article\",\"TechArticle\"],\"@id\":\"https://docs.foglamp.dev/dashboard/evals#article\",\"headline\":\"Evals\",\"name\":\"Evals\",\"description\":\"Score production traffic with code checks or LLM judges.\",\"url\":\"https://docs.foglamp.dev/dashboard/evals\",\"mainEntityOfPage\":{\"@id\":\"https://docs.foglamp.dev/dashboard/evals#webpage\"},\"dateModified\":\"2026-09-03T00:48:13.763Z\",\"publisher\":{\"@id\":\"https://docs.foglamp.dev/#organization\"},\"isPartOf\":{\"@id\":\"https://docs.foglamp.dev#website\"}}]}\u003c/script>\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@type\":\"WebSite\",\"name\":\"Foglamp\",\"creator\":{\"@type\":\"Organization\",\"name\":\"Mintlify\",\"url\":\"https://mintlify.com\"}}\u003c/script>","siteName":"Foglamp","nav":{"global":null,"tabs":[{"tab":"Documentation","pages":[{"title":"Documentation","href":"/introduction"}]},{"tab":"Dashboard","groups":[{"group":"Explore","pages":[{"title":"Overview","href":"/dashboard/overview"},{"title":"Traces","href":"/dashboard/traces"},{"title":"Workflows","href":"/dashboard/workflows"},{"title":"Agents","href":"/dashboard/agents"},{"title":"Sessions","href":"/dashboard/sessions"}]},{"group":"Operate","pages":[{"title":"Alerts","description":"Threshold rules on cost, latency, errors, and eval pass rate.","href":"/dashboard/alerts"},{"title":"Evals","href":"/dashboard/evals"},{"title":"Cost \u0026 pricing","description":"How Foglamp prices spans.","href":"/dashboard/cost"},{"title":"Projects, keys \u0026 billing","href":"/dashboard/account"}]}]},{"tab":"Self-hosting","pages":[{"title":"Self-hosting","href":"/self-hosting/overview"}]},{"tab":"Changelog","pages":[{"title":"Changelog","href":"/changelog"}]},{"tab":"API reference","pages":[{"title":"API reference","href":"/api-reference/introduction"}]}]},"basePath":"","title":"Evals - Foglamp","buildId":"dpl_DTau1J5HqS9UTgVSDwGksstFWtPa","deploymentId":"dpl_DTau1J5HqS9UTgVSDwGksstFWtPa","dynamics":[],"chunks":[]}