# Opik Documentation > Documentation for Opik Documentation. - [.NET](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/net-index/) - [Activate a pairing session](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/activatepairingsession/) - [Add blueprint to existing config](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updateagentconfig/) - [Add items to annotation queue](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/additemstoannotationqueue/) - [Add span comment](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/addspancomment/) - [Add span feedback score](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/addspanfeedbackscore/) - [Add thread comment](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/addthreadcomment/) - [Add trace comment](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/addtracecomment/) - [Add trace feedback score](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/addtracefeedbackscore/) - [Administration](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-index/) - [Agent Configs](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/agent-configs/) - [Agent Insights](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/agent-insights/) - [Agent Insights enrollment](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/agent-insights-enrollment/) - [Agent Insights Jobs](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/agent-insights-jobs/) - [AI Coding Assistants](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/ai-coding-assistants-index/) - [Alerts](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/alerts/) - [Annotation Queues](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/annotation-queues/) - [Append local runner job logs](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/appendjoblogs/) - [Apply changes to dataset items](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/applydatasetitemchanges/) - [Assertion Results](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/assertion-results/) - [Attachments](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/attachments/) - [Attachments list for entity](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/attachmentlist/) - [Automation rule evaluators](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/automation-rule-evaluators/) - [Batch feedback scoring for spans](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/scorebatchofspans/) - [Batch feedback scoring for threads](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/scorebatchofthreads/) - [Batch feedback scoring for traces](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/scorebatchoftraces/) - [Batch ingestion of assertion results](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/storeassertionsbatch/) - [Batch update dataset items](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/batchupdatedatasetitems/) - [Batch update experiments](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/batchupdateexperiments/) - [Batch update spans](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/batchupdatespans/) - [Batch update threads](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/batchupdatethreads/) - [Batch update traces](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/batchupdatetraces/) - [Cancel local runner job](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/canceljob/) - [Changelog](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/changelog/): What changed in each published version of this API. - [Chat Completions](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/chat-completions/) - [Check](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/check/) - [Check user access to workspace](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/checkaccess/) - [Check whether a project has spans](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/spansexist/) - [Check whether a project has traces](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tracesexist/) - [Close trace thread(s)](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/closetracethread/) - [Compare latest version with draft](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/comparedatasetversions/) - [Complete multipart attachment upload](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/completemultipartupload/) - [Complete report generation](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/completereport/) - [Configuration](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/configuration-index/) - [Contributing](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/contributing-index/) - [Cost Intelligence](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/cost-intelligence-index/) - [Create a pairing session](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createpairingsession/) - [Create Agent Insights job](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createagentinsightsjob/) - [Create alert](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createalert/) - [Create and execute experiment](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/executeexperiment/) - [Create annotation queue](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createannotationqueue/) - [Create annotation queue batch](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createannotationqueuebatch/) - [Create automation rule evaluator](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createautomationruleevaluator/) - [Create blueprint from mask](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createblueprintfrommask/) - [Create chat completions](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createchatcompletions/) - [Create dashboard](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createdashboard/) - [Create dataset](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createdataset/) - [Create dataset items from CSV file](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createdatasetitemsfromcsv/) - [Create dataset items from JSON file](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createdatasetitemsfromjson/) - [Create dataset items from spans](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createdatasetitemsfromspans/) - [Create dataset items from traces](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createdatasetitemsfromtraces/) - [Create dataset redirect url](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/datasetsredirect/) - [Create environment](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createenvironment/) - [Create experiment](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createexperiment/) - [Create experiment items](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createexperimentitems/) - [Create experiment redirect url](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/experimentsredirect/) - [Create feedback definition](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createfeedbackdefinition/) - [Create guardrails for traces in a batch](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createguardrails/) - [Create insights view](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createinsightsview/) - [Create local runner job](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createjob/) - [Create optimization](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createoptimization/) - [Create optimization redirect url](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/optimizationsredirect/) - [Create optimizer config with initial blueprint](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createagentconfig/) - [Create or extend annotation queue item lock](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/lockannotationqueueitem/) - [Create or update environments](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createorupdateenvs/) - [Create project](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createproject/) - [Create project redirect url](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/projectsredirect/) - [Create prompt](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createprompt/) - [Create prompt version](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createpromptversion/) - [Create retention rule](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createretentionrule/) - [Create span](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createspan/) - [Create spans](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createspans/) - [Create trace](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createtrace/) - [Create traces](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createtraces/) - [Create version tag](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createversiontag/) - [Create/update dataset items](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createorupdatedatasetitems/) - [Dashboards](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/dashboards/) - [Datasets](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/datasets/) - [Deactivate retention rule](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deactivateretentionrule/) - [Delete alert batch](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletealertbatch/) - [Delete annotation queue batch](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deleteannotationqueuebatch/) - [Delete attachments](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deleteattachments/) - [Delete automation rule evaluators](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deleteautomationruleevaluatorbatch/) - [Delete dashboard](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletedashboard/) - [Delete dashboards](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletedashboardsbatch/) - [Delete dataset by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletedataset/) - [Delete dataset by name](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletedatasetbyname/) - [Delete dataset items](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletedatasetitems/) - [Delete datasets](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletedatasetsbatch/) - [Delete environment](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deleteenv/) - [Delete environments](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deleteenvironmentsbatch/) - [Delete experiment items](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deleteexperimentitems/) - [Delete experiments by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deleteexperimentsbyid/) - [Delete feedback definition by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletefeedbackdefinitionbyid/) - [Delete feedback definitions](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletefeedbackdefinitionsbatch/) - [Delete insights view](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deleteinsightsview/) - [Delete insights views](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deleteinsightsviewsbatch/) - [Delete LLM Provider's ApiKeys](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletellmproviderapikeysbatch/) - [Delete ollie state](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deleteolliestate/) - [Delete optimizations by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deleteoptimizationsbyid/) - [Delete project by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deleteprojectbyid/) - [Delete projects](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deleteprojectsbatch/) - [Delete prompt](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deleteprompt/) - [Delete prompts](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletepromptsbatch/) - [Delete span by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletespanbyid/) - [Delete span comments](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletespancomments/) - [Delete span feedback score](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletespanfeedbackscore/) - [Delete thread comments](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletethreadcomments/) - [Delete thread feedback scores](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletethreadfeedbackscores/) - [Delete trace by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletetracebyid/) - [Delete trace comments](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletetracecomments/) - [Delete trace feedback score](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletetracefeedbackscore/) - [Delete trace threads](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletetracethreads/) - [Delete traces](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deletetraces/) - [Delete version tag](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deleteversiontag/) - [Delete workspace configuration](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/deleteworkspaceconfiguration/) - [Development](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-index/) - [Disconnect local runner](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/disconnectrunner/) - [Download attachment from MinIO](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/downloadattachment/) - [Download dataset export file](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/downloaddatasetexport/) - [Download ollie state](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/downloadolliestate/) - [Enrol projects in the auto-first-run rollout](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/enrolprojectsinautofirstrun/) - [Environments](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/environments/) - [Evaluation](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-index/) - [Execute Agent Insights free-form SQL](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/executeanalyticsquery/) - [Execute free-form analytics SQL](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/executescopedanalyticsquery/) - [Expand dataset with synthetic samples](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/expanddataset/) - [Experiments](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/experiments/) - [Feedback-definitions](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/feedback-definitions/) - [Find agent insights issues](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findagentinsightsissues/) - [Find alerts](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findalerts/) - [Find alerts by project](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findalertsbyproject/) - [Find annotation queues](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findannotationqueues/) - [Find dashboards](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/finddashboards/) - [Find dashboards by project](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/finddashboardsbyproject/) - [Find dataset items with experiment items](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/finddatasetitemswithexperimentitems/) - [Find datasets](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/finddatasets/) - [Find datasets by project](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/finddatasetsbyproject/) - [Find environments](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findenvironments/) - [Find experiment groups](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findexperimentgroups/) - [Find experiment groups with aggregations](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findexperimentgroupsaggregations/) - [Find experiments](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findexperiments/) - [Find experiments by project](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findexperimentsbyproject/) - [Find Feedback definitions](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findfeedbackdefinitions/) - [Find Feedback Score names](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findfeedbackscorenames/) - [Find Feedback Score names](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findfeedbackscorenames_1/) - [Find Feedback Score names](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findfeedbackscorenames_2/) - [Find Feedback Score names By Project Ids](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findfeedbackscorenamesbyprojectids/) - [Find insights views](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findinsightsviews/) - [Find LLM Provider's ApiKeys](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findllmproviderkeys/) - [Find optimizations](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findoptimizations/) - [Find optimizations by project](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findoptimizationsbyproject/) - [Find project Evaluators](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findevaluators/) - [Find projects](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findprojects/) - [Find retention rules](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findretentionrules/) - [Find Token Usage names](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findtokenusagenames/) - [Find Trace Threads Feedback Score names](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findtracethreadsfeedbackscorenames/) - [Finish experiments](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/finishexperiments/) - [Get agent insights issue by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getagentinsightsissuebyid/) - [Get Agent Insights job](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getagentinsightsjob/) - [Get Alert by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getalertbyid/) - [Get all active locks for an annotation queue](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getannotationqueuelocks/) - [Get all dataset export jobs](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getdatasetexportjobs/) - [Get annotation queue by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getannotationqueuebyid/) - [Get Authorization Consent Context](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getauthorizecontext/) - [Get automation rule evaluator by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getevaluatorbyid/) - [Get automation rule evaluator logs by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getevaluatorlogsbyid/) - [Get blueprint history](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getblueprinthistory/) - [Get bridge command](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getbridgecommand/) - [Get cost daily data](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getcost/) - [Get costs summary](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/costssummary/) - [Get dashboard by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getdashboardbyid/) - [Get dataset by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getdatasetbyid/) - [Get dataset by name](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getdatasetbyidentifier/) - [Get dataset export job status](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getdatasetexportjob/) - [Get dataset item by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getdatasetitembyid/) - [Get dataset items](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getdatasetitems/) - [Get dataset items output columns](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getdatasetitemsoutputcolumns/) - [Get datasets information for BI events](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getdatasetbiinfo/) - [Get environment by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getenvironmentbyid/) - [Get experiment by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getexperimentbyid/) - [Get experiment item by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getexperimentitembyid/) - [Get experiment items stats for dataset](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getdatasetexperimentitemsstats/) - [Get experiments information for BI events](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getexperimentbiinfo/) - [Get feedback definition by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getfeedbackdefinitionbyid/) - [Get insights view by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getinsightsviewbyid/) - [Get LLM models](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getllmmodels/) - [Get LLM Provider's ApiKey by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getllmproviderapikeybyid/) - [Get local runner](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getrunner/) - [Get local runner job](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getjob/) - [Get local runner job logs](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getjoblogs/) - [Get metric daily data](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getmetric/) - [Get metrics summary](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/metricssummary/) - [Get OAuth Authorization Server Metadata](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getoauthauthorizationservermetadata/) - [Get optimization by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getoptimizationbyid/) - [Get project by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getprojectbyid/) - [Get Project KPI Cards](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getprojectkpicards/) - [Get Project Metrics](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getprojectmetrics/) - [Get Project Stats](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getprojectstats/) - [Get prompt by commit](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getpromptbycommit/) - [Get prompt by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getpromptbyid/) - [Get prompt version by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getpromptversionbyid/) - [Get prompt version by sequential number](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getpromptversionbynumber/) - [Get prompt versions](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getpromptversions/) - [Get prompts](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getprompts/) - [Get prompts by commits](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getpromptsbycommits/) - [Get prompts by project](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getpromptsbyproject/) - [Get recent activity for a project](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getrecentactivity/) - [Get report preferences](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getreportpreference/) - [Get reports for a project](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getreports/) - [Get retention rule by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getretentionrulebyid/) - [Get Service Toggles](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getservicetoggles/) - [Get span by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getspanbyid/) - [Get span comment](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getspancomment/) - [Get span stats](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getspanstats/) - [Get spans by project_name or project_id and optionally by trace_id and/or type](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getspansbyproject/) - [Get spans count on previous day for all available workspaces](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getspanscountforworkspaces/) - [Get spans count on previous day grouped by workspace, project and user](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getspanscountbreakdownforworkspaces/) - [Get spans information for BI events](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getspansbiinfo/) - [Get Studio optimization logs](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getstudiooptimizationlogs/) - [Get thread comment](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getthreadcomment/) - [Get trace by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/gettracebyid/) - [Get trace comment](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/gettracecomment/) - [Get trace stats](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/gettracestats/) - [Get trace thread](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/gettracethread/) - [Get trace thread stats](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/gettracethreadstats/) - [Get trace threads](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/gettracethreads/) - [Get traces by project_name or project_id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/gettracesbyproject/) - [Get traces count on previous day for all available workspaces](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/gettracescountforworkspaces/) - [Get traces information for BI events](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/gettracesbiinfo/) - [Get webhook payload examples](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getwebhookexamples/) - [Get welcome wizard tracking status](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getwelcomewizardstatus/) - [Get workspace configuration](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getworkspaceconfiguration/) - [Get workspace permissions for the authenticated user](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getworkspaceuserpermissions/) - [Get workspace span metric](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getworkspacespanmetric/) - [Get workspace token usage names](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getworkspacetokenusagenames/) - [Getting started](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/getting-started/): Check authentication requirements, make your first call, and review recorded request history. - [Getting Started](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-index/) - [Guardrails](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/guardrails-index/) - [Guardrails](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/guardrails/) - [Guides](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/): Every guide in Opik Documentation. - [Insights Views](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/insights-views/) - [Installation](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/installation-index/) - [Integrations](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/integrations-index/) - [isAlive](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/isalive/) - [Java](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/java-index/) - [List available Ollama models](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/listmodels/) - [List dataset versions](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/listdatasetversions/) - [List failures for a project](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/findreportfailures/) - [List local runner jobs](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/listjobs/) - [List local runners](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/listrunners/) - [LLM Models](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/llm-models/) - [LlmProviderKey](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/llmproviderkey/) - [Local runner heartbeat](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/heartbeat/) - [Manual Evaluation](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/manual-evaluation/) - [Manually evaluate spans](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/evaluatespans/) - [Manually evaluate threads](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/evaluatethreads/) - [Manually evaluate traces](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/evaluatetraces/) - [Mark dataset export job as viewed](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/markdatasetexportjobviewed/) - [MCP OAuth](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/mcp-oauth/) - [Multi-Language](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/multi-language-index/) - [Next local runner job](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/nextjob/) - [No-Code](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/no-code-index/) - [OAuth Authorization Endpoint](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/authorize/) - [OAuth Dynamic Client Registration Endpoint](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/registeroauthclient/) - [OAuth Token Endpoint](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/token/) - [OAuth Token Revocation Endpoint](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/revoke/) - [Observability](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-index/) - [Ollama](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/ollama/) - [Ollie State](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/ollie-state/) - [Open trace thread](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/opentracethread/) - [OpenTelemetry Ingestion](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/opentelemetry-ingestion/) - [Opik Documentation](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/) - [Opik REST API](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/) - [Optimizations](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/optimizations/) - [Pairing](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/pairing/) - [Partially update dataset item by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/patchdatasetitem/) - [Patch runner checklist](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/patchchecklist/) - [Poll next bridge commands](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/nextbridgecommands/) - [Production](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/production-index/) - [Projects](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/projects/) - [Prompts](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/prompts/) - [Python](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-index/) - [Python SDK](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-sdk-index/) - [receiveProtobufTraces](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/receiveprotobuftraces/) - [Record a report/job failure](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createreportfailure/) - [Record experiment items in bulk](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/experimentitemsbulk/) - [Redirect](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/redirect/) - [Register local runner agents](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/registeragents/) - [Remove configuration parameters](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/removeconfigkeys/) - [Remove items from annotation queue](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/removeitemsfromannotationqueue/) - [Replace ollie state](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/replaceolliestate/) - [Report bridge command result](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/reportbridgeresult/) - [Report Failures](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/report-failures/) - [Report local runner job result](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/reportjobresult/) - [Reports](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/reports/) - [Rest API](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/rest-api-index/) - [Restore dataset to a previous version](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/restoredatasetversion/) - [Restore prompt version](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/restorepromptversion/) - [Retention Rules](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/retention-rules/) - [Retrieve blueprint by environment](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getblueprintbyenv/) - [Retrieve blueprint by ID](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getblueprintbyid/) - [Retrieve blueprint by name](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getblueprintbyname/) - [Retrieve dataset version by name](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/retrievedatasetversion/) - [Retrieve delta by blueprint ID](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getdeltabyid/) - [Retrieve latest blueprint](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getlatestblueprint/) - [Retrieve project](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/retrieveproject/) - [Retrieve prompt version](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/retrievepromptversion/) - [Retrieve prompt versions by ids](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/retrievepromptversionsbyids/) - [Ruby](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/ruby-index/) - [Runners](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/runners/) - [SDK & API reference](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/sdk-api-reference-index/) - [Search annotation queue items](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/searchannotationqueueitems/) - [Search spans](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/searchspans/) - [Search trace threads](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/searchtracethreads/) - [Search traces](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/searchtraces/) - [Self-hosting Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/self-hosting-opik-index/) - [Service Toggles](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/service-toggles/) - [Set environment by blueprint name](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/setenvbyblueprintname/) - [Set prompt version environment](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/setpromptversionenvironment/) - [Spans](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/spans/) - [Start dataset CSV export](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/startdatasetexport/) - [Start multipart attachment upload](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/startmultipartupload/) - [Store agent insights report results](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/reportagentinsightsissues/) - [Store LLM Provider's ApiKey](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/storellmproviderapikey/) - [Stream dataset items](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/streamdatasetitems/) - [Stream experiment items](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/streamexperimentitems/) - [Stream experiments](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/streamexperiments/) - [Submit Authorization Consent](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/consent/) - [Submit bridge command](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/createbridgecommand/) - [Submit welcome wizard](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/submitwelcomewizard/) - [System analytics queries](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/system-analytics-queries/) - [System usage](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/system-usage/) - [Test a provider's dynamic token auth](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/testllmproviderauthconfig/) - [Test alert webhook](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/testwebhook/) - [Test connection to Ollama instance](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/testconnection/) - [Traces](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/traces/) - [Trigger Agent Insights job](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/triggeragentinsightsjob/) - [Trigger report generation](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/generatereport/) - [TypeScript](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-index/) - [Typescript SDK](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-sdk-index/) - [Update agent insights issue status](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updateagentinsightsissue/) - [Update Agent Insights job](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updateagentinsightsjob/) - [Update alert](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updatealert/) - [Update annotation queue](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updateannotationqueue/) - [Update Automation Rule Evaluator by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updateautomationruleevaluator/) - [Update dashboard](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updatedashboard/) - [Update dataset by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updatedataset/) - [Update dataset version](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updatedatasetversion/) - [Update environment by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updateenvironment/) - [Update experiment by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updateexperiment/) - [Update feedback definition by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updatefeedbackdefinition/) - [Update insights view](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updateinsightsview/) - [Update LLM Provider's ApiKey](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updatellmproviderapikey/) - [Update optimization by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updateoptimizationsbyid/) - [Update project by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updateproject/) - [Update prompt](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updateprompt/) - [Update prompt versions](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updatepromptversions/) - [Update report preferences](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updatereportpreference/) - [Update span by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updatespan/) - [Update span comment by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updatespancomment/) - [Update thread](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updatethread/) - [Update thread comment by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updatethreadcomment/) - [Update trace by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updatetrace/) - [Update trace comment by id](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/updatetracecomment/) - [Upload attachment to MinIO](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/uploadattachment/) - [Upsert optimization](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/upsertoptimization/) - [Upsert workspace configuration](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/upsertworkspaceconfiguration/) - [User's default workspace name](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/getworkspacename/) - [Validate OAuth Access Token](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/validateoauthtoken/) - [version](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/version/) - [Welcome Wizard](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/welcome-wizard/) - [Workspace permissions](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/workspace-permissions/) - [Workspaces](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/operations/tags/workspaces/) - [Anonymous usage statistics](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/configuration-anonymous-usage-statistics/): Describes the usage statistics that are collected by Opik - [Authentication](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/api/authentication/): How this API authenticates requests, and where your API keys live. - [Contribution Overview](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/contributing-overview/) - [Cost Intelligence](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/cost-intelligence-overview/) - [Development Overview](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-overview/) - [Evaluation Overview](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-overview/) - [Guardrails overview](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/guardrails-overview/): Protect your LLM application in real time by blocking unsafe inputs and outputs - [Home](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-home/) - [Installation overview](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/installation-overview/) - [Observability for coding agents](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/ai-coding-assistants-coding-agents/): How to get Claude Code, Cursor, GitHub Copilot and OpenAI Codex sessions into Opik, and when Cost Intelligence or the MCP server is the better fit. - [Observability for Dify with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/no-code-dify/): Start here to integrate Opik into your Dify-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Spring AI (Java) with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/java-spring-ai/): Start here to integrate Opik into your Spring AI-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability Overview](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-overview/) - [OpenTelemetry](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/multi-language-opentelemetry/): Describes how to send data to Opik using OpenTelemetry - [OpenTelemetry Ruby SDK](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/ruby-opentelemetry-ruby-sdk/) - [Opik TS - Interactive Setup Tool](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-sdk-opik-ts/): A guided CLI tool for quickly integrating Opik SDK into your Node.js/TypeScript projects with automatic configuration and setup. - [Overview](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-overview/): Multi-user collaboration with enterprise-grade access control - [Overview](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/integrations-overview/) - [Overview](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/rest-api-overview/) - [Overview](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/sdk-api-reference-overview/) - [Overview](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/self-hosting-opik-overview/): High-level overview on how to self-host Opik - [REST API Client](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-sdk-rest-api/) - [Agent playground](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-observability-agent-sandbox/) - [Getting started with Evaluation](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-getting-started/) - [Getting started with Observability](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-getting-started/) - [Large CSV uploads](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/configuration-large-csv-uploads/): Configure Opik to support large CSV file uploads for datasets - [MCP Server](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/ai-coding-assistants-mcp-server/) - [Migrating to Opik 2.0](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/self-hosting-opik-v1-to-v2-migration/): Enable the background jobs that move your existing 1.x data into projects - [Observability for Flowise with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/no-code-flowise/): Start here to integrate Opik into your Flowise-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Quarkus LangChain4j with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/java-quarkus-langchain4j/): Configure Quarkus LangChain4j OpenTelemetry export to send traces to Opik. - [Plugin with MDM](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/installation-mdm/) - [Policies](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/guardrails-policies/): Define your checks once in Opik and reference them by name from your application - [Prompts](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-sdk-prompts/) - [Quickstart](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-quickstart/) - [Reduce coding agent spend](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/cost-intelligence-reduce-agent-spend/) - [Roles and Permissions](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-roles-and-permissions/): Understanding and configuring workspace roles and the permission model - [Data Anonymization](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-data-anonymization/): Mask sensitive values in trace data for users who do not have permission to see them - [Dataset versioning migration](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/configuration-dataset-versioning-migration/): Understanding the automated dataset versioning migration process - [Evaluation Concepts](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-concepts/) - [Guards](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/guardrails-guardrails/) - [Local deployment](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/self-hosting-opik-local-deployment/): Describes how to run Opik locally using Docker Compose - [Observability for Claude Code with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/ai-coding-assistants-claude-code/): Log Claude Code sessions to Opik with the Opik plugin, or export Claude Code's native OpenTelemetry spans to Opik, and know which one to pick. - [Observability for Hermes with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/no-code-hermes/): Install and configure the opik-hermes plugin to export LLM, tool, and agent traces to Opik. - [Opik Query Language (OQL)](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-sdk-opik-query-language/) - [Plugin with managed settings](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/installation-managed-settings/) - [Prompt Playground](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-prompt-engineering-playground/) - [Roll out cost policies](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/cost-intelligence-roll-out-cost-policies/) - [Tracing Core Concepts](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-tracing-concepts/): Learn about the core concepts of Opik's tracing system, including traces, spans, and threads, and how they work together to provide comprehensive observability for your LLM applications. - [Data, privacy and security](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/cost-intelligence-data-privacy-security/) - [Debugging agents with Ollie](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-debug-agents/) - [Kubernetes deployment](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/self-hosting-opik-kubernetes/): Describes how to run Opik on a Kubernetes cluster - [LLM Model Registry Configuration](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/configuration-llm-model-registry/) - [macOS app with MDM](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/installation-macos-app/) - [Observability for Cursor with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/ai-coding-assistants-cursor/): Start here to integrate Opik into your Cursor-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Langflow with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/no-code-langflow/): Start here to integrate Opik into your Langflow applications for end-to-end LLM observability. - [Prompt injection model](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/guardrails-prompt-injection-model/): Opik Guard, our purpose-built detection model, evaluated on attacks it has never seen - [Custom models](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/guardrails-custom-guardrails/): Fine-tune a language model for a check the built-in guards do not cover - [Diagnostics](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-diagnostics/) - [Migrating from Bitnami Charts and Images](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/self-hosting-opik-helm/): Guide for migrating from Bitnami charts and images - [Observability for GitHub Copilot with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/ai-coding-assistants-github-copilot/): Send GitHub Copilot Chat (VS Code) and Copilot CLI sessions to Opik over OpenTelemetry, with clear content-capture and endpoint expectations. - [Observability for n8n with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/no-code-n8n/): Start here to integrate Opik into your n8n-based workflow automation for end-to-end LLM observability. - [UUIDv7 ingestion validation](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/configuration-uuid-validation/): Bound the timestamp a client may embed in a trace or span id - [ClickHouse Cold-Tier Migration](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/self-hosting-opik-clickhouse-cold-tier-migration/): Enabling tiered (cold) ClickHouse storage on a multi-replica cluster - [Guardrails server](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/guardrails-server/): Install, configure, and run the backend that powers the model-based guards - [MCP OAuth](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/configuration-mcp-oauth/): Let coding agents sign in to your deployment through the browser - [Observability for OpenAI Codex with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/ai-coding-assistants-openai-codex/): Configure OpenAI Codex OpenTelemetry export to send trace telemetry to Opik. - [Observability for OpenClaw with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/no-code-openclaw/): Install and configure the OpenClaw community plugin to export LLM, tool, and agent traces to Opik. - [Observability for OpenWebUI with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/no-code-openwebui/): Start here to integrate Opik into your OpenWebUI-based AI application for end-to-end LLM observability and monitoring. - [Platform Architecture](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/self-hosting-opik-architecture/): High-level overview on Opik's Platform Architecture - [Observability for Prompt Flow with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/no-code-prompt-flow/): Configure Prompt Flow tracing with OpenTelemetry endpoint settings compatible with Opik deployment modes. - [Scaling Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/self-hosting-opik-scaling/): Comprehensive guide for scaling Opik in production environments - [Advanced clickhouse backup](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/self-hosting-opik-backup/): Comprehensive guide for ClickHouse backup options in Opik Kubernetes deployments - [Ollie](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-ollie/) - [FAQ](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-faq/) - [Opik TypeScript SDK](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-typescript-sdk/) - [Troubleshooting](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/self-hosting-opik-troubleshooting/): Troubleshooting guide for common issues when running self-hosted Opik deployments. - [Self-host changelog](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/self-hosting-opik-changelog/): Breaking and critical changes for self-hosted deployments - [Opik Python SDK](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-python-sdk/): How to send data to Opik using the Opik Python SDK - [OpenTelemetry Python SDK](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-opentelemetry-python-sdk/): How to send data to Opik using the OpenTelemetry Python SDK - [Upgrading to Opik 2.0](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-opik-v2-upgrade/) ## Frameworks - [Frameworks](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/net-frameworks/) - [Observability for Microsoft Agent Framework (.NET) with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/net-microsoft-agent-framework-dotnet/): Start here to integrate Opik into your Microsoft Agent Framework-based .NET application for end-to-end LLM observability, unit testing, and optimization. ## Frameworks - [Frameworks](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-frameworks/) - [Observability for AG2 with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-ag2/): Start here to integrate Opik into your AG2-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Agent Spec with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-agentspec/): Start here to integrate Opik into your Agent Spec-based application for end-to-end observability, unit testing, and optimization. - [Observability for Agno with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-agno/): Start here to integrate Opik into your Agno-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for BeeAI (Python) with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-beeai/): Start here to integrate Opik into your BeeAI-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Claude Agent SDK with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-claude-agent-sdk/): Configure Claude Code telemetry and OTLP export settings with clear signal and compatibility expectations for Opik. - [Observability for AutoGen with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-autogen/): Start here to integrate Opik into your AutoGen-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for CrewAI with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-crewai/): Start here to integrate Opik into your CrewAI-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for DSPy with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-dspy/): Start here to integrate Opik into your DSPy-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Google Agent Development Kit (Python) with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-adk/): Start here to integrate Opik into your Google Agent Development Kit-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Haystack with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-haystack/): Start here to integrate Opik into your Haystack-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Harbor with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-harbor/): Start here to integrate Opik into your Harbor benchmark evaluation runs for end-to-end agent observability and analysis. - [Structured Output Tracking for Instructor with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-instructor/): Start here to integrate Opik into your Instructor-based genai application for structured output tracking, schema validation monitoring, and LLM call observability. - [Observability for LangChain (Python) with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-langchain/): Start here to integrate Opik into your LangChain-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for LangGraph with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-langgraph/): Start here to integrate Opik into your LangGraph-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for LangServe with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-langserve/): Configure LangServe host-level OpenTelemetry export for Opik with clear applicability and minimal setup guidance. - [Observability for LiveKit with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-livekit/): Start here to integrate Opik into your LiveKit-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for LlamaIndex with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-llama-index/): Start here to integrate Opik into your LlamaIndex-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Microsoft Agent Framework (Python) with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-microsoft-agent-framework/): Start here to integrate Opik into your Microsoft Agent Framework-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for OpenAI Agents with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-openai-agents/): Start here to integrate Opik into your OpenAI Agents-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Pipecat with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-pipecat/): Start here to integrate Opik into your Pipecat-based real-time voice agent application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Pydantic AI with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-pydantic-ai/): Start here to integrate Opik into your Pydantic AI-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Semantic Kernel (Python) with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-semantic-kernel/): Start here to integrate Opik into your Semantic Kernel-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Smolagents with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-smolagents/): Start here to integrate Opik into your Smolagents-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Strands Agents with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-strands-agents/): Start here to integrate Opik into your Strands Agents-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Temporal with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-temporal/): Configure Temporal Python OpenTelemetry tracing and export to Opik. - [Observability for Twilio Agent Connect with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-twilio-agent-connect/): Start here to integrate Opik into your Twilio Agent Connect voice agent for end-to-end LLM observability, unit testing, and optimization. - [Observability for VoltAgent with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-voltagent/): Start here to integrate Opik into your VoltAgent-based genai application for end-to-end LLM observability, unit testing, and optimization. ## Frameworks - [Frameworks](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-frameworks/) - [Observability for BeeAI (TypeScript) with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-beeai-typescript/): Start here to integrate Opik into your BeeAI-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for LangChain (JavaScript) with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-langchainjs/): Start here to integrate Opik into your LangChain-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Mastra with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-mastra/): Start here to integrate Opik into your Mastra-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Vercel AI SDK with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-vercel-ai-sdk/): Start here to integrate Opik into your Vercel AI SDK-based genai application for end-to-end LLM observability, unit testing, and optimization. ## Online evaluation - [Online evaluation](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/production-online-evaluation/) - [Online Evaluation rules](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/production-online-evaluation-rules/): Describes how to define scoring rules for production traces ## Specific Contribution Guides - [Specific Contribution Guides](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/contributing-specific-contribution-guides/) - [Documentation](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/contributing-guides-documentation/) - [Local Development Setup](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/contributing-guides-local-development/): Comprehensive guide for setting up and running Opik locally for development - [Python SDK](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/contributing-guides-python-sdk/) - [TypeScript SDK](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/contributing-guides-typescript-sdk/) - [Opik Optimizer](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/contributing-guides-agent-optimizer-sdk/) - [Frontend](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/contributing-guides-frontend/) - [Backend](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/contributing-guides-backend/) ## Troubleshooting - [Troubleshooting](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-sdk-troubleshooting/) - [Batching and update operations](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-sdk-troubleshooting-batching-and-updates/) ## Gateway - [Gateway](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/production-gateway/) - [Gateway](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/production-gateway-guardrails-gateway/): Overview of LLM gateway integrations available with Opik - [Anonymizers](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/production-gateway-guardrails-anonymizers/) ## MCP Server - [MCP Server](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-mcp-server/) - [Opik's MCP server](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-prompt-engineering-mcp-server/) - [Use cases](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-prompt-engineering-mcp-server-use-cases/) - [MCP tools reference](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-prompt-engineering-mcp-server-tools/) - [Advanced setup](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-prompt-engineering-mcp-server-advanced-setup/) - [FAQ & troubleshooting](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-prompt-engineering-mcp-server-faq/) ## Advanced - [Advanced](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-advanced/) - [Building Test Suites](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-building-evaluation-suites/) - [Evaluate your agent](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-advanced-evaluate-your-llm/): Step by step guide on how to evaluate your LLM application - [Resume an interrupted evaluation](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-advanced-resume-evaluations/): Continue an evaluation from where it stopped - [Manage datasets](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-advanced-manage-datasets/): Guides you through the process of creating and managing datasets - [Evaluate agent trajectories](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-advanced-evaluate-agent-trajectory/): Step-by-step guide to evaluate agent trajectories - [Evaluate multi-turn agents](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-advanced-evaluate-multi-turn-agents/): Step-by-step guide to evaluate multi-turn agents - [Annotation Queues](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-advanced-annotation-queues/): Enable subject matter experts to review and annotate agent outputs with easy queues, invitations, and a clean annotation UI - [Manually logging experiments](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-advanced-log-experiments-with-rest-api/): Step by step guide to logging evaluation results using Python SDK and REST API - [Exporting experiment results](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-advanced-export-experiment-results/): Export a full experiment result set to CSV with the Python SDK ## Evaluation - [Evaluation](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-sdk-evaluation/) - [Evaluation](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-sdk-evaluation-overview/) - [Quick Start](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-sdk-evaluation-quick-start/) - [Datasets](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-sdk-evaluation-datasets/) - [Evaluate Function](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-sdk-evaluation-evaluate-function/) - [evaluatePrompt Function](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-sdk-evaluation-evaluate-prompt-function/) - [Models](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-sdk-evaluation-models/) - [Evaluation Metrics](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-sdk-evaluation-metrics/) - [Experiments](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-sdk-evaluation-experiments/) - [Test Suites](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-sdk-evaluation-test-suites/) ## Prompt library - [Prompt library](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-prompt-library/) - [Prompt Library Overview](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-prompt-engineering-overview/) - [Getting started with the Prompt Library](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-prompt-engineering-getting-started/) - [Text and chat prompts](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-prompt-engineering-prompt-types/) - [Version control](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-prompt-engineering-version-control/) ## Workspace Settings - [Workspace Settings](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-workspace-settings/) - [Overview](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-workspace-settings-overview/): Understanding workspace-level configuration options in Opik - [Feedback Definitions](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-workspace-settings-feedback-definitions/): Configure custom feedback types for evaluating LLM outputs - [AI Providers](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-workspace-settings-ai-providers/): Configure connections to Large Language Model providers - [Workspace Preferences](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-workspace-settings-workspace-preferences/): Configure workspace-wide behavior settings - [Workspace Members](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-workspace-settings-workspace-members/): Invite users, manage members, and control workspace-level access ## Advanced - [Advanced](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-advanced/) - [Log traces](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-tracing-advanced-log-traces/) - [Log conversations](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-tracing-advanced-log-chat-conversations/) - [Log media & attachments](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-tracing-advanced-log-multimodal-traces/) - [Log Agent Graphs](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-tracing-advanced-log-agent-graphs/) - [Log distributed traces](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-tracing-advanced-log-distributed-traces/) - [Log user feedback](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-tracing-advanced-annotate-traces/) - [Cost tracking](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-tracing-advanced-cost-tracking/) - [Export data](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-export-data/) - [Migrate data](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-migrate-data/) - [SDK configuration](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-tracing-advanced-sdk-configuration/) - [Offline fallback and message replay](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-tracing-advanced-offline-fallback/) ## Alerts - [Alerts](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/production-alerts/) - [Alerts](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/production-alerts-alerts/): Configure automated webhook notifications to stay informed about events in your Opik workspace, from trace errors to feedback scores and prompt changes. ## Model Providers - [Model Providers](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-model-providers/) - [Observability for Cloudflare Workers AI with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-cloudflare-workers-ai/): Start here to integrate Opik into your Cloudflare Workers AI-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Google Gemini (TypeScript) with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-gemini-typescript/): Start here to integrate Opik into your Google Gemini-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for OpenAI (TypeScript) with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/typescript-openai-typescript/): Start here to integrate Opik into your OpenAI-based genai application for end-to-end LLM observability, unit testing, and optimization. ## Optimization runs - [Optimization runs](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs/) - [Agent Optimization](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-overview/): Learn about Opik's automated LLM prompt and agent optimization SDK. Discover MetaPrompt, Few-shot Bayesian, and Evolutionary optimization algorithms for enhanced performance. - [Optimization Studio](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-optimization-studio/): Run prompt optimizations from the Opik UI with datasets, metrics, and visual progress tracking. - [Quickstart](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-quickstart/): Install the Agent Optimizer SDK, run your first optimization, and inspect the results in under 10 minutes. - [Optimizer Introduction Cookbook](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-quickstart-notebook/): Learn how to use Opik Agent Optimizer with the HotPotQA dataset through an interactive notebook, covering setup, configuration, and optimization techniques. - [Optimizer Frequently Asked Questions](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-faq/): Find answers to common questions about Opik Agent Optimizer, including optimizer selection, configuration, usage, and best practices. - [Changelog](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-changelog/): Release notes focused on Agent Optimizer features. - [Known Issues](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-known-issues/): Known runtime issues when running Opik Optimizer with current dependencies. ### Optimization - [Optimization](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization/) - [Opik Agent Optimizer Core Concepts](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-optimization-concepts/): Learn about the core concepts of Opik Agent Optimizer, including key terms, evaluation processes, optimization workflows, and best practices for effective LLM optimization. - [Configuring LLM Providers](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-optimization-configure-models/): Learn how to configure different LLM providers like OpenAI, Anthropic, Gemini, Azure, and Ollama for use with the Opik Agent Optimizer. - [Define datasets](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-optimization-define-datasets/): Design, version, and validate datasets used for optimization runs. - [Define metrics](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-optimization-define-metrics/): Create reliable metrics and composite objectives for Agent Optimizer runs. - [Optimize prompts](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-optimization-optimize-prompts/): Pick the right optimizer, run experiments, and ship better prompts. - [Optimize tools (MCP)](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-optimization-optimize-tools/): Improve MCP tool and parameter descriptions without changing prompt text. - [Optimize agents](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-optimization-optimize-agents/): Connect the Agent Optimizer to Agent Frameworks. - [Optimize multimodal prompts](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-optimization-optimize-multimodal/): Run optimizations for prompts that combine text, images, and other modalities. - [Dashboard results](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-optimization-dashboard-results/): Analyze optimization trials, failure modes, and improvements inside Opik. ### Optimization Algorithms - [Optimization Algorithms](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-algorithms/) - [Optimization algorithms overview](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-algorithms-overview/): Compare Agent Optimizer algorithms and pick the right one for your workload. - [Optimizer benchmarks](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-algorithms-benchmarks/): Compare algorithm performance across common datasets and learn how to run the benchmark suite locally. - [MetaPrompt Optimizer](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-algorithms-metaprompt-optimizer/): Learn how to use the MetaPrompt Optimizer to refine and improve your LLM prompts through systematic analysis and iterative refinement. - [HRPO (Hierarchical Reflective Prompt Optimizer)](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-algorithms-hierarchical-adaptive-optimizer/): Learn how to use HRPO (Hierarchical Reflective Prompt Optimizer) to improve prompts through systematic root cause analysis of failure modes and targeted refinement. - [Few-Shot Bayesian Optimizer](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-algorithms-fewshot-bayesian-optimizer/): Learn how to use the Few-Shot Bayesian Optimizer to find optimal few-shot examples for your chat-based prompts using Bayesian optimization techniques. - [Evolutionary Optimizer: Genetic Algorithms](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-algorithms-evolutionary-optimizer/): Learn how to use the Evolutionary Optimizer to discover optimal prompts through genetic algorithms, with support for multi-objective optimization and LLM-driven genetic operations. - [GEPA Optimizer](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-algorithms-gepa-optimizer/): Use the external GEPA package through Opik's `GepaOptimizer` to optimize a single system prompt for single-turn tasks with a reflection model. - [Parameter Optimizer: Bayesian Parameter Tuning](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-algorithms-parameter-optimizer/): Learn how to use the Parameter Optimizer to find optimal LLM call parameters (temperature, top_p, etc.) using Bayesian optimization without changing your prompt. - [Tool Optimization (MCP & Function Calling)](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-algorithms-tool-optimization/): Learn how to optimize prompts that leverage MCP (Model Context Protocol) tools and function calling capabilities across supported optimizers. ### Cookbooks & Tutorials - [Cookbooks & Tutorials](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-cookbooks-tutorials/) - [Synthetic Data Optimizer Cookbook](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-cookbooks-synthetic-data-optimizer-cookbook/): Learn how to generate synthetic Q&A data from Opik traces and optimize prompts using the MetaPromptOptimizer through an interactive notebook. - [ARC-AGI Optimization Tutorial](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-cookbooks-arc-agi-optimizer-cookbook/): End-to-end ARC-AGI optimization walkthrough with Opik Agent Optimizer. - [Multimodal Agent Optimization Tutorial](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-cookbooks-multimodal-agent-optimizer-cookbook/): Multimodal agent optimization tutorial inspired by a self-driving car example. ### Advanced Topics - [Advanced Topics](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-advanced-topics/) - [Extending Optimizers](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-advanced-extending-optimizers/): Learn how to extend Opik's optimization framework with custom algorithms and contribute to the project's development. - [Custom metrics](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-advanced-custom-metrics/): Build specialized metrics, integrate external models, and reuse them across optimizations. - [Custom Optimizer Prompts](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-advanced-prompt-customization/): Learn how to override and customize the internal prompt templates used by Opik optimizers to add domain constraints, safety requirements, or custom formatting. - [Sampling controls](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-advanced-n-samples/): Use n_samples, n_samples_minibatch, and the n parameter to trade cost for stability and exploration. - [Multiple Completions (n parameter)](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-advanced-multiple-completions/): Learn how to use the n parameter to generate multiple candidate outputs per evaluation, reducing variance and improving optimization results through best-of-k selection. - [Chaining optimizers](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-advanced-chaining-optimizers/): Run multiple optimizers in sequence to balance exploration and fine-tuning. - [Opik Agent Optimizer API Reference](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/development-optimization-runs-advanced-api-reference/): Technical SDK reference guide ## Admin Dashboard - [Admin Dashboard](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-admin-dashboard/) - [Admin Dashboard](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-admin-dashboard-overview/): How to access and use the organization administration dashboard - [Workspaces](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-admin-dashboard-workspaces/): Create and manage workspaces within your organization - [Users](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-admin-dashboard-users/): Manage users and organization roles - [Organization Settings](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-admin-dashboard-organization-settings/): Manage organization-wide configuration - [Service Accounts](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-admin-dashboard-service-accounts/): Creating and managing service accounts for automated systems and integrations ## Developer Programs - [Developer Programs](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/contributing-developer-programs/) - [Bounty Program](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/contributing-developer-programs-bounties/) ## Changelog - [Changelog](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog/) - [Changelog 2026 09 28](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-09-28/) - [Changelog 2026 09 21](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-09-21/) - [Changelog 2026 09 14](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-09-14/) - [Changelog 2026 09 07](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-09-07/) - [Changelog 2026 08 31](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-08-31/) - [Changelog 2026 08 24](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-08-24/) - [Changelog 2026 08 17](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-08-17/) - [Changelog 2026 08 10](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-08-10/) - [Changelog 2026 07 20](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-07-20/) - [Changelog 2026 07 13](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-07-13/) - [Changelog 2026 07 06](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-07-06/) - [Changelog 2026 06 23](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-06-23/) - [Changelog 2026 06 16](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-06-16/) - [Changelog 2026 06 09](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-06-09/) - [Changelog 2026 06 02](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-06-02/) - [Changelog 2026 05 26](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-05-26/) - [Changelog 2026 05 19](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-05-19/) - [Changelog 2026 05 12](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-05-12/) - [Changelog 2026 05 05](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-05-05/) - [Changelog 2026 03 03](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-03-03/) - [Changelog 2026 02 10](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-02-10/) - [Changelog 2026 01 27](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-01-27/) - [Changelog 2026 01 13](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2026-01-13/) - [Changelog 2025 12 18](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-12-18/) - [Changelog 2025 12 09](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-12-09/) - [Changelog 2025 11 18](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-11-18/) - [Changelog 2025 11 04](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-11-04/) - [Changelog 2025 10 21](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-10-21/) - [Changelog 2025 10 03](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-10-03/) - [Changelog 2025 09 05](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-09-05/) - [Changelog 2025 08 22](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-08-22/) - [Changelog 2025 08 01](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-08-01/) - [Changelog 2025 07 18](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-07-18/) - [Changelog 2025 07 04](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-07-04/) - [Changelog 2025 06 20](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-06-20/) - [Changelog 2025 06 06](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-06-06/) - [Changelog 2025 05 23](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-05-23/) - [Changelog 2025 05 05](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-05-05/) - [Changelog 2025 04 28](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-04-28/) - [Changelog 2025 04 21](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-04-21/) - [Changelog 2025 04 14](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-04-14/) - [Changelog 2025 04 07](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-04-07/) - [Changelog 2025 03 31](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-03-31/) - [Changelog 2025 03 24](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-03-24/) - [Changelog 2025 03 17](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-03-17/) - [Changelog 2025 03 10](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-03-10/) - [Changelog 2025 03 03](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-03-03/) - [Changelog 2025 02 24](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-02-24/) - [Changelog 2025 02 17](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-02-17/) - [Changelog 2025 02 10](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-02-10/) - [Changelog 2025 02 03](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-02-03/) - [Changelog 2025 01 27](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-01-27/) - [Changelog 2025 01 20](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-01-20/) - [Changelog 2025 01 13](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-01-13/) - [Changelog 2025 01 06](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2025-01-06/) - [Changelog 2024 12 30](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2024-12-30/) - [Changelog 2024 12 23](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2024-12-23/) - [Changelog 2024 12 16](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2024-12-16/) - [Changelog 2024 12 09](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2024-12-09/) - [Changelog 2024 12 02](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2024-12-02/) - [Changelog 2024 11 25](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2024-11-25/) - [Changelog 2024 11 18](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2024-11-18/) - [Changelog 2024 11 11](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2024-11-11/) - [Changelog 2024 11 04](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2024-11-04/) - [Changelog 2024 10 21](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2024-10-21/) - [Changelog 2024 10 18](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2024-10-18/) - [Changelog 2024 10 14](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2024-10-14/) - [Changelog 2024 10 07](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2024-10-07/) - [Changelog 2024 09 30](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/getting-started-changelog-2024-09-30/) ## Metrics - [Metrics](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics/) - [Overview](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-overview/): Describes all the built-in evaluation metrics provided by Opik - [Heuristic metrics](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-heuristic-metrics/): Describes all the built-in heuristic metrics provided by Opik - [Hallucination](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-hallucination/): Describes the Hallucination metric - [LLM Juries](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-llm-juries/): Combine multiple judges into an ensemble with LLMJuriesJudge - [G-Eval](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-g-eval/): Describes Opik's built-in G-Eval metric which is a task agnostic LLM as a Judge metric - [Conversation-level GEval Metrics](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-g-eval-conversation-metrics/): How to run GEval-based judges on full conversations - [Compliance risk](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-compliance-risk/): Flag non-compliant or high-risk assistant replies with ComplianceRiskJudge - [Prompt uncertainty](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-prompt-diagnostics/): Estimate prompt ambiguity with PromptUncertaintyJudge - [Moderation](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-moderation/): Describes the Moderation metric - [Meaning Match](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-meaning-match/): Describes the Meaning Match metric - [Usefulness](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-usefulness/): Describes the Usefulness metric - [Summarization consistency](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-summarization-consistency/): Ensure autogenerated summaries stay faithful to the source content - [Summarization coherence](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-summarization-coherence/): Rate how readable and well-structured a summary is with SummarizationCoherenceJudge - [Dialogue helpfulness](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-dialogue-helpfulness/): Measure how helpful an assistant reply is within a dialogue - [Answer relevance](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-answer-relevance/): Describes the Answer Relevance metric - [Context precision](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-context-precision/): Describes the Context Precision metric - [Context recall](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-context-recall/): Describes the Context Recall metric - [Trajectory accuracy](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-trajectory-accuracy/): Score whether an agent followed the expected action path - [Agent task completion](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-agent-task-completion/): Verify whether an agent fulfilled its assigned objective - [Agent tool correctness](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-agent-tool-correctness/): Evaluate whether an agent invoked and interpreted tools correctly - [Conversational metrics](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-conversation-threads-metrics/): Describes metrics related to scoring the conversational threads - [Custom model](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-custom-model/): Describes how to use a custom model for Opik's built-in LLM as a Judge metrics - [Advanced configuration](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-advanced-configuration/): Fine-tune Opik metrics with async scoring, evaluator temperatures, and logprob handling - [Custom metric](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-custom-metric/): Describes how to create your own metric to use with Opik's evaluation platform - [Custom conversation metric](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-custom-conversation-metric/): Learn how to create custom metrics for evaluating multi-turn conversations - [Structured Output Compliance](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-structure-output-compliance/): Describes the StructuredOutputCompliance metric - [Task span metrics](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-metrics-task-span-metrics/): Learn how to create task span metrics for evaluating the detailed execution information of your LLM tasks ## Authentication - [Authentication](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-authentication/) - [Authentication Overview](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-authentication-overview/): Understanding authentication options and choosing the right approach - [SAML SSO](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-authentication-saml/): Setting up SAML-based single sign-on with your identity provider - [OIDC SSO](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-authentication-oidc/): Setting up OpenID Connect authentication with your identity provider - [JWT Authentication](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/administration-authentication-jwt/): Setting up JWT token authentication for programmatic and service access ## Dashboards - [Dashboards](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-dashboards/) - [Dashboards](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-tracing-dashboards-dashboards/): Create customizable dashboards to monitor quality, cost, and performance of your LLM projects and visualize experiment results. - [Production monitoring](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/observability-tracing-dashboards-production-monitoring/): Describes how to monitor your LLM applications in production using Opik ## Model Providers - [Model Providers](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-model-providers/) - [Observability for Anthropic with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-anthropic/): Start here to integrate Opik into your Anthropic-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for AWS Bedrock with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-bedrock/): Start here to integrate Opik into your AWS Bedrock-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for BytePlus with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-byteplus/): Start here to integrate Opik into your BytePlus-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Cohere with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-cohere/): Start here to integrate Opik into your Cohere-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for DeepSeek with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-deepseek/): Start here to integrate Opik into your DeepSeek-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Fireworks AI with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-fireworks-ai/): Start here to integrate Opik into your Fireworks AI-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Google Gemini (Python) with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-gemini/): Start here to integrate Opik into your Google Gemini-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Groq with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-groq/): Start here to integrate Opik into your Groq-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for TypeSafe AI (Python) with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-typesafe/): Start here to integrate Opik into your TypeSafe AI-based application for end-to-end observability of System One (Jev) decisions. - [Observability for MiniMax with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-minimax/): Track MiniMax model calls with Opik through the OpenAI-compatible or Anthropic-compatible API. - [Observability for Mistral AI (Python) with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-mistral/): Start here to integrate Opik into your Mistral AI-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Novita AI with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-novita-ai/): Start here to integrate Opik into your Novita AI-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Ollama with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-ollama/): Start here to integrate Opik into your Ollama-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for OpenAI (Python) with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-openai/): Start here to integrate Opik into your OpenAI-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Qianfan with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-qianfan/): Start here to integrate Opik into your Qianfan-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Predibase with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-predibase/): Start here to integrate Opik into your Predibase-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Together AI with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-together-ai/): Start here to integrate Opik into your Together AI-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for IBM watsonx with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-watsonx/): Start here to integrate Opik into your IBM watsonx-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for xAI Grok with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-xai-grok/): Start here to integrate Opik into your xAI Grok-based genai application for end-to-end LLM observability, unit testing, and optimization. ## Tutorials - [Tutorials](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-tutorials/) - [Best practices for evaluating agents](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-evaluate-agents/): Step-by-step guide on how to evaluate and optimize AI agents throughout their lifecycle - [Evaluate threads](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-evaluate-threads/): Step-by-step guide on how to evaluate conversation threads - [Cookbook - Evaluate hallucination metric](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-evaluate-hallucination-metric/) - [Cookbook - Evaluate moderation metric](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/evaluation-evaluate-moderation-metric/) ## Dataset Management - [Dataset Management](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-dataset-management/) - [Observability for Hugging Face Datasets with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-huggingface-datasets/): Start here to integrate Opik with Hugging Face Datasets for end-to-end LLM observability, unit testing, and optimization. ## Evaluation - [Evaluation](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-evaluation/) - [Evaluate LLM Applications with Ragas Metrics in Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-ragas/): Use Ragas evaluation metrics to assess your LLM application quality and automatically track results in Opik for comprehensive performance monitoring. ## Gateways - [Gateways](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-gateways/) - [Observability for Opik LLM Gateway with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-opik-llm-gateway/): Start here to integrate Opik LLM Gateway into your genai application for centralized LLM provider access using a consistent API format. - [Observability for Kong AI Gateway with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-kong-ai-gateway/): Start here to integrate Kong AI Gateway with Opik for production-ready LLM gateway capabilities with enterprise features. - [Observability for AISuite with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-aisuite/): Start here to integrate Opik into your AISuite-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Helicone with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-helicone/): Learn how to integrate Helicone with Opik to log and monitor your LLM traffic using the standard Helicone integration setup. - [Observability for LiteLLM with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-litellm/): Start here to integrate Opik into your LiteLLM-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for OpenRouter with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-openrouter/): Start here to integrate Opik into your OpenRouter-based genai application for end-to-end LLM observability, unit testing, and optimization. - [Observability for Portkey with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-portkey/): Start here to integrate Portkey with Opik for enterprise-grade LLM gateway capabilities with advanced routing and fallback features. - [Observability for TrueFoundry with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-truefoundry/): Start here to integrate the TrueFoundry AI Gateway with Opik and trace every LLM and MCP call that passes through the gateway. - [Observability for Vercel AI Gateway with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-vercel-ai-gateway/): Start here to integrate Vercel AI Gateway with Opik for unified access to multiple AI providers with edge-optimized performance. ## Other - [Other](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-other/) - [Validation Tracking for Guardrails AI with Opik](https://opik-import.org-01ktrz69sw5mhv9wm5s6742fp8.doctorine.xyz/current/guides/python-guardrails-ai/): Start here to integrate Opik into your Guardrails AI-based genai application for validation tracking, compliance monitoring, and guard evaluation. --- _Truncated: 764 more page(s) omitted to stay under the 100,000-character llms-full.txt cap. Fetch individual pages as .md instead._