vision-eval (0.1.49)

Published 2026-05-07 16:46:06 +00:00 by pannabel

Installation

pip install --index-url  vision-eval

About this package

Agent evaluation and regression testing Django app

Vision-Eval

A Django app for agent evaluation and regression testing.

Installation

1. Install the package

pip install datapath-eval

Or add to your requirements.txt:

datapath-eval==x.y.z

2. Add required dependencies

This package requires the following dependencies:

Django>=5.2.11
django-cotton>=2.6.1
djangorestframework>=3.16.1
psycopg2-binary>=2.9.10
python-dotenv>=1.1.1
httpx>=0.28.1
instructor>=1.14.5
openpyxl>=3.1.0

3. Update your Django settings.py

Add the following to your INSTALLED_APPS:

INSTALLED_APPS = [
    # ... your existing apps
    'django.contrib.humanize',
    'vision-eval.apps.EvalConfig',
    'django_cotton',
]

Add Langfuse configuration for regression eval trace fetching:

# Langfuse — for regression eval trace fetching (public REST API)
LANGFUSE_PUBLIC_KEY = os.getenv("LANGFUSE_PUBLIC_KEY", "")
LANGFUSE_SECRET_KEY = os.getenv("LANGFUSE_SECRET_KEY", "")
LANGFUSE_HOST = os.getenv("LANGFUSE_HOST", "https://cloud.langfuse.com")

4. Update your project urls.py

Add the following to your project's urls.py:

from django.urls import path, include

urlpatterns = [
    # ... your existing URL patterns
    path('admin/eval/', include("eval.urls")),
]

5. Run migrations

python manage.py migrate

Usage

After installation, you can access the evaluation dashboard at:

http://your-domain/admin/eval/

The dashboard provides:

  • Trace evaluations
  • Regression testing
  • Gold set management
  • Criteria configuration

Requirements

  • Python >= 3.13
  • Django >= 5.2

How to Build

python -m build python -m twine upload dist/*

Requirements

Requires Python: >=3.11
Details
PyPI
2026-05-07 16:46:06 +00:00
2
864 KiB
Assets (2)
Versions (2) View all
0.1.49 2026-05-07
0.1.40 2026-03-27