Metadata-Version: 2.4
Name: vision-eval
Version: 0.1.49
Summary: Agent evaluation and regression testing Django app
Project-URL: Homepage, https://git.mydatapath.com/datapath/Vision-Eval
Project-URL: Issues, https://git.mydatapath.com/datapath/Vision-Eval/issues
Author-email: Peter Annabel <pannabel@mydatapath.com>, Haskell Macaraig <hmacaraig@mydatapath.com>
License-Expression: LicenseRef-Proprietary
Keywords: agent,django,eval,regression
Classifier: Framework :: Django
Classifier: Framework :: Django :: 5.2
Classifier: Intended Audience :: Developers
Classifier: Programming Language :: Python :: 3.13
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Requires-Python: >=3.11
Requires-Dist: django-cotton==2.6.1
Requires-Dist: django==5.2.11
Requires-Dist: djangorestframework==3.16.1
Requires-Dist: httpx==0.28.1
Requires-Dist: instructor==1.14.5
Requires-Dist: openpyxl>=3.1.0
Requires-Dist: psycopg2-binary==2.9.10
Requires-Dist: python-dotenv==1.1.1
Requires-Dist: wristband-django-auth==0.1.1
Description-Content-Type: text/markdown

# Vision-Eval

A Django app for agent evaluation and regression testing.

## Installation

### 1. Install the package

```bash
pip install datapath-eval
```

Or add to your requirements.txt:

```
datapath-eval==x.y.z
```

### 2. Add required dependencies

This package requires the following dependencies:

```
Django>=5.2.11
django-cotton>=2.6.1
djangorestframework>=3.16.1
psycopg2-binary>=2.9.10
python-dotenv>=1.1.1
httpx>=0.28.1
instructor>=1.14.5
openpyxl>=3.1.0
```

### 3. Update your Django settings.py

Add the following to your INSTALLED_APPS:

```python
INSTALLED_APPS = [
    # ... your existing apps
    'django.contrib.humanize',
    'vision-eval.apps.EvalConfig',
    'django_cotton',
]
```

Add Langfuse configuration for regression eval trace fetching:

```python
# Langfuse — for regression eval trace fetching (public REST API)
LANGFUSE_PUBLIC_KEY = os.getenv("LANGFUSE_PUBLIC_KEY", "")
LANGFUSE_SECRET_KEY = os.getenv("LANGFUSE_SECRET_KEY", "")
LANGFUSE_HOST = os.getenv("LANGFUSE_HOST", "https://cloud.langfuse.com")
```

### 4. Update your project urls.py

Add the following to your project's urls.py:

```python
from django.urls import path, include

urlpatterns = [
    # ... your existing URL patterns
    path('admin/eval/', include("eval.urls")),
]
```

### 5. Run migrations

```bash
python manage.py migrate
```

## Usage

After installation, you can access the evaluation dashboard at:

```
http://your-domain/admin/eval/
```

The dashboard provides:
- Trace evaluations
- Regression testing
- Gold set management
- Criteria configuration

## Requirements

- Python >= 3.13
- Django >= 5.2

# How to Build
> python -m build
> python -m twine upload dist/*