API Documentation
Projects
Simulations
Evaluators
Copy
curl --location 'https://api.withblast.com/projects/550e8400-e29b-41d4-a716-446655440000/benchmarks/7d9c8f90-1234-5678-9abc-def012345678/tests?offset=0&limit=2' \
--header 'Authorization: Bearer YOUR_JWT_TOKEN'
Copy
{
"tests": [
{
"test_id": 1234,
"benchmark_id": "7d9c8f90-1234-5678-9abc-def012345678",
"prompt": "How do I reset my password?",
"last_scores": {
"response_style": false,
"language_detection": true,
"knowledge_retrieval": true
},
"run_count": 1,
"last_run_at": "2024-01-23T10:30:00Z",
"project_id": "550e8400-e29b-41d4-a716-446655440000",
"created_at": "2024-01-20T14:30:00Z"
},
{
"test_id": 1235,
"benchmark_id": "7d9c8f90-1234-5678-9abc-def012345678",
"prompt": "My order hasn't arrived yet, what should I do?",
"last_scores": {
"response_style": true,
"language_detection": true,
"knowledge_retrieval": true
},
"run_count": 12,
"last_run_at": "2024-01-23T09:15:00Z",
"project_id": "550e8400-e29b-41d4-a716-446655440000",
"created_at": "2024-01-20T14:35:00Z"
}
],
"total": 25
}
Test Management
List Tests
Get a paginated list of tests for a specific benchmark
GET
/
projects
/
{project_id}
/
benchmarks
/
{benchmark_id}
/
tests
Copy
curl --location 'https://api.withblast.com/projects/550e8400-e29b-41d4-a716-446655440000/benchmarks/7d9c8f90-1234-5678-9abc-def012345678/tests?offset=0&limit=2' \
--header 'Authorization: Bearer YOUR_JWT_TOKEN'
Copy
{
"tests": [
{
"test_id": 1234,
"benchmark_id": "7d9c8f90-1234-5678-9abc-def012345678",
"prompt": "How do I reset my password?",
"last_scores": {
"response_style": false,
"language_detection": true,
"knowledge_retrieval": true
},
"run_count": 1,
"last_run_at": "2024-01-23T10:30:00Z",
"project_id": "550e8400-e29b-41d4-a716-446655440000",
"created_at": "2024-01-20T14:30:00Z"
},
{
"test_id": 1235,
"benchmark_id": "7d9c8f90-1234-5678-9abc-def012345678",
"prompt": "My order hasn't arrived yet, what should I do?",
"last_scores": {
"response_style": true,
"language_detection": true,
"knowledge_retrieval": true
},
"run_count": 12,
"last_run_at": "2024-01-23T09:15:00Z",
"project_id": "550e8400-e29b-41d4-a716-446655440000",
"created_at": "2024-01-20T14:35:00Z"
}
],
"total": 25
}
Authentication
Bearer token
Path Parameters
The unique identifier of the project (UUID format)
The unique identifier of the benchmark (UUID format)
Query Parameters
Number of items to skip for pagination
Number of items to return (1-100)
Response
Array of test objects
Show Test Object
Show Test Object
Unique test identifier
Associated benchmark ID (UUID)
Test prompt/input
Latest evaluation scores from the most recent run
Total number of runs for this test
ISO 8601 timestamp of the most recent run
Associated project ID (UUID)
ISO 8601 timestamp of creation
Total number of tests in the benchmark
Copy
curl --location 'https://api.withblast.com/projects/550e8400-e29b-41d4-a716-446655440000/benchmarks/7d9c8f90-1234-5678-9abc-def012345678/tests?offset=0&limit=2' \
--header 'Authorization: Bearer YOUR_JWT_TOKEN'
Copy
{
"tests": [
{
"test_id": 1234,
"benchmark_id": "7d9c8f90-1234-5678-9abc-def012345678",
"prompt": "How do I reset my password?",
"last_scores": {
"response_style": false,
"language_detection": true,
"knowledge_retrieval": true
},
"run_count": 1,
"last_run_at": "2024-01-23T10:30:00Z",
"project_id": "550e8400-e29b-41d4-a716-446655440000",
"created_at": "2024-01-20T14:30:00Z"
},
{
"test_id": 1235,
"benchmark_id": "7d9c8f90-1234-5678-9abc-def012345678",
"prompt": "My order hasn't arrived yet, what should I do?",
"last_scores": {
"response_style": true,
"language_detection": true,
"knowledge_retrieval": true
},
"run_count": 12,
"last_run_at": "2024-01-23T09:15:00Z",
"project_id": "550e8400-e29b-41d4-a716-446655440000",
"created_at": "2024-01-20T14:35:00Z"
}
],
"total": 25
}
⌘I