dan/skills

dan 4da1890fc3 docs: add scenario schema and example test fixtures

Scaffold for agent capability benchmark harness (skills-qng9):
- docs/specs/scenario-schema.md: YAML schema for test scenarios
- tests/scenarios/: Easy, medium, hard example scenarios
- tests/fixtures/: Python fixtures for testing

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

2026-01-11 21:24:28 -08:00

673 B

Raw Permalink Blame History

Flask User API Fixture

Flask application with user management for testing agent capability on medium/hard tasks.

Structure

src/
  __init__.py          # App factory
  cache.py             # Cache utilities
  routes/
    users.py           # User endpoints
  models/
    user.py            # User model
tests/
  test_users.py        # User endpoint tests
  stress_test_cache.py # Concurrency stress test

Scenarios Using This Fixture

medium/add-caching-to-api.yaml - Add caching to user lookup
hard/fix-race-condition.yaml - Debug cache race condition

Notes

This fixture intentionally contains a subtle race condition for the hard scenario.