# Agentic test-environment engineering course

> Create hermetic fixtures, layered oracles, adversarial scenarios, and trace-based evaluations that let agent systems fail safely and improve continuously.

- Canonical: https://learning.reopt.ai/en/courses/agentic-testing
- Language: en
- HTML: https://learning.reopt.ai/en/courses/agentic-testing

---

[Agent engineering](/en/tracks/agent-engineering)

# Agentic test-environment engineering

Build deterministic evidence for nondeterministic workers

Create hermetic fixtures, layered oracles, adversarial scenarios, and trace-based evaluations that let agent systems fail safely and improve continuously.
Advanced 8 lessons 515 XP About 89 min

Source · Handbook · Agentic test-environment engineering · Source reviewed 2026-07-01

Complete the prerequisite courses first
[Agentic documentation](/en/courses/agentic-documentation) to unlock this course.

[Study prerequisites](/en/courses/agentic-documentation)

![Agentic test-environment engineering course](/images/home/track-agent-engineering.png)
0%

Course progress 9 learning steps

## What you'll learn

- Design deterministic test boundaries around stochastic agent behavior.
- Combine contract, property, scenario, and model-based evaluation.
- Test tool failure, prompt injection, race conditions, and recovery paths.
- Run regression gates and production feedback loops without leaking sensitive data.

1

## 1. 테스트 하네스와 실행 토폴로지

runner·환경·계약·증거·게이트를 하나의 시스템으로 봅니다.

- 테스트 환경은 제품의 의사결정 인프라 probe portfolio, runner topology, evidence schema와 release 의미 Concept 45 XP
- 테스트 시스템 구조 퀴즈 probe·runner·environment·gate 책임 구분 Quiz 50 XP

2

## 2. 환경·데이터·Fixture 계약

테스트가 실패 원인을 숨기지 않도록 상태 구성 책임을 분리합니다.

- 환경은 재현 가능한 입력이다 seed·reset·clock·queue·flag와 identity/domain/external fixture Concept 45 XP
- 실전: 간헐적인 결제 E2E 공유 상태와 비동기 완료를 재설계 Scenario 60 XP

3

## 3. Flake와 Evidence 운영

비결정성을 분류·격리·복구하는 운영 상태로 관리합니다.

- Flake는 환경에서 새는 비결정성 taxonomy, quarantine, SLA, normalizer와 evidence completeness Concept 45 XP
- Flake 운영 준비도 감사 분류·격리·증거·SLA 체계 점검 Checklist 55 XP

4

## 4. 릴리즈 게이트·SLO·소유권

테스트 결과를 배포 판단과 조직 책임으로 연결합니다.

- Red/Green을 넘어 의사결정으로 PR·main·release·canary gate, KPI 계층, audit trail과 RACI Concept 45 XP
- 워크북: 릴리즈 게이트 운영표 위험·probe·증거·owner·SLO를 한 장으로 연결 Workbook 70 XP

## Final challenge

Turn what you learned into a reusable work artifact.

- 최종 챌린지 · 테스트 운영 모델 환경·증거·flake·gate·SLO를 연결한 테스트 하네스 설계 Complete lessons first 100 XP

---

Site guide for agents: https://learning.reopt.ai/llms.txt · Sitemap: https://learning.reopt.ai/sitemap.xml · Contact: https://learning.reopt.ai/contact