github-actions[bot]
published Aug 26, 2026, 1:09 PM · updated Aug 26, 2026, 1:09 PM
Part Summary
| Part | Files | Mean Score | Std Dev |
|---|---|---|---|
| Part 1 — core path (lessons 00–14) | 54 |
6.28 / 10.0 |
±0.73 |
| Part 2 — advanced (lessons 15+) | 34 |
6.03 / 10.0 |
±0.37 |
| Overall corpus | 89 |
6.18 / 10.0 |
±0.63 |
Part 1 Scores (lessons 00–14)
| File | Overall Score |
|---|---|
workshop/side-quest-01-02-environment-reference.md |
5.31 / 10.0 |
workshop/side-quest-11-06-anthropic-key.md |
5.39 / 10.0 |
workshop/04-github-actions-intro.md |
5.42 / 10.0 |
workshop/05-agentic-workflows-intro.md |
5.43 / 10.0 |
workshop/14b-pr-reviewer-workflow.md |
5.47 / 10.0 |
workshop/side-quest-05-03-two-file-structure.md |
5.51 / 10.0 |
workshop/side-quest-11-01b-workflow-structure.md |
5.62 / 10.0 |
workshop/side-quest-11-08-frontmatter-tools-outputs.md |
5.64 / 10.0 |
workshop/08-run-your-workflow.md |
5.67 / 10.0 |
workshop/side-quest-13-04-token-optimization.md |
5.67 / 10.0 |
workshop/side-quest-11-04-annotated-workflow.md |
5.72 / 10.0 |
workshop/05b-agentic-workflows-security.md |
5.75 / 10.0 |
workshop/side-quest-06-03a-copilot-requests-permission.md |
5.75 / 10.0 |
workshop/side-quest-05-01-actions-power-user.md |
5.83 / 10.0 |
workshop/side-quest-06-03-copilot-token.md |
5.83 / 10.0 |
workshop/14-next-steps.md |
5.85 / 10.0 |
workshop/side-quest-11-05-event-triggers.md |
5.87 / 10.0 |
workshop/side-quest-10-02-jailbreak-brief.md |
5.89 / 10.0 |
workshop/side-quest-11-07-openai-key.md |
5.91 / 10.0 |
workshop/side-quest-09-01f-debugging-checklist.md |
5.96 / 10.0 |
workshop/08b-interpret-your-run.md |
5.99 / 10.0 |
workshop/09-agentic-editing.md |
6.03 / 10.0 |
workshop/side-quest-08-01-codespaces-actions-write.md |
6.03 / 10.0 |
workshop/02a-setup-codespace.md |
6.09 / 10.0 |
workshop/side-quest-10-01-agent-brief.md |
6.09 / 10.0 |
workshop/side-quest-05-02-aw-deep-dive.md |
6.13 / 10.0 |
workshop/side-quest-09-01-debug-output.md |
6.15 / 10.0 |
workshop/side-quest-07d-billing-paths.md |
6.19 / 10.0 |
workshop/side-quest-09-01a-pattern-long-plan-chain.md |
6.20 / 10.0 |
workshop/05c-agentic-workflows-practice.md |
6.22 / 10.0 |
workshop/side-quest-11-03-better-prompts.md |
6.24 / 10.0 |
workshop/07-your-first-workflow.md |
6.25 / 10.0 |
workshop/07d-confirm-model-access.md |
6.25 / 10.0 |
workshop/side-quest-02-01-local-terminal.md |
6.25 / 10.0 |
workshop/side-quest-01-01-terminal-basics.md |
6.26 / 10.0 |
workshop/side-quest-09-01b-pattern-empty-results.md |
6.35 / 10.0 |
workshop/side-quest-09-01c-pattern-safe-output-blocked.md |
6.35 / 10.0 |
workshop/side-quest-09-01d-pattern-permission-denied.md |
6.37 / 10.0 |
workshop/side-quest-09-01e-pattern-done-no-write.md |
6.39 / 10.0 |
workshop/side-quest-06-01-install-troubleshooting.md |
6.41 / 10.0 |
workshop/side-quest-13-03-pr-checklist-pattern.md |
6.45 / 10.0 |
workshop/side-quest-06-03c-copilot-github-token-ui-only.md |
6.49 / 10.0 |
workshop/side-quest-07-01-compile-workflow.md |
6.49 / 10.0 |
workshop/side-quest-06-03b-copilot-github-token.md |
6.77 / 10.0 |
workshop/side-quest-06-04-install-local.md |
6.77 / 10.0 |
workshop/side-quest-01-03-permission-errors.md |
6.79 / 10.0 |
workshop/side-quest-11-02-yaml-frontmatter.md |
7.00 / 10.0 |
workshop/side-quest-11-01-frontmatter-deep-dive.md |
7.03 / 10.0 |
workshop/side-quest-06-02-cca-codespace.md |
7.25 / 10.0 |
workshop/side-quest-11-09-agent-session-phases.md |
7.69 / 10.0 |
workshop/side-quest-13-01-schedule-expressions.md |
7.89 / 10.0 |
workshop/side-quest-12-01-iterate-agent-output.md |
7.91 / 10.0 |
workshop/side-quest-13-02-pr-summary-pattern.md |
8.39 / 10.0 |
workshop/side-quest-13-01-pr-labeler-pattern.md |
8.63 / 10.0 |
Part 2 Scores (lessons 15+)
| File | Overall Score |
|---|---|
workshop/side-quest-17-07-repo-poisoning.md |
4.99 / 10.0 |
workshop/15-conditional-logic.md |
5.53 / 10.0 |
workshop/side-quest-20-01-memory-patterns.md |
5.57 / 10.0 |
workshop/17-add-mcp-tools.md |
5.65 / 10.0 |
workshop/20-persistent-memory.md |
5.67 / 10.0 |
workshop/16-connect-data-source.md |
5.71 / 10.0 |
workshop/side-quest-17-02-security-architecture.md |
5.77 / 10.0 |
workshop/side-quest-16-02-secrets-and-permissions.md |
5.79 / 10.0 |
workshop/side-quest-17-03-prompt-injection.md |
5.81 / 10.0 |
workshop/26-manage-costs-and-budgets.md |
5.85 / 10.0 |
workshop/side-quest-16-03-token-exfiltration.md |
5.85 / 10.0 |
workshop/side-quest-17-01-mcp-concepts.md |
5.91 / 10.0 |
workshop/side-quest-25-01-audit-reference.md |
5.91 / 10.0 |
workshop/side-quest-17-04-permission-escalation.md |
5.93 / 10.0 |
workshop/side-quest-17-06-output-injection.md |
5.97 / 10.0 |
workshop/21-inline-sub-agents.md |
5.99 / 10.0 |
workshop/side-quest-16-05-long-lived-credentials.md |
6.01 / 10.0 |
workshop/side-quest-17-05-supply-chain-mcp.md |
6.01 / 10.0 |
workshop/side-quest-16-04-deterministic-vs-agentic-data-ops.md |
6.03 / 10.0 |
workshop/29-skills-and-domain-knowledge.md |
6.05 / 10.0 |
workshop/side-quest-15-01-expressions-and-contexts.md |
6.05 / 10.0 |
workshop/side-quest-24-01-runner-infrastructure.md |
6.13 / 10.0 |
workshop/18-share-and-reuse.md |
6.15 / 10.0 |
workshop/side-quest-15-02-chaining-conditions.md |
6.21 / 10.0 |
workshop/25-audit-and-observability.md |
6.23 / 10.0 |
workshop/side-quest-26-01-forecast-costs.md |
6.24 / 10.0 |
workshop/28-orchestrate-workflows.md |
6.25 / 10.0 |
workshop/22-error-handling-and-resilience.md |
6.27 / 10.0 |
workshop/19-research-driven-training-node.md |
6.37 / 10.0 |
workshop/side-quest-16-01-github-output.md |
6.48 / 10.0 |
workshop/23-ab-experiments.md |
6.53 / 10.0 |
workshop/27-evaluate-workflow-quality.md |
6.59 / 10.0 |
workshop/24-self-hosted-runners.md |
6.63 / 10.0 |
workshop/side-quest-21-01-sub-agent-syntax.md |
6.93 / 10.0 |
Other Scores (no lesson number)
| File | Overall Score |
|---|---|
workshop/side-quest-enterprise-setup.md |
5.75 / 10.0 |
Score Trends (history window: 20 commits)
| File | Baseline | Latest | Delta | Direction |
|---|---|---|---|---|
workshop/02a-setup-codespace.md |
8.09 |
6.09 |
-2.00 |
declining |
workshop/04-github-actions-intro.md |
7.42 |
5.42 |
-2.00 |
declining |
workshop/05-agentic-workflows-intro.md |
7.45 |
5.43 |
-2.02 |
declining |
workshop/05b-agentic-workflows-security.md |
7.75 |
5.75 |
-2.00 |
declining |
workshop/05c-agentic-workflows-practice.md |
8.59 |
6.22 |
-2.37 |
declining |
workshop/07-your-first-workflow.md |
8.61 |
6.25 |
-2.36 |
declining |
workshop/07d-confirm-model-access.md |
6.55 |
6.25 |
-0.30 |
declining |
workshop/08-run-your-workflow.md |
7.67 |
5.67 |
-2.00 |
declining |
workshop/08b-interpret-your-run.md |
7.99 |
5.99 |
-2.00 |
declining |
workshop/09-agentic-editing.md |
8.03 |
6.03 |
-2.00 |
declining |
workshop/14-next-steps.md |
7.91 |
5.85 |
-2.06 |
declining |
workshop/14b-pr-reviewer-workflow.md |
7.53 |
5.47 |
-2.06 |
declining |
workshop/15-conditional-logic.md |
7.53 |
5.53 |
-2.00 |
declining |
workshop/16-connect-data-source.md |
7.71 |
5.71 |
-2.00 |
declining |
workshop/17-add-mcp-tools.md |
7.75 |
5.65 |
-2.10 |
declining |
workshop/18-share-and-reuse.md |
8.15 |
6.15 |
-2.00 |
declining |
workshop/19-research-driven-training-node.md |
8.39 |
6.37 |
-2.02 |
declining |
workshop/20-persistent-memory.md |
7.81 |
5.67 |
-2.14 |
declining |
workshop/21-inline-sub-agents.md |
7.99 |
5.99 |
-2.00 |
declining |
workshop/22-error-handling-and-resilience.md |
8.29 |
6.27 |
-2.02 |
declining |
workshop/23-ab-experiments.md |
8.53 |
6.53 |
-2.00 |
declining |
workshop/24-self-hosted-runners.md |
8.63 |
6.63 |
-2.00 |
declining |
workshop/25-audit-and-observability.md |
8.25 |
6.23 |
-2.02 |
declining |
workshop/26-manage-costs-and-budgets.md |
7.85 |
5.85 |
-2.00 |
declining |
workshop/27-evaluate-workflow-quality.md |
8.37 |
6.59 |
-1.78 |
declining |
workshop/28-orchestrate-workflows.md |
8.25 |
6.25 |
-2.00 |
declining |
workshop/29-skills-and-domain-knowledge.md |
8.05 |
6.05 |
-2.00 |
declining |
workshop/side-quest-01-01-terminal-basics.md |
8.25 |
6.26 |
-1.99 |
declining |
workshop/side-quest-01-02-environment-reference.md |
7.31 |
5.31 |
-2.00 |
declining |
workshop/side-quest-01-03-permission-errors.md |
8.81 |
6.79 |
-2.02 |
declining |
workshop/side-quest-02-01-local-terminal.md |
8.25 |
6.25 |
-2.00 |
declining |
workshop/side-quest-05-01-actions-power-user.md |
7.85 |
5.83 |
-2.02 |
declining |
workshop/side-quest-05-02-aw-deep-dive.md |
8.13 |
6.13 |
-2.00 |
declining |
workshop/side-quest-05-03-two-file-structure.md |
7.51 |
5.51 |
-2.00 |
declining |
workshop/side-quest-06-01-install-troubleshooting.md |
8.43 |
6.41 |
-2.02 |
declining |
workshop/side-quest-06-02-cca-codespace.md |
9.25 |
7.25 |
-2.00 |
declining |
workshop/side-quest-06-03-copilot-token.md |
7.83 |
5.83 |
-2.00 |
declining |
workshop/side-quest-06-03a-copilot-requests-permission.md |
7.77 |
5.75 |
-2.02 |
declining |
workshop/side-quest-06-03b-copilot-github-token.md |
8.77 |
6.77 |
-2.00 |
declining |
workshop/side-quest-06-03c-copilot-github-token-ui-only.md |
8.49 |
6.49 |
-2.00 |
declining |
workshop/side-quest-06-04-install-local.md |
8.77 |
6.77 |
-2.00 |
declining |
workshop/side-quest-07-01-compile-workflow.md |
8.49 |
6.49 |
-2.00 |
declining |
workshop/side-quest-07d-billing-paths.md |
6.19 |
6.19 |
+0.00 |
stable |
workshop/side-quest-08-01-codespaces-actions-write.md |
8.03 |
6.03 |
-2.00 |
declining |
workshop/side-quest-09-01-debug-output.md |
8.15 |
6.15 |
-2.00 |
declining |
workshop/side-quest-09-01a-pattern-long-plan-chain.md |
8.21 |
6.20 |
-2.01 |
declining |
workshop/side-quest-09-01b-pattern-empty-results.md |
8.37 |
6.35 |
-2.02 |
declining |
workshop/side-quest-09-01c-pattern-safe-output-blocked.md |
8.35 |
6.35 |
-2.00 |
declining |
workshop/side-quest-09-01d-pattern-permission-denied.md |
8.39 |
6.37 |
-2.02 |
declining |
workshop/side-quest-09-01e-pattern-done-no-write.md |
8.39 |
6.39 |
-2.00 |
declining |
workshop/side-quest-09-01f-debugging-checklist.md |
8.01 |
5.96 |
-2.05 |
declining |
workshop/side-quest-10-01-agent-brief.md |
8.09 |
6.09 |
-2.00 |
declining |
workshop/side-quest-10-02-jailbreak-brief.md |
7.89 |
5.89 |
-2.00 |
declining |
workshop/side-quest-11-01-frontmatter-deep-dive.md |
9.05 |
7.03 |
-2.02 |
declining |
workshop/side-quest-11-01b-workflow-structure.md |
7.65 |
5.62 |
-2.03 |
declining |
workshop/side-quest-11-02-yaml-frontmatter.md |
8.75 |
7.00 |
-1.75 |
declining |
workshop/side-quest-11-03-better-prompts.md |
8.63 |
6.24 |
-2.39 |
declining |
workshop/side-quest-11-04-annotated-workflow.md |
7.72 |
5.72 |
-2.00 |
declining |
workshop/side-quest-11-05-event-triggers.md |
7.91 |
5.87 |
-2.04 |
declining |
workshop/side-quest-11-06-anthropic-key.md |
7.39 |
5.39 |
-2.00 |
declining |
workshop/side-quest-11-07-openai-key.md |
7.93 |
5.91 |
-2.02 |
declining |
workshop/side-quest-11-08-frontmatter-tools-outputs.md |
7.64 |
5.64 |
-2.00 |
declining |
workshop/side-quest-11-09-agent-session-phases.md |
7.71 |
7.69 |
-0.02 |
stable |
workshop/side-quest-12-01-iterate-agent-output.md |
7.93 |
7.91 |
-0.02 |
stable |
workshop/side-quest-13-01-pr-labeler-pattern.md |
8.63 |
8.63 |
+0.00 |
stable |
workshop/side-quest-13-01-schedule-expressions.md |
7.91 |
7.89 |
-0.02 |
stable |
workshop/side-quest-13-02-pr-summary-pattern.md |
8.39 |
8.39 |
+0.00 |
stable |
workshop/side-quest-13-03-pr-checklist-pattern.md |
8.49 |
6.45 |
-2.04 |
declining |
workshop/side-quest-13-04-token-optimization.md |
7.71 |
5.67 |
-2.04 |
declining |
workshop/side-quest-15-01-expressions-and-contexts.md |
8.05 |
6.05 |
-2.00 |
declining |
workshop/side-quest-15-02-chaining-conditions.md |
8.23 |
6.21 |
-2.02 |
declining |
workshop/side-quest-16-01-github-output.md |
8.50 |
6.48 |
-2.02 |
declining |
workshop/side-quest-16-02-secrets-and-permissions.md |
7.79 |
5.79 |
-2.00 |
declining |
workshop/side-quest-16-03-token-exfiltration.md |
7.85 |
5.85 |
-2.00 |
declining |
workshop/side-quest-16-04-deterministic-vs-agentic-data-ops.md |
8.03 |
6.03 |
-2.00 |
declining |
workshop/side-quest-16-05-long-lived-credentials.md |
8.05 |
6.01 |
-2.04 |
declining |
workshop/side-quest-17-01-mcp-concepts.md |
5.91 |
5.91 |
+0.00 |
stable |
workshop/side-quest-17-02-security-architecture.md |
5.77 |
5.77 |
+0.00 |
stable |
workshop/side-quest-17-03-prompt-injection.md |
5.81 |
5.81 |
+0.00 |
stable |
workshop/side-quest-17-04-permission-escalation.md |
5.93 |
5.93 |
+0.00 |
stable |
workshop/side-quest-17-05-supply-chain-mcp.md |
6.01 |
6.01 |
+0.00 |
stable |
workshop/side-quest-17-06-output-injection.md |
5.97 |
5.97 |
+0.00 |
stable |
workshop/side-quest-17-07-repo-poisoning.md |
5.45 |
4.99 |
-0.46 |
declining |
workshop/side-quest-20-01-memory-patterns.md |
5.57 |
5.57 |
+0.00 |
stable |
workshop/side-quest-21-01-sub-agent-syntax.md |
6.93 |
6.93 |
+0.00 |
stable |
workshop/side-quest-24-01-runner-infrastructure.md |
6.13 |
6.13 |
+0.00 |
stable |
workshop/side-quest-25-01-audit-reference.md |
5.91 |
5.91 |
+0.00 |
stable |
workshop/side-quest-26-01-forecast-costs.md |
6.24 |
6.24 |
+0.00 |
stable |
workshop/side-quest-enterprise-setup.md |
5.75 |
5.75 |
+0.00 |
stable |
Overall Trend
- Baseline mean score:
7.76 - Latest mean score:
6.18 - Delta:
-1.58 - Direction: declining
Bloom's Taxonomy Distribution
| Level | Count |
|---|---|
| Remember | 6 |
| Understand | 17 |
| Apply | 46 |
| Analyze | 7 |
| Evaluate | 5 |
| Create | 8 |
Distribution health: The corpus has a healthy pyramidal base (46 Apply + 17 Understand steps) with adequate upper-order representation (7 Analyze, 5 Evaluate, 8 Create). Both has_min_understand_steps and has_min_analyze_steps are satisfied. No Bloom gap proposals were generated.
Bloom's Reclassification Audit
| File | Level | Justification |
|---|---|---|
02a-setup-codespace.md |
apply | Primary cues: intro:install, title:setup. |
04-github-actions-intro.md |
understand | Primary cues: title:intro, intro:intro. |
05-agentic-workflows-intro.md |
understand | Primary cues: title:intro, intro:intro. |
05b-agentic-workflows-security.md |
apply | Primary cues: intro:run, intro:schedule. |
05c-agentic-workflows-practice.md |
apply | Primary cues: intro:run, intro:use. |
07-your-first-workflow.md |
create | Primary cues: intro:create, title:write. |
07d-confirm-model-access.md |
apply | Primary cues: intro:run, intro:configure. |
08-run-your-workflow.md |
apply | Primary cues: title:run, intro:run. |
08b-interpret-your-run.md |
apply | Primary cues: title:run, intro:run. |
09-agentic-editing.md |
evaluate | Primary cues: intro:review, title:test. |
14-next-steps.md |
apply | Primary cues: intro:schedule, activity:commands_or_code. |
14b-pr-reviewer-workflow.md |
create | Primary cues: intro:create, title:build. |
15-conditional-logic.md |
apply | Primary cues: intro:run, intro:use. |
16-connect-data-source.md |
apply | Primary cues: intro:run, intro:install. |
17-add-mcp-tools.md |
apply | Primary cues: intro:install, activity:commands_or_code. |
18-share-and-reuse.md |
apply | Primary cues: intro:run, activity:commands_or_code. |
19-research-driven-training-node.md |
create | Primary cues: title:build, intro:build. |
20-persistent-memory.md |
apply | Primary cues: intro:run, activity:commands_or_code. |
21-inline-sub-agents.md |
remember | Primary cues: title:reference, intro:reference. |
22-error-handling-and-resilience.md |
apply | Primary cues: intro:run, activity:commands_or_code. |
23-ab-experiments.md |
evaluate | Primary cues: title:test, intro:test. |
24-self-hosted-runners.md |
apply | Primary cues: title:run, intro:run. |
25-audit-and-observability.md |
apply | Primary cues: intro:run, intro:install. |
26-manage-costs-and-budgets.md |
apply | Primary cues: intro:run, activity:commands_or_code. |
27-evaluate-workflow-quality.md |
evaluate | Primary cues: title:evaluate, intro:review. |
28-orchestrate-workflows.md |
create | Primary cues: intro:build, intro:compose. |
29-skills-and-domain-knowledge.md |
remember | Primary cues: intro:reference, intro:glossary. |
side-quest-01-01-terminal-basics.md |
apply | Primary cues: intro:run, intro:use. |
side-quest-01-02-environment-reference.md |
remember | Primary cues: title:reference, intro:reference. |
side-quest-01-03-permission-errors.md |
apply | Primary cues: intro:run, intro:setup. |
side-quest-02-01-local-terminal.md |
apply | Primary cues: intro:run, intro:install. |
side-quest-05-01-actions-power-user.md |
understand | Primary cues: intro:intro, intro:introduction. |
side-quest-05-02-aw-deep-dive.md |
understand | Primary cues: intro:intro, intro:introduction. |
side-quest-05-03-two-file-structure.md |
understand | Primary cues: intro:intro, intro:introduction. |
side-quest-21-01-sub-agent-syntax.md |
(stable, not reclassified) | — |
Corpus-level Observations
- Checkpoint deficit is the primary score driver. 80+ files score between 5.3 and 6.8. The most common shared penalty is
checkpoint_quality: 0.0(missing checkpoint), which zeroes out the highest-weighted dimension (weight 2.0). Adding a ≥4-item checkpoint to any file immediately lifts its weighted score by ~1.5–2 points. - Scaffolding is universally half-credit. Virtually all files lack a "Before You Start" or "Prerequisites" section and receive 5/10 on scaffolding (weight 1.5). A systemic scaffolding pass across side quests would improve every score.
- Corpus-wide decline trend. The baseline mean was 7.76; the latest mean is 6.18 (−1.58). Nearly all pages show a ≈ −2.0 delta, suggesting a systematic scoring model change or rubric revision between commits rather than isolated content regressions. Five pages are stable (no change); no pages are improving.
Warning
Firewall blocked 1 domain
The following domain was blocked by the firewall during workflow execution:
awmgmcpg
To allow these domains, add them to the
network.allowedlist in your workflow frontmatter:
network:
allowed:
- defaults
- "awmgmcpg"See Network Configuration for more information.
Generated by 🔬 Curriculum Quality Evaluator · 63.8 AIC · ⌖ 9.61 AIC · ⊞ 6.2K · ◷
- expires on Aug 27, 2026, 1:09 PM UTC