[curriculum-eval] curriculum-scorecard: overall page scores and trend analysis

Curriculum Quality Evaluator · issue · closed

Filter2mode:review mode:live
All recorded Export JSON
github-actions[bot]

published Aug 21, 2026, 1:07 PM · updated Aug 22, 2026, 2:44 PM

Curriculum Scorecard

Part Summary

Part Files Mean Score Std Dev
Part 1 — core path (lessons 00–14) 54 7.62 / 10.0 ±1.05
Part 2 — advanced (lessons 15+) 34 6.74 / 10.0 ±1.05
Overall corpus 89 7.26 / 10.0 ±1.13

Part 1 Scores (lessons 00–14)

File Overall Score
workshop/04-github-actions-intro.md 5.42 / 10.0
workshop/05-agentic-workflows-intro.md 5.43 / 10.0
workshop/14b-pr-reviewer-workflow.md 5.47 / 10.0
workshop/08-run-your-workflow.md 5.67 / 10.0
workshop/05b-agentic-workflows-security.md 5.75 / 10.0
workshop/14-next-steps.md 5.85 / 10.0
workshop/08b-interpret-your-run.md 5.99 / 10.0
workshop/09-agentic-editing.md 6.03 / 10.0
workshop/02a-setup-codespace.md 6.09 / 10.0
workshop/side-quest-07d-billing-paths.md 6.19 / 10.0
workshop/05c-agentic-workflows-practice.md 6.22 / 10.0
workshop/07-your-first-workflow.md 6.25 / 10.0
workshop/07d-confirm-model-access.md 6.55 / 10.0
workshop/side-quest-01-02-environment-reference.md 7.31 / 10.0
workshop/side-quest-11-06-anthropic-key.md 7.39 / 10.0
workshop/side-quest-05-03-two-file-structure.md 7.51 / 10.0
workshop/side-quest-11-08-frontmatter-tools-outputs.md 7.64 / 10.0
workshop/side-quest-11-01b-workflow-structure.md 7.65 / 10.0
workshop/side-quest-13-04-token-optimization.md 7.67 / 10.0
workshop/side-quest-11-09-agent-session-phases.md 7.69 / 10.0
workshop/side-quest-11-04-annotated-workflow.md 7.72 / 10.0
workshop/side-quest-06-03a-copilot-requests-permission.md 7.77 / 10.0
workshop/side-quest-06-03-copilot-token.md 7.83 / 10.0
workshop/side-quest-05-01-actions-power-user.md 7.85 / 10.0
workshop/side-quest-10-02-jailbreak-brief.md 7.89 / 10.0
workshop/side-quest-11-05-event-triggers.md 7.89 / 10.0
workshop/side-quest-13-01-schedule-expressions.md 7.89 / 10.0
workshop/side-quest-11-07-openai-key.md 7.91 / 10.0
workshop/side-quest-12-01-iterate-agent-output.md 7.91 / 10.0
workshop/side-quest-09-01f-debugging-checklist.md 7.96 / 10.0
workshop/side-quest-08-01-codespaces-actions-write.md 8.03 / 10.0
workshop/side-quest-10-01-agent-brief.md 8.09 / 10.0
workshop/side-quest-05-02-aw-deep-dive.md 8.13 / 10.0
workshop/side-quest-09-01-debug-output.md 8.15 / 10.0
workshop/side-quest-09-01a-pattern-long-plan-chain.md 8.21 / 10.0
workshop/side-quest-01-01-terminal-basics.md 8.25 / 10.0
workshop/side-quest-02-01-local-terminal.md 8.25 / 10.0
workshop/side-quest-11-03-better-prompts.md 8.26 / 10.0
workshop/side-quest-09-01c-pattern-safe-output-blocked.md 8.35 / 10.0
workshop/side-quest-09-01b-pattern-empty-results.md 8.37 / 10.0
workshop/side-quest-09-01d-pattern-permission-denied.md 8.39 / 10.0
workshop/side-quest-09-01e-pattern-done-no-write.md 8.39 / 10.0
workshop/side-quest-13-02-pr-summary-pattern.md 8.39 / 10.0
workshop/side-quest-06-01-install-troubleshooting.md 8.43 / 10.0
workshop/side-quest-13-03-pr-checklist-pattern.md 8.47 / 10.0
workshop/side-quest-06-03c-copilot-github-token-ui-only.md 8.49 / 10.0
workshop/side-quest-07-01-compile-workflow.md 8.49 / 10.0
workshop/side-quest-11-02-yaml-frontmatter.md 8.50 / 10.0
workshop/side-quest-13-01-pr-labeler-pattern.md 8.63 / 10.0
workshop/side-quest-06-03b-copilot-github-token.md 8.77 / 10.0
workshop/side-quest-06-04-install-local.md 8.77 / 10.0
workshop/side-quest-01-03-permission-errors.md 8.81 / 10.0
workshop/side-quest-11-01-frontmatter-deep-dive.md 9.03 / 10.0
workshop/side-quest-06-02-cca-codespace.md 9.25 / 10.0

Part 2 Scores (lessons 15+)

File Overall Score
workshop/side-quest-17-07-repo-poisoning.md 4.99 / 10.0
workshop/side-quest-20-01-memory-patterns.md 5.57 / 10.0
workshop/17-add-mcp-tools.md 5.65 / 10.0
workshop/side-quest-17-02-security-architecture.md 5.77 / 10.0
workshop/20-persistent-memory.md 5.81 / 10.0
workshop/side-quest-17-03-prompt-injection.md 5.81 / 10.0
workshop/26-manage-costs-and-budgets.md 5.85 / 10.0
workshop/side-quest-17-01-mcp-concepts.md 5.91 / 10.0
workshop/side-quest-25-01-audit-reference.md 5.91 / 10.0
workshop/side-quest-17-04-permission-escalation.md 5.93 / 10.0
workshop/side-quest-17-06-output-injection.md 5.97 / 10.0
workshop/21-inline-sub-agents.md 5.99 / 10.0
workshop/side-quest-17-05-supply-chain-mcp.md 6.01 / 10.0
workshop/side-quest-24-01-runner-infrastructure.md 6.13 / 10.0
workshop/18-share-and-reuse.md 6.15 / 10.0
workshop/25-audit-and-observability.md 6.23 / 10.0
workshop/side-quest-26-01-forecast-costs.md 6.24 / 10.0
workshop/22-error-handling-and-resilience.md 6.27 / 10.0
workshop/19-research-driven-training-node.md 6.37 / 10.0
workshop/23-ab-experiments.md 6.53 / 10.0
workshop/24-self-hosted-runners.md 6.63 / 10.0
workshop/side-quest-21-01-sub-agent-syntax.md 6.93 / 10.0
workshop/15-conditional-logic.md 7.53 / 10.0
workshop/16-connect-data-source.md 7.71 / 10.0
workshop/side-quest-16-02-secrets-and-permissions.md 7.79 / 10.0
workshop/side-quest-16-03-token-exfiltration.md 7.85 / 10.0
workshop/side-quest-16-04-deterministic-vs-agentic-data-ops.md 8.03 / 10.0
workshop/29-skills-and-domain-knowledge.md 8.05 / 10.0
workshop/side-quest-15-01-expressions-and-contexts.md 8.05 / 10.0
workshop/side-quest-16-05-long-lived-credentials.md 8.05 / 10.0
workshop/side-quest-15-02-chaining-conditions.md 8.23 / 10.0
workshop/28-orchestrate-workflows.md 8.25 / 10.0
workshop/side-quest-16-01-github-output.md 8.50 / 10.0
workshop/27-evaluate-workflow-quality.md 8.61 / 10.0

Other Scores (no lesson number)

File Overall Score
workshop/side-quest-enterprise-setup.md 5.75 / 10.0

Score Trends (history window: 20 commits)

File Baseline Latest Delta Direction
workshop/02a-setup-codespace.md 8.09 6.09 -2.00 declining
workshop/04-github-actions-intro.md 7.42 5.42 -2.00 declining
workshop/05-agentic-workflows-intro.md 7.45 5.43 -2.02 declining
workshop/05b-agentic-workflows-security.md 7.75 5.75 -2.00 declining
workshop/05c-agentic-workflows-practice.md 8.59 6.22 -2.37 declining
workshop/07-your-first-workflow.md 8.61 6.25 -2.36 declining
workshop/07d-confirm-model-access.md 7.19 6.55 -0.64 declining
workshop/08-run-your-workflow.md 7.67 5.67 -2.00 declining
workshop/08b-interpret-your-run.md 7.99 5.99 -2.00 declining
workshop/09-agentic-editing.md 8.03 6.03 -2.00 declining
workshop/14-next-steps.md 7.91 5.85 -2.06 declining
workshop/14b-pr-reviewer-workflow.md 7.67 5.47 -2.20 declining
workshop/15-conditional-logic.md 7.53 7.53 +0.00 stable
workshop/16-connect-data-source.md 7.71 7.71 +0.00 stable
workshop/17-add-mcp-tools.md 7.75 5.65 -2.10 declining
workshop/18-share-and-reuse.md 8.15 6.15 -2.00 declining
workshop/19-research-driven-training-node.md 8.39 6.37 -2.02 declining
workshop/20-persistent-memory.md 7.81 5.81 -2.00 declining
workshop/21-inline-sub-agents.md 7.99 5.99 -2.00 declining
workshop/22-error-handling-and-resilience.md 8.29 6.27 -2.02 declining
workshop/23-ab-experiments.md 8.53 6.53 -2.00 declining
workshop/24-self-hosted-runners.md 8.63 6.63 -2.00 declining
workshop/25-audit-and-observability.md 8.25 6.23 -2.02 declining
workshop/26-manage-costs-and-budgets.md 7.85 5.85 -2.00 declining
workshop/27-evaluate-workflow-quality.md 8.37 8.61 +0.24 improving
workshop/28-orchestrate-workflows.md 8.25 8.25 +0.00 stable
workshop/29-skills-and-domain-knowledge.md 8.05 8.05 +0.00 stable
workshop/side-quest-01-01-terminal-basics.md 8.25 8.25 +0.00 stable
workshop/side-quest-01-02-environment-reference.md 7.31 7.31 +0.00 stable
workshop/side-quest-01-03-permission-errors.md 8.81 8.81 +0.00 stable
workshop/side-quest-02-01-local-terminal.md 8.25 8.25 +0.00 stable
workshop/side-quest-05-01-actions-power-user.md 7.85 7.85 +0.00 stable
workshop/side-quest-05-02-aw-deep-dive.md 7.37 8.13 +0.76 improving
workshop/side-quest-05-03-two-file-structure.md 7.51 7.51 +0.00 stable
workshop/side-quest-06-01-install-troubleshooting.md 8.43 8.43 +0.00 stable
workshop/side-quest-06-02-cca-codespace.md 9.25 9.25 +0.00 stable
workshop/side-quest-06-03-copilot-token.md 7.83 7.83 +0.00 stable
workshop/side-quest-06-03a-copilot-requests-permission.md 7.77 7.77 +0.00 stable
workshop/side-quest-06-03b-copilot-github-token.md 8.79 8.77 -0.02 stable
workshop/side-quest-06-03c-copilot-github-token-ui-only.md 8.53 8.49 -0.04 stable
workshop/side-quest-06-04-install-local.md 8.77 8.77 +0.00 stable
workshop/side-quest-07-01-compile-workflow.md 8.49 8.49 +0.00 stable
workshop/side-quest-08-01-codespaces-actions-write.md 8.03 8.03 +0.00 stable
workshop/side-quest-09-01-debug-output.md 8.15 8.15 +0.00 stable
workshop/side-quest-09-01a-pattern-long-plan-chain.md 8.21 8.21 +0.00 stable
workshop/side-quest-09-01b-pattern-empty-results.md 8.37 8.37 +0.00 stable
workshop/side-quest-09-01c-pattern-safe-output-blocked.md 8.35 8.35 +0.00 stable
workshop/side-quest-09-01d-pattern-permission-denied.md 8.39 8.39 +0.00 stable
workshop/side-quest-09-01e-pattern-done-no-write.md 8.39 8.39 +0.00 stable
workshop/side-quest-09-01f-debugging-checklist.md 8.01 7.96 -0.05 stable
workshop/side-quest-10-01-agent-brief.md 8.09 8.09 +0.00 stable
workshop/side-quest-10-02-jailbreak-brief.md 7.89 7.89 +0.00 stable
workshop/side-quest-11-01-frontmatter-deep-dive.md 9.05 9.03 -0.02 stable
workshop/side-quest-11-01b-workflow-structure.md 7.65 7.65 +0.00 stable
workshop/side-quest-11-02-yaml-frontmatter.md 8.75 8.50 -0.25 declining
workshop/side-quest-11-03-better-prompts.md 8.63 8.26 -0.37 declining
workshop/side-quest-11-04-annotated-workflow.md 7.72 7.72 +0.00 stable
workshop/side-quest-11-05-event-triggers.md 7.91 7.89 -0.02 stable
workshop/side-quest-11-06-anthropic-key.md 7.39 7.39 +0.00 stable
workshop/side-quest-11-07-openai-key.md 7.93 7.91 -0.02 stable
workshop/side-quest-11-08-frontmatter-tools-outputs.md 7.64 7.64 +0.00 stable
workshop/side-quest-11-09-agent-session-phases.md 7.71 7.69 -0.02 stable
workshop/side-quest-12-01-iterate-agent-output.md 7.93 7.91 -0.02 stable
workshop/side-quest-13-01-pr-labeler-pattern.md 8.63 8.63 +0.00 stable
workshop/side-quest-13-01-schedule-expressions.md 7.91 7.89 -0.02 stable
workshop/side-quest-13-02-pr-summary-pattern.md 8.39 8.39 +0.00 stable
workshop/side-quest-13-03-pr-checklist-pattern.md 8.49 8.47 -0.02 stable
workshop/side-quest-13-04-token-optimization.md 7.71 7.67 -0.04 stable
workshop/side-quest-15-01-expressions-and-contexts.md 8.05 8.05 +0.00 stable
workshop/side-quest-15-02-chaining-conditions.md 8.23 8.23 +0.00 stable
workshop/side-quest-16-01-github-output.md 8.50 8.50 +0.00 stable
workshop/side-quest-16-02-secrets-and-permissions.md 7.79 7.79 +0.00 stable
workshop/side-quest-16-03-token-exfiltration.md 7.85 7.85 +0.00 stable
workshop/side-quest-16-04-deterministic-vs-agentic-data-ops.md 8.03 8.03 +0.00 stable
workshop/side-quest-16-05-long-lived-credentials.md 8.05 8.05 +0.00 stable
workshop/side-quest-17-01-mcp-concepts.md 7.91 5.91 -2.00 declining
workshop/side-quest-17-02-security-architecture.md 7.77 5.77 -2.00 declining
workshop/side-quest-17-03-prompt-injection.md 7.81 5.81 -2.00 declining
workshop/side-quest-17-04-permission-escalation.md 7.93 5.93 -2.00 declining
workshop/side-quest-17-05-supply-chain-mcp.md 8.01 6.01 -2.00 declining
workshop/side-quest-17-06-output-injection.md 7.99 5.97 -2.02 declining
workshop/side-quest-17-07-repo-poisoning.md 7.45 4.99 -2.46 declining
workshop/side-quest-20-01-memory-patterns.md 7.57 5.57 -2.00 declining
workshop/side-quest-21-01-sub-agent-syntax.md 8.93 6.93 -2.00 declining
workshop/side-quest-24-01-runner-infrastructure.md 8.13 6.13 -2.00 declining
workshop/side-quest-25-01-audit-reference.md 7.91 5.91 -2.00 declining
workshop/side-quest-26-01-forecast-costs.md 8.23 6.24 -1.99 declining
workshop/side-quest-enterprise-setup.md 7.75 5.75 -2.00 declining

Note: workshop/side-quest-07d-billing-paths.md is a new file with no baseline score; it scores 6.19 / 10.0 in the latest run.

Overall Trend

  • Baseline mean score: 8.07
  • Latest mean score: 7.26
  • Delta: -0.81
  • Direction: declining

Bloom's Taxonomy Distribution

Level Count
Remember 6
Understand 17
Apply 46
Analyze 7
Evaluate 5
Create 8

The distribution is healthy. Both has_min_understand_steps and has_min_analyze_steps are true; no gap proposals are required.

Systemic Decline Note

Approximately 40 files show a near-uniform −2.00 score drop between the baseline commit (62d97e80) and the latest run. This pattern is consistent with checkpoint_quality collapsing to 0 across previously-passing files — likely caused by checkpoints being removed or the rubric's checkpoint detection logic changing. The five flagged findings below reflect the worst absolute scores in the current run.

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

Generated by 🔬 Curriculum Quality Evaluator · 47.1 AIC · ⌖ 9.14 AIC · ⊞ 6.2K ·

  • expires on Aug 22, 2026, 1:07 PM UTC