[curriculum-eval] curriculum-scorecard: overall page scores and trend analysis

Curriculum Quality Evaluator · issue · closed

Filter2mode:review mode:live
All recorded Export JSON
github-actions[bot]

published Aug 22, 2026, 1:06 PM · updated Aug 23, 2026, 2:45 PM

Curriculum Scorecard

Evaluation date: 2026-08-22 | History window: 20 commits | Rubric: Bloom's Taxonomy, Cognitive Load Theory, Mayer's Multimedia Principles


Part Summary

Part Files Mean Score Std Dev
Part 1 — core path (lessons 00–14) 54 7.62 / 10.0 ±1.05
Part 2 — advanced (lessons 15+) 34 6.74 / 10.0 ±1.05
Overall corpus 89 7.26 / 10.0 ±1.13

Part 1 Scores (lessons 00–14)

File Overall Score
workshop/04-github-actions-intro.md 5.42 / 10.0
workshop/05-agentic-workflows-intro.md 5.43 / 10.0
workshop/14b-pr-reviewer-workflow.md 5.47 / 10.0
workshop/08-run-your-workflow.md 5.67 / 10.0
workshop/05b-agentic-workflows-security.md 5.75 / 10.0
workshop/14-next-steps.md 5.85 / 10.0
workshop/08b-interpret-your-run.md 5.99 / 10.0
workshop/09-agentic-editing.md 6.03 / 10.0
workshop/02a-setup-codespace.md 6.09 / 10.0
workshop/side-quest-07d-billing-paths.md 6.19 / 10.0
workshop/05c-agentic-workflows-practice.md 6.22 / 10.0
workshop/07-your-first-workflow.md 6.25 / 10.0
workshop/07d-confirm-model-access.md 6.55 / 10.0
workshop/side-quest-01-02-environment-reference.md 7.31 / 10.0
workshop/side-quest-11-06-anthropic-key.md 7.39 / 10.0
workshop/side-quest-05-03-two-file-structure.md 7.51 / 10.0
workshop/side-quest-11-08-frontmatter-tools-outputs.md 7.64 / 10.0
workshop/side-quest-11-01b-workflow-structure.md 7.65 / 10.0
workshop/side-quest-13-04-token-optimization.md 7.67 / 10.0
workshop/side-quest-11-09-agent-session-phases.md 7.69 / 10.0
workshop/side-quest-11-04-annotated-workflow.md 7.72 / 10.0
workshop/side-quest-06-03a-copilot-requests-permission.md 7.77 / 10.0
workshop/side-quest-06-03-copilot-token.md 7.83 / 10.0
workshop/side-quest-05-01-actions-power-user.md 7.85 / 10.0
workshop/side-quest-10-02-jailbreak-brief.md 7.89 / 10.0
workshop/side-quest-11-05-event-triggers.md 7.89 / 10.0
workshop/side-quest-13-01-schedule-expressions.md 7.89 / 10.0
workshop/side-quest-11-07-openai-key.md 7.91 / 10.0
workshop/side-quest-12-01-iterate-agent-output.md 7.91 / 10.0
workshop/side-quest-09-01f-debugging-checklist.md 7.96 / 10.0
workshop/side-quest-08-01-codespaces-actions-write.md 8.03 / 10.0
workshop/side-quest-10-01-agent-brief.md 8.09 / 10.0
workshop/side-quest-05-02-aw-deep-dive.md 8.13 / 10.0
workshop/side-quest-09-01-debug-output.md 8.15 / 10.0
workshop/side-quest-09-01a-pattern-long-plan-chain.md 8.21 / 10.0
workshop/side-quest-01-01-terminal-basics.md 8.25 / 10.0
workshop/side-quest-02-01-local-terminal.md 8.25 / 10.0
workshop/side-quest-11-03-better-prompts.md 8.26 / 10.0
workshop/side-quest-09-01c-pattern-safe-output-blocked.md 8.35 / 10.0
workshop/side-quest-09-01b-pattern-empty-results.md 8.37 / 10.0
workshop/side-quest-09-01d-pattern-permission-denied.md 8.39 / 10.0
workshop/side-quest-09-01e-pattern-done-no-write.md 8.39 / 10.0
workshop/side-quest-13-02-pr-summary-pattern.md 8.39 / 10.0
workshop/side-quest-06-01-install-troubleshooting.md 8.43 / 10.0
workshop/side-quest-13-03-pr-checklist-pattern.md 8.47 / 10.0
workshop/side-quest-06-03c-copilot-github-token-ui-only.md 8.49 / 10.0
workshop/side-quest-07-01-compile-workflow.md 8.49 / 10.0
workshop/side-quest-11-02-yaml-frontmatter.md 8.50 / 10.0
workshop/side-quest-13-01-pr-labeler-pattern.md 8.63 / 10.0
workshop/side-quest-06-03b-copilot-github-token.md 8.77 / 10.0
workshop/side-quest-06-04-install-local.md 8.77 / 10.0
workshop/side-quest-01-03-permission-errors.md 8.81 / 10.0
workshop/side-quest-11-01-frontmatter-deep-dive.md 9.03 / 10.0
workshop/side-quest-06-02-cca-codespace.md 9.25 / 10.0

Part 2 Scores (lessons 15+)

File Overall Score
workshop/side-quest-17-07-repo-poisoning.md 4.99 / 10.0
workshop/side-quest-20-01-memory-patterns.md 5.57 / 10.0
workshop/17-add-mcp-tools.md 5.65 / 10.0
workshop/side-quest-17-02-security-architecture.md 5.77 / 10.0
workshop/20-persistent-memory.md 5.81 / 10.0
workshop/side-quest-17-03-prompt-injection.md 5.81 / 10.0
workshop/26-manage-costs-and-budgets.md 5.85 / 10.0
workshop/side-quest-17-01-mcp-concepts.md 5.91 / 10.0
workshop/side-quest-25-01-audit-reference.md 5.91 / 10.0
workshop/side-quest-17-04-permission-escalation.md 5.93 / 10.0
workshop/side-quest-17-06-output-injection.md 5.97 / 10.0
workshop/21-inline-sub-agents.md 5.99 / 10.0
workshop/side-quest-17-05-supply-chain-mcp.md 6.01 / 10.0
workshop/side-quest-24-01-runner-infrastructure.md 6.13 / 10.0
workshop/18-share-and-reuse.md 6.15 / 10.0
workshop/25-audit-and-observability.md 6.23 / 10.0
workshop/side-quest-26-01-forecast-costs.md 6.24 / 10.0
workshop/22-error-handling-and-resilience.md 6.27 / 10.0
workshop/19-research-driven-training-node.md 6.37 / 10.0
workshop/23-ab-experiments.md 6.53 / 10.0
workshop/24-self-hosted-runners.md 6.63 / 10.0
workshop/side-quest-21-01-sub-agent-syntax.md 6.93 / 10.0
workshop/15-conditional-logic.md 7.53 / 10.0
workshop/16-connect-data-source.md 7.71 / 10.0
workshop/side-quest-16-02-secrets-and-permissions.md 7.79 / 10.0
workshop/side-quest-16-03-token-exfiltration.md 7.85 / 10.0
workshop/side-quest-16-04-deterministic-vs-agentic-data-ops.md 8.03 / 10.0
workshop/29-skills-and-domain-knowledge.md 8.05 / 10.0
workshop/side-quest-15-01-expressions-and-contexts.md 8.05 / 10.0
workshop/side-quest-16-05-long-lived-credentials.md 8.05 / 10.0
workshop/side-quest-15-02-chaining-conditions.md 8.23 / 10.0
workshop/28-orchestrate-workflows.md 8.25 / 10.0
workshop/side-quest-16-01-github-output.md 8.50 / 10.0
workshop/27-evaluate-workflow-quality.md 8.61 / 10.0

Other Scores (no lesson number)

File Overall Score
workshop/side-quest-enterprise-setup.md 5.75 / 10.0

Score Trends (history window: 20 commits)

File Baseline Latest Delta Direction
workshop/02a-setup-codespace.md 8.09 6.09 -2.00 declining
workshop/04-github-actions-intro.md 7.42 5.42 -2.00 declining
workshop/05-agentic-workflows-intro.md 7.45 5.43 -2.02 declining
workshop/05b-agentic-workflows-security.md 7.75 5.75 -2.00 declining
workshop/05c-agentic-workflows-practice.md 8.59 6.22 -2.37 declining
workshop/07-your-first-workflow.md 8.61 6.25 -2.36 declining
workshop/07d-confirm-model-access.md 7.19 6.55 -0.64 declining
workshop/08-run-your-workflow.md 7.67 5.67 -2.00 declining
workshop/08b-interpret-your-run.md 7.99 5.99 -2.00 declining
workshop/09-agentic-editing.md 8.03 6.03 -2.00 declining
workshop/14-next-steps.md 7.91 5.85 -2.06 declining
workshop/14b-pr-reviewer-workflow.md 7.67 5.47 -2.20 declining
workshop/15-conditional-logic.md 7.53 7.53 +0.00 stable
workshop/16-connect-data-source.md 7.71 7.71 +0.00 stable
workshop/17-add-mcp-tools.md 7.75 5.65 -2.10 declining
workshop/18-share-and-reuse.md 8.15 6.15 -2.00 declining
workshop/19-research-driven-training-node.md 8.39 6.37 -2.02 declining
workshop/20-persistent-memory.md 7.81 5.81 -2.00 declining
workshop/21-inline-sub-agents.md 7.99 5.99 -2.00 declining
workshop/22-error-handling-and-resilience.md 8.29 6.27 -2.02 declining
workshop/23-ab-experiments.md 8.53 6.53 -2.00 declining
workshop/24-self-hosted-runners.md 8.63 6.63 -2.00 declining
workshop/25-audit-and-observability.md 8.25 6.23 -2.02 declining
workshop/26-manage-costs-and-budgets.md 7.85 5.85 -2.00 declining
workshop/27-evaluate-workflow-quality.md 8.37 8.61 +0.24 improving
workshop/28-orchestrate-workflows.md 8.25 8.25 +0.00 stable
workshop/29-skills-and-domain-knowledge.md 8.05 8.05 +0.00 stable
workshop/side-quest-01-01-terminal-basics.md 8.25 8.25 +0.00 stable
workshop/side-quest-01-02-environment-reference.md 7.31 7.31 +0.00 stable
workshop/side-quest-01-03-permission-errors.md 8.81 8.81 +0.00 stable
workshop/side-quest-02-01-local-terminal.md 8.25 8.25 +0.00 stable
workshop/side-quest-05-01-actions-power-user.md 7.85 7.85 +0.00 stable
workshop/side-quest-05-02-aw-deep-dive.md 7.37 8.13 +0.76 improving
workshop/side-quest-05-03-two-file-structure.md 7.51 7.51 +0.00 stable
workshop/side-quest-06-01-install-troubleshooting.md 8.43 8.43 +0.00 stable
workshop/side-quest-06-02-cca-codespace.md 9.25 9.25 +0.00 stable
workshop/side-quest-06-03-copilot-token.md 7.83 7.83 +0.00 stable
workshop/side-quest-06-03a-copilot-requests-permission.md 7.77 7.77 +0.00 stable
workshop/side-quest-06-03b-copilot-github-token.md 8.79 8.77 -0.02 stable
workshop/side-quest-06-03c-copilot-github-token-ui-only.md 8.53 8.49 -0.04 stable
workshop/side-quest-06-04-install-local.md 8.77 8.77 +0.00 stable
workshop/side-quest-07-01-compile-workflow.md 8.49 8.49 +0.00 stable
workshop/side-quest-08-01-codespaces-actions-write.md 8.03 8.03 +0.00 stable
workshop/side-quest-09-01-debug-output.md 8.15 8.15 +0.00 stable
workshop/side-quest-09-01a-pattern-long-plan-chain.md 8.21 8.21 +0.00 stable
workshop/side-quest-09-01b-pattern-empty-results.md 8.37 8.37 +0.00 stable
workshop/side-quest-09-01c-pattern-safe-output-blocked.md 8.35 8.35 +0.00 stable
workshop/side-quest-09-01d-pattern-permission-denied.md 8.39 8.39 +0.00 stable
workshop/side-quest-09-01e-pattern-done-no-write.md 8.39 8.39 +0.00 stable
workshop/side-quest-09-01f-debugging-checklist.md 8.01 7.96 -0.05 stable
workshop/side-quest-10-01-agent-brief.md 8.09 8.09 +0.00 stable
workshop/side-quest-10-02-jailbreak-brief.md 7.89 7.89 +0.00 stable
workshop/side-quest-11-01-frontmatter-deep-dive.md 9.05 9.03 -0.02 stable
workshop/side-quest-11-01b-workflow-structure.md 7.65 7.65 +0.00 stable
workshop/side-quest-11-02-yaml-frontmatter.md 8.75 8.50 -0.25 declining
workshop/side-quest-11-03-better-prompts.md 8.63 8.26 -0.37 declining
workshop/side-quest-11-04-annotated-workflow.md 7.72 7.72 +0.00 stable
workshop/side-quest-11-05-event-triggers.md 7.91 7.89 -0.02 stable
workshop/side-quest-11-06-anthropic-key.md 7.39 7.39 +0.00 stable
workshop/side-quest-11-07-openai-key.md 7.93 7.91 -0.02 stable
workshop/side-quest-11-08-frontmatter-tools-outputs.md 7.64 7.64 +0.00 stable
workshop/side-quest-11-09-agent-session-phases.md 7.71 7.69 -0.02 stable
workshop/side-quest-12-01-iterate-agent-output.md 7.93 7.91 -0.02 stable
workshop/side-quest-13-01-pr-labeler-pattern.md 8.63 8.63 +0.00 stable
workshop/side-quest-13-01-schedule-expressions.md 7.91 7.89 -0.02 stable
workshop/side-quest-13-02-pr-summary-pattern.md 8.39 8.39 +0.00 stable
workshop/side-quest-13-03-pr-checklist-pattern.md 8.49 8.47 -0.02 stable
workshop/side-quest-13-04-token-optimization.md 7.71 7.67 -0.04 stable
workshop/side-quest-15-01-expressions-and-contexts.md 8.05 8.05 +0.00 stable
workshop/side-quest-15-02-chaining-conditions.md 8.23 8.23 +0.00 stable
workshop/side-quest-16-01-github-output.md 8.50 8.50 +0.00 stable
workshop/side-quest-16-02-secrets-and-permissions.md 7.79 7.79 +0.00 stable
workshop/side-quest-16-03-token-exfiltration.md 7.85 7.85 +0.00 stable
workshop/side-quest-16-04-deterministic-vs-agentic-data-ops.md 8.03 8.03 +0.00 stable
workshop/side-quest-16-05-long-lived-credentials.md 8.05 8.05 +0.00 stable
workshop/side-quest-17-01-mcp-concepts.md 7.91 5.91 -2.00 declining
workshop/side-quest-17-02-security-architecture.md 7.77 5.77 -2.00 declining
workshop/side-quest-17-03-prompt-injection.md 7.81 5.81 -2.00 declining
workshop/side-quest-17-04-permission-escalation.md 7.93 5.93 -2.00 declining
workshop/side-quest-17-05-supply-chain-mcp.md 8.01 6.01 -2.00 declining
workshop/side-quest-17-06-output-injection.md 7.99 5.97 -2.02 declining
workshop/side-quest-17-07-repo-poisoning.md 7.45 4.99 -2.46 declining
workshop/side-quest-20-01-memory-patterns.md 7.57 5.57 -2.00 declining
workshop/side-quest-21-01-sub-agent-syntax.md 8.93 6.93 -2.00 declining
workshop/side-quest-24-01-runner-infrastructure.md 8.13 6.13 -2.00 declining
workshop/side-quest-25-01-audit-reference.md 7.91 5.91 -2.00 declining
workshop/side-quest-26-01-forecast-costs.md 8.23 6.24 -1.99 declining
workshop/side-quest-enterprise-setup.md 7.75 5.75 -2.00 declining

Overall Trend

  • Baseline mean score: 8.07
  • Latest mean score: 7.26
  • Delta: -0.81
  • Direction: declining

Bloom's Taxonomy Distribution

Level Count
Remember 6
Understand 17
Apply 46
Analyze 7
Evaluate 5
Create 8

The distribution is pyramid-shaped with a strong Apply majority (52%). The corpus satisfies minimum thresholds: 17 Understand steps (≥ 2) and 7 Analyze steps (≥ 2). No Bloom gap proposals are required.

Bloom Reclassification Audit

File Level Justification
02a-setup-codespace.md apply Primary cues: intro:install, title:setup.
04-github-actions-intro.md understand Primary cues: title:intro, intro:intro.
05-agentic-workflows-intro.md understand Primary cues: title:intro, intro:intro.
05b-agentic-workflows-security.md apply Primary cues: intro:run, intro:schedule.
05c-agentic-workflows-practice.md apply Primary cues: intro:run, intro:use.
07-your-first-workflow.md create Primary cues: intro:create, title:write.
07d-confirm-model-access.md apply Primary cues: intro:run, intro:configure.
08-run-your-workflow.md apply Primary cues: title:run, intro:run.
08b-interpret-your-run.md apply Primary cues: title:run, intro:run.
09-agentic-editing.md evaluate Primary cues: intro:review, title:test.
14-next-steps.md apply Primary cues: intro:schedule, activity:commands_or_code.
14b-pr-reviewer-workflow.md create Primary cues: intro:create, title:build.
15-conditional-logic.md apply Primary cues: intro:run, intro:use.
16-connect-data-source.md apply Primary cues: intro:run, intro:install.
17-add-mcp-tools.md apply Primary cues: intro:install, activity:commands_or_code.
18-share-and-reuse.md apply Primary cues: intro:run, activity:commands_or_code.
19-research-driven-training-node.md create Primary cues: title:build, intro:build.
20-persistent-memory.md apply Primary cues: intro:run, activity:commands_or_code.
21-inline-sub-agents.md remember Primary cues: title:reference, intro:reference.
22-error-handling-and-resilience.md apply Primary cues: intro:run, activity:commands_or_code.
23-ab-experiments.md evaluate Primary cues: title:test, intro:test.
24-self-hosted-runners.md apply Primary cues: title:run, intro:run.
25-audit-and-observability.md apply Primary cues: intro:run, intro:install.
26-manage-costs-and-budgets.md apply Primary cues: intro:run, activity:commands_or_code.
27-evaluate-workflow-quality.md evaluate Primary cues: title:evaluate, intro:review.
28-orchestrate-workflows.md create Primary cues: intro:build, intro:compose.
29-skills-and-domain-knowledge.md remember Primary cues: intro:reference, intro:glossary.
side-quest-01-01-terminal-basics.md apply Primary cues: intro:run, intro:use.
side-quest-01-02-environment-reference.md remember Primary cues: title:reference, intro:reference.
side-quest-01-03-permission-errors.md apply Primary cues: intro:run, intro:setup.
side-quest-02-01-local-terminal.md apply Primary cues: intro:run, intro:install.
side-quest-05-01-actions-power-user.md understand Primary cues: intro:intro, intro:introduction.
side-quest-05-02-aw-deep-dive.md understand Primary cues: intro:intro, intro:introduction.
side-quest-05-03-two-file-structure.md understand Primary cues: intro:intro, intro:introduction.
side-quest-06-01-install-troubleshooting.md apply Primary cues: intro:run, title:install.
side-quest-06-02-cca-codespace.md apply Primary cues: intro:run, intro:install.
side-quest-06-03-copilot-token.md apply Primary cues: intro:run, intro:install.
side-quest-06-03a-copilot-requests-permission.md apply Primary cues: intro:run, intro:setup.
side-quest-06-03b-copilot-github-token.md apply Primary cues: intro:run, intro:configure.
side-quest-06-03c-copilot-github-token-ui-only.md apply Primary cues: intro:setup, intro:configure.
side-quest-06-04-install-local.md apply Primary cues: intro:run, title:install.
side-quest-07-01-compile-workflow.md apply Primary cues: intro:run, intro:use.
side-quest-07d-billing-paths.md apply Primary cues: intro:configure, intro:use.
side-quest-08-01-codespaces-actions-write.md apply Primary cues: title:run, intro:run.
side-quest-09-01-debug-output.md analyze Primary cues: title:debug, intro:diagnose.
side-quest-09-01a-pattern-long-plan-chain.md apply Primary cues: intro:run, intro:setup.
side-quest-09-01b-pattern-empty-results.md apply Primary cues: intro:run, intro:setup.
side-quest-09-01c-pattern-safe-output-blocked.md analyze Primary cues: intro:debug, title:output.
side-quest-09-01d-pattern-permission-denied.md analyze Primary cues: intro:inspect, intro:debug.
side-quest-09-01e-pattern-done-no-write.md create Primary cues: intro:create, title:write.
side-quest-09-01f-debugging-checklist.md analyze Primary cues: intro:inspect, intro:debug.
side-quest-10-01-agent-brief.md apply Primary cues: intro:run, intro:setup.
side-quest-10-02-jailbreak-brief.md understand Primary cues: intro:understand, intro:architecture.
side-quest-11-01-frontmatter-deep-dive.md understand (inferred from deep-dive reference structure)
side-quest-11-01b-workflow-structure.md understand (inferred from structure overview)
side-quest-11-02-yaml-frontmatter.md apply (hands-on YAML editing)
side-quest-11-03-better-prompts.md apply (iterative prompt writing)
side-quest-11-04-annotated-workflow.md understand (annotation/explanation focus)
side-quest-11-05-event-triggers.md apply (configuring triggers)
side-quest-11-06-anthropic-key.md apply (key setup)
side-quest-11-07-openai-key.md apply (key setup)
side-quest-11-08-frontmatter-tools-outputs.md understand (reference/overview)
side-quest-11-09-agent-session-phases.md understand (concept explanation)
side-quest-12-01-iterate-agent-output.md apply (iteration practice)
side-quest-13-01-pr-labeler-pattern.md apply (pattern application)
side-quest-13-01-schedule-expressions.md apply (configuration)
side-quest-13-02-pr-summary-pattern.md apply (pattern application)
side-quest-13-03-pr-checklist-pattern.md apply (pattern application)
side-quest-13-04-token-optimization.md analyze (analysis/optimization)
side-quest-15-01-expressions-and-contexts.md apply (expression writing)
side-quest-15-02-chaining-conditions.md apply (condition chaining)
side-quest-16-01-github-output.md apply (output configuration)
side-quest-16-02-secrets-and-permissions.md apply (security configuration)
side-quest-16-03-token-exfiltration.md analyze (threat analysis)
side-quest-16-04-deterministic-vs-agentic-data-ops.md analyze (comparative analysis)
side-quest-16-05-long-lived-credentials.md apply (credential management)
side-quest-17-01-mcp-concepts.md understand (concept introduction)
side-quest-17-02-security-architecture.md understand (architecture review)
side-quest-17-03-prompt-injection.md analyze (threat analysis)
side-quest-17-04-permission-escalation.md analyze (threat analysis)
side-quest-17-05-supply-chain-mcp.md analyze (threat analysis)
side-quest-17-06-output-injection.md analyze (threat analysis)
side-quest-17-07-repo-poisoning.md create Primary cues: intro:create, intro:author.
side-quest-20-01-memory-patterns.md remember Primary cues: title:reference, intro:reference.
side-quest-21-01-sub-agent-syntax.md apply (syntax application)
side-quest-24-01-runner-infrastructure.md understand (infrastructure overview)
side-quest-25-01-audit-reference.md remember (reference page)
side-quest-26-01-forecast-costs.md apply (cost forecasting)
side-quest-enterprise-setup.md apply (setup procedure)

Systemic Finding: Widespread Checkpoint Regression

The most significant pattern in this evaluation window is a corpus-wide checkpoint regression: 57 of 89 files (64%) are missing checkpoints in the latest commit, compared to the baseline. The uniform −2.00 point drop in checkpoint_quality scores across the majority of the lesson files confirms that checkpoints were removed or never added in a recent batch edit. The 20 files that previously had checkpoints contributing to their baseline scores now score 0.0 on checkpoint_quality.

Recommended systemic action: Run a batch audit to identify all learning pages with has_checkpoint: false and restore or add ## :white_check_mark: Checkpoint sections with ≥ 4 specific checklist items each.

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

Generated by 🔬 Curriculum Quality Evaluator · 64.1 AIC · ⌖ 10.4 AIC · ⊞ 6.2K ·

  • expires on Aug 23, 2026, 1:06 PM UTC