microsoft/AI-Engineering-Coach

microsoft/AI-Engineering-Coach

Description: better agentic engineering

Language: TypeScript

License: MIT

Stars: 1961

Forks: 266

Open issues: 38

Created: 2026-05-06T20:27:16Z

Pushed: 2026-06-10T19:42:34Z

Default branch: main

Fork: no

Archived: no

README: AI Engineer Coach

better agentic engineering.

Analyze your AI coding assistant usage — any harness, one dashboard.

https://github.com/user-attachments/assets/9f0239bf-20e0-459f-b137-17cce0edd1b2

---

What it does

AI Engineer Coach reads your local AI session logs and turns them into actionable insights — no data leaves your machine.

• Track progress -- practice scores, weekly trends, daily activity charts
• Detect anti-patterns -- 45 rules across prompt quality, session hygiene, code review, tool mastery, and context management
• Measure output -- AI-generated code volume by language, workspace, model, and harness
• Discover skills -- find repeated prompts and turn them into reusable skills
• Score context health — agentic readiness checks, instruction-file audits, workspace context maps

Screenshots

---

Installation

Choose one of these paths.

Path 1 -- Prebuilt VSIX (easiest)

Prerequisites:

• VS Code
• Access to the repository Releases page

Steps:

1. Download the latest ai-engineer-coach-*.vsix from Releases. 2. Install it in VS Code:

macOS / Linux

code --install-extension ai-engineer-coach-*.vsix

Windows / PowerShell

code --install-extension (Get-ChildItem . -Filter 'ai-engineer-coach-*.vsix' | Select-Object -First 1).FullName

Path 2 -- Dev Container build (no local Node.js/npm)

Prerequisites:

• VS Code
• Dev Containers extension
• Docker or Podman

Steps:

1. Clone the repo and open it in VS Code. 2. Reopen in container. 3. Run:

npm ci
npm run package

4. Install the generated .vsix using one of the commands above. If it doesn't work simply Install it via VS Code UI: Open VS Code Press Ctrl+Shift+P Type Install from VSIX Browse to the .vsix file and select it

Path 3 -- Local build

Prerequisites:

• VS Code
• Node.js and npm

Steps:

git clone https://github.com/microsoft/ai-engineering-coach.git
cd ai-engineering-coach
npm ci
npm run package

Then install the generated .vsix using one of the commands above.

Release permissions and contribution path

If you do not have permission to publish a Release artifact, open a PR with your changes and ask a maintainer to publish the .vsix in Releases.

After install:

1. Open the command palette (Cmd+Shift+P / Ctrl+Shift+P) 2. Run AI Engineer Coach: Open Dashboard 3. Navigate pages from the sidebar, filter by workspace or harness

---

Pages

Observe

| Page | Description | | ------------------ | ------------------------------------------------------------------------------------- | | Dashboard | Practice scores with week-over-week trends, daily activity chart, top workspace stats | | Timeline | Gantt-style session timeline with per-day drill-down and overlap detection | | Coding Moments | Screenshot gallery from AI coding sessions with story reels and workspace filtering |

Measure

| Page | Description | | ------------ | ------------------------------------------------------------------------------------------- | | Output | Generated code volume by language, model usage table _(token breakdown temporarily hidden)_ | | Burndown | Monthly AI token budget progress with projections _(temporarily disabled)_ | | Patterns | 7×24 activity heatmap and work-life balance signals |

Improve

| Page | Description | | ------------------- | ------------------------------------------------------------------------------------------------------------------------------------------ | | Anti-Patterns | Five practice score cards with severity ratings, concrete actions, and example prompts. 45 editable markdown rules plus a coverage heatmap | | Rule Editor | Create, edit, and tune detection rules visually or as raw markdown. Live-test against your data | | Rule Playground | Interactive REPL for the rule DSL with field browser, function catalog, and metric list | | Data Explorer | Browse session fields, view distributions, run ad-hoc filters | | Skill Finder | Discover repeated prompt patterns and matching community skills from the open-source catalog | | Context Health | Overall context score, agentic readiness checklist, workspace context map, AI-powered instruction-file review |

Level Up

| Page | Description | | ------------------- | -------------------------------------------------------------------------------- | | Learning Center | Personalized quizzes and code-comparison rounds generated from your actual usage | | Achievements | XP-based progression with Bronze → Silver → Gold → Diamond tiers | | Agentic SDLC | How you use AI across the full software-development lifecycle | | Share | Generate a shareable stat card and export Markdown/JSON summaries |

---

Privacy

• Read-only — the extension never modifies your session files
• Local analysis — all parsing and analytics run entirely on your machine
• No proprietary telemetry — the extension does not phone home or collect usage data
• Optional AI features — some features (rule compiler, skill finder, context review) use the VS Code built-in Copilot language model API when explicitly invoked by the user

---

Code of Conduct

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact [opencode@microsoft.com](mailto:opencode@microsoft.com) with any additional questions or comments.

Trademarks

This project may contain trademarks or logos for projects, products, or services. Authorized use of Microsoft trademarks or logos is subject to and must follow Microsoft's Trademark & Brand Guidelines. Use of Microsoft trademarks or logos in modified versions of this project must not cause confusion or imply Microsoft sponsorship. Any use of third-party trademarks or logos are subject to those third-party's policies.

License

[MIT](LICENSE)

Disclaimer

This project is an open-source community effort by Microsoft employees. It is…