Milestones
Active
Production Readiness and Adoption
Status: In progress
Deploy the completed M6-M9 work, restore account recovery, publish
forge-tool 1.1.0, validate official-tool installation from production, and
make coding-agent discovery and project-local creation easy to adopt.
Completed
M9: The Feedback Loop
Target: Q2-Q3 2027 Status: Completed (2026-07-20)
Added prompt variation and optimization, improvement proposals, community workflows, full integrity verification, and signed supply-chain attestation. The cumulative non-integration suite reached 777 passing tests at completion.
M8: The Librarian
Target: Q1 2027 Status: Completed (2026-07-20)
Added input/output contracts and inference, deterministic preflight and conformance testing, evidence-based regression analysis, schema compatibility, explainable quality scores, reuse detection, audit evidence, deprecation, and registry-aware discovery. Privacy-sensitive usage tracking was implemented as an explicit local opt-in workflow. The milestone passed 710 tests before later hardening work.
M7: Architecture Modernization
Target: Q4 2026 Status: Completed (2026-07-20)
Added bidirectional, stdio-based MCP integration and evolved providers into bounded agents with validated skills, CmdForge-tool/MCP-server access policies, and recursive delegation context. Final non-integration validation: 577 passed, 12 skipped, 12 integration tests deselected.
| Deliverable | Status |
|---|---|
| MCP architecture decision | Done |
MCP client and dedicated McpStep | Done |
| CmdForge MCP server with typed schemas and exposure policy | Done |
| Provider-attached Agent Skills | Done |
| Provider tool and MCP-server access control | Done |
| Recursive profile, skill, tool, and provider delegation | Done |
Streamable HTTP was completed in the later follow-up. Non-tool MCP capabilities, registry-backed discovery, and parallel/restarting clients remain ideas for future evaluation in the private roadmap and MCP decision record.
M6: Stability & Fixes
Target: Q3 2026 Status: Completed (2026-07-19)
Modernized provider execution and onboarding, removed stale provider data and
dead code, extracted shared semver handling, and closed visibility model gaps.
Baseline: CmdForge commit 6908d8e (Modernize provider support), validated
with 406 passing non-integration tests.
| Deliverable | Status |
|---|---|
| Provider audit and remediation | Done |
| Subprocess, OpenAI-compatible API, and experimental PTY provider types | Done |
| Provider discovery and first-run configuration | Done |
| Multi-step fallback chains with cycle detection | Done |
| Provider install guide updates | Done |
| Dead-code removal and semver extraction | Done |
| Tool visibility model and regression fixes | Done |
Deferred follow-ups are tracked explicitly in the roadmap: tool-level fallback
chain preference, PTY production hardening, and migration of still-relevant
olddocs/ material.
M5: Testing & Polish
Target: Q1 2027 Status: Completed (100%)
Testing framework, theming, and version management. Project dependencies (completed): - cmdforge.yaml manifest format for declaring tool dependencies - cmdforge install to install all dependencies from manifest - cmdforge add official/toolname to add a dependency to manifest - cmdforge remove <tool> to remove dependencies from manifest - Automatic dependency checking before running meta-tools. Tool testing framework includes: - TestStepDialog for interactive step testing from GUI - Test button in Tool Builder to test individual steps - Variable input forms auto-detect {variable} references from step templates - Multiple assertion types (not_empty, contains, valid_json, matches_regex, min/max_length, etc.) - Background execution with timing metrics - Output variable display and assertion pass/fail results - Provider override for testing with mock provider
| Deliverable | Status |
|---|---|
| Tool testing framework | Done |
| Simple theming (external QSS files) | Done |
| Dark mode | Done |
| Tool versioning support | Done |
| Version constraints in manifests | Done |
Project dependency system (cmdforge install) | Done |
cmdforge add command | Done |
cmdforge remove command | Done |
| Dependency resolution for meta-tools | Done |
| Hash verification fix | Done |
Improved add UX for local tools | Done |
M0: Core Platform
Target: December 2025 Status: Completed (100%)
The foundational CmdForge platform with AI-powered CLI tool builder, YAML tool definitions, web UI, offline caching, and provider abstraction.
| Deliverable | Status |
|---|---|
| YAML tool definition system | Done |
| CLI entry point and subcommands | Done |
| Provider abstraction layer | Done |
| Offline caching for tools | Done |
| Web UI for tool browsing | Done |
| Tool execution engine | Done |
M1: Production Ready
Target: February 2026 Status: Completed (100%)
Production deployment with proper server configuration, complete documentation, and improved reliability.
| Deliverable | Status |
|---|---|
| Public documentation | Done |
| Systemd service setup | Done |
| Gunicorn production server | Done |
| Systemd linger for persistence | Done |
| CI/CD pipeline | Done |
| Error message improvements | Done |
| Source field display in web UI | Done |
M2: Tool Discovery
Target: Q2 2026 Status: Completed (100%)
Enable users to discover, rate, and share tools through a marketplace interface with curation to maintain quality. Tool search and filtering includes: - /api/v1/tags endpoint for listing tags with counts - Advanced search with tag filtering (AND logic), multi-category (OR logic), owner, download range, date range - Faceted search responses with category/tag/owner counts - CLI: --tag, --owner, --min-downloads, --popular, --since, --json, --show-facets options - CLI: registry tags subcommand - Web UI: Filter sidebar with checkboxes, dropdowns, active filter chips, URL-based state PySide6 GUI conversion includes: - Modern desktop GUI replacing urwid TUI - Sidebar navigation (My Tools, Registry, Providers, Profiles) - Tool Builder with visual form for creating/editing tools - Keyboard shortcuts (Ctrl+N, Ctrl+S, Ctrl+R, Ctrl+1/2/3/4, Escape, Ctrl+Q) - Window geometry persistence GUI Registry browser includes: - Browse/search tools with category and sort filters - Star ratings display in table and details - Clickable tags for filtering - Installed indicator (✓) and update available (↑) - Pagination for large result sets - Publisher reputation info GUI Publishing includes: - Connect dialog with polling-based account pairing - Publish workflow with version selection - Full publish workflow with confirmation Infrastructure improvements: - Dockerfile.test-install: Fresh environment for testing installer - Dockerfile.ready: Pre-installed container for quick usage - install.sh: Interactive installer with venv, PATH setup, optional example tools - Database migration: Auto-adds missing columns on server start Registry curation system includes: - Role-based access control (user, moderator, admin) - Tool moderation workflow (pending → approved/rejected/removed) - Publisher management (ban/unban, role changes) - Private/unlisted tool visibility (auto-approved, owner-only access) - Audit logging for all moderation actions - Admin web UI pages (pending queue, publishers, reports, audit log) - Report resolution workflow App pairing/connection flow includes: - cmdforge config connect <username> CLI command - GUI Connect dialog with polling-based approval - Web UI "Connections" page (replaces API Tokens) - Device hostname tracking for connected apps Tool ratings/reviews includes: - 5-star rating system with review text - Average rating display on tool cards - Publisher reputation scores - Rating count and distribution Tool marketplace UI enhancements includes: - Browse all tools on page load - Category filter dropdown - Sort by popularity, rating, newest, name - Clickable tags for filtering - Installed/update indicators - Pagination controls AI persona profiles includes: - Profile dataclass with name, description, system_prompt - 8 built-in profiles (Comedian, Technical Writer, Teacher, Concise, Creative, Code Reviewer, Analyst) - Custom profile creation and storage - Profile selector in Prompt Step dialog - Profile injection during tool execution - Profiles page in GUI (Ctrl+4) AI-assisted code generation includes: - Split-view Code Step dialog (editor + AI assist panel) - Provider selector for AI calls - Smart prompt template with available variables - Background thread for non-blocking AI calls - Automatic markdown fence stripping - Python syntax checking before save
| Deliverable | Status |
|---|---|
| Tool search and filtering | Done |
| PySide6 GUI conversion | Done |
| GUI Registry browser | Done |
| GUI Publishing with connect flow | Done |
| Docker containers (test + ready) | Done |
| Interactive installer script | Done |
| Database migration system | Done |
| Registry curation system | Done |
| App pairing/connection flow | Done |
| Tool ratings/reviews | Done |
| Tool marketplace UI enhancements | Done |
| AI persona profiles | Done |
| AI-assisted code generation | Done |
M3: Content & Automation
Target: Q3 2026 Status: Completed (100%)
Automated content ingestion and quality assurance for the tool ecosystem. Import Fabric patterns includes: - Run existing scripts/import_fabric.py to populate registry - Automatic attribution with source fields (imported, MIT license, Daniel Miessler) - Category mapping based on pattern name prefixes - README generation with original pattern attribution Auto-vetting pipeline includes: - Integration with existing scrutiny.py (honesty, transparency, scope, efficiency checks) - Integration with existing similarity.py (duplicate detection) - Auto-approve/review/reject decision logic - Helpful suggestions for tool improvements Scheduled sync includes: - Periodic checks for Fabric repo updates - Automatic import of new patterns - Version tracking for updated patterns - Admin notifications for review queue
| Deliverable | Status |
|---|---|
| Import Fabric patterns (233 total) | Done |
| Scheduled Fabric repo sync | Done |
| Auto-vetting pipeline integration | Done |
| Community tool submissions workflow | Done |
| Duplicate detection automation | Done |
M4: User Experience
Target: Q4 2026 Status: Completed (100%)
Visual improvements, interactive guidance, and missing registry features. Collections CLI commands includes: - cmdforge collections list - List available collections with tool counts - cmdforge collections info <name> - Show collection details with tool list - cmdforge collections install <name> - Install all tools in a collection - --json flag for machine-readable output - --pinned flag to use pinned versions from collection Admin collections management includes: - Admin dashboard page at /dashboard/admin/collections - Create/edit/delete collections via web UI - Tool reference input with version pinning - Admin API endpoints (GET/POST/PUT/DELETE) Password reset flow includes: - /forgot-password page with email input form - /reset-password?token=xxx page with new password form - API endpoints: request, validate, complete password reset - Email utility module (logs to console in dev mode, SMTP-ready for production) - Security: 1-hour token expiry, single-use tokens, rate limiting (5/hour per IP, 3/hour per email) - Session invalidation on password change - Email enumeration prevention (always returns success message) Visual node-based editor includes: - NodeGraphQt-based flow visualization (flow_graph.py) - Custom node types: InputNode, PromptNode, CodeNode, OutputNode - Visual connections showing data flow between steps - Double-click nodes to edit steps - Auto-layout with fit-to-view - Keyboard shortcuts (A: select all, F: fit view) - Context menu for common actions - Help banner overlay with controls Drag-and-drop step reordering includes: - Drag-drop reordering in list view - Reordering support from flow view - Variable dependency warnings when reordering breaks references - Automatic step index updates Tool visualization improvements includes: - Flow graph widget showing tool execution pipeline - Color-coded nodes by step type (indigo=prompt, green=code, purple=tool) - Input/output port visualization - Variable flow connections between steps Tool composition and chaining UI includes: - ToolStep data class for calling other tools as pipeline steps - ToolStepDialog for configuring tool steps (tool selection, input mapping, args) - "Add Tool" button in Tool Builder alongside Add Prompt/Add Code - ToolNode in flow graph visualization (purple node) - Input template with variable substitution from previous steps - Argument passing with variable substitution - Provider override option for nested tool calls - Recursion depth protection (max 10 levels) - Dependency checking and missing tool warnings - Auto-populate dependencies when adding ToolStep in GUI - --auto-install flag for automatic dependency installation at runtime Interactive walkthroughs includes: - First-time user onboarding - Guided tool creation tutorial - Feature discovery tooltips - Context-sensitive help Interactive Tool Picker includes: - cf command for fuzzy-search tool selection - Piping support for seamless workflow integration
| Deliverable | Status |
|---|---|
| Collections CLI commands | Done |
| Admin collections management UI | Done |
| Visual node-based step editor | Done |
| Interactive onboarding walkthroughs | Done |
| Tool visualization improvements | Done |
| Tool composition and chaining UI | Done |
| Drag-and-drop step reordering | Done |
| Password reset flow | Done |
Interactive Tool Picker (cf command) | Done |