I am a heavy user of agentic coding tools, part of my job is to evaluate their capabilities and limitations. This is an experiment where I am tracking their capabilities, limitations and my overall impression of them.

Note: Some cells have more information when you hover over them.

Colour Key:

  • Requires subscription
  • Minor limitation
  • Moderate
  • Significant
  • Major
Claude CodeClineOpenAI CodexGithub CopilotCursorAmazon Kiro
Functionality
Inference Providers & Model SelectionAny that support Claude, DeepSeek, GLM and other strong modelsAnyOpenAI models (US Based), Can BYO baseURLUS Based with limited context window, Can BYOCursor - US Based, limited by plan, BYO option heavily limits featuresUS Based, Waitlist
Sub-Agentstruetruefalsefalsefalsefalse
Custom AgentstrueNo (coming soon)falsefalsefalsefalse
Prompt templatestruetruefalsetruetruefalse
Coding abilitiesBest in classBest in classMid/Higher endLower endMid/Lower endMid range
SpeedFastestFastestSlowSlowMedium/Slow
MCP Spec alignmentHighMedium/HighHighHighMedium/LowLow
Operational management
Consumption budget controlsfalseWith enterprise / teams subscriptionPartialN/ANo (for BYO)N/A
Developer experience
User InterfaceVSCode, IntelliJ IDE, TUI, Zed, CLIVSCode IDE, IntelliJ, CLIVSCode IDE, CLIVSCode, Zed, CLIStandalone IDE (Fork of VSCode), CLIStandalone IDE (Fork of VSCode)
Babysitting requiredLowLowHighHighMedium/High
Plan/Act modestruetruePartialfalsefalse
Community sizeLargelargeMediumLargeLargeSmall
SourceClosed sourcetruetruetrueClosed sourceClosed source
Configuration management
File based configurationtruefalsetrueLimited - no RBACfalseLimited - no RBAC or rules
Per-project configuration (rules, MCP, RBAC)trueIn betatrueLimited - no RBACfalseLimited - no RBAC
Centralised configurationPartialWith enterprise / teams subscriptionfalsefalseNo (for BYO), Yes for US basedfalse
Automation
Automation hookstrueIn betatruefalsefalsetrue
Headless / CLI / CI/CD modetruetruetruetrueIn betafalse
Automated Context Cleanuptruetruefalsefalsefalse
Access control
RBAC - CommandstrueWith enterprise / teams subscriptionPartialfalsefalsefalse
RBAC - MCP toolstrueWith enterprise / teams subscriptionfalsefalsefalsefalse
RBAC - Web domainstrueWith enterprise / teams subscriptionfalsefalsefalsefalse
SSOtrueWith enterprise / teams subscriptiontruetrueNo (for BYO), Yes for US basedtrue
User Interface (Subjective)
User InterfaceBestBestGoodGoodGoodAverage
Cost (Estimate)
Monthly cost ($USD) estimate for agentic coding (used to the best of the tools limitations)$100-$200$1200-$2200$200+$100-$300$200+$200+