I am a heavy user of agentic coding tools, part of my job is to evaluate their capabilities and limitations. This is an experiment where I am tracking their capabilities, limitations and my overall impression of them.

Note: Some cells have more information when you hover over them.

Colour Key:

  • Requires subscription
  • Minor limitation
  • Moderate
  • Significant
  • Major
Claude CodeClineOpenCodeOpenAI CodexGithub CopilotGoogle AntigravityCursorAmazon Kiro
Functionality
Inference Providers & Model SelectionAny (works best with Anthropic models)AnyAnyOpenAI models only, US based or BYO baseURLUS based with limited context window, can BYOUS based Gemini models onlyUS based models, limited by plan, BYO option but limits featuresUS based models
Sub-AgentsYesYesYesNoNoPartial / very limitedYes (limited)No
Custom AgentsYesYesYesNoYesYesNoNo
Prompt templatesYesYesYesNoYesPartialYesNo
Coding abilitiesBestVery goodGoodGoodLower endMediumMid rangeMid range
SpeedFastestFastestGoodGoodSlowMediumSlowSlow
MCP Spec alignmentHighMedium/HighMediumMedium/HighHighMediumMedium/LowLow
Full model capabilityFullFullFullFullHeavily Context LimitedFullContext LimitedContext Limited
Operational management
Consumption budget controlsWith EnterpriseWith EnterpriseNoPartial (basic project/key limits)N/ANoNo (for BYO)N/A
Developer experience
User InterfaceVSCode, IntelliJ IDE, TUI, Zed, CLI, CI/CDVSCode IDE, IntelliJ, CLITUI, CLIVSCode IDE, CLIVSCode, Zed, CLIStandalone IDE (Fork of VSCode), CLIStandalone IDE (Fork of VSCode), CLIStandalone IDE (Fork of VSCode), CLI
SourceClosed sourceOpen sourceOpen sourceOpen sourceOpen sourceClosed sourceClosed sourceClosed source
Babysitting requiredVery LowLowMedium/LowMedium/LowVery HighHighVery HighVery High
Plan/Act modesYesYesYesNoYesPartial (doesn't work)YesNo
Workflow flexibilityHighHighHighHighMediumMediumMediumVery Low
Community sizeVery LargeLargeMediumMediumLargeSmallLargeSmall
Configuration management
File based configurationYesNoYesYesPartialLimitedNoLimited - no RBAC or rules
Per-project configuration (rules, MCP, RBAC)YesIn betaPartialPartialLimited - no RBACLimitedNoLimited - no RBAC
Centralised configurationPartial (manual - split across config files)With enterprise / teams subscriptionNoNoPartialNoNo (for BYO), Yes for US basedNo
Automation
Automation hooksYesYesYes (Plugins)YesNoNoNoYes
Headless / CLI / CI/CD modeYesYesYesYesYesYesIn betaNo
Automated Context CleanupYesYesYes (Plugin)NoYesNoNo
Access control
RBAC - CommandsYesPartial (basic)YesPartialNoNo (has basic allow list - easy to bypass)No (has basic allow list - easy to bypass)No (has basic allow list - easy to bypass)
RBAC - Web domainsYesWith enterprise / teams subscriptionYesNoNoNoNoNo
RBAC - MCP toolsYesWith enterprise / teams subscriptionYesNoNoNoNoNo
SSOYesWith enterprise / teams subscriptionN/ANoYesYesNo (for BYO), Yes for US basedYes
User Interface (Subjective)
User InterfaceBestBestGoodGoodGoodGoodGoodAverage
Cost (Estimate)
Monthly cost ($USD) estimate for agentic coding (used to the best of the tools limitations)$100-$200$1200-$2200$1200-$2200$200+$100-$300$200+$200+$200+