I am a heavy user of agentic coding tools, part of my job is to evaluate their capabilities and limitations. This is an experiment where I am tracking their capabilities, limitations and my overall impression of them.

Note: Some cells have more information when you hover over them.

Colour Key:

  • Requires subscription
  • Minor limitation
  • Moderate
  • Significant
  • Major
Claude CodeClineOpenAI CodexGithub CopilotGoogle AntigravityCursorAmazon Kiro
Functionality
Inference Providers & Model SelectionAny that support Claude, DeepSeek, GLM and other strong modelsAnyOpenAI models (US Based), Can BYO baseURLUS Based with limited context window, Can BYOUS BasedCursor - US Based, limited by plan, BYO option heavily limits featuresUS Based, Waitlist
Sub-AgentsYesYesNoNoPartial / LimitedNoNo
Custom AgentsYesNo (coming soon)NoNoYesNoNo
Prompt templatesYesYesNoYesPartialYesNo
Coding abilitiesBest in classBest in classGoodLower endGoodMid/Lower endMid range
SpeedFastestFastestMedium/FastSlowMediumSlowSlow
MCP Spec alignmentHighMedium/HighMedium/HighHighMediumMedium/LowLow
Operational management
Consumption budget controlsNoWith enterprise / teams subscriptionPartialN/ANoNo (for BYO)N/A
Developer experience
User InterfaceVSCode, IntelliJ IDE, TUI, Zed, CLIVSCode IDE, IntelliJ, CLIVSCode IDE, CLIVSCode, Zed, CLIStandalone IDE (Fork of VSCode), CLIStandalone IDE (Fork of VSCode), CLIStandalone IDE (Fork of VSCode)
Babysitting requiredLowLowMedium/LowHighHighHighVery High
Plan/Act modesYesYesNoPartialPartial (doesn't work)NoNo
Community sizeLargelargeMediumLargeSmallLargeSmall
SourceClosed sourceYesOpen sourceYesClosed sourceClosed sourceClosed source
Configuration management
File based configurationYesNoYesLimited - no RBACLimitedNoLimited - no RBAC or rules
Per-project configuration (rules, MCP, RBAC)YesIn betaPartialLimited - no RBACLimitedNoLimited - no RBAC
Centralised configurationPartialWith enterprise / teams subscriptionNoNoNoNo (for BYO), Yes for US basedNo
Automation
Automation hooksYesYesYesNoNoNoYes
Headless / CLI / CI/CD modeYesYesYesYesYesIn betaNo
Automated Context CleanupYesYesNoYesNoNo
Access control
RBAC - CommandsYesWith enterprise / teams subscriptionPartialNoNo (has basic allow list - easy to bypass)NoNo
RBAC - MCP toolsYesWith enterprise / teams subscriptionNoNoNoNoNo
RBAC - Web domainsYesWith enterprise / teams subscriptionNoNoNoNoNo
SSOYesWith enterprise / teams subscriptionNoYesYesNo (for BYO), Yes for US basedYes
User Interface (Subjective)
User InterfaceBestBestGoodGoodGoodGoodAverage
Cost (Estimate)
Monthly cost ($USD) estimate for agentic coding (used to the best of the tools limitations)$100-$200$1200-$2200$200+$100-$300$200+$200+$200+