Test management for teams whose work lives in Jira or GitHub, without buying into Microsoft’s DevOps suite. Probara starts free, bills per user with no minimum, keeps read-only users free, and sends CI results straight from Playwright, Jest, Cypress and Vitest.
What each product offers, as published by its vendor. Probara’s column covers every plan, with the plan noted where a feature needs one.
What each product offers, as published by its vendor. Probara’s column covers every plan, with the plan noted where a feature needs one.
Feature
Probara
ATPAzure Test Plans
Platform
Cloud (SaaS)
Included
IncludedAzure DevOps Services
Self-hosted option
Not available
IncludedAzure DevOps Server
Works without Jira
IncludedNo Jira license needed
Not availableAn access level inside Azure DevOps
Free plan
IncludedUp to 3 users and 3 projects
PartialFree Basic users run tests, not plans
Interface in Spanish
IncludedEnglish and Spanish
PartialLanguage support not documented
Billing in local currencies
IncludedUSD, EUR, MXN, BRL and COP
IncludedUSD converted through Azure billing
Test design
Suites and folders
IncludedNested suites
IncludedStatic, requirement and query-based suites
Shared steps
IncludedShared across projects from Pro
IncludedShared steps and shared parameters
Parameterized test cases
IncludedShared parameters across projects from Pro
IncludedOne iteration per row of values
Custom fields
On some plansPro
IncludedThrough work item process customization
Test case version history
On some plansCompare and restore, Pro
PartialWork item history, no restore documented
Test case review and approval
On some plansPro
Not availableNo review workflow documented
Execution
Test runs
Included
IncludedManual and automated runs
Test plans
Included
Included
Configurations (browsers, devices, environments)
IncludedConfiguration matrix on test plans
IncludedOperating systems, browsers and versions
Milestones and releases
Included
PartialAzure Boards iterations, no test milestones
Exploratory testing sessions
Not available
IncludedTest & Feedback browser extension
Tracking and reporting
Built-in defect tracking
IncludedLinked to results and cases
IncludedBug work items with Test Runner data
Requirements traceability
On some plansCoverage reports from Jira and GitHub issues, Pro
IncludedTests linked to stories and features
Dashboards
On some plansPro
IncludedTest widgets and Analytics
Query language
On some plansPQL tables and charts, Pro
IncludedWIQL work item queries; OData Analytics
Automation and AI
Test automation reporting
On some plansPlaywright, Jest, Cypress, Vitest, and JUnit XML through the CLI, Pro
PartialJUnit XML through Azure Pipelines
REST API
IncludedEvery plan
Included
Webhooks
On some plansPro
IncludedService hooks
MCP server for AI agents
Included270+ tools and operations, every plan
IncludedOfficial Azure DevOps MCP server
Built-in AI test generation
Not availableBring your own agent through MCP
Not availableDocumented Copilot workflow through MCP
Integrations
Jira integration
On some plansJira Cloud, Pro
Not availableNo native integration documented
GitHub integration
On some plansIssues, Actions workflows and PR comments, Pro
IncludedAzure Boards and Pipelines with GitHub
Security and administration
Single sign-on
On some plansGoogle Workspace, OpenID Connect and SAML, Pro
IncludedMicrosoft Entra ID
Two-factor sign-in
IncludedAuthenticator app, every plan; owners can require it
IncludedThrough Microsoft Entra ID
Audit log
IncludedExport on Enterprise
PartialEntra ID organizations only, off by default
SOC 2 or ISO 27001 report
Not available
IncludedSOC 2 Type 2 and ISO 27001
Pricing
Azure Test Plans is sold as the Basic + Test Plans access level, at $52 per user per month with a 30-day trial; the first five Basic users are free, but Basic users cannot create test plans. Probara is priced per user from the first seat, with a free plan for small teams.
Probara
Free
$0
up to 3 users
Pro
$24
per user per month, billed annually
$30 billed monthly
Enterprise
Custom
pricing and terms for advanced procurement, security or support needs
How does Probara’s pricing compare with Azure Test Plans?
Probara’s Pro plan costs $24 per user per month billed annually. Azure Test Plans charges $52 per user per month for the Basic + Test Plans access level, which everyone who creates or manages test plans needs; its first five Basic users are free and can run tests, but cannot create test plans. Probara bills per user from the first seat, with no seat minimum and no packs, and on Pro, read-only viewers never take a seat, so the people who only follow results cost nothing. There is also a Free plan for 3 users and 3 projects, and every new organization starts with a 14-day Pro trial, with no credit card.
Can I bring my test cases over from Azure Test Plans?
Yes. Azure Test Plans exports test cases to CSV or Excel, and Probara imports CSV and XLSX files laid out in its import template, with their suites and steps. Arrange the exported columns to match the template described in the CSV import guide and import the file into a project. If you would rather have Probara read the Azure Test Plans export as it is, or bring over anything else, ask for it with Send feedback in your profile menu in the app, or through the contact page before you sign up, and the team adds support for it.
Do we need Azure DevOps to use Probara?
No. Probara is a standalone web app: sign up, create a project and start writing test cases, with no tracker, pipeline service or Microsoft subscription to set up first. It connects to Jira Cloud and GitHub rather than Azure DevOps, so if your boards live in Azure DevOps, your tests and work items stay in separate tools.
Can we keep running our tests in Azure Pipelines?
Yes. Probara’s reporters for Playwright, Jest, Cypress and Vitest run in any CI service, Azure Pipelines and GitHub Actions included, and send each run straight into a test run with its attachments, creating the cases a report names that do not exist yet. Any other framework can send JUnit XML through the open-source Probara CLI. With GitHub, Probara can also launch GitHub Actions workflows from a run and post a results comment on pull requests. All of this is on the Pro plan.
Does Probara work with Jira?
Yes, with Jira Cloud on the Pro plan: create Jira issues from defects and failed results with their steps and evidence, keep status in sync both ways, link issues to the test cases that cover them, and build coverage reports from them. Microsoft does not document a native Jira integration for Azure Test Plans.
Can AI agents work in Probara?
Yes. Probara’s MCP server, with 270+ tools and operations, reached through up to 14 tools listed by default, lets Claude, ChatGPT, Cursor and other MCP clients write test cases, start runs, record results and file defects, with the same permissions as the person who connected them. It is included on every plan, Free included.