AI-Suggested Test Cases

QA.tech now intelligently suggests valuable test cases by automatically analyzing your website. Our AI-powered agent can:

1. Log into your website (if authentication details are provided).
2. Crawl your site's structure to identify key features.
3. Instantly suggest high-value test cases tailored to your application.
4. Automatically set up and execute each suggested test without any manual scripting.

Benefits:

• Generate actionable tests rapidly (over 20 tests in under 30 minutes).
• Significantly reduce manual test scripting effort.
• Ensure comprehensive coverage with AI-driven insights.

QA.tech now provides insights into your test executions. With clear visual analytics, you'll instantly understand your test performance and trends:

What's Included:

• Test Execution Trend: Easily track the number of tests executed, including pass/fail status, over any period.
• Execution Time Distribution: Understand how long your tests take to execute, highlighting the 95th percentile performance (p95).

Testing File Downloads

QA.tech's agent can now easily test the file download and export functionality of your web applications. When running a test involving file downloads, the agent will:

1. Detect the file download trigger
2. Wait for the download to finish
3. Confirm the file downloaded successfully
4. Display a clear success message with file details

Just write your test as usual, and the agent handles the rest. For example, writing "Click the export button" will automatically trigger and verify the file download.

Things to Keep in Mind

• Downloads have a 30-second completion limit
• Maximum file size supported: 100MB
• Specialized downloads (e.g., streaming media) aren't supported
• Downloaded files are temporary and can't be re-uploaded
• Need to verify file formats? Reach out to our support
• Email attachment downloads are not supported—contact us for assistance with such tests

Understand Every Step of Your AI Agent

Why We Built This

Debugging test automation can be frustrating when you don't know why a test failed or how the AI agent reached its decision. With this update, we've made it incredibly easy to see what went wrong, step by step.

How It Works

• Step-by-Step Breakdown: Follow every action the AI agent takes in real time. See what elements it interacts with, what data it processes, and why it makes certain choices.
• Clear Error Insights: When a test fails, you'll get precise details on what went wrong—whether it's a missing element, an unexpected page state, or an incorrect output.
• Agent Thought Process: Understand not just what happened but why—see the AI's reasoning behind every interaction, making debugging much faster.
• Visual Logs & Reports: Quickly navigate logs with timestamps, screenshots, and structured explanations of the agent's actions.

Provide data that the AI agent will use when running all tests. This feature ensures the agent understands key aspects of your site, enabling more accurate and reliable test execution.

How it Works:

• Centralized Information: Define project-specific details that the AI agent should consider during testing.
• Context-Aware Testing: The agent uses this data to adapt its actions based on your website's behavior and requirements.

What Should You Add to Project Context?

Project Contexts should include information that helps the AI understand and interact with your application effectively. Examples include:

• Website Behavior Rules: Define interactions such as requiring hover actions before clicking menu items.
• Domain-Specific Constraints: Specify rules such as only using Swedish company data if your service handles Swedish businesses.
• Testing Guidelines: Ensure that tests fail on specific conditions, such as obvious typos or interactions with restricted UI elements.

Examples of Project Context Data:

• The service is a route planning tool for American railways.
• When creating users, always use Swedish names.
• Always fail tests when obvious typos are found.
• If a button is red, it should never be clicked.

You find the Project Context settings if you go to Project Settings - Configs

Quick Summaries for Failed Tests, making it much easier to diagnose and understand test failures at a glance.

How it Works:

• Hover to View Details: Quickly see why a test failed by hovering over the status in the test list.
• Concise Failure Summaries: Get an instant overview of errors without digging into logs.
• Run Overview: View a high-level summary of failures for an entire test run, helping you pinpoint patterns and common issues.

This feature speeds up debugging by providing essential failure insights right where you need them. No more clicking through multiple logs—just hover and analyze!

Test Plans allow you to organize and manage groups of test cases that can be executed together as a single unit.

Overview

Test Plans are collections of test cases that you want to run together regularly. This feature provides flexibility in running tests through multiple methods: API triggers, scheduled runs, or manual execution through the UI.

Benefits:

• Organizing related test cases into logical groups
• Enabling automated execution on schedules
• Supporting API-triggered test automation

We've enhanced file upload testing capabilities to support both default and custom files, making it easier to test different file import scenarios.

How it Works:

• Default Test Files: QA.tech provides built-in test files, including test.pdf and test.jpg, that are automatically available for use in tests.
• Custom File Uploads: Users can upload their own files for testing specific import features or custom requirements.
• File Selector Integration: The system captures file selector events and allows automated uploads from pre-configured test files.
• File Type Restrictions: The AI agent detects allowed file types from input elements and ensures only matching file types are used in tests.

This feature provides greater flexibility for file-related test cases, helping teams validate upload functionality with ease.

We've introduced the ability to define multiple configurations for test runs, allowing for more flexibility in how tests are executed. Now, you can create and manage different test setups based on user roles, file uploads, or other test-specific variations.

How it Works:

• Role-Based Configurations: Define different login credentials and permissions for various user roles within a test.
• Flexible File Handling: Set up different configurations to test with multiple file types, sizes, or formats.

This feature helps teams create more dynamic and comprehensive test cases, improving overall test coverage and reliability. Start using multiple configurations for enhanced test execution today!

Alongside Trello, we've also introduced Jira integration to simplify bug tracking. Now, you can send bug reports directly to Jira, ensuring a smoother workflow for teams using the platform.

How it Works:

• Direct Jira Reporting: Send bug reports to Jira without leaving the test environment.
• Customizable Issues: Select the appropriate Jira project, issue type, and priority to keep your bug tracking structured.
• Rich Bug Details: Automatically include relevant test data, steps to reproduce, and screenshots, reducing manual effort.

This integration helps teams efficiently track, prioritize, and resolve issues within Jira. Start streamlining your bug tracking with Jira integration today!