Frequently Asked Question

Get your answers here

How long would it take to complete the Learn phase?

+
  • If it's source code – Typically it takes less than a day once the setup is completed. If it's Open Telemetry (OTEL) – we want the client to run their regression test suite once so we discover all endpoints and scenarios at a minimum. This can be 2–3 days. The process helps seed high-quality inputs for API integration testing and automated integration testing.

Since Open Telemetry can't be used on staging, how effective would it really be?

+
  • Even without Open Telemetry, the integration tests are of very high quality. Open Telemetry gives us more realistic synthetic data; however, our system can also learn from existing test suites to create appropriate synthetic data, enabling scalable agentic automation as part of modern integration testing tools.

How often is the AI model updated? Can it adapt without complete retraining?

+
  • We have releases every 2 weeks, but you can expect pushes to customer environments maybe once every month or two. Yes, it can adapt without complete retraining. The QA team can use the Playbook feature to guide the system via simple natural language—this supports evolving practices in Agentic QA and Agentic AI in Test Automation.

Where is our code processed?

+
  • BaseRock is deployed in the client environment in their Kubernetes namespace – so it is all processed locally, supporting secure, on-premises system integration testing workflows without UI.

Does it support on-premise or private cloud deployment?

+
  • Yes, we support both on-premise and private cloud deployment options. Our integration testing tool supports all technologies through a GitHub connector approach. For Open Telemetry-based setups, we currently support Java, Python, Go, and JavaScript-based stacks.

 What compliance certifications does baserock.ai hold?

+
  • We are in the process of getting our SOC 2 compliance. This will enhance confidence in adopting agentic AI in software testing within regulated environments.

What data is stored and for how long?

+
  • In the Open Telemetry-based approach, it’s the metadata; in the GitHub-based approach, it’s source code (read access only) and metadata.
    All data is stored in the client environment, and duration can be configured. This storage supports service-level comparison of integration testing vs regression testing over time.

 How can we be assured of Data privacy – AI may analyze sensitive data?

+
  • The prompts are developed in a way that only utilizes metadata to create test cases and synthetic data. Our control plane resides inside your VPC or on-premise. We can also deploy our fine-tuned model in your environment or use services like AWS Bedrock or Azure OpenAI where you already have agreements. These setups are ideal for privacy-conscious agentic QA frameworks.

How is Source code leakage prevented?

+
  • Since everything is processed locally, you can set up appropriate firewall rules to control access and prevent leakage. Our approach ensures language-agnostic security whether you're using Java, Python, Go, or other stacks with our integration testing framework.

Where would the Agent be deployed, can that be deployed in Azure too?

+
  • The agent is deployed as part of BaseRock.ai control plane. Yes, it can be deployed on Azure or any other cloud service provider like AWS, GCP, etc. This flexibility allows for scalable continuous integration testing automation.

Is frontend test generation (e.g., React, Angular) supported?

+
  • Not right now – it’s in our future roadmap. While we currently focus on backend API integration testing, frontend support will be introduced as part of upcoming platform updates.

How are tests maintained over time as code evolves?

+
  • We store different versions of tests as we detect code changes. The tests are automatically updated without human intervention. However, the QA team can audit and make adjustments as needed—ideal for large teams using AI tools for developers in integration environments.

What CI/CD tools does baserock.ai integrate with ?

+
  • We integrate with all major CI/CD tools and can accommodate any specific requests that you may have. This supports seamless CI/CD integration testing across your environments.

 Are analytics or dashboards provide ?

+
  • Yes, analytics and dashboards are provided via our user interface, enabling visibility into automated integration testing and coverage across services.

 Are UI test scripts for Selenium/Playwright supported ?

+
  • Not right now, this is an integration testing product. We will be releasing a new product for UI tests later this year, including support for Agentic QA for Scalable Selenium Testing.

Is it possible to automate user interface flows and real-time systems or hardware interactions ?

+
  • UI flows and real-time systems or hardware cannot be automated currently. However, the underlying API calls and system interactions can be automated using Cypress integration testing, Rust integration testing, or other supported frameworks.

Is it possible to automate cross-environment validations ?

+
  • Yes, we utilize test profiles associated with each environment to enable automated cross-environment validations—ideal for continuous integraYes, we utilize test-profiles associated with respective environments for validations. These profiles can be enriched with agentic AI coding assistants to scale reliably across staging, QA, and production.tion testing automation and agentic QA.

 Is there a chance that baserock.ai could do some manipulations to the database, like rewriting database values?

+
  • We don’t do that as of now. We will introduce features to perform actions on databases in the future. These would align with goals of automated integration testing across complex data pipelines.

How to debug baserock.ai failures and where are diagnosis reports sent to ?

+
  • Failure logs are exposed via our portal and can also be downloaded to any external system. These diagnostics support troubleshooting within environments using Pytest integration testing, Android Kotlin integration tests, or other tools.

Awesome, I'm hooked. How do I signup for an account? 

You can shoot an email to help@sapient.ai and we'll send over a signup link!

Do you offer discounts?

Yes, we offer discounts on a case-by-case basis and strive to accommodate your needs. For more details, contact us at help@sapient.ai.

What's the process for upgrading or downgrading my plan?

Reach out to help@sapient.ai for seamless plan transitions. We'll guide you through the upgrade or downgrade process.

Sometimes you may forget the best practices and hard code things, making the code untestable. We are all human - we got you!
We give you the feedback to ensure 100% test coverage.
Sign up