Frequently Asked Question

Got Questions? Click a Category Below to Get Answers!

Q1. What is integration testing, and how does BaseRock automate it?

+

BaseRock's integration testing validates how services, modules, and APIs work together, using OpenTelemetry-based discovery or source code analysis to map real dependencies - automatically, without manually scripted test scenarios.

Q2. Does BaseRock test microservice-to-microservice communication?

+

Yes. BaseRock validates the underlying API calls and system interactions across both mono-repo and multi-repo architectures, confirming services communicate correctly as your system grows.

Q3. How does BaseRock detect breaking API changes?

+

Continuous monitoring of code and telemetry flags contract or logic changes as they happen, automatically updating affected tests so breaking changes are caught before they reach production.

Q4. How long does it take BaseRock to learn my environment?

+

Source code learning typically completes in under a day. OpenTelemetry-based learning takes 2–3 days after one full regression run, after which BaseRock has a working map of your real dependencies.

Q5. Can integration tests block a deployment?

+

Yes. BaseRock integrates with GitHub, GitLab, Bitbucket, Jenkins, and Azure DevOps, and failing integration tests can be configured to block a merge or deployment automatically.

Q6. Does integration testing cover UI flows?

+

Not directly - UI flows themselves aren't automated by this capability yet, but the underlying API calls and system interactions those UI flows depend on are fully testable.

Q7. What's the difference between integration testing and functional testing at BaseRock?

+

Integration testing validates that services and APIs work together correctly at the system level; functional testing validates a full feature or user workflow against requirements. See Functional Testing FAQs below for the distinction.

Functional Testing FAQs

Q1. What is functional testing, and how is it different from integration testing?

+

Functional testing validates a feature or workflow from a user or business perspective across multiple components, generated from requirements, code, and acceptance criteria together -not just from service-to-service communication.

Q2. Can BaseRock generate functional tests from Jira stories or PRDs?

+

Yes. BaseRock reads Jira tickets, PRDs, and Figma files alongside code context to generate functional tests that reflect actual product requirements, not just what the code currently does.

Q3. Does functional testing cover negative and edge-case scenarios?

+

Yes. Scenario-based and edge-case paths are included and benchmarked against historical regression failures, so coverage goes beyond happy-path checks.

Q4. How is functional test coverage tracked?

+

Coverage is auditable through the BaseRock dashboard, where teams can review generated tests directly against requirements and flag any gaps before release.

Q5. Can QA edit functional tests without engineering help?

+

Yes. Tests are fully editable in the BaseRock portal, and the Playbook feature lets QA guide test generation using plain natural language, no scripting required.

Q6. Does functional testing validate multi-step workflows across services?

+

Yes. It's designed to validate complete feature workflows spanning multiple modules or services, not a single isolated function or endpoint.

Q7. Which frameworks and languages does functional testing support?

+

BaseRock supports major frameworks including NestJS, Next.js, Vue.js, React.js, Django, Spring Boot, Go, and TypeScript-based stacks, with automatic project structure detection.

Business Use Case Testing (B.U.C.T.) FAQs

Q1. What is Business Use Case Testing?

+

Business Use Case Testing validates the customer journeys and revenue-critical workflows - like checkout, signup, or billing -beyond the individual code paths a developer thought to test, catching failures and traditional testing misses.

Q2. How is B.U.C.T. different from functional testing?

+

Functional testing checks that one feature works as specified. B.U.C.T. validates that entire business-critical journeys spanning multiple features deliver the outcome the business actually depends on.

Q3. How does BaseRock identify business-critical use cases?

+

BaseRock combines code analysis, requirements, and usage patterns to map and prioritize the workflows most tied to revenue or customer experience, without requiring a manual audit.

Q4. Does B.U.C.T. require manual input from business teams?

+

Not necessarily - critical flows can be inferred automatically, though teams can guide and refine prioritization using the Playbook feature if they want more control.

Q5. Can B.U.C.T. reports to be shared with non-technical stakeholders?

+

Yes. Reports are framed around business outcomes and release readiness, so they're directly usable by product managers and business leaders, not just engineers.

Q6. Does B.U.C.T. validate cross-system flows like payment providers?

+

Yes. It's designed to validate complete feature workflows spanning multiple modules or services, not a single isolated function or endpoint.

Q7. Why does code that passes all its tests still fail the customer?

+

Code can be technically correct - passing every syntax or unit-level check - while still being business incorrect if it fails the customer's actual journey. B.U.C.T. is built specifically to catch that gap.

Platform, Security & Deployment FAQs

Q1. Where does BaseRock run, and does my source code leave my environment?

+

BaseRock's control plane deploys inside your own Kubernetes namespace, VPC, or on-premise environment, so processing happens locally and your source code and proprietary requirements never leave your approved security perimeter.

Q2. Which cloud providers does BaseRock support?

+

BaseRock can be deployed on Azure, AWS, GCP, or any other major cloud provider, as well as fully on-premise or in a private cloud, giving teams flexibility to match their existing infrastructure.

Q3. Is BaseRock SOC 2 compliant?

+

Yes, BaseRock has achieved SOC 2 compliance, reflecting independently audited controls for security, availability, and confidentiality; a SOC 2 report is available to partners under NDA.

Q4. What data does BaseRock actually access?

+

Depending on the integration approach, BaseRock accesses either telemetry metadata (OpenTelemetry-based) or read-only source code and metadata (GitHub-based) - never write access — and all data is stored in your own environment with a configurable retention duration.

Q5. Can I use my own LLM instead of BaseRock's hosted model?

+

Yes. BaseRock supports bring-your-own-LLM through providers like Anthropic, OpenAI, Azure OpenAI, and AWS Bedrock, or you can deploy BaseRock's fine-tuned model directly inside your own environment.

Q6. Do you offer a trial before we commit to a plan?

+

Yes. It's designed to validate complete feature workflows spanning multiple modules or services, not a single isolated function or endpoint.

Sometimes you may forget the best practices and hard code things, making the code untestable. We are all human - we got you!
We give you the feedback to ensure 100% test coverage.