Position Title: Enterprise QA Architect (Data / AI / Apps)

Location: Remote

Duration: 3 Months contract

________________________________________

Position Overview

Our client is building an enterprise-scale AI Health Cloud ecosystem on Microsoft Azure and Databricks platforms. The initiative includes multiple Data and AI-driven software products that require a robust, scalable, secure, and automation-first Enterprise Testing Strategy.

We are seeking an experienced and hands-on Enterprise QA Architect who will take end-to-end ownership of defining, enhancing, governing, and implementing the Enterprise Testing Strategy across all client products and workstreams.

The ideal candidate will possess strong expertise in enterprise quality engineering, test automation, performance engineering, API testing, security testing, data validation, cloud-native platforms, and healthcare-compliant software delivery practices. This role requires both strategic leadership and hands-on technical execution capabilities.

________________________________________

Key Responsibilities

Enterprise QA Strategy & Architecture

• Own and drive the End-to-End Enterprise Testing Strategy across all products.

• Define enterprise-wide QA standards, frameworks, governance models, and testing best practices.

• Establish scalable Quality Engineering processes aligned with Agile, DevOps, and CI/CD methodologies.

• Design enterprise testing architecture covering:

o Functional Testing

o Non-Functional Testing

o Security Testing

o Data Validation Testing

o API Testing

o Integration Testing

o Performance Engineering

o Regression Testing

o User Acceptance Testing

o AI Testing

o DR Testing

• Define quality gates, release readiness criteria, and test governance processes.

• Establish enterprise-wide test metrics, KPIs, dashboards, and reporting mechanisms.

________________________________________

Test Automation Leadership

• Lead the implementation of an Automation-First Testing Strategy targeting high automation coverage across products.

• Architect scalable automation frameworks for:

o UI Automation

o API Automation

o Data Validation & Reconciliation

o Regression Testing

o Integration Testing

• Standardize reusable automation components, libraries, accelerators, and utilities.

• Drive shift-left testing practices across development teams.

• Collaborate with DevOps Engineers for integration of automated testing into Azure DevOps CI/CD pipelines.

________________________________________

Test Framework & Tooling Ownership

• Define and govern the enterprise QA tooling ecosystem.

• Implement and manage testing tools including:

o Pytest

o Playwright

o Postman

o JMeter

o Grafana k6

o Azure Test Plans

o Azure Boards

• Evaluate and recommend additional testing and observability tools where required.

• Establish enterprise test repositories, versioning standards, and framework governance.

________________________________________

Data & AI Platform Testing

• Define testing strategies for:

o Azure-based cloud applications

o Databricks workloads

o Data Engineering pipelines

o Data Warehouse migration initiatives

o Semantic Layer implementations

o Power BI reporting ecosystems

o AI/ML-enabled platforms

• Lead enterprise data quality validation and reconciliation strategies.

• Define validation frameworks for:

o ETL/ELT Pipelines

o Data Integrity

o Data Consistency

o Data Reconciliation

o Business Rule Validation

• Collaborate with Data Engineering and AI teams to validate model outputs and data processing workflows.

________________________________________

Security & Compliance Testing

• Collaborate with Security Team for Security Testing using enterprise security testing strategy including:

o SAST

o DAST

o SCA

o Penetration Testing

• Ensure testing processes comply with healthcare and PHI data security standards.

• Establish secure test data management strategies across environments.

• Define governance for synthetic, non-production, and production data usage.

• Collaborate with security and compliance teams to address vulnerabilities and audit requirements.

________________________________________

Performance Engineering

• Architect enterprise performance testing strategy covering:

o Load Testing

o Stress Testing

o Volume Testing

o Scalability Testing

• Define performance benchmarks, SLAs, and monitoring frameworks.

• Identify system bottlenecks and optimization opportunities across cloud-native platforms.

________________________________________

Environment & Release Management

• Define and govern multi-tier testing environments:

o DEV

o INT

o QA

o PROD Parallel

o PROD

• Establish environment readiness and deployment validation processes.

• Collaborate with DevOps and Infrastructure teams to ensure stable and scalable testing environments.

• Drive release quality governance and production readiness assessments.

________________________________________

Stakeholder Collaboration & Leadership

• Work closely with:

o Product Owners

o Engineering Teams

o Solution Architects

o Data Engineers

o AI/ML Teams

o Security Teams

o Business Stakeholders

o Client Leadership

• Lead QA governance meetings, defect triage sessions, and release reviews.

• Mentor QA engineers and establish enterprise QA capability maturity.

• Provide strategic recommendations to improve software quality, automation maturity, and delivery efficiency.

________________________________________

Required Skills & Experience

Technical Skills

Mandatory

• Strong experience in Enterprise QA Architecture and Quality Engineering.

• Hands-on expertise with:

o Playwright

o Pytest

o Postman

o JMeter / Grafana k6

o Azure DevOps

o Azure Test Plans

o Azure Boards

• Strong understanding of:

o Test Automation Frameworks

o API Testing

o Integration Testing

o Security Testing

o Performance Testing

• Experience testing:

o Cloud-native applications

o Azure services

o Databricks platforms

o Data Engineering pipelines

o Power BI ecosystems

• Strong SQL and data validation expertise.

• Experience with enterprise test data management and reconciliation frameworks.

• Experience with Agile/Scrum delivery models.

________________________________________

Preferred Skills

• Experience in Healthcare, PHI, HIPAA, or regulated industry environments.

• Exposure to AI/ML system validation and testing.

• Experience with large-scale enterprise transformation programs.

• Familiarity with observability and monitoring platforms.

• Experience building enterprise reusable QA accelerators/frameworks.

________________________________________

Experience Requirements

• 10+ years of experience in Software Testing / Quality Engineering.

• 5+ years of experience in QA Architecture or QA Leadership roles.

• Proven experience implementing enterprise-scale automation and testing strategies.

• Experience leading QA for Data, Cloud, and AI transformation initiatives.

________________________________________

Educational Qualifications

• Bachelor’s or Master’s degree in:

o Computer Science

o Information Technology

o Software Engineering

o Data Engineering

o Related discipline

Preferred Certifications:

• ISTQB Advanced Level

• Azure Certifications

• Certified Scrum Master (CSM)

• Performance Testing / Security Testing Certifications

________________________________________

Key Success Metrics

• Increased automation coverage across enterprise testing landscape.

• Reduced defect leakage into production.

• Improved release quality and deployment confidence.

• Faster testing cycles and reduced regression effort.

• Improved security and compliance posture.

• Standardized QA governance across all AI Health Cloud products.

• Enhanced traceability, reporting, and audit readiness.

________________________________________

Ideal Candidate Profile

The ideal candidate is a strategic QA leader with strong hands-on engineering capabilities who can establish enterprise-grade testing practices for complex Data and AI ecosystems. The individual should be capable of driving both architectural decisions and technical implementation while collaborating effectively with cross-functional global teams.

Celebal Technologies

New Jobs

Enterprise QA Architect