Test Architect / Tech Lead - CTI MD Tech (GRA/GSC)

Design, build, and own reusable test automation frameworks and shared components such as libraries, harnesses, fixtures, and evaluation pipelines for consistent adoption across Global Regulatory Affairs (GRA) and Global Scientific Communications (GSC).

Design and build application architecture for GRA/GSC platforms as a technical lead, defining technical approaches, component designs, and integration patterns alongside test and quality strategy.

Own end-to-end delivery of key technical initiatives from architecture and development through testing and release, with accountability for outcomes rather than only quality gates.

Drive test-automation initiatives across GRA and GSC by identifying opportunities to replace manual and duplicated testing with scalable shared automation.

Build and own evaluation frameworks for generative AI and agentic systems, including groundedness validation, hallucination detection, relevance and accuracy testing, Retrieval-Augmented Generation (RAG) evaluation, and Large Language Model (LLM) evaluation.

Define and lead test initiatives end to end, including scoping, prioritization, delivery, and continuous quality-engineering improvements across concurrent teams and workstreams.

Partner with engineering leads, product owners, and quality/compliance stakeholders to align architecture, delivery plans, test strategy, and adoption of shared frameworks.

Establish agent observability and trace-analysis practices to diagnose failures in multi-agent and agentic workflows and feed findings into architecture, framework, and test design.

Build synthetic test-data generation capabilities and apply risk-based prioritization to determine appropriate testing depth and coverage for critical workflows.

Mentor test engineers and technical leads and develop team capability in architecture, framework design, automation, and AI evaluation.

Apply AI evaluation approaches and tools including RAGAS, DeepEval, and LLM-as-a-Judge.

Perform groundedness validation, hallucination detection, relevance and accuracy testing, generative AI testing, agentic AI testing, RAG validation, and LLM evaluation.

Apply prompt engineering and context validation techniques.

Work with multi-agent systems and agentic frameworks.

Establish AI quality-engineering practices appropriate for regulated pharmaceutical environments.

Application and solution architecture.

End-to-end test automation and reusable testing frameworks.

API and integration testing.

Agent observability and trace analysis.

Synthetic test-data generation.

Python and JavaScript/TypeScript.

AI evaluation frameworks and quality-validation practices.

Proven experience architecting and scaling test-automation frameworks across multiple concurrent programs.

Demonstrated experience designing application architecture and leading end-to-end delivery of significant technical initiatives as a tech lead.

Demonstrated ability to drive technical direction for AI-driven or agentic platforms rather than focusing solely on test execution.

Experience establishing quality and validation standards consistently across distributed or vendor-delivered teams.

Demonstrated senior-level ability to operate across functional boundaries in ambiguous and rapidly scaling transformation environments.

Experience in Global Regulatory Affairs and Scientific Communications, or comparable regulated pharmaceutical functions, is an additional qualification.

Familiarity with Regulatory Content and Submission Management and platforms such as Veeva RIM.

Experience with document and content-management ecosystems.

Background in pharmaceutical and GxP-regulated environments.

Establish strategic test and application architecture standards across GRA and GSC rather than fragmented program-specific approaches.

Scale reusable automation and AI-evaluation capabilities across multiple teams and workstreams.

Balance quality, regulatory compliance, technical architecture, delivery outcomes, and transformation priorities.

Provide technical direction and mentorship while influencing senior stakeholders across engineering, product, quality, and compliance functions.

Path/Level: R4 Test Architect / Tech Lead.

The role combines test architecture, application architecture, technical leadership, delivery ownership, automation strategy, and AI quality engineering.