QA Engineer (Artificial Intelligence)

Every day, Global Payments makes it possible for millions of people to move money between buyers and sellers using our payments solutions for credit, debit, prepaid and merchant services. Our worldwide team helps over 3 million companies, more than 1,300 financial institutions and over 600 million cardholders grow with confidence and achieve amazing results. We are driven by our passion for success and we are proud to deliver best-in-class payment technology and software solutions. Join our dynamic team and make your mark on the payments technology landscape of tomorrow.

QA Engineer (Artificial Intelligence)

Enterprise AI/ML Organization

Reports to Leader of ML Engineering Group

OVERVIEW

This QA Engineer position is for a hands-on professional with experience in testing and automating AI/ML pipelines. The ideal candidate is someone who has worked closely with machine learning engineers and data scientists to ensure the quality and reliability of AI/ML models and systems. You will join a dynamic team passionate about innovation, learning, and applying cutting-edge technologies to deliver high-quality AI solutions.

RESPONSIBILITIES

• Develop and implement QA strategies tailored for AI/ML solutions, including models, APIs, pipelines, and agent-based architectures.

• Create and maintain automated and manual test cases for model validation (accuracy, bias, robustness, explainability, drift).

• Collaborate with AI engineers, data scientists, and product teams to define success criteria, acceptance standards, and performance metrics.

• Validate model outputs and system behaviors against business and ethical guidelines.

• Perform regression, integration, stress, and adversarial testing of AI models and systems.

• Identify, log, and track bugs and anomalies, ensuring timely resolutions.

• Support monitoring production AI systems to detect model performance degradation (concept drift, data drift, hallucinations).

• Ensure compliance with internal AI governance standards, responsible AI principles, and regulatory requirements.

• Contribute to building automated AI testing frameworks, pipelines, and synthetic data generation systems.

• Document testing procedures, results, and quality assessments clearly and effectively.

Must Haves:

• Bachelor's degree in Computer Science, Engineering, or a related field.

• 2+ years of experience in quality assurance, specifically testing AI/ML applications.

• Experience with the following:

  • Hands-on skills with Python and relevant AI/QA libraries (Pytest, Unittest, Great Expectations, MLflow, Deepchecks, etc.).

  • Familiarity with machine learning frameworks (TensorFlow, PyTorch, or scikit-learn).

  • Experience with test automation tools and frameworks.

  • Knowledge of CI/CD tools (Jenkins, GitLab CI, or similar).

  • Experience with containerization technologies like Docker and orchestration systems like Kubernetes.

  • Familiarity with version control systems like Git.

• Strong understanding of software testing methodologies and best practices.

• Excellent analytical and problem-solving skills.

• Excellent communication and collaboration skills.

Bonus Attributes:

• Experience with testing data pipelines and ETL processes.

• Experience testing agentic AI frameworks (LangChain, LangGraph, CrewAI, Autogen, etc.).

• Cloud platform experience; GCP, AWS or Azure are acceptable.

• Experience with performance testing tools.

• Understanding of data science concepts and statistical analysis.

• Certifications in software testing or cloud technologies.

Abilities:

• Ability to work with a high level of initiative, accuracy, and attention to detail.

• Ability to prioritize multiple assignments effectively. Ability to meet established deadlines.

• Ability to successfully, efficiently, and professionally interact with staff and customers.

• Excellent organization skills.

• Critical thinking ability ranging from moderately to highly complex.

• Flexibility in meeting the business needs of the customer and the company.

• Ability to work creatively and independently with latitude and minimal supervision.

• Ability to utilize experience and judgment in accomplishing assigned goals.

• Experience in navigating organizational structure.

Travel Required: 2%

Physical Demands:

• Standing/ Walking - minimal level

• Sitting - moderate to high level

• Lifting - up to 15 lbs.

• Visual Concentration - high level

• Work Environment - typical office environment.

Position Type and Expected Hours of Work: Full Time

Disclaimer:

The above statement is intended to describe the general nature and level of work being performed. It is not intended to be an exhaustive list of responsibilities, duties and skills required.

Global Payments Inc. is an equal opportunity employer. Global Payments provides equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex (including pregnancy), national origin, ancestry, age, marital status, sexual orientation, gender identity or expression, disability, veteran status, genetic information or any other basis protected by law. If you wish to request reasonable accommodations related to applying for employment or provide feedback about the accessibility of this website, please contact jobs@globalpay.com.