Job Summary:

We are seeking an Automation Testing Engineer with strong Python, SQL, and data platform experience to design, implement, and execute automated test solutions across our modern data platform. The candidate will work extensively with Databricks, PySpark, Delta Lake, and CI/CD pipelines to ensure the accuracy, reliability, and quality of complex data pipelines, analytics systems, and BI reporting solutions.

You will play a key role in building scalable automated test frameworks, validating complex data transformations, and proactively identifying data quality issues across distributed systems and enterprise data workflows.

Key Responsibilities:

• Design, implement, and maintain automated data testing frameworks across Databricks-based pipelines and workflows.
• Build comprehensive test coverage using Python, SQL, and PySpark for validating data pipelines, ETL/ELT processes, and data lakehouse transformations.
• Develop and execute automated test plans for data ingestion, transformation, and consumption layers.
• Validate data transformations within Delta Lake tables, ensuring schema changes and data integrity are handled appropriately.
• Collaborate with Data Engineers, Data Architects, QA Analysts, and Business Analysts to define test cases based on business logic and data requirements.
• Build reusable test components that can be integrated into Databricks Workflows and CI/CD pipelines using GitHub and other automation tools.
• Leverage scalable test frameworks for complex data pipelines involving large-scale, distributed datasets.
• Perform automated validation of reports and dashboards across BI platforms such as QuickSight, Tableau, or Power BI.
• Actively monitor production pipelines and participate in defect triage, root cause analysis, and resolution of data quality issues.
• Document test strategies, test cases, test results, defect logs, and maintain traceability for audit and compliance.

Required Qualifications:

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 3+ years of experience in data QA, test automation, or data engineering roles with strong emphasis on automation.
• Strong hands-on experience with Python and SQL for data testing, validation, and automation.
• Strong experience with Databricks, including notebooks, Delta Lake, PySpark, and distributed data pipelines.
• Experience validating BI reports and dashboards (QuickSight, Tableau, Power BI, etc.).
• Deep understanding of data lakehouse architecture, ETL/ELT workflows, and data modeling concepts.
• Proven experience writing automation scripts to validate large-scale datasets across ingestion, transformation, and reporting layers.
• Familiarity with CI/CD processes for data pipelines (e.g., GitHub Actions, Databricks Repos, Jenkins, Azure DevOps).
• Ability to analyze requirements, develop test plans, estimate test effort, and track progress.
• Strong documentation, defect tracking, and reporting skills.

Preferred Qualifications:

• Experience with Unity Catalog, data governance, and access control within Databricks.
• Experience building reusable Python-based data test automation frameworks.
• Exposure to MLflow or testing machine learning pipelines and model outputs.
• Experience working in regulated environments requiring data quality audit trails.

Summary of Core Technologies:

• Python, SQL, PySpark
• Databricks, Delta Lake
• BI Tools: QuickSight, Tableau, Power BI
• CI/CD: GitHub Actions, Jenkins, Databricks Repos
• ETL/ELT processes and data pipelines
• Distributed data validation and large-scale data quality testing

EEO Employer:

RELI Group is an Equal Employment Opportunity / Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to race, color, national origin, ancestry, citizenship status, military status, protected veteran status, religion, creed, physical or mental disability, medical condition, marital status, sex, sexual orientation, gender, gender identity or expression, age, genetic information, or any other basis protected by law, ordinance, or regulation.

HUBZone:

We encourage all candidates who live in a HUBZone to apply.  You can check to see if your address is located in a HUBZone by accessing the SBA HUBZone Map.

The annual salary range for this position is $110,000 to $125,000. Actual compensation will depend on a range of factors, including but not limited to the individual’s skills, experience, qualifications, certifications, location, other business and organizational needs, and applicable employment laws. The estimate displayed represents the typical salary range for this position and is just one component of the total compensation package for employees. RELI Group provides a variety of additional benefits to its employees. For additional details on the benefits that RELI Group offers click here