ETL Testing & Data Quality Engineer (Spark/Python)

Infosys; Richardson (TX); Vor Ort; USD 95.000 - 140.000; Vollzeit

Benefits dieser Stelle

Medical/Dental/Vision/Life Insurance

Long-term/Short-term Disability

Health and Dependent Care Reimburse­-s

401(k) plan

Paid holidays plus Paid Time Off

Zusammenfassung

Infosys in Richardson, TX, USA is hiring a Technology Consultant 2 to drive data warehousing, ETL, and analytics initiatives. You will contribute to requirements, design discussions, coding, and testing across Spark-based pipelines and cloud platforms.

Expect collaboration with cross-functional teams, documentation, and ongoing production issue resolution to ensure reliable data solutions. The role emphasizes end-to-end SDLC involvement, automation in ETL, and experience with big data tools and

Qualifikationen

• Experience in understanding of Data Warehousing testing concepts including Facts, Dimensions, Star Schema, and SCD validations.
• Experience in building and maintaining scalable ETL, data warehouse, and data migration pipelines using Apache Spark, PySpark, Spark SQL, and Python, with a focus on end-to-end automation.
• Strong expertise in SparkSQL and database validation across Oracle, SQL Server, PostgreSQL, Snowflake, AWS Redshift, or BigQuery.
• Experience in developing Python-based automation for ETL pipeline execution, data ingestion, transformation, and operational workflows.
• Experience in ETL tools such as Informatica, Ab Initio, ODI, SSIS, DataStage, Azure Data Factory, or Databricks.
• Experience in developing automated data quality controls within Apache Spark pipelines, including reconciliation, schema validation, data profiling, and exception handling for high-volume financial datasets.
• Experience in validating cloud-based data platforms on AWS, Azure Databricks, Snowflake, or GCP.
• Experience with batch job validation, workflow monitoring, and scheduling tools such as Autosys, Control-M, or Airflow.
• Experience in Develop automation solutions using Python/Shell scripting for ETL and data validation activities.

Aufgaben

• Contribute to the requirements elicitation process by documenting assigned parts of business requirements, in line with guidance provided.
• Facilitate software application design discussions, and document design decisions to guide the technical team towards building software solutions.
• Participate in coding and integrate new features or updates into existing applications, with a focus on maintaining system stability.
• Conduct code reviews, do changes to the codebase and maintain code repositories.
• Implement test strategies, analyse results, and coordinate bug fixes to uphold the software quality standards.
• Develop user training programs, documentation, and support frameworks to ensure a smooth transition to new software applications.
• Actively participate in resolving production issues and recommend preventive strategies to enhance system reliability.
• Maintain detailed records of code, testing techniques, and support activities to enrich the knowledge base and assist other similar projects.

Kenntnisse

Data warehousing testing

ETL pipelines

Spark SQL

Python automation

ETL tools

Data quality controls

Cloud data platforms

Workflow scheduling

Python scripting

DB validation

Ausbildung

Bachelor's degree

Tools

Informatica

Ab Initio

ODI

SSIS

DataStage

Azure Data Factory

Databricks

Jobbeschreibung

Infosys in Richardson, TX, USA is hiring a Technology Consultant 2 to drive data warehousing, ETL, and analytics initiatives. You will contribute to requirements, design discussions, coding, and testing across Spark-based pipelines and cloud platforms.

Expect collaboration with cross-functional teams, documentation, and ongoing production issue resolution to ensure reliable data solutions. The role emphasizes end-to-end SDLC involvement, automation in ETL, and experience with big data tools and