Senior Software Engineer: Big Data, Genai & Cloud

Visa; Austin (TX); Hybrid; USD 140,000 - 170,000; Full time

Benefits offered by this job

Competitive salary

Annual performance bonus

Healthcare insurance

Hybrid work model

Generous PTO

Conference attendance

Job summary

Visa in Austin is seeking a Senior Data Engineer to join a growing data platform team. You will design and maintain robust data pipelines and infrastructure to enable advanced analytics and ML initiatives, collaborating with data scientists, analysts, and engineers.

The role emphasizes scalable ETL/ELT processes, data warehouses and lakes, data quality, and performance optimization. Candidates should have 5+ years in data engineering, strong SQL, Spark/Hadoop, and cloud experience

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field
• 5+ years of data engineering or related experience
• Strong SQL and experience with Spark or Hadoop
• Experience with cloud data platforms (AWS, Azure, or GCP)
• Proficiency in Python or Scala and data warehousing concepts

Responsibilities

• Design, build, and optimize scalable ETL/ELT pipelines for large data volumes
• Develop and maintain data warehouses and data lakes
• Implement data quality checks and monitoring for data integrity
• Collaborate with data scientists, analysts, and software engineers
• Manage and optimize data platform performance
• Stay current with emerging big data technologies and methodologies

Skills

SQL proficiency

Data warehousing concepts

Dimensional modeling

Python/Scala programming

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Apache Spark

Hadoop

AWS

Azure

GCP

Redshift

S3

EMR

BigQuery

Dataflow

Python

Scala

Job description

Senior Data Engineer

Our client is seeking a highly skilled Senior Data Engineer to join their rapidly growing data platform team in Austin. This role is instrumental in building and maintaining robust, scalable, and efficient data pipelines and infrastructure that support advanced analytics and machine learning initiatives. You will work with large datasets, cutting‑edge technologies, collaborating closely with data scientists, analysts, and software engineers to ensure data is accessible, reliable, and actionable.

Key Responsibilities

• Design, build, and optimize scalable ETL/ELT pipelines for ingesting and transforming large volumes of data.
• Develop and maintain data warehouses, data lakes, and other big data storage solutions.
• Implement data quality checks and monitoring to ensure data accuracy and integrity.
• Collaborate with data scientists and analysts to understand data needs and provide timely, high-quality data solutions.
• Manage and optimize data platform performance, ensuring efficient resource utilization.
• Stay current with emerging big data technologies and methodologies, recommending improvements.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field, or equivalent experience.
• 5+ years of experience in data engineering or a related role.
• Strong proficiency in SQL and experience with big data processing frameworks like Apache Spark or Hadoop.
• Hands‑on experience with cloud data platforms such as AWS (Redshift, S3, EMR), Azure (Data Factory, Synapse), or GCP (BigQuery, Dataflow).
• Proficiency in programming languages commonly used in data engineering (e.g., Python, Scala).
• Experience with data warehousing concepts and dimensional modeling.

Benefits

• Competitive salary and annual performance bonus.
• Comprehensive health, dental, and vision insurance plans.
• Hybrid work model offering a balance of in‑office collaboration and remote flexibility.
• Generous paid time off and holidays.
• Opportunities for professional growth, training, and conference attendance.
• Dynamic and innovative work environment in the heart of Austin's tech scene.