AWS Data Engineer

Symphony Solutions; Austin (TX); Hybrid; USD 140,000 - 180,000; Full time

Job summary

Symphony Solutions in Austin, TX, is seeking an AWS Data Engineer to design and implement scalable data pipelines and warehousing solutions. The role combines hybrid onsite work with remote collaboration, focusing on Python, Airflow, and AWS services for analytics.

You will lead data integration efforts, optimize streaming workflows, and mentor junior engineers while ensuring governance and security across data platforms.

Qualifications

• Bachelor’s or Master’s degree in CS, Engineering, or related field.
• 8–10 years of data engineering experience.
• Proficient in Python and Airflow for workflow management.
• Strong AWS data storage, processing, and analytics expertise.
• Experience with real-time streaming technologies (Kafka, SQS, Event Bridge).
• Familiarity with API-based integrations (AppFlow).
• Deep knowledge of data warehousing concepts and data modelling.
• Ability to lead and mentor technical teams with good communication.

Responsibilities

• Develop and execute a strategic roadmap for data processing, storage, and analytics.
• Design, implement, and maintain robust data pipelines using Python and Airflow.
• Leverage AWS services (S3, Glue, EMR, Redshift) for data processing and analytics.
• Implement real-time data processing using Kafka, SQS, and Event Bridge.
• Oversee integration of diverse data sources via AppFlow and APIs.
• Develop data warehousing solutions and data modelling best practices.
• Monitor, optimize, and troubleshoot pipelines for performance and scalability.
• Ensure data governance, privacy, and security compliance.

Skills

Python

Airflow

Data pipelines

AWS

S3

Spark

Kafka

EventBridge

APIs

Data modelling

Data warehousing

Education

Bachelor’s or Master’s degree in Computer Science or Engineering

Tools

AWS S3

AWS Glue

AWS EMR

Redshift

Kafka

EventBridge

AppFlow

APIs

Job description

AWS Data Engineer

Austin, TX (Hybrid)

Key Responsibilities

• Develop and execute a strategic roadmap for data processing, storage, and analytics aligned with organizational goals.
• Design, implement, and maintain robust data pipelines using Python and Airflow, ensuring efficient data flow and transformation for analytical and operational purposes. Experience with Python, Airflow, S3, Spark(Glue, EMR), Kafka (SQS, Event Bridge), Integration(AppFlow, APIs), AWS Services, Redshift, EMR, DW Concepts & Data Modeling.
• Utilize AWS services, including S3 for data storage, Glue and EMR for data processing, and orchestrate data workflows that are scalable, reliable, and secure.
• Implement real-time data processing solutions using Kafka, SQS, and Event Bridge, addressing high-volume data ingestion and streaming needs.
• Oversee the integration of diverse systems and data sources through AppFlow, APIs, and other integration tools, ensuring seamless data exchange and connectivity.
• Develop data warehousing solutions, applying best practices in data modelling to support efficient data storage, retrieval, and analysis.
• Continuously monitor, optimize, and troubleshoot data pipelines and infrastructure to ensure optimal performance and scalability.
• Ensure adherence to data governance, privacy, and security policies, implementing measures to protect sensitive data and comply with regulatory requirements.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 8-10 years of experience in data engineering
• Proficient in Python programming and experience with Airflow for workflow management.
• Strong expertise in AWS cloud services, particularly in data storage, processing, and analytics (S3, Glue, EMR, etc.).
• Experience with real-time streaming technologies like Kafka, SQS, and Event Bridge.
• Solid understanding of API based integrations and familiarity with integration tools such as AppFlow.
• Deep knowledge of data warehousing concepts, data modelling techniques, and experience in implementing large-scale data warehousing solutions.
• Demonstrated ability to lead and mentor technical teams, with excellent communication and project management skills.