Lead Data Engineer: Real-Time Pipelines on AWS

Artifintech; Irving (TX); On-site; USD 84,000 - 120,000; Full time

Job summary

Artifintech is seeking a senior Data Engineer to architect and deliver scalable data pipelines and microservices in Python on AWS. The role focuses on real-time and batch processing, with hands-on development and leadership across cross-functional teams.

You will drive ingestion, streaming, and CI/CD pipelines while ensuring data quality and system reliability using CloudWatch and other observability tools.

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, or related field.
• 8+ years of experience in data engineering or related disciplines with increasing responsibility.
• Strong Python development experience in production environments.
• Extensive experience with AWS data services (Kinesis, S3, DynamoDB, EventBridge).
• Experience deploying software using CI/CD tools such as Azure DevOps, Jira, Jenkins, etc.
• Experience building high-throughput, scalable data pipelines.
• Experience with relational and NoSQL databases.
• Ability to ensure data integrity across distributed and streaming systems.
• Experience with monitoring and observability using CloudWatch.

Responsibilities

• Define solution architecture with Principal Engineers and Data Architects.
• Lead design and optimization of scalable data pipelines and microservices in Python.
• Drive cloud-native data ingestion and streaming using AWS services.
• Own data integration frameworks and source data pipelines for CI Autonomy initiatives.
• Collaborate with business, product, and engineering to translate requirements into scalable designs.
• Establish automated testing, data quality controls, and validation frameworks.
• Lead monitoring and performance tuning using observability tools to maintain reliability.

Skills

Python

AWS

Data pipelines

SQL

CI/CD

Distributed systems

Leadership

ETL

Education

Bachelor's degree in Computer Science or related field

Tools

Jira

Azure DevOps

Jenkins

CloudWatch

Job description

Artifintech is seeking a senior Data Engineer to architect and deliver scalable data pipelines and microservices in Python on AWS. The role focuses on real-time and batch processing, with hands-on development and leadership across cross-functional teams.

You will drive ingestion, streaming, and CI/CD pipelines while ensuring data quality and system reliability using CloudWatch and other observability tools.