Senior Data Engineer — Remote, Lead Data Pipelines

ImagineX; United States; On-site; USD 150,000 - 190,000; Full time

Job summary

ImagineX, a tech company deploying AI-assisted teams to build and secure enterprise solutions, seeks a Senior Data Engineer to lead design and implementation of modern data platforms. You will architect scalable data solutions, drive best practices, and mentor engineers while remaining hands-on with code.

Work with AWS analytics, Apache Spark, AWS Glue, and Apache Hudi to build robust data lakehouses, ensure data quality, and deliver business insights from conception to deployment across the US.

Qualifications

• 7+ years of professional software or data engineering experience.
• Expert proficiency in SQL and advanced relational data management techniques.
• Strong hands-on experience building distributed data processing frameworks using Apache Spark.
• Proven experience architecting cloud data solutions, serverless execution with AWS Glue, and interactive analytics via Amazon Athena.
• Deep understanding of modern open-source table formats, specifically constructing transactional lakehouse layers with Apache Hudi.
• Deep understanding of data engineering fundamentals, dimensional modeling, testing strategies (data quality validation, unit, integration), and version control (Git).
• Strong communication skills, with the ability to articulate complex technical data concepts to both technical and non-technical stakeholders.
• Proven ability to lead technical teams, mentor engineers, and drive successful data project delivery.

Responsibilities

• Lead the development and maintenance of robust, scalable data pipelines and ETL/ELT workflows using AWS Glue and Apache Spark
• Architect and build complex, transactional data lakehouses leveraging Apache Hudi for efficient ingestion and data management
• Guide design discussions, conduct rigorous code reviews, and provide data architecture leadership for development squads
• Collaborate with cross-functional team members, product managers, and client stakeholders to deliver high-quality data features and business insights from conception to deployment
• Establish data engineering standards, drive clean code initiatives, and champion best practices across the data development lifecycle
• Leverage AI-assisted tools to optimize development workflows, automate data testing, and improve overall pipeline reliability
• Troubleshoot, debug, and optimize high-scale analytical queries within Amazon Athena and distributed data systems for peak performance and security
• Oversee CI/CD pipeline integration, cloud data infrastructure deployments, and workflow automation efforts
• Mentor junior and mid-level data engineers, fostering a culture of technical excellence and continuous growth

Skills

SQL proficiency

Distributed data processing

Leadership

Communication

Code reviews

Mentoring

AWS Glue

Apache Spark

Amazon Athena

Tools

AWS Glue

Hudi

Job description

ImagineX, a tech company deploying AI-assisted teams to build and secure enterprise solutions, seeks a Senior Data Engineer to lead design and implementation of modern data platforms. You will architect scalable data solutions, drive best practices, and mentor engineers while remaining hands-on with code.

Work with AWS analytics, Apache Spark, AWS Glue, and Apache Hudi to build robust data lakehouses, ensure data quality, and deliver business insights from conception to deployment across the US.