Lead Data Engineer - AI-Driven Cloud Platforms

DigitalXNode

New Jersey

On-site

USD 150,000 - 200,000

Full time

14 days+

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

DigitalXNode in the United States seeks a Lead Data Engineer to contribute to AI-powered risk management solutions and cloud-native data platforms. You will collaborate with engineers in an Agile environment to design, build, test, and deploy scalable data pipelines and analytics capabilities.

Lead and mentor teams while delivering secure, high-performance cloud solutions for enterprise clients, leveraging Snowflake, Redshift, Databricks, Spark, and modern cloud services across AWS, Azure, and

Qualifications

Bachelor's or Master's Degree in a relevant discipline.
Strong expertise in Data Engineering using Databricks, Apache Spark, Hadoop, Kafka, Hive, EMR, MapReduce, and cloud data warehouse platforms including Snowflake and Amazon Redshift.
Proficiency in Python, Java, Scala, and SQL, with hands-on experience in full-stack development, distributed systems, microservices, and AI/ML-powered software solutions.
Extensive experience with AWS, Microsoft Azure, and Google Cloud Platform (GCP), along with RDBMS, NoSQL databases (MongoDB, Cassandra, MySQL), UNIX/Linux, Shell Scripting, and real-time data streaming.

Responsibilities

Collaborate with cross-functional Agile teams to design, build, test, deploy, and maintain scalable technical solutions.
Lead and mentor software engineers working on machine learning platforms, distributed systems, cloud-native applications, and full-stack technologies.
Design robust data engineering solutions using Python, Java, Scala.
Develop and maintain cloud-based data warehouse solutions using Snowflake and Amazon Redshift.
Build scalable applications utilizing both relational and NoSQL databases.
Work with distributed computing frameworks and big data platforms to process large-scale datasets.
Partner with Digital Product Managers and business stakeholders to deliver secure, reliable, and high-performance cloud solutions.
Perform unit testing, peer code reviews, and performance optimization to ensure high-quality software delivery.
Stay current with emerging technologies, cloud innovations, AI-powered engineering tools, and modern software development practices.
Participate in internal and external technology communities while mentoring engineering teams and promoting technical excellence.