Senior Data Engineering Lead: ML, Cloud & Big Data

Jobtailor; New York (NY); On-site; USD 180,000 - 240,000; Full time

Job summary

Jobtailor in New York, NY seeks a senior leader to drive full-stack development, ML initiatives, and cloud-based data platforms. You will lead engineers across distributed microservices and data warehousing, delivering robust solutions for financial empowerment.

Responsibilities include mentoring teams, partnering with product managers, and ensuring rigorous testing and code quality. Strong background in Java/Scala/Python, big data, and cloud services is required.

Qualifications

• Bachelor’s degree required.
• At least 6 years of experience in application development.
• At least 2 years of experience in big data technologies.
• At least 1 year experience with cloud computing (AWS, Azure, Google Cloud).
• At least 4 years of people management experience.
• Preferred: Master’s degree.
• Preferred: 9+ years of experience in application development including Python, SQL, Scala, or Java.
• Preferred: 4+ years of experience with a public cloud (AWS, Azure, Google Cloud).
• Preferred: 5+ years experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL).
• Preferred: 4+ years experience working on real-time data and streaming applications.
• Preferred: 4+ years of experience with NoSQL (Mongo, Cassandra).
• Preferred: 4+ years of data warehousing experience (Redshift or Snowflake).
• Preferred: 4+ years of UNIX/Linux experience.
• Preferred: 2+ years of experience with Agile engineering practices.
• Preferred: 6+ years of people management experience.

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions.
• Lead a team of developers with experience in machine learning, distributed microservices, and full stack systems.
• Utilize Java, Scala, Python, and SQL; work with RDBMS and NoSQL databases; and leverage cloud data warehousing like Redshift and Snowflake.
• Stay current with technology trends, experiment with new technologies, and mentor engineering teams.
• Collaborate with product managers to deliver robust cloud-based solutions for financial empowerment.
• Perform unit tests and conduct code reviews to ensure high-quality, performant code.

Skills

Full-Stack Development

Machine Learning

Cloud Computing

Big Data Technologies

People Management

Collaboration

Mentoring

Leadership

Education

Bachelor’s Degree

Master’s Degree

Tools

Kafka

Hive

EMR

MongoDB

Cassandra

Redshift

Snowflake

Job description

Jobtailor in New York, NY seeks a senior leader to drive full-stack development, ML initiatives, and cloud-based data platforms. You will lead engineers across distributed microservices and data warehousing, delivering robust solutions for financial empowerment.

Responsibilities include mentoring teams, partnering with product managers, and ensuring rigorous testing and code quality. Strong background in Java/Scala/Python, big data, and cloud services is required.