Lead Data Engineer

ZipRecruiter; Ludwigshafen am Rhein; Vor Ort; EUR 90.000 - 100.000; Vollzeit

Zusammenfassung

A leading technology company is seeking a Lead Data Engineer to drive innovative data solutions utilizing big data and machine learning technologies. With responsibilities ranging from mentoring team members to leading complex Data & AI projects, this role offers the opportunity to shape the company's data-driven strategy while ensuring high-quality standards and collaboration within the tech team. Ideal applicants should bring over 5 years of relevant experience, strong cloud proficiency, and excellent communication skills in both German and English.

Qualifikationen

• 5+ years of experience in data architecture or engineering, with leadership experience.
• Extensive knowledge of cloud environments and machine learning/AI.
• Strong programming skills in Python and SQL, communicative in English and German.

Aufgaben

• Act as liaison for leadership, mentor team members and foster learning.
• Support project setups, devise architectures and assign Data Engineers.
• Lead Data & AI projects ensuring quality and stability through agile processes.

Kenntnisse

Leadership

Data Architecture

Machine Learning

Cloud Computing

Programming in Python

SQL

Mathematics and Statistics

Communication

Ausbildung

Degree/PhD in Computer Science or related technical discipline

Tools

Azure Data Factory

Terraform

AWS

GCP

Azure Databricks

Azure Synapse Analytics

Sci-kit-learn

TensorFlow

PyTorch

Azure ML

Jobbeschreibung

Job Description

Position - Lead Data Engineer

Salary - 90k-100k

Given the significant responsibilities we bear towards our customers, assets, and the environment, we're dedicated to analyzing and developing innovative solutions. Leveraging advanced big data and machine learning technologies, our aim is to deliver optimal services, enhance efficiency, and promote smarter, cleaner practices.

Your Responsibilities:

• Act as the primary liaison for the leadership team, fostering mentorship among team members and cultivating a culture of continuous learning.
• Provide support for projects and initiatives, particularly in their initial setup phase. Collaborate with the team to devise suitable architectures, estimate efforts, and assign appropriate Data Engineers.
• Lead Data & AI projects closely with internal clients, ensuring high quality and stability through agile processes and peer code reviews. Enhance efficiency and time-to-market by implementing reusable data models, architecture templates, and deployable data products.
• Take charge of technical evaluations of new candidates during the hiring process.
• Stay updated with industry trends and emerging technologies in data architecture and engineering. Evaluate and recommend new tools, technologies, and methodologies to enhance data management and analysis capabilities.

Your Skills:

• Possess 5+ years of professional experience in data architecture or engineering, with leadership experience and a degree/PhD in Computer Science or a related technical discipline. Strong affinity for mathematics and statistics.
• Extensive knowledge of Azure, AWS, and GCP cloud environments, along with architecture best practices and tools relevant for machine learning/AI use cases. Hands-on experience with Infrastructure-as-Code frameworks like Terraform and/or ARM templates.
• Proven experience in ETL processes, data extraction, transformation, and loading with Azure Data Factory, Azure Databricks, and/or Azure Synapse Analytics. Familiarity with DevOps, CI/CD pipelines, and deployment best practices.
• Proficient in Machine Learning frameworks like sci-kit-learn, Tensor Flow, PyTorch, Azure ML, etc. (including ML interpretability). Excellent programming skills in Python & SQL.
• Strong communication and presentation skills, adaptable to varying levels of precision and audience, fluent in English and German. Knowledge of the energy industry is advantageous.

What to Expect from a Career in Digital Technology:

Embark on a unique journey that combines your passion for technology with the opportunity to work on topics of high societal relevance. Contribute to our ambitious digitalization strategies, broaden your expertise through diverse assignments, work with cutting-edge technology, and explore international career growth opportunities within the organization.