Data Team Lead

DataArt; United States; Hybrid; USD 140,000 - 200,000; Full time

Benefits offered by this job

Vacation days up to 26 days per year

Health and life insurance

English language classes from day one

Flexible hybrid work options

Certification reimbursement (AWS, GCP)

Job summary

DataArt in the United States is seeking a senior Data Engineer Lead to drive the Data Engineering team, set technical direction, and coordinate delivery across architectures, product and client work.

You will translate client requirements into scalable data pipelines using AWS, Spark, SQL and modern CI/CD practices, review solutions, mentor engineers, and manage risks and priorities to ensure high-quality execution.

Qualifications

• Strong experience in data engineering, technical leadership, and delivery coordination.
• Hands-on with at least one major cloud platform (AWS, Azure, or GCP).
• Experience with batch processing, object storage, relational databases, messaging, containers, and serverless computing.
• Experience with Apache Spark.
• Strong SQL knowledge, relational databases, and data modelling.
• Experience with Git-based development and CI/CD (GitHub Actions, Azure DevOps or equivalent).
• Experience with web scraping and web parsing.
• Understanding of Master Data Management.
• Ability to translate client requirements into technical scope, estimates, and delivery plans.
• Ability to evaluate technical and architectural proposals and provide constructive feedback.
• Strong ownership and proactive blockers resolution.
• Clear communication and collaboration skills.
• Nice to have: experience on other cloud platforms and engineering tools.

Responsibilities

• Lead the day-to-day work of the Data Engineering team, including technical direction, planning, prioritization, and delivery.
• Translate client requirements into clear technical scope, implementation activities, estimates, and delivery plans.
• Contribute to solution design by proposing approaches, reviewing architectural decisions, and constructively challenging them when appropriate.
• Work closely with the Data Architect to ensure proposed solutions are practical, scalable, and aligned with implementation needs.
• Coordinate team priorities, task ownership, dependencies, and progress.
• Review technical solutions, code changes, database changes, and implementation approaches.
• Support engineers with technical decisions and blockers.
• Take ownership of problems and drive them through investigation, resolution, and validation.
• Identify risks and dependencies early and coordinate with the relevant teams to resolve them.
• Collaborate with Backend, AI, QA, DevOps, Product, and Architecture teams.
• Communicate progress, risks, estimates, and technical decisions clearly to stakeholders.

Skills

Data engineering leadership

Delivery coordination

Cloud platforms (AWS/Azure/GCP)

Batch processing and object storage

Relational databases & SQL

Apache Spark

Git-based development & CI/CD

Web scraping / parsing

Master Data Management understanding

Requirements translation into scope &

Architecture evaluation & feedback

Problem ownership & blockers

Communication & collaboration

Experience across cloud platforms

Tools

GitHub

CI/CD tools

Job description

Technology stack

• AWS Batch
• AWS RDS
• AWS S3
• AWS SNS
• AWS SQS
• AWS ECR
• AWS Lambda
• Apache Spark
• PostgreSQL
• GitHub
• GitHub Actions
• web parsing and scraping
• Master Data Management

Project overview

You will work closely with architects, engineers, product teams, and clients to translate business requirements into technical solutions, estimate and plan delivery, resolve technical challenges, and ensure high-quality engineering standards across the team.

Responsibilities

• Lead the day-to-day work of the Data Engineering team, including technical direction, planning, prioritization, and delivery.
• Translate client requirements into clear technical scope, implementation activities, estimates, and delivery plans.
• Contribute to solution design by proposing approaches, reviewing architectural decisions, and constructively challenging them when appropriate.
• Work closely with the Data Architect to ensure proposed solutions are practical, scalable, and aligned with implementation needs.
• Coordinate team priorities, task ownership, dependencies, and progress.
• Review technical solutions, code changes, database changes, and implementation approaches.
• Support engineers with technical decisions and blockers.
• Take ownership of problems and drive them through investigation, resolution, and validation.
• Identify risks and dependencies early and coordinate with the relevant teams to resolve them.
• Collaborate with Backend, AI, QA, DevOps, Product, and Architecture teams.
• Communicate progress, risks, estimates, and technical decisions clearly to stakeholders.

Requirements

• Strong experience in data engineering, technical leadership, and delivery coordination.
• Hands-on experience with at least one major cloud platform, such as AWS (preferably), Azure, or GCP.
• Experience with cloud services for batch processing, object storage, relational databases, messaging, containers, and serverless computing.
• Experience with Apache Spark.
• Strong knowledge of SQL, relational databases, and data modelling.
• Experience with Git-based development, code reviews, and CI/CD tools such as GitHub Actions, Azure DevOps or equivalent platforms.
• Experience with web scraping and web parsing.
• Understanding of Master Data Management.
• Ability to understand client requirements and translate them into technical scope, estimates, and delivery plans.
• Ability to evaluate technical and architectural proposals, suggest alternatives, and provide constructive feedback.
• Strong ownership and a proactive approach to identifying and resolving blockers.
• Clear communication, collaboration, and interpersonal skills.
• Nice to haveCandidates with equivalent experience from other cloud platforms and engineering tools.

What We Offer:

• Vacation days: Up to 26 business days per year.
• 10 illness/special days off per year (fully paid, no medical papers needed) for all contract types
• Health and life insurance (Luxmed)
• MyBenefit platform with Multisport option
• Internal psychological support service
• English language classes from the first working day
• Access to external learning platforms: O’Reilly, LinkedIn Learning, Udemy, and a wide catalog of diverse internal training
• Flexible workplace: work from the office, from home, or choose a hybrid option
• Tech Skills Mentoring Program
• Opportunities to develop as a public speaker, mentor, or technical interviewer
• Fully paid idle (bench) when not involved in a project
• Certification reimbursement (AWS, GCP, Microsoft, etc.)