Senior Data Engineer: Build Scalable AI Data Platforms

Archer; United States; On-site; USD 140,000 - 190,000; Full time

Job summary

Archer, collaborating with Kainos, seeks a Senior Data Engineer to design and develop scalable data processing systems. You will contribute to big data solutions, lead development, and guide teams in production-ready data pipelines.

Ideal candidates have strong Java/Scala/Python skills, expertise in data platforms, and a passion for AI technologies. Expect collaboration with cross-functional teams in a fast-paced Agile environment.

Qualifications

• Strong software development experience in Java, Scala, or Python.
• Experience with data-processing platforms from AWS, Azure, GCP, Databricks.
• Developed substantial components for large-scale data processing and production deployment.
• Proficient in SQL and analytical SQL extensions.
• Solid understanding of ETL/ELT patterns for data processing.

Responsibilities

• Develop data processing software for Big Data deployments from design to test and deployment.
• Collaborate with Architects and Lead Engineers to support non-functional requirements.
• Mentor and coach team members while upholding code quality and maintainability.
• Coordinate with operations for production readiness and monitoring.
• Estimate effort and implications of user stories for stakeholders.
• Provide guidance and expertise on data best practices.

Skills

Java

Scala

Python

SQL

ETL/ELT

CI/CD

AI

Distributed data processing

Tools

AWS

Azure

GCP

Databricks

Job description

Archer, collaborating with Kainos, seeks a Senior Data Engineer to design and develop scalable data processing systems. You will contribute to big data solutions, lead development, and guide teams in production-ready data pipelines.

Ideal candidates have strong Java/Scala/Python skills, expertise in data platforms, and a passion for AI technologies. Expect collaboration with cross-functional teams in a fast-paced Agile environment.