Azure Databricks Engineer

Sogeti; Atlanta (GA); Hybrid; USD 90,000 - 120,000; Full time

Benefits offered by this job

Healthcare including dental and vision

401(k) matched 150% up to 6%

3 weeks Personal Time Off (PTO)

Paid parental leave

Tuition Reimbursement

Social well-being benefits

Job summary

A leading company in IT consulting is seeking a Data Engineer skilled in Databricks and SQL to design and optimize data pipelines. The ideal candidate will have 5+ years of experience and will work in a hybrid environment. Responsibilities include managing large-scale data processing and collaborating with cross-functional teams. The role offers a supportive work culture with benefits focused on well-being and growth.

Qualifications

• 5+ years experience as a data engineer with Databricks.
• Strong programming skills in Python, SQL, and/or Scala.

Responsibilities

• Design and develop scalable data pipelines using Databricks.
• Optimize and troubleshoot existing data workflows.
• Collaborate with data scientists and analysts.

Skills

Python

SQL

Databricks

PySpark

ETL

Problem Solving

Communication

Education

Bachelors or Masters Degree

Tools

Azure

AWS

GCP

Job description

Direct message the job poster from Sogeti

Talent Aquisition Manager @ Sogeti, part of Capgemini | South & Northeast Division

Sogeti USA is looking for a Data Engineer with Databricks and SQL experience.

Role Type: Full Time Employment (no C2C/C2H)

Location:

• Preferred locations: GA, MD, NY, NJ, FL, NC, SC, CT, MA, PA, or VA.
• Work hours are based on Eastern Standard Time (EST).
• Ideal candidates will be open to a hybrid work arrangement, depending on proximity to the client or company office.

All Sogeti Prospective Candidates Must:

• Possess a Bachelors and/or Masters Degree from an accredited institution.
• Must have valid work authorization that does not currently and/or will not require future require sponsorship of a visa for employment authorization in the US by Sogeti-Capgemini.

Job description: We are looking for a skilled Databricks Engineer with expertise in SQL and PySpark to design, build, and optimize data pipelines for our big data platforms. The ideal candidate will have 5+ years of hands-on experience with Databricks and be responsible for managing large-scale data processing, ensuring data quality, and driving efficiency in data workflows. As a Data Engineer, you will collaborate with cross-functional teams, apply data engineering best practices, and support the data needs of the organization.

Key responsibilities:

• Design and develop scalable data pipelines using Databricks.
• Optimize and troubleshoot existing data workflows.
• Collaborate with data scientists and analysts to understand data requirements.
• Implement data security and governance best practices.
• Monitor and maintain Databricks infrastructure.
• Perform data integration from various sources.
• Develop and maintain documentation for data processes.

Required Skills/Qualifications:

• 5-7+ years of experience as a data engineer with Azure Databricks
• Strong programming skills in Python, SQL, and/or Scala.
• Proficiency in PySpark.
• Strong understanding of data processing, ETL pipelines, and big data technologies.
• Experience in optimizing data workflows and ensuring data quality.
• Strong problem-solving and communication skills.

Preferred:

• Experience with cloud platforms like AWS, Azure, or GCP.
• Familiarity with CI/CD pipelines and DevOps practices.
• Certification in Databricks or related technologies.

Life at Sogeti - We support all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:

• Healthcare including dental, vision, mental health, and well-being programs
• Financial well-being programs such as 401(k) (matched 150% up to 6%) and Employee Share Ownership Plan
• 3 weeks Personal Time Off (PTO) and 7 Paid Holidays
• Paid parental leave
• Family building benefits like adoption assistance, surrogacy, and cryopreservation
• Social well-being benefits like subsidized back-up child/elder care and tutoring
• Mentoring, coaching and learning programs
• Continuing Education: $12,000 Annual Tuition Reimbursement plus access to over 20,000 online courses and certifications through Capgemini University, as well as Coursera and Degreed.
• Programs for Counseling, Support, Health and Fitness perks, Auto discounts and much, much more!
• Employee Resource Groups
• Disaster Relief

Disclaimer - Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

Please be aware that Capgemini may capture your image (video or screenshot) during the interview process and that image may be used for verification, including during the hiring and onboarding process.

This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.

Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.

Click the following link for more information on your rights as an Applicant http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law

Please be aware that Capgemini may capture your image (video or screenshot) during the interview process and that image may be used for verification, including during the hiring and onboarding process.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Consulting and Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Sogeti by 2x

Inferred from the description for this job

Medical insurance

Vision insurance

401(k)

Paid paternity leave

Paid maternity leave

Tuition assistance

Disability insurance

Child care support

Get notified about new Data Engineer jobs in Atlanta Metropolitan Area.

Python and Kubernetes Software Engineer - Data, AI/ML & Analytics

Staff Software Engineer, Backend - Python/Java (Remote)

DevOps Software Engineer (Remote - United States)

Senior Software Reliability Engineer (Remote)

Cybersecurity Principal Engineer – IAM / Data Science (Remote)

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.