Data Engineer

Diverse Lynx, LLC; Charlotte (NC); On-site; USD 95,000 - 120,000; Full time

Job summary

Diverse Lynx, LLC is recruiting a senior data engineering professional in Charlotte, NC. The role blends hands-on software development with leadership, overseeing big data initiatives and collaborating with product owners, data scientists, and architects.

Ideal candidates have 8+ years of experience, strong Hadoop/Hive/Spark/Cloudera background, Python and SQL proficiency, and familiarity with AWS/Azure. On-site work in Charlotte is expected.

Qualifications

• 8+ years hands-on data engineer/software development experience, including 5+ years onsite.
• Experience with big data processing systems like Hadoop, Cloudera.
• Proficient in Python, SQL, and UNIX.
• Knowledge of Hadoop ecosystem: Hive, Spark, Pispark.
• Experience with cloud services (AWS, Azure).
• Ability to lead junior engineers toward delivery and also codeHands-on.

Responsibilities

• Lead technology initiatives and guide junior engineers to project completion and deliveries.
• Switch between technology leadership and hands-on coding when required.
• Collaborate with product owners and data scientists to shape data solutions.

Skills

Data engineering

Big data

Python

SQL

UNIX

Hadoop

Hive

Spark

Cloudera

AWS/Azure

Bitbucket

CI/CD

Tools

Bitbucket

Job description

About this job

Location: Charlotte, NC

Salary Range - $95,000-$120,000 a year

Objective of Role:

Primary Interactions:

• Business partners and stakeholders
• Product Owner
• Development Team
• Architect
• Domain Community of Practice
• Data Scientists

Job Description

Required Skills:

• - Minimum 8+ years hands-on data engineer/Software development exp (at least 5 years of onsite exp)
• - Experience with big data processing systems like Hadoop, Cloudera etc
• - Experience with one or more of the programming languages like Python (Modular python programming exp)
• - Strong SQL and UNIX experience
• - Hadoop - Hive, Spark , Pispark
• Proven experience with technology leadership guiding junior engineers towards project completion and deliveries
• Experience with cyber security domain, preferably vulnerability data management
• 8+ years of hands-on data engineer/software development
• Ability to switch from technology leadership to hands on coding when required
• Experience with big data processing systems like Hadoop, Cloudera, etc.
• Experience with Cloud Services\Technologies like AWS, Azure, etc.
• Experience with one or more of the programming languages like Python
• Strong SQL and UNIX experience
• Experience with data stores like HIVE, HBase Elastic
• Experience with code versioning systems like Bitbucket
• Experience with CICD pipelines
• Good knowledge on Data engineering principles and SDLC process
• Ability to detect early and articulate with business partners the challenges and gaps in requirements

Experience: Minimum 8+ years

Disclaimer: Diverse Lynx LLC is an Equal Opportunity Employer. All applicants and employees are evaluated without discrimination, based solely on their qualifications, ability, competence and performance.