Sr Data Engineer

ACI Infotech, Inc.; Atlanta (GA); Hybrid; USD 140,000 - 190,000; Full time

Job summary

ACI Infotech, Inc. is seeking a Data Engineering Lead (Marketing) in Atlanta, GA, to guide the Marketing Tech data platform. You will architect data pipelines, mentor a mixed onsite/offshore team, and partner with Marketing and Digital Guest Engagement to deliver data-driven experiences.

The role requires 5+ years of data engineering with Azure, Databricks, PySpark, Python, and strong leadership skills in a fast-moving environment. Hybrid work arrangement offered.

Qualifications

• Bachelor's degree required or equivalent experience.
• 5+ years hands-on data engineering with Azure data tools.
• Experience leading data engineering teams and projects.

Responsibilities

• Lead data engineering and analytics teams within Marketing Tech.
• Design and implement scalable Azure-based data pipelines and models.
• Mentor contingent engineers onsite and offshore.
• Collaborate with cross‑functional teams to align data solutions with business goals.
• Deliver data products and oversee CI/CD deployment for analytics solutions.

Skills

Data engineering

Azure

Databricks

PySpark

Python

Leadership

Mentoring

CI/CD pipelines

Data models

SQL

Education

Bachelor's degree in Computer Science or related field

Tools

Azure Data Factory

Azure Databricks

Python scripting

Job description

Data Engineering Lead (Marketing)

Location: Atlanta, GA.

Duration: FULL TIME / C2H.

Mode: Hybrid (3 days a Week).

This Data Engineering Lead (Marketing) position is part of Client IT's Marketing Technology team focused on enabling the development and roll-out of world-class modern Marketing Data Engineering capabilities at Client. This role partners with teams responsible for Marketing and Digital Guest Engagement platforms that leverage world-class technology to create personalized, relevant, data-driven experiences. In this role, you will lead teams designing and building Data & BI solutions that capture, explore, transform, and utilize curated data to support Marketing Business Unit's Data-driven transformation journey and decision-making process. In addition to leading the design and implementation of data products, you will also mentor and develop a team of contingent worker data engineers onsite and offshore.

Duties and Responsibilities

• Thought Leadership (20%) Provides industry thought leadership to fellow team members across business and technical project dimensions, solving complex business requirements. Proactively considers the future state of the organization and how technology can support these efforts. Advocates and define Marketing Data Engineering vision from a strategic perspective, including internal and exterior platforms, tools, and systems. Maintains overall MarTech industry Data knowledge on latest trends, technology, etc.
• Mentoring (20%) Manage and lead a technical team responsible for data engineering and analysis. focusing on individual's professional development as well as overall team health and technical proficiency on their assigned project tasks. Conducts product work reviews with team members. Serves in the development of team members by actively facilitating new learning opportunities and experiences in the Data Engineering space.
• Development (20%) Design and implement scalable data solutions on Azure platform using Data Factory, Databricks, PySpark, Python and other related services. Build data pipelines and workflows to ingest, transform, and load data from various sources. Develop and maintain data models and schemas for efficient data storage and retrieval. Develop and maintain CI/CD pipelines for automated deployment and testing of data solutions. Lead development and production deployment of analytic Data and BI products (also potentially pilots and proof of concepts), determining appropriate design strategies and methodologies.
• Collaborations (20%) Collaborate and maintain relationships with cross-functional teams (Cloud Infra, Enterprise Data & IT-SEC) to ensure data solutions meet business requirements. Continuously evaluate and recommend new data technologies and approaches to improve data solutions. Develop business partnerships and influence priorities by identifying solutions that are aligned with current business objectives and closely follow industry trends; understanding how to apply them and sharing knowledge with coworkers. Communicate with partners, describing technology concepts in ways the business can understand, documenting initiatives in a concise and clear manner. Partner with Enterprise Data management & information security colleagues to ensure the adherence of Data Governance standards for Client.
• Delivery Management (20%) Find creative solutions to challenging problems involving factors with potentially broad implications; reflecting on solutions, measuring impact, and using that information to ideate and optimize. Execute data strategies with an understanding of enterprise architecture, consumption patterns, platforms and application infrastructure. Stay ahead of the impediments to ensure a smooth, on time and in budget, implementation of Data Projects Collect weekly status updates from Dev teams across multiple Data POD teams and consolidate for leadership project health reporting.

Work Experience/ Education

• Bachelor's degree in computer science, Information Technology or a related study, or equivalent experience
• 5+ years of hands-on Data Engineering experience with On-Prem and Cloud based Data tools/Platforms, 3+ years of experience in data engineering with expertise specifically in Azure Data Factory, Databricks, PySpark, Python and related services.
• Proven experience in leading and managing technical teams in data engineering and analysis.
• Experience in designing and developing data models and schemas.
• Strong proficiency in programming languages such as Python.
• Experience in developing and maintaining CI/CD pipelines for automated deployment and testing.
• Good understanding of cloud computing and its services (e.g., Azure, AWS, Google Cloud Platform).
• Excellent problem-solving skills and ability to work in a fast-paced environment.
• Experience with the some of the following concepts: Real-time & Batch Data Processing, Workload Orchestration, Cloud, Data lakes, Data Security, Networking, Serverless, Testing / Test Automation (Unit, Integration, Performance, etc.), WebServices, DevOps, Logging, Monitoring, and Alerting, Containerization, Encryption / Decryption, Data Masking, Cost & Performance Optimization.
• Skilled leading and/or participating in system design and architectural activities including technical requirement writing experience and ability to lead collaboration sessions for important design reviews and decisions.
• Proven experience succeeding in complex, matrix and cross-functional projects.
• Ability to personally deliver large scale initiatives in a fast-paced environment with high levels of complexity and ambiguity.
• Experience and comfort managing indirect teams; scrums, agile cross functional teams, vendor stakeholders.
• Strong collaboration skills and the ability to work in a team-based environment including employees, vendors and third-party contractors.
• Ability to inspire, influence and collaborate across a wide range of constituents across functions and organizational levels.
• Excellent mentoring skills and the desire to contribute to efforts beyond the scope of the day-to-day project work.
• Excellent written, presentation and oral communication skills.
• Knowledge of technical architecture as a role discipline.
• Good to have, but not mandatory: Experience working with Loyalty Management data, and other Marketing business processes data.
• Experience with Campaign Management, Customer Data Platforms, Content Management, Advertising Technology, Personalization Engines as a Solution, etc.

Tech Skills

• Microsoft Azure Cloud: Azure Data Factory, APIM, Function Apps, Logic Apps, Key Vault, Azure App Insights, Azure SQL, Azure DevOps
• Databases: Azure SQL, Databricks, MongoDB, DevOps: GitHub, Azure DevOps, CI/CD Pipelines
• Programming Languages: SQL, PYTHON, SCALA, R
• API Development: Azure APIM, REST APIs, web services, security such as Oauth2, SAML, IDM, open API standards like swaggers, RAML, developer portal, API Testing: Postman, Log Analytics: Splunk, Dynatrace Web/Mobile App Analytics: Google Analytics, Firebase, Google Tag management
• Architecture modeling: Lucid Chart, Visio, ARIS, etc., Software development Experience using SaFe Agile methodologies.

ACI (Advanced Computing International) is a Global Technology Services, Products & Solutions Company focused on designing and delivering the next generation applications and digital experiences for businesses and consumers. We specialize in Big Data & Analytics, Digital Transformation, IT Service Management, Cognitive Solutions, Artificial Intelligence, IOT & Future Networks, DevOps, Enterprise Applications & Managed Infrastructure Services & Industry Specific Solutions. Leveraging the insights gained from working on innovative solutions and disruptive technologies, ACI develops Solutions to enhance business performance, accelerate product & applications time-to-market, harmonize Consumer Experiences and streamline their business operations. ACI works with clients across different business sectors: Financial Services, Healthcare, Manufacturing, Hi-Tech, Media, Utilities, Public sector, Retail, Telecom, E-commerce & Logistics, and Higher Education. ACI s core DNA is built on Innovation and co-existence to build a collaborative ecosystem where companies and consumers win.