AWS Cloud Data Engineer

Synechron; Piscataway Township (NJ); On-site; USD 110,000 - 120,000; Full time

Benefits offered by this job

Competitive compensation

Global opportunities

Paid annual leave

Job summary

Synechron is seeking an AWS Cloud Data Engineer to design, build, and optimize cloud-based data pipelines and analytics capabilities. The role emphasizes hands-on data engineering, Databricks, Python development, and AWS services to deliver scalable solutions for BI and data integration.

You will collaborate with data analysts, BI developers, and business stakeholders to implement ingestion, transformation, and reporting components, leveraging Power BI and Tableau where applicable.

Qualifications

• 8+ years of experience in data engineering or cloud development.
• Experience with Databricks and Spark.
• Experience with Power BI and Tableau.
• Experience with AWS services (Lambda, S3, IAM, CloudWatch).
• Experience with MongoDB and data ingestion pipelines.
• Familiarity with GitHub Actions and CI/CD.
• Ability to work within an Agile development environment.

Responsibilities

• Develop, maintain, and support scalable data pipelines using Python, Databricks, and AWS services.
• Build data ingestion, transformation, validation, and processing workflows.
• Work with structured, semi-structured, and unstructured data sources.
• Develop data processing solutions using Databricks and Apache Spark.
• Implement data cleansing, enrichment, transformation, aggregation, and validation processes.
• Write efficient, maintainable, and well-documented code.
• Troubleshoot data quality, pipeline performance, processing, and integration issues.
• Collaborate with developers, analysts, BI developers, and stakeholders.
• Contribute to data models, data structures, and development documentation.
• Develop and support data solutions using AWS cloud services.
• Build serverless data-processing components using AWS Lambda.
• Use Amazon S3 for data storage, staging, archival, and data-lake workflows.
• Integrate AWS services into automated pipelines.
• Implement error handling, logging, monitoring, and alerting.
• Secure handling of data, credentials, and configuration.
• Assist with deployment, troubleshooting, and operational support of AWS-based workloads.
• Follow established AWS development and security standards.

Skills

Python development

Agile methodologies

Power BI experience

Tools

Databricks

AWS

AWS Lambda

Amazon S3

MongoDB

GitHub

GitHub Actions

Tableau

Job description

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 17000+, and has 58 offices in 22 countries within key global markets.

We are seeking a hands-on AWS Cloud Data Engineer to develop, maintain, and enhance cloud-based data solutions and analytics pipelines.

The successful candidate will have practical experience with Databricks, AWS, Python, AWS Lambda, Amazon S3, and MongoDB, along with familiarity with GitHub, GitHub Actions, and Agile development practices. The role will focus on hands-on development, data engineering, pipeline implementation, troubleshooting, and analytics enablement—not enterprise architecture or people management.

Experience with business intelligence tools is important. Strong Power BI experience is required, and knowledge of Tableau would be highly desirable.

Additional Information*

The base salary for this position will vary based on geography and other factors.

In accordance with law, the base salary for this role if filled within Piscataway, NJ is $110K-$120K/year & benefits (see below).

Responsibilities:

Data Engineering and Development

• Develop, maintain, and support scalable data pipelines using Python, Databricks, and AWS services.
• Build data ingestion, transformation, validation, and processing workflows.
• Work with structured, semi-structured, and unstructured data sources.
• Develop reliable data processing solutions using Databricks and Apache Spark.
• Implement data cleansing, enrichment, transformation, aggregation, and validation processes.
• Write efficient, maintainable, and well-documented code.
• Troubleshoot data quality, pipeline performance, processing, and integration issues.
• Collaborate with application developers, data analysts, BI developers, and business stakeholders.
• Contribute to data models, data structures, technical specifications, and development documentation.
• Develop and support data solutions using AWS cloud services.
• Build serverless data-processing components using AWS Lambda.
• Use Amazon S3 for data storage, staging, archival, and data-lake-related workflows.
• Integrate AWS services into automated data ingestion and processing pipelines.
• Implement appropriate error handling, logging, monitoring, and alerting.
• Support secure handling of data, credentials, and configuration.
• Assist with deployment, troubleshooting, and operational support of AWS-based data workloads.
• Follow established AWS development and security standards.

Databricks and Spark

• Develop notebooks, jobs, workflows, and data transformations in Databricks.
• Use Python and PySpark to process and transform data at scale.
• Build and maintain scheduled and event-driven Databricks jobs.
• Improve data pipeline performance and optimize processing where necessary.
• Implement appropriate partitioning, caching, schema management, and data validation techniques.
• Support integration between Databricks, Amazon S3, MongoDB, and other data sources.
• Maintain clear documentation for notebooks, jobs, dependencies, and operational procedures.

Python Development

• Develop production-quality Python applications, scripts, utilities, and data-processing components.
• Write modular, testable, maintainable, and reusable code.
• Implement unit tests, integration tests, validation checks, and error-handling routines.
• Use Python libraries and frameworks appropriate to data engineering and AWS development.
• Identify and resolve performance, reliability, and maintainability issues.
• Follow agreed coding standards, peer-review practices, and development processes.

MongoDB and Data Integration

• Work with MongoDB databases, collections, documents, indexes, and queries.
• Develop processes to extract data from MongoDB and load it into AWS and Databricks environments.
• Support data transformation between document-oriented and analytical data structures.
• Write efficient queries and assist with data-performance optimization.
• Handle schema variation, nested data, data quality issues, and changing source structures.
• Support data reconciliation and validation between source and target systems.

Business Intelligence and Reporting

• Develop, maintain, and support dashboards, reports, and data models in Microsoft Power BI.
• Connect Power BI to appropriate data sources and curated datasets.
• Create effective data models, relationships, calculated columns, and measures using DAX.
• Develop user-friendly visualizations and dashboards based on business requirements.
• Work with business users and analysts to understand reporting needs.
• Validate report data and troubleshoot discrepancies between reports and source systems.
• Apply appropriate refresh, performance, security, and deployment practices.
• Experience with Tableau is highly desirable and may be useful for supporting existing reporting solutions.

GitHub, GitHub Actions, and Development Processes

• Use GitHub for source control, collaboration, pull requests, code reviews, and issue tracking.
• Contribute to branching, versioning, and release-management practices.
• Develop and maintain GitHub Actions pipelines for automated build, testing, validation, and deployment.
• Support automated deployment of Python code, Databricks assets, Lambda functions, and related data components.
• Participate in peer reviews and follow established coding and repository standards.
• Maintain appropriate documentation for code, pipelines, configuration, and operational procedures.
• Troubleshoot failed builds, tests, deployments, and pipeline executions.

Agile Delivery

• Work as an active member of an Agile development team.
• Participate in sprint planning, daily stand-ups, backlog refinement, demonstrations, and retrospectives.
• Break work into clear technical tasks and provide realistic estimates.
• Collaborate with product owners, analysts, developers, testers, and stakeholders.
• Deliver incremental, tested, and documented solutions.
• Identify risks, dependencies, blockers, and opportunities for improvement.
• Contribute to continuous improvement of team development and delivery processes.

Requirements:

• 8+ years of experience in data engineering, cloud development, software development, or a closely related field.
• Strong hands-on experience with Databricks and Apache Spark.
• Strong Python development experience, particularly for data processing and automation.
• Experience with Tableau in addition to Power BI.
• Experience with Delta Lake, Unity Catalog, or Databricks Workflows.
• Experience working with data lakes, lakehouses, or modern cloud data platforms.

Practical experience with AWS cloud services, especially:

• AWS Lambda
• Amazon S3
• IAM
• CloudWatch
• Event-driven or serverless integrations
• Experience working with MongoDB and document-oriented data.
• Experience developing and supporting data ingestion and transformation pipelines.
• Experience using GitHub for source control and collaborative development.
• Familiarity with GitHub Actions and automated CI/CD pipelines.
• Strong experience developing reports and dashboards in Microsoft Power BI.
• Working knowledge of data modeling, data quality, data validation, and data integration.
• Familiarity with Agile software development practices.
• Experience writing unit tests, integration tests, and data validation checks.
• Strong troubleshooting, analytical, and problem-solving skills.
• Ability to work collaboratively within a development team.
• Strong written and verbal communication skills.

We offer:

• A highly competitive compensation and benefits package.
• A multinational organization with 58 offices in 22 countries and the possibility to work abroad.
• 10 days of paid annual leave (plus sick leave and national holidays).
• Maternity & paternity leave plans.
• A comprehensive insurance plan including medical, dental, vision, life insurance, and long-/short-term disability (plans vary by region).
• Retirement savings plans.
• A higher education certification policy.
• Commuter benefits (varies by region).
• Extensive training opportunities, focused on skills, substantive knowledge, and personal development.
• On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses.
• Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups.
• Cutting edge projects at the world’s leading tier-one banks, financial institutions and insurance firms.
• A flat and approachable organization.
• A truly diverse, fun-loving, and global work culture.

S YNECHRON’S DIVERSITY & INCLUSION STATEMENT

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.

All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.