[Job-20191] Data Engineer

CI&T; United States; Remote; USD 90,000 - 130,000; Full time

Job summary

A leading company in tech transformation seeks a Senior Data Engineer to enhance their data solutions specifically for clients in Australia and the APAC region. This role involves deep technical expertise in data architecture and engineering, contributing to cutting-edge projects and mentorship within the team. Candidates should bring extensive experience in data warehousing, analytics, and familiarity with modern cloud services, showcasing a passion for innovative data methodologies.

Qualifications

• 6+ years in software development.
• Expertise in Data Warehousing and Analytics.
• Experience with modern data formats like Delta Tables and Parquet.

Responsibilities

• Design, build, and deploy data solutions.
• Collaborate on technical engagements and design discussions.
• Create and maintain technical documentation.

Skills

Data Warehousing

Data Analytics

Python

Spark

Data Modeling

SQL

Cloud Data Services

Data Pipeline Orchestration

MLOps

Infrastructure as Code

Tools

Databricks

Snowflake

Azure Data Factory

AWS Glue

Apache Airflow

Job description

We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions.With over 6,500 CI&Ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.

We are seeking a Senior Data Engineer with extensive hands-on experience in Data Architecture and Engineering to serve as a technical contributor within our team. This role focuses on working primarily with Australian clients and the broader APAC region. As a Senior Data Engineer, you will be responsible for designing, building, and deploying cutting-edge data solutions while contributing to establishing our data practice in Australia.

Key Accountabilities

• Contribute to technical engagements and proactively identify opportunities to expand CI&T's business with clients.
• Collaborate on multiple projects across various domains, providing diverse subject matter expertise.
• Participate in technical design and architecture discussions to ensure robust solutions.
• Ensure adherence to security and performance best practices in all solutions.
• Create and maintain technical documentation required by clients.
• Communicate effectively with customer team members to ensure alignment and clarity of technical solutions.
• Understand client requirements and develop viable technical solutions by selecting appropriate frameworks.
• Guarantee a stable and productive development environment for all team members.

Knowledge and Experience

• 6+ years of experience in the software development area;
• Proven expertise in Data Warehousing and Data Analytics projects, encompassing data acquisition, transformation, and data science initiatives.
• Exposure with modern data file formats such as Delta Tables, Apache Iceberg, and Parquet.
• Proficiency in Python, Spark, DBT, and other data transformation tools and frameworks.
• Expertise in data modelling, with familiarity in conceptual, logical, and physical data models, following methodologies like Data Vault 2.0 and Dimensional Modelling.
• Experience with cloud data services such as Microsoft Intelligent Data Platform, AWS Data Services, or Google Cloud Data Analytics.
• Hands-on experience with cloud data platforms like Databricks and/or Snowflake; certifications.
• Skilled in data pipeline orchestration tools, including Azure Data Factory, AWS Glue, Apache Airflow, or Prefect.
• Experience with CI/CD and MLOps pipelines to streamline development and deployment processes.
• Proficient in Infrastructure as Code (IaC) for efficient infrastructure management.
• Expertise in data migration, performance tuning, and optimisation of databases and SQL queries queries.
• Understanding of Data Governance and Data Management concepts.
• Understanding of design patterns, clean architecture, and clean coding principles.
• Familiarity with unit, integration, and E2E testing.

Personal Attributes

• Mentorship: Ability to mentor and share knowledge with junior team members, fostering their growth and development.
• Consulting Mindset: Demonstrate adaptability in diverse situations, effectively managing changing priorities while maintaining a positive attitude and thriving in ambiguous.
• Communication: Strong communication skills, capable of communicating clearly and efficiently with team members and clients and presenting ideas effectively according to the audience and context.
• Non-functional Requirements: In-depth understanding of non-functional requirements, including performance, security, data privacy, and protection.
• Passion for Data: A genuine passion for working with data, evident in your enthusiasm for coding, experimenting, and problem-solving.
• Innovative Spirit: Excited by the challenge of deploying pipelines and dashboards, with a drive to continuously improve and innovate.
• AI Enthusiast: Keen interest in AI technologies, such as Generative AI, for self-augmentation and performance improvement.

Collaboration is our superpower, diversity unites us, and excellence is our standard.

We value diverse identities and life experiences, fostering a diverse, inclusive, and safe work environment. We encourage applications from diverse and underrepresented groups to our job positions.