Senior Python & Data Pipeline Engineer (AWS, Airflow)
Valiant Technologies LLC
A complete application in a minute
Tailored resume and cover letter, ready to send.
Job summary
Valiant Technologies LLC is seeking a skilled Python/Data Engineering professional to design and implement scalable data pipelines using PySpark, Airflow, and AWS services. You will work across the stack with Pandas/NumPy, Flask/Django, and modern CI/CD practices to deliver robust, high-performance solutions.
Ideal candidates have hands-on experience with Snowflake or Databricks and may explore ML/AI frameworks or AI-assisted tools to boost productivity.
Qualifications
- Expert Python programming and strong problem-solving skills.
- Extensive PySpark experience, Spark SQL, and distributed data processing.
- Proficient in Python testing (PyTest, PyUnit) and debugging.
- Deep knowledge of Pandas, NumPy, Flask or Django libraries.
- Hands-on with Airflow, Kafka, Jenkins, Spinnaker data pipelines.
- Ability to design scalable, reliable, high-performance apps.
- Experience with AWS services (S3, EC2, Lambda, ECS, EventBridge).
- Familiar with CI/CD and DevOps for automated deployments.
- Nice to have Snowflake, Databricks in cloud data warehousing.
- Exposure to ML/AI frameworks and AI-assisted tools like Copilot and LLMs.
Skills
Tools
Job description
Valiant Technologies LLC is seeking a skilled Python/Data Engineering professional to design and implement scalable data pipelines using PySpark, Airflow, and AWS services. You will work across the stack with Pandas/NumPy, Flask/Django, and modern CI/CD practices to deliver robust, high-performance solutions.
Ideal candidates have hands-on experience with Snowflake or Databricks and may explore ML/AI frameworks or AI-assisted tools to boost productivity.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
