Python / Databricks Developer
Posted: 4 days ago
Job Description
Our client is expanding their Data Engineering Team and seeking skilled Python/Databricks Developers to join an integrated, cross-functional team operating within a SAFe/Agile environment. The team is responsible for designing, developing, and maintaining data pipelines, models, and products on an AWS Cloud-based ETL platform. This platform supports data integration and analytics for pharma supply chain operations, including inventory management, logistics, and manufacturing planning.Key ResponsibilitiesData Engineering & Pipeline DevelopmentDesign, develop, and optimize ETL pipelines using Databricks and a configuration-based framework.Build and maintain data models, data products, and backend functionalities leveraging Databricks native tools.Implement and manage data ingestion processes using AWS DMS (Database Migration Service).Work with Kafka for real-time data streaming and integration.Cloud & AutomationUtilize AWS cloud services for data storage, transformation, and orchestration.Implement CI/CD pipelines for code management and deployment using GitHub or similar tools.(Optional) Automate infrastructure and workflows using Terraform and AWS Lambda.Collaboration & DeliveryCollaborate with data modelers, business analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.Contribute to team ceremonies and development cycles within the Agile/SAFe framework.Ensure scalability, performance, and compliance with regulatory standards within data solutions.Technical Skills / Must-Haves3–5+ years of professional experience in data engineering or software development.Strong proficiency in Python programming.Hands-on experience with Databricks as an ETL platform.Solid understanding of AWS Cloud Services (e.g., S3, Lambda, EC2, Glue, etc.).Experience with Kafka for data streaming and integration.Familiarity with AWS DMS or similar database replication tools.Practical experience with CI/CD pipelines and Git-based version control systems.Preferred / Advantageous SkillsExperience with Terraform and AWS Lambda for infrastructure automation.Background in pharmaceutical manufacturing or regulated environments.Working knowledge of Agile/SAFe development methodologies.
Job Application Tips
- Tailor your resume to highlight relevant experience for this position
- Write a compelling cover letter that addresses the specific requirements
- Research the company culture and values before applying
- Prepare examples of your work that demonstrate your skills
- Follow up on your application after a reasonable time period