Senior Data Engineer with Python

We are seeking an experienced and driven Senior Data Engineer to join our expanding Data Engineering team.This position involves working as part of one of our established Platform Teams, where you will design, develop, and scale data pipelines in Databricks with PySpark on Microsoft Azure, empowering our AI Factory teams to create and deploy advanced machine learning solutions.This role offers the chance to contribute at the nexus of big data, cloud engineering, and MLOps, delivering reliable, scalable, and high-performance data platforms that support innovation across the organization. ResponsibilitiesDesign cloud-native analytical solutions using Big Data and NoSQL technologiesBuild scalable data pipelines in Databricks with PySpark on AzureCollaborate with MLOps and ML Engineering teams to deliver data platforms for AI development and deploymentSupport requirements gathering and deliver aligned solutions with architects, technical leads, and cross-functional teamsAssist the SAP Platform Team in utilizing SAP BTP and hyperscaler offerings for enterprise-grade data solutionsConduct code reviews to ensure technical standards and practices are maintainedProvide mentorship to junior engineers to cultivate a high-performance cultureIncorporate CI/CD methodologies into data engineering workflows using tools like Jenkins or GitLab CI/CDEngage with stakeholders to understand processes, model input data, and ensure deliverable alignment Requirements4+ years of experience in Software Engineering with a focus on Data Engineering, Machine Learning, or MLOpsProficiency in Python and PySparkBackground in Databricks and Microsoft Azure cloud servicesKnowledge of software version control tools, including GitHub or GitCapability to work with CI/CD frameworks such as Jenkins, Concourse, or GitLab CI/CDExpertise in building scalable, robust, and available data solutionsCompetency in problem-solving and analytical skills, along with effective stakeholder engagement Nice to haveSkills in an additional programming language like Java, SQL, or ScalaUnderstanding of SAP BTP or similar enterprise data platformsFamiliarity with agile development environments We offerOpportunity to Engineer your Future and to drive the world’s digital transformation with top industry clientsPersonal development program that will allow you to be valued for your strengthsWide range of professional trainings and workshopsBeing part of a collaborative, fast-growing, and innovative design teamEstablished and accelerated growth toward different career paths, competencies, and rolesBroad projects variety and possible mobility between projects over the timeCollaboration in a multicultural environment and exchange of best practices with colleagues around the worldVaried social benefits, Sports, Transportation and Health programsWork-life balance and flexible schedule, team buildings and sport opportunitiesModern office/collaboration spaces (incl. new Infinity Tower business center, Sofia)Hybrid By Design - we provide you with the best productivity options from the 2 worlds. Meet, socialize and enjoy F2F time with your colleagues, while working from the modern EPAM's office for a few days per week and benefit from the EPAM's virtual working environment - making you able to be productive and work from remote for the rest of the week