Senior Data DevOps Engineer (AWS, Databricks)

We are looking for a Senior Data DevOps to join EPAM and contribute to a project for a large customer in the e-commerce and fashion industry.As a Senior Data DevOps in Data Platform, you will focus on maintaining and implementing new features for the data transformation architecture, which is the backbone of the Customer's analytical data platform.By challenging the status quo, you will deliver high-performance data processing solutions that are efficient and reliable at scale. ResponsibilitiesIn the area of Operational Excellence:Troubleshoot user issues related to Databricks Spark and suggest optimizations for long-running or resource-intensive jobsGuide users on best practices for Databricks cluster managementConsult teams to develop, implement and maintain sustainable high-performance data-processing and data integration systemsIn the area of Delivering New Features:Implement services to improve the CI/CD experience for users with a focus on self-serviceCollaborate with teams in Customer’s Data Infrastructure to deliver services that support the central datalakeIn the area of Compliance and Security:Improve data access methods to provide secure and compliant self-service platform by defaultIn the area of Cost Savings:Guide users to find cost-effective setups while maintaining high efficiencyImplement observability solutions in Databricks to reduce slack costsPromote adoption of advanced Databricks features such as Photon and Graviton instancesReview infrastructure to identify cost-saving opportunitiesSupport business needs for the platform search application through analysis, design and development in an Agile team RequirementsKnowledge of distributed data processing frameworks such as Apache Spark and understanding of relational database management systemsBackground in production environments with DatabricksSkills in Python and Scala combined with SQLProficiency in cloud technologies including AWS services such as IAM S3 Lambda EC2Expertise in software development processes with focus on testing continuous integration and delivery monitoring and documentationAdvanced English skills Nice to haveFamiliarity with AWS Networking or basics of networking on AWS CloudCompetency in TerraformAdvanced English skills We offerWe connect like-minded people:Delivering innovative solutions to industry leaders, making a global impactEnjoyable working environment, whether it is the vibrant office or the comfort of your own homeOpportunity to work abroad for up to two months per yearRelocation opportunities within our offices in 55+ countriesCorporate and social eventsWe invest in your growth: Leadership development, career advising, soft skills and well-being programsCertifications, including GCP, Azure and AWSUnlimited access to LinkedIn Learning and Get AbstractFree English classes with certified teachersDiscounts in local language schools, including offline courses for the Uzbek languageWe cover it all:Monetary bonuses for engaging in the referral programMedical & family care packageFour trust days per year (sick leave without a medical certificate)Discounts for fitness clubs, dance schools and sports programsBenefits package (sports activities, a variety of stores and services) Join our team in our well-equipped office in Tashkent. Experience the freedom of remote work from anywhere in Uzbekistan, whether it's the comfort of your home or our modern office in Tashkent. EPAM Uzbekistan is a team of technologists and innovators united by technology. In 2019, we opened our first office in Tashkent. Since then, we’ve built a continuously learning organization that helps its employees reach their full potential and achieve professional goals through learning. Our agile methodologies, client collaboration frameworks, engineering excellence programs, and hybrid teams offer many career paths and development opportunities.