Azure Data Engineer

"EngineerDesign, build, test, and maintain ETLELT pipelines using Azure Data Factory and Azure Data-bricks Architect scalable data storage solutions with Azure SQL, Data Lake, and Synapse Analytics Optimize performance and troubleshoot data delivery issues Define and enforce da-ta governance, security, and compliance Collaborate with cross-functional teams to deliver reliable data insights Automate deployments and monitor pipelines using Azure DevOps and Azure MonitorExperience working as Data Engineer with focus on big data processing and/or relational da-tabases with good understanding of SQ LExperienced with working on Structured and Semi-Structured datasets. Experience working with Microsoft Azure Data Platform, specifically Az-ure SQL Database, Azure Data Factory, ADLS storage account, Azure DataBricks and DevOpsExperienced in creating data pipelines & developing complex and optimized queries Experienced with Workflow Management Tools: Airflow, Crontab, CA Workload Automation-vExperience with implementing CI / CD pipeline on GitHub, Jenkins / JGP. Experience writing complex SQL and NoSQL jobs to analyze data in traditional DBMS (MS-SQL, Oracle) envi-ronments Experience with integrating to back-end/legacy environments Experience integrating business and technology teams Experienced in any of the following programming/scripting languages (SQL, Python, Shell, Scala) Excellent organizational and time management skills, strong business presence with ability to multi-task and effectively deal with competing priori-tiesNice to have: Proficiency in writing software in one or more languages - such as Java, Node, Python, .NET. Exposure to microservices. Experience in scripting language such as groovy, Py-thon, shell.Grounding in DevOps principles, test-driven development, continuous integration, and continuous delivery. Experience in Microsoft Azure and AKS or other similar cloud tech-nologies. ? Experience automating infrastructure provisioning with tools such as Terraform, Chef, and HELM charts.? Experience with Jenkin, Artifactory, SonarCube.? Familiarity with package management tools such as npm, pip.? Familiarity with build processes and build tools such as maven, gradle.? Familiarity with standard IT security practices.? Familiarity with database technologies in cloud such as Azure SQL, Cosmos/Mongo.Experience: 6"