Consultant Databricks Engineer

We’re looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team.Job Opportunity: Consultant Databricks EngineerWe are looking for candidates with strong technology and data skills in big data engineering who have proven delivery experience. Join a leading firm and a growing Data and Analytics team.Key Responsibilities:Develop and deploy Azure Databricks in the cloud using Azure services.Configure and replicate Azure Databricks platform components based on existing Hadoop workloads.Migrate Hadoop jobs, ETL workflows, Kafka streams, and database queries to Azure Databricks.Manage workflow scheduling and orchestration with Databricks Jobs Scheduler.Monitor Databricks environment health and performance, set up alerts for issues.Maintain code in Git with peer reviews for quality.Conduct testing (System Integration and QA) during development.Document and resolve issues found during testing.Manage production migration and communicate with stakeholders.Validate data integrity after migration.Provide post-deployment support and transition to standard operations.Skills and Experience:3 - 7 years in data ingestion, processing, and analytics pipelines for big data, relational and NoSQL databases, and data warehouses.Hands-on experience with Snowflake and Azure services like Databricks, ADLS, Data Factory, Synapse, Azure SQL DB, and Event Hubs.Proficient in Python/PySpark programming.Good understanding of Data Warehouse concepts and ACID transactions.Experienced in DevOps and CI/CD deployments.Strong SQL and procedural SQL skills.Strong analytical and problem-solving skills.Qualifications:Computer Science degree or equivalent with 3 to 7 years of industry experience.Experience working in Agile delivery environments preferred.Self-motivated, proactive, and takes ownership of problem resolution.Skilled in software development best practices, debugging, and optimization.Experience delivering enterprise-grade solutions considering security, performance, and scalability.Excellent communication skills and client management abilities.Involved in all phases of solution delivery from analysis to support.Let me know if you want it tailored further or made even simpler!