Senior Data Engineer

On behalf of our client, a cutting-edge provider of data intelligence solutions for the global maritime industry, we are looking for a Senior Data Engineer. This is a unique opportunity to work with a team dedicated to transforming operational data into actionable insights using advanced cloud-based technologies.In this role, you'll be instrumental in designing and maintaining scalable, high-performance data pipelines and architectures in an Azure-based environment, collaborating closely with software engineers and data scientists.Your day to dayDesign, develop, and manage scalable and resilient data ingestion pipelinesCollaborate with stakeholders to evolve data architecture and enhance assetsOptimize and implement modern data infrastructureConduct code reviews and uphold code quality best practicesEnsure data quality with robust monitoring and validation toolsStay current with the latest in data engineering trends and technologiesMust have:Bachelor’s or Master’s in Computer Engineering, Computer Science, or a related field5+ years of experience in data engineering or a similar roleExpertise in Python and data pipeline developmentSolid background in database systems and data modeling (Medallion Architecture, PostgreSQL, TimescaleDB)Proficient in workflow orchestration tools (e.g., Apache Airflow, Databricks Workflows)Hands-on experience with big data frameworks and streaming technologies (Spark, Kafka)Nice to Have:Scala or Java for data processingExperience with Kubernetes, Docker, and cloud-native architectureFamiliarity with monitoring tools such as Prometheus and GrafanaExposure to CI/CD tools like JenkinsAgile/Scrum experienceWhat’s in for youPrivate health insuranceHybrid set-upAllocated budget for certifications & trainings