Senior Data Engineer IRC278995

DescriptionGlobalLogic is searching for a motivated, results-driven, and innovative software engineer to join our project team at a dynamic startup specializing in pet insurance. Our client is a leading global holding company that is dedicated to developing an advanced pet insurance claims clearing solution designed to expedite and simplify the veterinary invoice reimbursement process for pet owners.You will be working on a cutting-edge system built from scratch, leveraging Azure cloud services and adopting a low-code paradigm. The project adheres to industry best practices in quality assurance and project management, aiming to deliver exceptional results.We are looking for an engineer who thrives in collaborative, supportive environments and is passionate about making a meaningful impact on people’s lives. If you are enthusiastic about building innovative solutions and contributing to a cause that matters, this role could be an excellent fit for you.RequirementsStrong hands-on experience with Azure Databricks (DLT Pipelines, Lakeflow Connect, Delta Live Tables, Unity Catalog, Time Travel, Delta Share) for large-scale data processing and analyticsProficiency in data engineering with Apache Spark, using PySpark, Scala, or Java for data ingestion, transformation, and processingProven expertise in the Azure data ecosystem: Databricks, ADLS Gen2, Azure SQL, Azure Blob Storage, Azure Key Vault, Azure Service Bus/Event Hub, Azure Functions, Azure Data Factory, and Azure CosmosDBSolid understanding of Lakehouse architecture, Modern Data Warehousing, and Delta Lake conceptsExperience designing and maintaining config-driven ETL/ELT pipelines with support for Change Data Capture (CDC) and event/stream-based processingProficiency with RDBMS (MS SQL, MySQL, PostgreSQL) and NoSQL databasesStrong understanding of data modeling, schema design, and database performance optimizationPractical experience working with various file formats, including JSON, Parquet, and ORCFamiliarity with machine learning and AI integration within the data platform contextHands-on experience building and maintaining CI/CD pipelines (Azure DevOps, GitLab) and automating data workflow deploymentsSolid understanding of data governance, lineage, and cloud security (Unity Catalog, encryption, access control)Strong analytical and problem-solving skills with attention to detailExcellent teamwork and communication skillsUpper-Intermediate English (spoken and written)Job responsibilitiesDesign, implement, and optimize scalable and reliable data pipelines using Databricks, Spark, and Azure data servicesDevelop and maintain config-driven ETL/ELT solutions for both batch and streaming dataEnsure data governance, lineage, and compliance using Unity Catalog and Azure Key VaultWork with Delta tables, Delta Lake, and Lakehouse architecture to ensure efficient, reliable, and performant data processingCollaborate with developers, analysts, and data scientists to deliver trusted datasets for reporting, analytics, and machine learning use casesIntegrate data pipelines with event-based and microservice architectures leveraging Service Bus, Event Hub, and FunctionsDesign and maintain data models and schemas optimized for analytical and operational workloadsIdentify and resolve performance bottlenecks, ensuring cost efficiency and maintainability of data workflowsParticipate in architecture discussions, backlog refinement, estimation, and sprint planningContribute to defining and maintaining best practices, coding standards, and quality guidelines for data engineeringPerform code reviews, provide technical mentorship, and foster knowledge sharing within the teamContinuously evaluate and enhance data engineering tools, frameworks, and processes in the Azure environmentWhat we offerCulture of caring. At GlobalLogic, we prioritize a culture of caring. Across every region and department, at every level, we consistently put people first. From day one, you’ll experience an inclusive culture of acceptance and belonging, where you’ll have the chance to build meaningful connections with collaborative teammates, supportive managers, and compassionate leaders.Learning and development. We are committed to your continuous learning and development. You’ll learn and grow daily in an environment with many opportunities to try new things, sharpen your skills, and advance your career at GlobalLogic. With our Career Navigator tool as just one example, GlobalLogic offers a rich array of programs, training curricula, and hands-on opportunities to grow personally and professionally.Interesting & meaningful work. GlobalLogic is known for engineering impact for and with clients around the world. As part of our team, you’ll have the chance to work on projects that matter. Each is a unique opportunity to engage your curiosity and creative problem-solving skills as you help clients reimagine what’s possible and bring new solutions to market. In the process, you’ll have the privilege of working on some of the most cutting-edge and impactful solutions shaping the world today.Balance and flexibility. We believe in the importance of balance and flexibility. With many functional career areas, roles, and work arrangements, you can explore ways of achieving the perfect balance between your work and life. Your life extends beyond the office, and we always do our best to help you integrate and balance the best of work and life, having fun along the way!High-trust organization. We are a high-trust organization where integrity is key. By joining GlobalLogic, you’re placing your trust in a safe, reliable, and ethical global company. Integrity and trust are a cornerstone of our value proposition to our employees and clients. You will find truthfulness, candor, and integrity in everything we do.About GlobalLogicGlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.