DATA 部門 - Lead Data Engineer

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.Job DescriptionCollaborate with users and project team on requirements and expectationsAnalyze business requirements, create proper data solutions that meets functional and non-functional requirementsDesign and implement highly scalable and robust data pipelines in Scala/Spark/Java for processing of extreme large amount of dataCreate and maintain reusable frameworks for data ingestion, validation, normalization, and transformationCreate scripts for test automation, CI/CD, data migrations, data validationsProvide technical support for incident recoveryExperienceJob Description - Grade SpecificMinimum 3~6 years of working experience as developer or data engineerSkillsStrong programming skills and has software development experience in Scala, Java or PythonDeep understanding of distributed systems (Hadoop, Spark, etc.) and its optimizationExperience in public cloud technologies, preferably AzureGood knowledge of Oracle database, MS-SQL Server, Linux, networkingProficient in SQL, shell scripting, git, unit testing, CI/CD toolsUnderstanding of design principles, coding standards and best practicesStrong learning ability and problem-solving skillsExcellent communication, presentation, and interpersonal skillsPreferableUnderstanding of REST API, NoSQL, micro-services, ETLHand-on experience with Cloud services is preferredUnderstanding of streaming data processing and change data capture is preferredExperience with BI tools is preferredLanguageJapanese: Business Level (Optional)English: Business LevelPersonalityDetailed and precise, able to drive alone the design and development of complex system.Able to articulate technical aspects in an easy-to-understand way for non-developersStrong performer with focus on delivery, fast learning and able to apply his knowledge in various domains.Willing to learn new technologies and pick up challenging workTeam playerCapgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.