Senior Data Consultant

As a Senior Data Engineer you are expected to perform following activities:For application, candidates must be residing in Japan and able to be interviewed in Japanese language1.Technical Development (80%)Design and implement scalable, production-grade data platform infrastructure components using AWS, Databricks, and modern data stack architecture.Lead the development of critical data pipeline components, ensuring performance, security, reliability, and segregation of duty compliance.Architect and implement complex data transformation workflows to efficiently handle large-scale data processing.Develop and maintain infrastructure-as-code (IaC) for reproducibility and standardization.Implement advanced monitoring and observability solutions for the entire data platform.2. Research & Innovation (10%)Research emerging technologies and architectural patterns to improve performance, maintainability, efficiency, and cost.Evaluate and prototype new tools and frameworks to enhance platform capabilities.Present technical proposals and Proof of Concepts (PoCs) to Data Platform Engineering leadership.Develop technical documentation and design proposals to support onboarding and platform improvements.3. Technical Leadership (10%)Mentor and guide team members while reviewing critical code contributions.Collaborate with junior stakeholders to align technical solutions with business requirements.Lead technical design discussions and architecture review sessions.Share knowledge through documentation, workshops, and technical presentations.Qualifications:1. Technical & Professional SkillsMaster's degree in Computer Science, Data Engineering, or related field.10+ years of experience in data engineering and software development.Deep expertise in Cloud Platforms (AWS preferred) and data processing frameworks (Spark preferred).Expert-level proficiency in Python (preferred), Scala, or Java.Experience with modern SQL Warehouses (Databricks preferred, Snowflake, BigQuery) and data architectures (Lakehouse preferred).Strong experience in DBT (Data Build Tool) and Data Modeling methodologies.Expert-level knowledge of Infrastructure-as-Code (IaC) practices, using Terraform and AWS CDK.Solid background in distributed systems and high-performance computing.Proven ability to lead complex technical initiatives.2. Behavioral SkillsStrong communication skills to explain complex technical concepts to various audiences.Excellent problem-solving abilities and analytical thinking.Demonstrated leadership in technical decision-making.Self-motivated, with the ability to work autonomously.Experienced in mentoring and coaching technical team members.Strong project management skills with a results-oriented mindset.