Information Technology Group- Data Engineer

The IT Data and Analytics department within the IT group is in charge of defining enterprise data and data architecture, producing data models and data transformation to support analytics and reporting needs across all BDO applications.As a Data Engineer, you will play a key role in designing, developing, and maintaining end-to-end data solutions. You will be responsible for building scalable, efficient, reliable, and reusable data pipelines and analytic applications and your expertise will be leveraged in both backend and frontend development. You will collaborate closely with cross-functional teams to understand business requirements, architect data solutions, and implement best practices for data engineering and analytics.Role Responsibilities:Design, develop, and implement data solutions including data ingestion pipelines to acquire data from various source systems, storage processing, and visualization as needed, leveraging Azure Data Platforms and Databricks.Design and define data models, schemas, and structures to support analytical and reporting needs, ensuring scalability, performance, and data integrity.Configure and manage data storage solutions to store structured, semi-structured, and unstructured data, optimize data storage and retrieval mechanisms for performance, cost efficiency, and compliance with data governance standards and regulations.Design, upgrade, and implement new data workflows, automation, tools, and API integrations.Perform unit and integration testing. Provide support in UAT, user training, pre-implementation and post-implementation support activities.Collaborate with data scientists, analysts, and other stakeholders to support their data needs and to ensure that data is properly integrated and aligned with business requirements.Monitor and optimize the performance of data pipelines and analytics applications, identifying bottlenecks, optimizing query performance, and tuning Spark jobs for efficiency.Competencies:Technical Skills: Strong understanding of data architecture principles, data modeling techniques, and data integration patters, with experience in designing scalable and efficient data pipelines.Analytical Skills: Problem-solving capabilities, strong analytical skills, and flexibility to be able to handle complex situations as necessary.Teamwork: Excellent communication and collaboration skills, with an aptitude for working in cross-functional teams.Adaptability: Agile in adapting to change and learning new technologies.Attention to Detail: High level of precision in coding, debugging, and documentation.Qualifications:Bachelor's Degree.Minimum of 3-5 years of experience as data engineer, software engineer with a focus on data engineering and analytics.Have at least 2 years of experience in Databricks and Microsoft Azure Data Platform.Experience in SQL, Python, Shell, Scala as well as experience with data manipulation processing using Apache Spark and Databricks.Experience with DevOps practices, CI/CD pipelines such as Azure DevOps is a strong advantage.Familiarity with data visualization and reporting tools such as PowerBI is a strong advantage.The Candidate must be willing to work in Makati.