Data Engineer - Remote

Aubay Portugal is a multinational French company, in Portugal since 2007. We have offices in Lisbon and Oporto and we are a specialized consultant in Management, Implementation, Development and Maintenance of Information Systems. We have more than 150 active partners and we operate in sectors such as banking, insurance, telecommunications, services, energy and transports.What are you going to do?Design, build, and optimize scalable and reliable data pipelines for cleaning, integrating, and transforming large datasets;Create and maintain data processing infrastructure to ensure high-quality data supply for digital analysts and data scientists;Leverage Azure cloud services, including Data Factory, Databricks, and Datalake Storage, to deploy robust data solutions;Develop dimensional data models and maintain data warehousing solutions to support analytics and reporting needs;Write efficient, maintainable, and well-tested Python and SQL code, ensuring optimal performance for large-scale datasets;Work with Apache Spark to write and optimize PySpark code and SQL queries, understanding Spark internals for maximum efficiency;Partner with data analysts, data scientists, and stakeholders to understand data requirements, ensure quality, and support data-driven decision-making;Ensure data governance, monitor data quality, and implement best practices for data management;Support deployment and monitoring of machine learning pipelines and data solutions in production environments.What are we looking for?More than 4 years of hands-on software engineering experience, developing and maintaining data pipelines;Strong experience with software engineering best practices (OOP, TDD, CI/CD, version control);Proficiency with PySpark and SQL, including the ability to optimize queries and understand Spark internals;Proficient in Python for data processing and automation tasks;Strong expertise with Azure cloud services, including Databricks, Data Factory, DevOps, and Datalake Storage;Solid experience in dimensional data modelling and data warehousing principles;Knowledge of Kubernetes and Docker for containerized applications;Experience with Google Analytics data – plus;Fluency in English (B2+) – Mandatory.What do we have to offer you?Health Insurance;Feedback&Coffee – the system that includes Aubay’s Performance Management Cycle, with regular moments of feedback and the Career Progression Model;Working model: remote;A Training Academy designed to think of you and your needs. You can count on technical and behavioural training sessions (e-Learning and classroom), Meet&Techs, Webinars and Mentoring;Events and Teambuildings.What makes us different?Our organizational culture is based on values such as transparency, team spirit, regular feedback and continuous learning;Reference prizes and birthday present;We don’t have a dress code;We know your name and all address each other informally;You will grow in good company. Isn’t this one of the ways in which to develop professionally?If we got your attention, we now hope to spark your enthusiasm. Ready for the first phase?We are waiting for you!Personal Data collected by AUBAY PORTUGAL as Data Controller, regarding the identification, contact and professional capabilities of the candidates, in the present procedure, will be processed for the application analysis, having in consideration that the processing is conducted in order to to take the steps, at the request of the data subject, prior to entering into a contract; Personal data sent through the present application will be kept by Aubay during the application procedure and will remain stored whilst updated (for two years period).The collected data might be transferred or include other processing activities, as long as the data subject is informed, in the occurrence of a standard application and selection procedure, for the compliance of legal obligations for the time required by law.For any queries or request regarding personal data protection rights, the Data Subject may contact AUBAY PORTUGAL’s headquarters in Avenida Duque D`Ávila, nº46 em Lisboa or use the DPO’s e-mail - dpo@aubay.pt. The Data Subject also has the right to file a complaint with the National Data Protection Authority – www.cnpd.pt. (please do not include data regarding racial or ethnical origins, political opinions, religion, philosophy, biometrical data, health data, sexual life and orientation, or relating to criminal convictions and offences.)