Data Engineer

We are seeking a Data Engineer to lead the development, maintenance, support, and integration of our expandingarray of data sources into Azure-hosted SQL data warehouse, and the Power BI platform.In this role, you will oversee the technical aspects of Reporting & BI solutions within the Technology team at Harding+, providingrobust reporting capabilities to support Commercial, Operational, and Finance functions. You will possess a deep understanding ofdata structure, analysis, modelling, and management to drive a technical agenda and data roadmap. Your focus will be on designingand enhancing the data platform primarily using Azure cloud technologies like ADF, Azure Synapse Analytics, and Power BI Premiumfeatures.Reporting across supply chain, finance, commercial, andoperational areas is essential, making a background in retail or wholesaling business highly beneficial.Key Role Objective and Accountabilities Data Warehouse Optimisation:Performance Tuning: Analyse, optimise, and refactor existing stored procedures, ETL jobs, and dataworkflows to improve performance and reduce load times on the current data warehouse.Capacity Management: Clean up and enhance the efficiency of the current Power BI Premium (P1) instance, ensuring optimal resource allocation and utilization as data volumes and complexity grow.Job Scheduling & Monitoring: Review and maintain the scheduling of data jobs to ensure timeliness and reliability,improving operational processes to meet evolving business needs.Data Quality & Governance: Implement data quality checks, governance, and performance monitoring for both ETL processes and reporting outputs.Operational Support: Provide ongoing support for the existing data platform, responding to and resolvingperformance issues, data quality concerns, and user queries.Migration Leadership & Futureproofing:Cloud Migration Strategy: Lead and actively execute the long-term migration of the on-premises data warehouse toMicrosoft Fabric, including hands-on development and implementation of a robust strategy for transitioning datasets, ETL pipelines, and reporting solutions to the cloud.ETL & Pipeline Development: Build scalable ETL processes using Azure Data Factory, Azure Synapse, and other Fabric-native tools, ensuring a smooth integration between the on-prem and future cloud environments.Cloud Infrastructure Design: Design and implement Azure-based data architecture, leveraging tools like Azure Data Lake, Azure Synapse Analytics, and Fabric’s data capabilities to future-proof the platform.Azure Expertise: Utilize Azure tools such as Synapse Analytics, Logic Apps, and Azure Functions to streamline dataprocessing and orchestration across the business.End-User Reporting & Analytics:Power BI Optimisation: Lead optimization efforts in Power BI, leveraging Power BI Premium features such as incremental refresh, paginated reports, and composite models to enhance reporting performance and scalability.DAX and Data Modelling: Write advanced DAX and perform complex data modelling within Power BI to support high-quality, dynamic reporting.Self-Service BI: Empower stakeholders to build their own reports and dashboards by enhancing dataaccessibility and developing self-service capabilities.Essential Knowledge, Skills, and ExperienceData Warehouse Expertise: Extensive experience in maintaining and optimizing on-premises SQL Server data warehouses,focusing on stored procedures, indexing, partitioning, and load performanceAzure Cloud Proficiency: Deep understanding of Azure cloud tools such as Azure Synapse Analytics, Azure Data Lake, Azure Data Factory, and Logic AppsMicrosoft Fabric: Hands-on experience with Microsoft Fabric or similar modern cloud platforms, with a strong focus on data migration strategies and ETL developmentAdvanced SQL & Python: Proficiency in writing advanced SQL queries, stored procedures, and Python scripts for data manipulation, pipeline development, and automationETL & Data Pipelines: Experience with ETL tools (both on-prem like SSIS, and cloud-based like Azure Data Factory) for creating, optimising, and maintaining data pipelinesPower BI Premium: Skilled in Power BI Premium, including data modelling, DAX, performance tuning, and advanced reportingfeatures like composite models and incremental refreshData Governance & Security: Strong understanding of data governance, security best practices, and compliance requirements (GDPR, etc.)Experience working with Agile methodologiesStakeholder Communication: Excellent communication skills, capable of collaborating with both technical and non-technicalstakeholders to translate business needs into effective data solutionsAdvantageous ExperienceExperience with Microsoft Dynamics 365 Business CentralExperience of defining and operating within data management best practice frameworksExperience working in a Retail environmentKey AttributesTrust: Builds trust through integrity, responsible actions, and honest relationshipsCollaboration: A great team player, who works collaboratively with others, from across the businessRespect: Values others, treating everyone with dignity and professionalismPassion: Passionately cares about the success of the business. Shows energy, drive, and commitment to delivering successDrive: Highly motivated with an overwhelming desire to deliver innovative, intelligent, best in class solutionsResilience: Maintain laser focus when faced with complex, often ambiguous, and changing priorities