Data Engineer

Data EngineerWe are looking for a meticulous and detail-oriented Data Engineer to join our team. The successful candidate will ensure the accuracy, consistency, and reliability of our data assets, including both master (MDM) and transactional data sets. You will collaborate with cross-functional teams to develop ELT pipelines, implement data quality best practices, perform data validation, and establish effective data management practices.Responsibilities· Create and maintain optimal data pipeline architecture.· Work with data and analytics experts to strive for greater functionality in our data systems.· Assemble large, complex data sets that meet functional / non-functional business requirements.· Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.· Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources leveraging various technologies part of the Azure platform.· Be part of a team responsible for operational integrity of the Enterprise Analytics platform.Qualifications· 3-5+ years’ experience supporting data transformation, data structures, metadata, dependency, and workload management.· Experience with relational and NoSQL databases, unstructured data sets, and data streams.· Project Management: Proven ability to manage and support complex projects, including understanding business requirements, documentation, and implementation.· Analytical Skills: Strong analytical skills with the ability to interpret and leverage data for decision-making and process improvement.· Communication Skills: Excellent verbal and written communication skills, with the ability to effectively interact with stakeholders at all levels.· Problem-Solving: Demonstrated ability to address and resolve complex issues related to data and system processes.· Technical Proficiency: Experience with modern data management platforms and tools (e.g., ETL tools, data warehouses).· Agile Methodology: Experience with Agile project management methodologies and tools (e.g., JIRA, Confluence).· Data Governance: Knowledge of data governance frameworks and best practices.Preferred Technical Stack SkillsT-SQL, Python, PySpark, Databricks, Azure Data Factory