Clarrio.ai

Data Engineer

Posted: 18 minutes ago

Job Description

We are seeking a Data Engineer with approximately 3 years of hands-on experience working with Microsoft Azure data technologies. The ideal candidate has practical experience building data pipelines, working with Azure storage/processing tools, and contributing to scalable data platforms.Key Responsibilities1. Build & Maintain Data PipelinesDevelop ETL/ELT pipelines using Azure Data Factory (ADF).Implement data ingestion from SQL Server, APIs, cloud storage, and third-party sources.Schedule, monitor, and troubleshoot pipeline executions.2. Azure Data Architecture & StorageWork with Azure Data Lake Storage (ADLS) to manage structured and unstructured data.Implement folder structures following medallion architecture (Bronze/Silver/Gold).Support data warehousing solutions using Azure Synapse Analytics or Azure SQL Database.3. Data Processing & TransformationBuild and optimize data transformation jobs in Azure Databricks (PySpark).Use Azure Functions for lightweight data processing and automation tasks.Contribute to streaming or near–real-time pipelines using Azure Stream Analytics or Event Hub (nice to have).4. Data Quality, Security & GovernanceApply data quality checks and validation routines in ADF or Databricks.Implement secure access using Azure RBAC, Key Vault, Managed Identities, etc.Document data lineage and contribute to governance efforts using Microsoft Purview.5. CollaborationWork closely with Data Scientists, Software Engineers, and Product teams.Participate in agile ceremonies and contribute to sprint planning.Document processes, pipelines, and architectural decisions.Technical Skills3+ years of experience in data engineering roles.Strong SQL skills (T-SQL) and experience with Microsoft SQL Server.Hands-on experience with core Azure services:Azure Data Factory (ADF)Azure Data Lake Storage (ADLS)Azure Databricks (PySpark)Azure Synapse Analytics (DW or serverless)Azure SQL DatabaseExperience using Git (Azure DevOps, GitHub) for version control.Understanding of CI/CD concepts and automated deployments.Soft SkillsStrong problem-solving and debugging skills.Clear communication with technical and non-technical stakeholders.Good documentation skills and attention to detail.Team-oriented mindset with a willingness to learn and grow.

Job Application Tips

  • Tailor your resume to highlight relevant experience for this position
  • Write a compelling cover letter that addresses the specific requirements
  • Research the company culture and values before applying
  • Prepare examples of your work that demonstrate your skills
  • Follow up on your application after a reasonable time period

You May Also Be Interested In