Data Engineer

We are a SaaS company that collects data from the web, analyzes it and creates consumer insights for our clients. In addition we provide tools for managing Ecom and Social and product development. These tools and insights are provided via web app dashboards and data drops built over our classified catalog of products and reviews and social data (reviews, posts, videos, and more)Our work involves extracting, processing, and analyzing large datasets using cutting-edge technologies. We value collaboration, learning, and a problem-solving mindset.We are seeking a Strong Data Engineer to design, build, and optimize scalable data pipelines using AWS and the Databricks framework.As a key member of the Data Team, you will ensure data reliability, integrity, and efficiency, while also contributing to the implementation of ML, MLflow, and LLM-based solutions.Above all, you will be responsible for delivering high-quality, client-ready data solutions on time.You’ll collaborate closely with R&D, Product, and Delivery teams to validate features, resolve issues, and guarantee the smooth delivery of insights to clients.Responsibilities: Build, optimize, and maintain data pipelines using PySpark and AWS services.Deliver production-grade data outputs with high accuracy, reliability, and timeliness.Develop and evolve automated testing systems to support data quality assurance.Integrate ML, MLflow, and LLM-based workflows into pipelines.Troubleshoot and resolve complex data and pipeline issues.Collaborate with Product Managers and Delivery Analysts to define release readiness and client-facing quality standards.Promote best practices in data engineering, QA, and documentation.Requirements: 4+ years of experience as a Data Engineer.Strong expertise in PySpark, Python, and SQL.Experience with AWS Framework.Background in automated testing and QA for data pipelines.Strong problem-solving and debugging skills, with pipeline optimization experience.Excellent communication skills (English) and ability to collaborate cross-functionally.This role is offered on a contractor basis and requires invoice-based billing.