Senior Data Engineer

About AcelabOur mission at Acelab is to transform how the building industry makes material decisions. We've created a comprehensive platform that connects architects with the right materials for their projects because we believe materials are fundamental to transforming inspired designs into exceptional buildings.At the heart of our mission is the understanding that material choices shape aesthetics, performance, sustainability, and ultimately, the human experience of built spaces. We recognize that architects face overwhelming challenges in navigating hundreds of thousands of products while trying to capture and maintain their firm's collective material expertise.Through our Material Hub platform, we aim to:Empower architects to make material choices that truly matterProvide easier access to innovative products and collective knowledgeElevate not just individual buildings but the entire built environmentCreate a shared language for materials that enables seamless communication between architects, manufacturers, contractors, and clientsPreserve institutional knowledge within architecture firmsStreamline the material selection and specification processOur mission statement "Because Materials Matter" encapsulates our commitment to elevating material selection from a fragmented, time-consuming process to a strategic aspect of architectural excellence. By connecting the industry's deepest technical database with material decision-making workflow tools, we're working to ensure that every project benefits from better informed material decisions.About The RoleWe are seeking a Senior Data Engineer to join our AI-focused data team and lead the development of scalable data processing and enrichment pipelines. You'll work at the cutting edge of AI-powered data engineering, building production-grade systems that power our Material Hub platform and enable architects to access comprehensive, up-to-date material information.The Work You'll DoProduction Engineering: Transform experimental AI workflows into robust, automated production systems with comprehensive monitoring and quality assuranceSystem Architecture: Design scalable data processing pipelines, create reusable modular components, and establish engineering standards for team collaborationData Quality & Automation: Build evaluation frameworks to monitor pipeline quality, implement automated error handling, and reduce manual intervention requirementsTechnical Leadership: Mentor team members, conduct thorough code reviews, and set best practices for AI system designRequirementsRequired QualificationsTechnical SkillsAdvanced Python programming with experience building production data processing systemsProven experience productionalizing and scaling AI/ML systems using LangChain or similar LLM orchestration frameworksAdvanced SQL skills with PostgreSQL experience and familiarity with vector databasesExperience with Google Cloud Platform or another major cloud platformExperience with containerization using DockerProficiency with workflow orchestration tools such as AirflowStrong system design skills and experience with CI/CD pipelinesProfessional CompetenciesStrategic problem-solving with ability to choose appropriate AI versus deterministic approachesExperience mentoring team members and setting technical standardsExperience conducting thorough code reviews with focus on quality, security, and performanceSelf-motivated with proven ability to take ownership of complex technical initiativesExcellent communication skills for working with other engineers, business subject matter experts, and product teamsEmbrace learning of new technologies and sharing knowledge with colleaguesPreferred QualificationsData science experience, including evaluation and monitoring experienceMCP (Model Context Protocol) experienceGraph database (e.g. Neo4j) experienceKubernetes experienceExperience with event-driven architectures (Kafka, GCP Pub/Sub, AWS SQS, or Azure Event Hubs)Experience with web scrapingInterest in or experience with the AEC (Architecture, Engineering, Construction) industryResponsibilitiesWork within a team to design and implement scalable AI-powered data processing pipelinesAutomate manual processes and build intelligent resource management systemsTransform proof-of-concept solutions from other team members into production-grade deployed systemsEstablish monitoring, logging, and CI/CD infrastructureProvide technical mentorship and conduct code reviewsArchitect reusable components and quality assurance frameworksBenefitsImpact & Growth OpportunityDrive Business Growth: Enable significant expansion of our data capabilities and platform reachShape Technical Direction: Influence system architecture decisions and establish patterns for platform evolutionOwn Critical Infrastructure: Take ownership of core data workflows after onboardingWork with Cutting-Edge Technology: Leverage the latest AI/LLM technology and supporting technologies in productionJoin us in building the future of how the architecture industry discovers, evaluates, and specifies building materials.