Data Engineer - AI Infra Group

At Dream, we redefine cyber defense vision by combining AI and human expertise to create products that protect nations and critical infrastructure. This is more than a job; It’s a Dream job. Dream is where we tackle real-world challenges, redefine AI and security, and make the digital world safer. Let’s build something extraordinary together.Dream's AI cybersecurity platform applies a new, out-of-the-ordinary, multi-layered approach, covering endless and evolving security challenges across the entire infrastructure of the most critical and sensitive networks. Central to our Dream's proprietary Cyber Language Models are innovative technologies that provide contextual intelligence for the future of cybersecurity.At Dream, our talented team, driven by passion, expertise, and innovative minds, inspires us daily. We are not just dreamers, we are dream-makers.The Dream-Maker Responsibilities:Design and maintain agentic data pipelines that adapt dynamically to new sources, schemas, and AI-driven tasksBuild self-serve data systems that allow teams to explore, transform, and analyze data with minimal engineering effortDevelop modular, event-based pipelines across AWS environments, combining cloud flexibility with custom open frameworksAutomate ingestion, enrichment, and fusion of cybersecurity data including logs, configs, and CTI streamsCollaborate closely with AI engineers and researchers to operationalize LLM and agent pipelines within the CLM ecosystemImplement observability, lineage, and data validation to ensure reliability and traceabilityScale systems to handle complex, high-volume data while maintaining adaptability and performanceOwn the data layer end-to-end including architecture, documentation, and governanceThe Dream Skill Set:5+ years of experience building large-scale distributed systems or platforms, preferably in ML or data-intensive environmentsProficiency in Python with strong software engineering practices, familiarity with data structures and design patternsDeep understanding of orchestration systems (e.g., Kubernetes, Argo) and distributed computing frameworks (e.g., Ray, Spark)Experience with GPU compute infrastructure, containerization (Docker), and cloud-native architecturesProven track record of delivering production-grade infrastructure or developer platformsSolid grasp of ML workflows, including model training, evaluation, and inference pipelinesNever Stop Dreaming...:If you think this role doesn't fully match your skills but are eager to grow and break glass ceilings, we’d love to hear from you!We're always eager to connect with dream-like-minded and vision-inspiring individuals just like you.Feel free to reach out, as your Dream might be closer than you think!