AI Prompt Engineer & Quality Tester

Location: Remote (Serbia/Balkan)Position Type: Full time, B2B contractAbout the companyAt SETVI, we’re on a mission to revolutionize how manufacturers and distributors accelerate revenue. Headquartered in Philadelphia, USA, and with a fast growing team in Belgrade, Serbia, our AI-powered platform cuts through manual complexity, streamlines operations, and unlocks new levels of efficiency and sales growth. By focusing exclusively on manufacturing and distribution, we deliver industry-specific tools and workflows that drive real impact where it matters most. Today, SETVI is helping to power businesses ranging from $100M to $1BN+ in revenue and, we're just getting started! Check us out here to learn more > https://setvi.com/Role overviewWe are a cutting-edge technology company at the forefront of the Artificial Intelligence (AI) revolution. Our mission is to create intelligent solutions to transform the Manufacturing and Distribution industry and drive innovation. As we continue to expand, we seek a talented and motivated AI Prompt Engineer and Tester to join our dynamic team and play a pivotal role in shaping the future of AI.In this role, you will not only craft, optimize, and refine prompts for Large Language Models (LLMs) but also rigorously validate and test the results within our AI-driven platform. Your work will be pivotal in ensuring that AI outputs - from product matching to attribute comparisons - meet our high standards for accuracy, relevance, and quality.What you'll doPrompt Development & Optimization:Design, refine, and maintain clear, concise, and creative prompts to improve LLM performance.Experiment with various LLM prompt-engineering techniques to enhance model responses and tailor them to specific business needs.Analyze model outputs to identify areas of improvement and suggest prompts to our Data Scientist to optimize AI model performance. You will be trained on LLM prompts.Rigorous Output Validation & Testing:Conduct thorough testing of AI outputs - such as product matches and product attribute comparisons - to ensure accuracy and consistency.Develop and follow test plans to identify, document, and track issues or areas of improvement in model responses.Self-learning and conducting research to stay updated with the latest advancements in AI, NLP (Natural Language Processing), and prompt engineering practices. Cross-Functional Collaboration:Work closely with product managers, developers, and data scientists to align prompt strategies with overall product goals and customer requirements.Participate in client-facing meetings to gather feedback, provide insights, and ensure prompt strategies meet end-user expectations.Your profileUniversity degree in Machine Learning, Data Science or other related fieldsKnowledge of LLM, data science, machine learning principles, or NLP conceptsStrong proficiency in English with an exceptional command of grammar, syntax, and language nuancesFamiliarity with AI-related tools, platforms, and models such as OpenAI, Gemini, Anthropic models or other LLMsExperience in client-facing rolesA creative mindset with the ability to design engaging, clear, and effective prompts to elicit the desired AI responsesSolid problem-solving and analytical skills, with a keen eye for detailAbility to conduct research and experiment with different prompt techniques to refine and improve model outputsExcellent communication skills, both written and verbal, with the ability to clearly explain prompt strategies and adjustmentsPassion for artificial intelligence, natural language processing, and the future of AI-driven technologiesPerks of working at SETVICompensation above the industry average - because we want you to feel appreciated21 days of PTO - excluding public holidaysWork from anywhere - as long as you get the job doneOpportunity to work on exciting projects at a growing startup companyMonthly get-togethers with the local teamExpand your knowledge and learn more about design, technology, and all things that spark your interest (Udemy courses)Referral bonuses