Business Analyst with AI evaluation skills

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.Role OverviewWe are looking for a detail-oriented Business Analyst to support evaluation and annotation workflows focused on quality, accuracy, and structured reasoning. This role is ideal for someone who is comfortable working with digital tools, performing side-by-side evaluations, and providing clear, well-supported justifications based on fact-checking.What You'll DoPerform side-by-side (SxS) evaluations on GHD, comparing outputs and assessing quality, accuracy, and relevanceConduct fact-checking to validate information and identify inconsistencies or inaccuraciesProvide detailed, well-structured justifications to support evaluation decisionsFollow established evaluation guidelines and quality standards consistentlyUse browser-based tools and extensions to support analysis and review tasksExecute simple command-line instructions when required to support evaluation workflowsDocument findings clearly and communicate insights to stakeholders when neededCommitments Required: 6-8 hours per day with an overlap of 3 hours with PST. Employment type: Contractor assignment (no medical/paid leave)Duration of contract: 2 monthsLocation: Argentina, Brazil, Peru, Colombia, Chile, MexicoSelection process: 60 min technical test (comparing AI outputs)RequirementsSolid comfort using a computer in a professional settingExperience working with browser extensions and online toolsAbility to run basic command-line commands (no advanced programming required)Strong analytical and critical thinking skillsHigh attention to detail and ability to justify decisions clearly and objectivelyComfortable working with evaluation frameworks, comparisons, and structured analysisPrevious experience with evaluation, annotation, QA, or audit-type workFamiliarity with data quality, content evaluation, or model/output assessmentsGood written communication skills in EnglishBenefitsWork in a fully remote environmentOpportunity to work on cutting-edge AI projects with leading Tech companies