Note: The job is a remote job and is open to candidates in USA. Go2Group LLC is seeking a highly hands-on Senior Applied AI Engineer to lead the design and development of LLM-powered workflows for a high-priority enterprise AI initiative. This role involves architecting production-oriented AI solutions and working closely with engineers and stakeholders to improve model quality and shape the overall AI solution architecture.ResponsibilitiesDesign and build LLM workflows for evidence extraction and rule generationLead prompt engineering, grounding, structured outputs, and validation logicDevelop scoring, ranking, and confidence models for AI-generated outputsCreate evaluation frameworks to measure output quality and reliabilityIdentify hallucination risks, false positives, and failure patternsPartner with SMEs to refine prompts, scoring logic, and validation rulesGuide architecture decisions and practical MVP tradeoffsSkills4-5+ years of hands-on Data Science, Machine Learning, or Applied AI development experienceStrong Python skillsDeep hands-on experience with LLMs / Generative AIExperience with prompt engineering, structured outputs, and AI output evaluationExperience with RAG, embeddings, semantic search, or vector-based retrievalExperience designing evaluation frameworks, benchmarks, or scoring methodologiesStrong analytical, technical leadership, and stakeholder communication skillsEnterprise AI or consulting experienceExperience with telemetry, observability, support analytics, or infrastructure dataExposure to logs, advisories, tickets, or technical documentationExperience with JSON schema validation, rules engines, or ontology designExperience deploying AI solutions in production or production-adjacent environmentsCompany OverviewGo2Group is a talent identification and acquisition expert for growing companies. At Go2, weβre about fulfilling potential. It was founded in 2016, and is headquartered in Naperville, Illinois, USA, with a workforce of 2-10 employees. Its website is https://www.go2groupinc.com.
Apply To this Job