Principal Software Engineer- GenAI

TITLE: Principal Software Engineer - GenAI WHAT YOU'LL DO: As a Principal Software Engineer on the GenAI team, you will drive the technical vision and execution of advanced AI-powered solutions across multiple initiatives. You will design and implement scalable, secure, and high-performing systems that leverage large language models (LLMs), retrieval-augmented generation (RAG), and AI-driven services. This role requires deep technical expertise, hands-on coding, and the ability to align multiple engineering teams toward a shared vision. • Lead technical strategy for GenAI-based products and platforms, ensuring alignment with enterprise architecture and business goals. • Own the design and implementation of the AI orchestration runtime, including agent workflows, context assembly, tool invocation, policy enforcement, and execution control. • Build platform-level capabilities for observability, evaluation, auditability, and cost management across AI workloads. • Design and implement core AI services, including model orchestration, inference pipelines, and standardized prompt and configuration patterns. • Collaborate with data scientists and ML engineers to integrate LLMs and fine-tuned models into production systems. • Enable product teams to deliver AI capabilities without reinventing orchestration, governance, or runtime infrastructure. • Architect and deliver solutions for high-complexity Agile stories across multiple domains, ensuring scalability and resilience. • Mentor and guide engineers on modern AI development practices, including distributed systems, model deployment, and performance optimization. • Ensure compliance and security in AI solutions, including data privacy, responsible AI principles, and model governance. • Debug and resolve complex issues in distributed AI systems, ensuring minimal downtime and high availability. • Champion CI/CD and MLOps practices for continuous delivery of AI features and models. • Participate in hiring and talent development for the GenAI team. WHAT YOU'VE DONE: • Bachelor's degree, or higher education level, or its foreign equivalent, in Computer Science, Computer Information Sciences, and/or related field • Total Work Experience: 7+ years (software development), 5+ years of strategic leadership experience • Expertise in AI/ML systems: LLM integration, RAG pipelines, vector databases, and prompting strategies • Experience with LLM evaluation frameworks (e.g., RAGAS, LangSmith evaluations, custom benchmarks) • Hands-on experience with agent frameworks, workflow orchestration, and LLM runtime systems (e.g., LangGraph, Agent Development Kit, Agent Framework, or similar), including tool use, memory, evaluation, and governance SPECIALIZED KNOWLEDGE, SKILLS, AND/OR ABILITIES: • Expert of scalable, resilient, modern, cloud-native microservice development with Java, .NET, Python, or Typescript • Excels in the ability to lead, teach, and guide modern software-development practices across Product Development, operating independently with guidance • Experience building monitoring, alerting, and observability for maintaining high customer SLAs for SaaS delivered products • Experience in regulated industries (financial services, insurance, healthcare) preferred • Experience with CQRS, event-driven architecture, and Kafka • Experience with Terraform/Ansible or other IaC platforms • Experience with cost controls and usage attribution of model execution • Knowledge of data security, compliance, and responsible AI principles • Experience in Cloud platforms and cloud-native architectures, including Serverless • Proven experience building multi-agent systems with planning, tool calling, and state management • Expert with CI/CD to deliver software enhancements to customers with full automation • Expert in distributed software patterns, such as DDD, microservices, serverless, and event-driven architecture WHAT ADDITIONAL INFORMATION YOU MAY WANT TO KNOW: Travel: 0-10% Work Authorization: Legally authorized to work in the country of job location. The Company does not sponsor visa petitions for this position. Duck Creek Technologies supports a flexible-first work environment and has employees throughout the United States. Based on a fair and equitable compensation philosophy, we have five (5) United States pay markets based on regional validated survey market data. The expected salary range for this position is between $136,100 and $219,600. This position is also eligible for annual bonuses. The final compensation may vary due to the above listed factors and be determined based on experience and other factors permitted by law. We also offer a competitive benefits package that includes: • Flexible work environment • Medical, dental, vision, life and disability insurance • 401(k) Retirement Plan • Flexible Spending & Health Savings Account • Paid holidays, vacation, and volunteer time • Employee assistance program and other benefits. The application window will remain open until the position is filled or until a sufficient number of qualified candidates have been identified.