AI Project Lead

ABOUT THE ROLE The AI Project Lead at the Kings County District Attorney's Office scopes, plans, and delivers AI-enabled solutions to assist prosecutor workflows. Reporting to the Director of Application Development, this role collaborates with executive stakeholders and end-users to architect scalable AI and machine learning solutions. The lead acts as a trusted advisor, guiding a team of developers through ideation, solution exploration, tech stack development, product testing, and enterprise-wide deployment to support the office's mission of seeking justice. KEY RESPONSIBILITIES - Analyze, design, implement, maintain, and support AI applications and monitoring solutions for enterprise infrastructure. - Manage cloud and on-premises infrastructure for AI and machine learning tasks, including GPU infrastructure for inference and training. - Scope and design AI application architecture, including fine-tuning large language models using frameworks like HuggingFace, LoRA, or PEFT. - Implement large language model guardrails, hallucination mitigation, personally identifiable information detection, and output validation. - Mitigate risks regarding data security, integrity, and AI veracity by implementing audit logging, explainability, and human-in-the-loop workflows. - Design and deploy retrieval-augmented generation pipelines and test hybrid environments. - Review and draft training materials and internal governance to ensure compliance with agency standards. - Train, upskill, supervise, and mentor project teams and communicate project plans with stakeholders. - Oversee testing, quality assurance, scale-up, deployment, and event, patch, release, and change management processes. - Monitor industry developments and liaise with vendors regarding new products and technologies. MINIMUM QUALIFICATIONS 1. A baccalaureate degree in computer science, engineering, or a related field from an accredited college and four years of satisfactory full-time experience related to IT automation engineering, monitoring engineering, or management of infrastructure. 2. Eight years of satisfactory full-time experience related to IT automation engineering, monitoring engineering, or management of infrastructure. 3. An equivalent combination of education and/or experience. SPECIAL REQUIREMENTS - Technical competency in Python and experience with Azure, AWS, and/or GCP. - Proficiency with LLM fine-tuning, prompt engineering, agent/tool-use frameworks, and containerization of AI workloads. - Experience with vector databases, chunking strategies, embedding models, and hybrid search approaches. - Familiarity with government or legal sector data governance, data residency, and automated document processing or de-identification pipelines. - Experience with speech-to-text pipelines, multilingual natural language processing, or translation workflows. - Ability to benchmark LLM performance, track ML experiments, and communicate AI planning effectively to executive stakeholders. SELECTION PROCESS No exam is required for this position. The role falls under the Civil Service title of IT Automation and Monitoring E with a Non-Competitive-5 title classification. HOW TO APPLY Submit an application for Job ID 789724 before the posting closes on 08/26/2026. EMPLOYMENT DETAILS - Position Type: Full-Time - Location: 350 Jay St, Brooklyn, NY - Department: Information Technology - Category: Technology, Data & Innovation - Experience Level: Experienced (Non-Manager) - Number of Positions: 1 - Residency Requirement: NYC residency is not required. - Benefits: Eligible for federal Public Service Loan Forgiveness and state repayment assistance programs. - Employer: The City of New York is an inclusive equal opportunity employer committed to a diverse workforce and a discrimination-free work environment.