Sr. ML Ops Engineer
Job type: Full Time · Department: EPD · Work type: Hybrid · USD 190000 - 210000 / year
New York, New York, United States
Each year, the U.S. healthcare system suffers from over $500B in wasted spending due to medical billing fraud, waste, and administrative burden. At Alaffia, we’re committed to changing that paradigm. We’ve assembled a team of clinicians, AI engineers, and product experts to build advanced AI solutions that will directly bend the cost curve for all patients across the healthcare ecosystem. Collectively, we’re building best-in-class AI software to provide our customers with co-pilot tools, AI agents, and other cutting-edge solutions to reduce administrative burden and reduce healthcare costs.
We’re a high-growth, venture-backed startup based in NYC and are actively scaling our company.
Alaffia is a healthcare AI startup revolutionizing health and data automation. Our AI-driven platform leverages state-of-the-art generative AI and machine learning technologies to enhance accuracy, efficiency, and compliance in medical billing and auditing. As we scale, we are seeking a Senior AI Ops Engineer to build the cutting-edge AI solutions, drive innovation, and shape the future of healthcare automation.
At Alaffia, AI is at the core of our mission. We are seeking an experienced engineer who is passionate about deploying scalable, safe, and regulatory-compliant AI-driven systems. Our AI technology powers intelligent automation for medical billing, ensuring accuracy and operational efficiency. We seek someone who thrives on building large-scale AI systems that enhance workflow efficiency, while also prioritizing all the necessary safety guardrails for responsible AI. You will have the opportunity to orchestrate various AI agents with an optimized system design that integrates AI platforms, data storage, and human-in-the-loop feedback. In this role, you’ll be shaping the future of AI-driven healthcare automation while tackling some of the most significant challenges in AI deployment and monitoring.
Deploy NLP, OCR, and multi-modal AI products on secure cloud environments.
Design AI system, focusing on pipeline architecture and tooling to ensure scalability, observability, performance, latency and fault tolerance requirements
Design data schema and develop ETL processes to integrate data and human annotation with AI model tuning and benchmarking pipelines.
Create best practices for data and AI experiment management
Write highly robust, scalable code that is flexible, reusable, and adaptable to evolving requirements.
Ensure high code quality through rigorous code review processes and foster a collaborative engineering culture.
Build and leverage AI tools to improve developer efficiency and alignment across teams.
Proactively identify, resolve, and mitigate technical risks before deployments and releases.
8+ years of technical experience, with at least 4+ years in a dedicated software engineering role
Strong background in data modeling, versioning, and storage for AI data and annotation
Recent development experience of scalable enterprise AI products
Proficient in multiple AI frameworks, for example, MLFLow, LangChain, LangFuse, CrewAI, Weights & Bias
Firm understanding of AI software development and quality assurance procedures
Working knowledge and design skills across a wide array of databases
Experience with AI experiment tracking, monitoring, and comparison
Demonstrated ability to stay up to date with the latest AI methodologies and systems.
Exceptional problem-solving skills and the ability to work in a fast-paced, evolving environment.
Excellent communication and collaboration skills, with the ability to articulate complex technical concepts to non-technical stakeholders.
At Alaffia, we fundamentally believe that the whole is more valuable than the sum of its individual parts. Further to that point, we believe a diverse team of individuals with various backgrounds, ideologies, and types of training generates the most value. Our people are entrepreneurial by nature, problem solvers, and are passionate about what they do — both inside and outside of the office.
Competitive compensation package
Medical, Dental and Vision benefits
Flexible, paid vacation policy
Work in a flat organizational structure — direct access to Leadership
Autofill application
Save time by importing your resume in one of the following formats: .pdf or .docx.