Job Title: Software Engineer Manager (AI)
Location: Charlotte, NC 28207
Work Arrangement: Hybrid 3 days per week onsite
Office Location: 108 Providence Road, Charlotte, NC
Interview Process: One round In-person interview
Industry: Healthcare / Healthcare Technology
Position Overview
We are seeking an experienced Software Engineering Manager AI to lead the design, development, and deployment of AI-powered software solutions within a healthcare environment. This role combines hands-on software engineering, people management, cloud architecture, and production AI delivery.
The ideal candidate will have strong experience building and operating AI/ML applications, including Large Language Models (LLMs), AI agents, Retrieval-Augmented Generation (RAG), and NLP solutions. The candidate must also possess healthcare domain knowledge, preferably involving Epic, HL7, FHIR, patient access, patient experience, or revenue cycle workflows.
This is a hands-on leadership position requiring the ability to guide engineering teams, make architectural decisions, deliver secure and scalable solutions on Microsoft Azure, and ensure compliance with HIPAA and other healthcare security requirements.
Key Responsibilities
- Lead, mentor, and manage software engineers while remaining hands-on with architecture, coding, code reviews, and technical problem-solving.
- Design, develop, deploy, and maintain production-grade AI applications using LLMs, AI agents, RAG pipelines, NLP, and related machine learning technologies.
- Architect and operate cloud-native applications using Microsoft Azure services, including Azure Functions, App Service, AKS, Azure API Management, Azure SQL, Cosmos DB, and Azure Storage.
- Build AI-driven solutions that improve patient access, patient experience, contact center operations, patient messaging, and revenue cycle workflows.
- Collaborate with product managers, healthcare stakeholders, security teams, and executive leadership to translate business needs into scalable technical solutions.
- Implement secure healthcare data pipelines, API integrations, and AI workflows while protecting Protected Health Information (PHI).
- Establish and maintain CI/CD pipelines, infrastructure-as-code practices, automated testing, and DevOps standards.
- Implement monitoring, observability, alerting, and incident management using Azure Monitor, Application Insights, Grafana, or equivalent tools.
- Ensure adherence to HIPAA, HITECH, healthcare data privacy, encryption, access control, audit logging, secrets management, and secure development requirements.
- Establish AI quality and governance practices, including model evaluation, guardrails, bias testing, and validation where applicable.
- Manage agile delivery, engineering metrics, project timelines, quality standards, and technical risks.
- Coordinate with full-time engineers, vendor partners, and offshore teams as needed.
- Communicate technical decisions, architectural tradeoffs, project status, and risks effectively to technical and non-technical stakeholders.
Required Qualifications
- 10+ years of software engineering experience, including at least 2 years of direct engineering management experience.
- Healthcare industry experience, preferably with Epic, HL7, FHIR, patient access, patient experience, or revenue cycle systems.
- Demonstrated hands-on technical expertise, including the ability to explain and discuss code and architecture personally developed within the last two years.
- Production experience delivering AI or machine learning solutions, including LLM-based applications, AI agents, RAG pipelines, or NLP systems.
- Strong Microsoft Azure experience across compute, data, identity, security, and monitoring services.
- Experience deploying and operating production workloads on Azure or another major cloud platform.
- Proficiency in Python and experience with at least one additional programming language: Java, TypeScript, or Go.
- Experience with CI/CD, infrastructure as code, automated testing, and DevOps practices in regulated environments.
- Experience developing and operating applications in HIPAA-regulated environments, including PHI handling, privacy controls, encryption, least-privilege access, audit logging, and secrets management.
- Experience leading agile engineering delivery, tracking metrics, and maintaining accountability for deadlines and software quality.
- Strong written and verbal communication skills, including the ability to explain complex technical concepts to executive stakeholders.
Preferred Qualifications
- Experience with Azure OpenAI, Azure AI Foundry, Azure AI Search, and agent orchestration frameworks such as LangGraph.
- Experience with LLM evaluation, prompt engineering, AI guardrails, vector databases, and model observability.
- Background in contact center technology, IVR, conversational AI, patient messaging, or voice-based AI applications.
- Experience with AI governance, model risk management, bias testing, and clinical validation.
- Familiarity with healthcare AI security assessments and regulatory compliance reviews.
- Experience managing a combination of full-time engineers, vendors, and offshore development teams.
- Experience with Databricks, Microsoft Fabric, Unity Catalog, healthcare data models, and enterprise data pipelines.
Technical Skills
Cloud & Azure: Azure App Service, Azure Functions, AKS, Azure API Management, Azure Storage, Azure SQL, Cosmos DB, Key Vault, Microsoft Entra ID.
AI & Machine Learning: Azure OpenAI, Azure AI Foundry, Azure AI Search, LLMs, RAG, NLP, prompt engineering, AI agents, LangGraph, vector databases, model evaluation, guardrails, tracing, and observability.
Programming & Data: Python, Java, TypeScript, Go, SQL, data pipelines, Databricks, Microsoft Fabric, Unity Catalog, healthcare data models.
Engineering & DevOps: Git, Azure DevOps, GitHub, Terraform, Bicep, Docker, CI/CD, automated testing, infrastructure as code, and secure software development.
Monitoring & Observability: Azure Monitor, Application Insights, Grafana, application performance monitoring, alerting, incident management, and ServiceNow integration.
Healthcare Security & Compliance: HIPAA, HITECH, PHI de-identification and redaction, role-based access control, Microsoft Entra ID, Key Vault, encryption at rest and in transit, audit logging, code scanning, and dependency scanning.
Delivery & Collaboration: Azure Boards, Jira, ServiceNow, Mural, Agile/Scrum, engineering metrics, and stakeholder communication.
