MLOps/LLMOps Architect

HMG America LLC is the best Business Solutions focused Information Technology Company with IT consulting and services, software and web development, staff augmentation and other professional services. One of our direct clients is looking for MLOps/LLMOps Architect in Remote. Below is the detailed job description.

Title: MLOps/LLMOps Architect

Location: Remote Preferred Dallas but any east, central or south is ok given the situation

Duration: FTE and contracting both allowed

Job Description:

Key Responsibilities

• Architect and Implement MLOps/LLMOps Frameworks:
  • Design and build scalable MLOps/LLMOps pipelines for model training, deployment, monitoring, and retraining.
  • Establish automated CI/CD pipelines to streamline model development and deployment.
• Model Observability and Monitoring:
  • Develop and implement model observability strategies using tools like Arize to track model performance, drift, and bias.
  • Create real-time dashboards and alerts for proactive issue identification and resolution.
• Performance and Scalability:
  • Ensure high availability, low latency, and scalability of deployed models.
  • Optimize model inference and serving using best practices in distributed computing and cloud infrastructure.
  • Manage and optimize compute costs for large-scale Gen AI models by implementing intelligent load balancing, autoscaling, and infrastructure tuning.
• Model Governance and Compliance:
  • Establish frameworks for model versioning, auditing, and explainability to meet regulatory and business requirements.
  • Ensure alignment with Responsible AI and ethical AI guidelines.
• Cross-Functional Collaboration:
  • Partner with data scientists, ML engineers, platform teams, and business stakeholders to align MLOps strategies with business objectives.
  • Provide technical leadership and mentorship to junior team members.

Required Skills and Qualifications

• Experience: 10 to 15 years of experience in machine learning, MLOps, and AI model deployment in enterprise environments.
• MLOps/LLMOps Expertise: Strong background in MLOps and LLMOps, including model lifecycle management, monitoring, and automation.
• Observability Tools: Proficient in using observability platforms such as Arize, Weights & Biases, TensorBoard, MLflow, or similar tools.
• Cloud Platforms: Experience with cloud-based ML solutions (e.g., AWS, Azure, Google Cloud Platform).
• Programming: Strong programming skills in Python and experience with ML frameworks such as TensorFlow, PyTorch, and Hugging Face.
• Containerization and Orchestration: Hands-on experience with Docker, Kubernetes, and distributed computing frameworks.
• Model Monitoring: Experience in detecting and mitigating model drift, bias, and data quality issues.
• Performance Tuning: Expertise in model optimization, inference acceleration, and efficient resource utilization.