LLM Inference / AI Infrastructure Engineer

Company Overview: Req ID: 372211 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a On-Premise LLM Inference & GPU Systems Engineer to join our team in Charlotte, North Carolina (US-NC), United States (US). Job Description: Role Overview We are seeking an AI Infrastructure Runtime Engineer to build and maintain large-scale

vLLM, TensorRT-LLM, Triton Inference Server, SGLangInference optimization techniques:Continuous batchingSpeculative decodingKV cache / Prefix cachingModel optimization:FP8, AWQ, GPTQ Distributed & GPU Systems Tensor parallelism and large model scalingCUDA, NCCL, GPU architectureGPU partitioning & optimization (MIG)Kubernetes & ML Serving Kubernetes-based ML serving platformsKServe, OpenShift AIHelm charts, Operators, platform automationGPU Orchestration Run:AI or similar GPU scheduling/orchestra

Job Title: Senior AI Engineer (NVIDIA NIM & Triton) Location: Open Across USA (Remote) Job Summary We are seeking a Senior AI Engineer with strong experience in NVIDIA AI technologies, specifically NVIDIA NIM Microservices and Triton Inference Server. The ideal candidate will be responsible for designing, deploying, optimizing, and scaling Generative AI and LLM-based applications in enterprise environments. Required Skills Hands-on experience with NVIDIA NIM MicroservicesStrong experience with N

AI engineer Remote Preference will be given to candidates with prior experience at Oracle. Job Summary We are seeking a highly skilled AI Engineer with strong experience in Generative AI, Large Language Models (LLMs), and modern AI application development. The ideal candidate will design, develop, deploy, and optimize AI-powered solutions using cutting-edge Gen AI technologies such as OpenAI, LangChain, vector databases, and cloud AI platforms. The role requires expertise in machine learning