Job Description


Job Overview

  • Job ID:

    J55603

  • Job Title:

    AI Optimization Engineer

  • Location:

    Jersey City, NJ

  • Duration:

    12 Months + Extension

  • Domain Exposure:

    Banking & Finance

  • Client:

    To Be Discussed Later

  • Employment Type:

    W-2, 1099, C2C

  • Work Authorization:

    US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title:  AI Optimization Engineer
Location :Jersey City, NJ
Duration: 12 Months + Extension
Bill Rate: $88/hour
Job Type: W-2, 1099, C2C
Client: To Be Discussed Later
Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD


Job Description :


We are seeking an experienced AI Optimization Engineer to design, optimize, and deploy large-scale AI/ML and Generative AI workloads within GPU-accelerated High-Performance Computing (HPC) environments.

The ideal candidate will have strong hands-on experience with Python, Machine Learning, Large Language Models (LLMs), GPU clusters, SLURM workload orchestration, NVIDIA Triton Inference Server, and TensorRT-LLM (TRTLLM). This role involves optimizing model training and inference performance, managing scalable AI infrastructure, and deploying production-ready AI solutions.

Key Responsibilities :

  • Design, deploy, and optimize AI/ML workloads across GPU-based HPC clusters.
  • Deploy, manage, and scale Large Language Models (LLMs) in enterprise production environments.
  • Implement model optimization techniques, including pruning, quantization, and knowledge distillation.
  • Develop automated workload scheduling and orchestration using SLURM, REST APIs, and Flask.
  • Optimize model inference pipelines using NVIDIA Triton Inference Server and TensorRT-LLM (TRTLLM).
  • Build and deploy containerized ML applications and microservices.
  • Monitor and troubleshoot infrastructure and model performance using Prometheus and Grafana.
  • Perform exploratory data analysis, model evaluation, and performance benchmarking.
  • Collaborate with AI/ML, infrastructure, and DevOps teams to improve scalability, reliability, and resource utilization.

Required Technical Skills

1. AI/ML & Generative AI :

  • Strong Python programming experience.
  • Machine Learning and Deep Learning using NumPy, Scikit-learn, TensorFlow, PyTorch, and Keras.
  • Hands-on experience with LLMs, Generative AI, Transformers, NLP, CNNs, and Neural Networks.
  • Knowledge of supervised and unsupervised learning techniques.

2. AI Infrastructure & Model Optimization :

  • Hands-on experience with GPU clusters and HPC infrastructure.
  • Strong experience with SLURM workload management and job scheduling.
  • Experience with NVIDIA Triton Inference Server and TensorRT-LLM (TRTLLM).
  • Expertise in model optimization techniques: pruning, quantization, and knowledge distillation.
  • Experience optimizing large-scale model training and inference workloads.

3. DevOps, Containerization & Automation :

  • Docker, Kubernetes, Podman, and containerized microservices.
  • Experience with Enroot and Pyxis container runtimes.
  • MLflow, Terraform, Jenkins, GitHub, and Hugging Face.
  • Flask API development and REST API integration.

4. Monitoring & Linux Administration :

  • Prometheus and Grafana for infrastructure and application monitoring.
  • Strong Linux administration experience, preferably RHEL/CentOS.
  • Experience troubleshooting GPU utilization, system performance, and HPC workloads.

5. Data Analysis & Visualization :

  • Experience with Plotly, Seaborn, and Matplotlib.
  • Model performance evaluation, benchmarking, and exploratory data analysis.
  • Knowledge of vector embeddings and cloud-based AI/ML deployments is a plus.

Preferred Qualifications :

  • Experience deploying enterprise-scale Generative AI and LLM solutions.
  • Knowledge of GPU resource optimization and distributed computing.
  • Experience with cloud platforms and vector embedding technologies.
  • Ability to troubleshoot complex AI infrastructure and inference performance issues.

Important Submission Requirements :

  • 12+ years of overall IT/AI engineering experience.
  • Must have strong hands-on experience with Python, AI/ML, LLMs, SLURM, Triton Inference Server, TRTLLM, GPU clusters, and HPC infrastructure.

Apply Now
Equal Opportunity Employer

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.