Nebius seeks a Principal ML Solutions Architect to join the Token Factory serverless platform team for remote work across the United States. This remote position suits an experienced machine learning professional who wants to guide strategic accounts and shape large-scale artificial intelligence infrastructure.
Role Overview
Nebius is hiring a Principal ML Solutions Architect to act as the primary technical authority for customers using the Token Factory serverless inference and fine-tuning platform. The position focuses on leading high-stakes customer engagements, solving complex performance challenges, mentoring team members, and collaborating with research and engineering groups to direct platform development.
Key Responsibilities
Manage complex customer engagements from initial architecture design through production deployment across multiple modalities.
Optimize large language model inference at framework and hardware levels and create reusable team playbooks.
Lead supervised and reinforcement fine-tuning procedures to improve model quality.
Design production-ready workflows using Token Factory inference services.
Provide expertise in prompt engineering, retrieval-augmented generation architectures, model selection, and scaling trade-offs.
Partner with product, engineering, and research teams to prototype platform features and influence the roadmap.
Guide clients from proof of concept to production while setting standards for performance, reliability, and cost efficiency.
Mentor senior and mid-level Solutions Architects and elevate technical standards through reviews and knowledge sharing.
Represent Token Factory publicly through conferences, blog posts, and talks.
Requirements
Eight or more years of professional background in machine learning and artificial intelligence systems.
At least four years dedicated specifically to large language models and generative artificial intelligence.
Demonstrated technical leadership in handling ambiguous and high-impact problems across teams and customers.
Expert knowledge of model architectures, fine-tuning approaches, and inference internals within the large language model ecosystem.
Hands-on command of inference optimization including quantization, key-value cache management, batching, and routing.
Practical experience running large language models in production at scale down to the framework level.
Experience with fine-tuning methods such as supervised fine-tuning, Low-Rank Adaptation, and reinforcement learning-based techniques.
Experience building task-specific benchmarks, offline and online evaluation pipelines, and evaluation setups.
Practical use of inference frameworks and libraries like vLLM, SGLang, and TensorRT-LLM with the ability to modify internals.
Experience deploying applications via APIs from OpenAI, Anthropic, or open-source models.
Strong programming proficiency in Python.
Excellent communication skills for explaining technical concepts to diverse audiences from engineers to executives.
Nice to Have
Contributions or maintainership roles in major open-source inference and machine learning projects.
Published research, conference presentations, or technical writing in the language model serving domain.
Experience working with multimodal artificial intelligence models including vision-language and speech.
Proficiency with DevOps tooling such as Docker, Kubernetes, and infrastructure-as-code.
Experience building internal tooling and automation for large-scale machine learning workflows.
Skills and Tools
Python
vLLM
TensorRT-LLM
SGLang
Transformers
OpenAI SDK and Anthropic SDK
Kubernetes and Docker
Git
AWS SageMaker, AWS Bedrock, GCP Vertex AI, and Azure ML
Salary and Benefits
Base compensation ranging from $208,000 to $261,000 USD.
One hundred percent company-paid medical, dental, and vision health insurance coverage for employees and families.
A 401(k) plan featuring up to a four percent company match with immediate vesting.
Twenty weeks of paid parental leave for primary caregivers and twelve weeks for secondary caregivers.
Remote work reimbursement of up to $85 per month for mobile and internet expenses.
Company-paid short-term disability, long-term disability, and life insurance coverage.
About the Company
Nebius builds a full-stack artificial intelligence cloud platform supporting developers and enterprises across data, model training, and production deployment. Headquartered in Amsterdam with global research and development hubs, the company is listed on Nasdaq under the ticker symbol NBIS.
How to Apply
Apply directly on the official company careers page.
