Engineering & IT · New York, NY

Machine Learning Engineer jobs in New York, NY

Machine learning engineers take models from notebook to production — building training pipelines, serving infrastructure, and monitoring so ML systems keep working after launch.

604
Open roles today
$57–$146/hr
Typical pay range
$195k
Median, full-time
5
Fresh in this list

No email, no resume, no sign-up. Save any listing below and you start anonymously.

You're signed in. Saving a listing drops it straight into your pipeline.

01

Open machine learning engineer roles

12 shown of 604 · sorted by freshness

Machine Learning Engineer (IC) - New York

Capital One · New York, NY · Full-time
$197.3k - $245.6k

Requirements: Bachelors degree or higher in Computer Science, Machine Learning, or a related quantitative field such as Statistics, Economics, Operations Research, Analytics, Mathematics, or Engineering. At least 4 years…

Posted 2d ago
+ Save to tracker View listing
$124k - $186k

both for our audiences and our employees – and aim to leave a positive mark on culture. Overview We are seeking a Machine Learning Engineer to join the PlutoTV pod. You will focus on Channel, Guide, and Schedule personal…

Posted 6d ago
+ Save to tracker View listing

Machine Learning Engineer 5

Capital One · New York, NY
$229.9k - $262.4k

Overview Machine Learning Engineer 5 Do you love building and pioneering in the AI and technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery en…

Posted 1w ago
+ Save to tracker View listing

Machine Learning Engineer 4

Capital One · New York, NY
$215.2k - $245.6k

Overview Machine Learning Engineer 4 Do you love building and pioneering in the AI and technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery en…

Posted 1w ago
+ Save to tracker View listing

Senior Machine Learning Engineer

Fusemachines · New York, NY · Temporary

mission to democratize AI. Leveraging proprietary AI Studio and AI Engines, the company helps drive the clients’ AI Enterprise... ...Remote, Full-time Role Overview We’re hiring a Senior Machine Learning Engineer to arch…

Posted 1w ago
+ Save to tracker View listing

Senior Staff Machine Learning Engineer

ServiceNow · New York, NY · Full-time
$201.3k - $352.3k

It all started when engineer Fred Luddy wrote code that automated a tedious task for... ...experiences, and a culture of continuous learning. This is a zero-to-one incubation. We... ...Computer Science, Artificial Intell…

Posted 3w ago
+ Save to tracker View listing

Machine Learning Engineer

Virtu Financial · New York, NY · Full-time
$200k - $300k

Virtu’s Research Technology team is looking for an experienced Machine Learning Engineer to join a small group of technologists whose primary function is building the infrastructure that powers our quantitative researche…

Posted 1mo ago
+ Save to tracker View listing
02

What machine learning engineers earn in New York

Hourly first — that's how the offer arrives

ExperienceHourlyAnnual, full-time
Entry level $57–$79 $119k–$165k
Mid level $79–$108 $165k–$224k
Senior $105–$146 $218k–$304k

Adjusted for the New York market from national ranges.

03

What employers ask for

The skills these listings keep naming

Python and software engineeringPyTorch or TensorFlowML fundamentals and evaluationModel serving and APIsMLOps (tracking, registries, CI)Docker and KubernetesData pipelines and feature storesLLM fine-tuning and RAG (a plus)Monitoring and drift detection
04

Interview questions worth rehearsing

With the thing the interviewer is actually listening for

Walk me through taking a model from prototype to production.

Cover data pipelines, training reproducibility, serving, and monitoring. Emphasize that the model is a small part of the system — that framing is the job.

How do you monitor a model in production?

Discuss input drift, prediction distributions, delayed labels, and business metrics — plus what triggers retraining. Mention that silent degradation is the default failure mode.

How would you reduce inference latency or cost for a large model?

Options include distillation, quantization, batching, caching, and smaller models. Frame it as measuring first, then choosing the cheapest acceptable quality tradeoff.

Tell me about a time a model failed in production. What happened?

A real story about skew, drift, or a data bug — with detection and prevention — is far more convincing than claiming smooth deployments.

How do you evaluate a model beyond accuracy?

Talk about the metric matching the business cost of errors, slicing by segment, and offline-online gaps. Naming a case where accuracy misled is a strong touch.

When would you fine-tune an LLM versus use retrieval or prompting?

Start cheap: prompting, then RAG for knowledge, fine-tuning for behavior and format. Cost and maintenance burden should drive the answer.

How do you make training reproducible?

Version code, data, and config; track experiments; pin environments. This is engineering discipline applied to ML, which is exactly the role.

05

Resume tips that move the needle

For machine learning engineers specifically — generic advice costs you here

01

Center bullets on production systems: models served, request volume, latency, and the business metric they moved.

02

Show software engineering credentials explicitly — testing, CI, code review — since MLE hiring filters hardest on engineering rigor.

03

Name the MLOps tooling you have run (MLflow, SageMaker, Kubeflow, vector databases) as these are common screens.

04

Include LLM work with specifics — fine-tuning, RAG, evaluation — if you have it; vague 'GenAI experience' claims read poorly.

05

Distinguish your role on shared projects: built the serving layer, owned the pipeline, or trained the model.

06

Where this role goes

Typical progression

01 ML Engineer
02 Senior ML Engineer
03 Staff ML Engineer
04 ML Platform Lead
Ten quiet minutes a day

Applying for machine learning engineer jobs in New York?

Robbi carries this page into your first day: your role, your city, your shift preference. Then it hands you a few small things each morning and keeps the pipeline honest.

Save what looks right here, then let Robbi hand you a few small things each morning and keep the follow-ups honest.

Start with this search No email, no resume, no sign-up. Open your tracker Everything you saved is already there.
604 Machine Learning Engineer roles in New York Save them into one pipeline Save them into your pipeline
Start free My tracker