VLM Researcher

san francisco, ca or remotefull time or contract

Train vision-language and video models that help robots and applications understand people, events, space, and ongoing interactions. Own model research and evaluation, working with the Multimodal Engineer on the prepared datasets that connect EQ's human-interaction research to model behavior.

what you'll own

  • Develop and fine-tune vision-language and video models for temporal understanding, spatial grounding, and human interaction.
  • Define learning objectives, dataset specifications, and experiments with the Multimodal Engineer, who owns data preparation and QA/QC.
  • Evaluate scene understanding, hallucinations, temporal consistency, and response relevance on held-out data and real-world sessions.
  • Run reproducible experiments and ablations, examine model failures, and measure generalization across people, environments, and later sessions.
  • Work with the LLM Researcher and Applied Robotics Engineer to bring structured observations and model responses into robots and products.

what we're looking for

  • Hands-on experience training, fine-tuning, and evaluating vision-language, video, or multimodal models on real data.
  • Strong Python and PyTorch or JAX, with practical distributed-training and experiment-management experience.
  • Demonstrated work in temporal or spatial grounding, video understanding, or human interaction modeling.
  • A rigorous approach to evaluation: setting baselines, using held-out data, examining failures, and communicating results clearly.
  • Research or industry work you can explain in depth, including the decisions you made and what you learned.

Streaming video understanding, cross-modal fusion, embodied perception, or relevant publications are useful. A PhD is not required. The data infrastructure engineer owns the production dataset-processing pipeline.

location and compensation

Available full time or on contract, in San Francisco or remotely. Pay within these ranges depends on location, job-related knowledge, skills, and experience.

  • Contract: $70–$110 per hour
  • Full time: $130,000–$200,000 per year, plus equity