[Remote] AI Applied Scientist - PhD Intern, Evaluation Systems and Metrics
Note: The job is a remote job and is open to candidates in USA. Zillow is a leading real estate platform in the U.S., dedicated to reshaping how people navigate the real estate market. The company is seeking remote PhD interns to develop innovative evaluation methodologies for AI systems, focusing on metrics and frameworks that assess generative models across multiple modalities.
Responsibilities
- Develop innovative assessment methodologies for emerging AI capabilities, focusing on consistency and quality across complex multi-modal outputs
- Design evaluation systems that learn and adapt from feedback, automatically discovering new evaluation criteria and improving assessment quality over time
- Design frameworks that incorporate domain-specific implementations of differential privacy to protect sensitive user information while maintaining utility for model training and assessment
- Develop scalable methodologies for assessing agentic systems, ensuring compliance with fair housing standards and promoting ethical, responsible AI deployment
Skills
- Currently enrolled as a PhD student in computer science, machine learning, computer vision, or a related field, with strong publication record
- Candidates should have a background in one or more of the following areas: Evaluation methodologies for AI/ML systems, Computer vision metrics and 3D consistency assessment, Generative model evaluation (text, image, video, 3D), Multi-modal assessment and automated feedback systems, Knowledge of data privacy methods (e.g., differential privacy, federated learning, secure ML) and their application, Single agent or multi-agent system evaluations
- Familiarity with modern deep learning frameworks (e.g., PyTorch, Hugging Face Transformers)
- Strong research mindset, with motivation to publish
- Interest in applying AI to complex, multi-stakeholder domains
- A record of publication in conferences, workshops, or journals is a plus
Company Overview
Company H1B Sponsorship