About the role
Perplexity is looking for an experienced analyst to help us build and improve our core search technologies. You'll work at the intersection of data analysis and engineering - designing metrics, building data pipelines, and improving the quality of our search and answer systems. This role is hybrid in Belgrade, London or Berlin. Responsibilities - Find and diagnose quality issues in our search pipeline - Design metrics from scratch to track and measure search quality - Build datasets for model training, including LLM-as-a-judge labeling pipelines - Improve search snippet quality and page selection algorithms for indexing - Design and analyze A/B experiments to validate improvements Qualifications - 4+ years of experience as a data analyst or in a related role - Strong coding skills — expected to write production-grade code at a mid-level backend engineer level - Proficiency with SQL and Python - Demonstrated hands-on experience with at least one of the following: - Designing metrics from scratch (not just analyzing existing A/B experiments) - Building labeling pipelines using LLM-as-a-judge - Training ML models that shipped to production with measurable metric improvements - Designing evals with known ground truth (e.g. SimpleQA, BrowseComp) or driving meaningful improvements on such evals Preferred Qualifications - Experience working on search-related products - Knowledge of statistics and A/B experiment design - Experience with Apache Spark or Databricks
What you’ll bring
- Perplexity is looking for an experienced analyst to help us build and improve our core search technologies.
- You'll work at the intersection of data analysis and engineering - designing metrics, building data pipelines, and improving the quality of our search and answer systems.
- This role is hybrid in Belgrade, London or Berlin.
- Find and diagnose quality issues in our search pipeline
- Design metrics from scratch to track and measure search quality
- Build datasets for model training, including LLM-as-a-judge labeling pipelines
- Improve search snippet quality and page selection algorithms for indexing
- Design and analyze A/B experiments to validate improvements
Skills connected to this role
- SQL
- Python
- Data analysis
- AI
Application source
This opportunity was collected from the employer-hosted Ashby board. CarrerFit is an independent career platform and is not the hiring employer.