Data Scientist / Data Analyst (m/w/d) (Data Scientist)
Vollzeit
Mercor
Homeoffice
- Homeoffice
Job Description: AI Task Evaluation & Statistical Analysis Specialist
Role Overview
We're seeking a data-driven analyst to conduct comprehensive failure analysis on AI agent performance across finance-sector tasks. You'll identify patterns, root causes, and systemic issues in our evaluation framework by analyzing task performance across multiple dimensions (task types, file types, criteria, etc.).
Key Responsibilities
Statistical Failure Analysis : Identify patterns in AI agent failures across task components (prompts, rubrics, templates, file types, tags)
Root Cause Analysis : Determine whether failures stem from task design, rubric clarity, file complexity, or agent limitations
Dimension Analysis : Analyze performance variations across finance sub-domains, file types, and task categories
Reporting & Visualization : Create dashboards and reports highlighting failure clusters, edge cases, and improvement opportunities
Quality Framework : Recommend improvements to task design, rubric structure, and evaluation criteria based on statistical findings
Stakeholder Communication : Present insights to data labeling experts and technical teams
Required Qualifications
Statistical Expertise : Strong foundation in statistical analysis, hypothesis testing, and pattern recognition
Programming : Proficiency in Python (pandas, scipy, matplotlib/seaborn) or R for data analysis
Data Analysis : Experience with exploratory data analysis and creating actionable insights from complex datasets
AI/ML Familiarity : Understanding of LLM evaluation methods and quality metrics
Tools : Comfortable working with Excel, data visualization tools (Tableau/Looker), and SQL
Preferred Qualifications
Experience with AI/ML model evaluation or quality assurance
Background in finance or willingness to learn finance domain concepts
Experience with multi-dimensional failure analysis
Familiarity with benchmark datasets and evaluation frameworks
2-4 years of relevant experience
Die Stellenanzeige wurde vor Vor 24 Tagen veröffentlicht
Ähnliche Jobs, die für Sie interessant sein könntenBasierend auf das Stellenangebot Data Scientist / Data Analyst (m/w/d) (Data Scientist) in Homeoffice
- ...Role Description Mercor is hiring on behalf of a leading AI research lab to bring on a highly skilled Data Scientist with a Kaggle Grandmaster profile. In this role, you will transform complex datasets into actionable insights, high-performing models, and scalable...EmpfohlenHomeofficeVollzeit
- ...Your tasks As a Data Scientist at AIPERIA, you'll develop the AI models that ensure bakeries and food retailers only produce what's actually sold. You'll work with real sales, weather, event, and other data, build robust forecasting models, and ensure our recommendations...EmpfohlenVollzeitHomeoffice
- ...the latest technologies across various domains of IT including Data, Web, Infrastructure, AI, and many others. Our expertise in IT... ...complex challenges. Requirements Job Description: Lead Data Scientist (Fintech / Banking) Role Overview We are seeking a Lead Data...EmpfohlenHomeofficeVollzeit
- ...than 1% of all hires occur through the HeyJobs platform. We offer you an influential role in a fast-growing company: As a Data Scientist (w/m/d) at HeyJobs, you will develop marketing steering models, which will help our Talent Marketing to attract talents to the...EmpfohlenHomeofficePhD Position
- ...to the following position. At bridgingIT, people are our priority , and now it's your turn! YOUR role Shape the future of data with us! Whether you're a beginner or an experienced professional – if you love data and want to create real value from it, you've...EmpfohlenUnbefristete ArbeitVollzeitTeilzeit
- ...Fortbildungsangebote und geregelte Arbeitszeiten. Unser Unternehmen wächst - für unser Team in der Zentrale in Fürth suchen wir Dich ab sofort als Data Engineer (m/w/d)! Mit diesen Aufgaben starten Sie durch - Aufbau eines neuen Data Warehouses mit finanziellen, operativen und...Ab sofortHybrides Arbeitsmodell
- ...sustainable product development. We’re looking for innovative, driven Data Engineers who are passionate about technology and... ...cleaning, and transformation processes. ~ Collaborate with data scientists, analysts, and other stakeholders to understand data needs and...Unbefristete ArbeitVollzeitHomeoffice
€ 75.000 - € 95.000
...Projekten einzusetzen, dann bewirb dich jetzt! Deine Aufgaben Du bist verantwortlich für den Aufbau und Betrieb von modernen onpremises Data Lakehouse Systemen bis in den Petabyte-Bereich. Dein Hauptfokus liegt dabei auf Lakehouse Architekturen, die du auf Basis der...HomeofficeUnbefristete ArbeitVollzeitPhD Position- ...based on property valuations and market insights. Leveraging big data, cutting-edge analytics, and great visualization, our product... ...The impact you will have Work with backend engineers and data scientists to turn raw data into trusted insights, handling everything...Homeoffice
- ...Job Title: Data Engineering Senior Developer Base Location: Munich, Germany (Fully Remote/Hybrid) Duration: B2b Contract/FTC/FTE Experience: 8-10 Years Language: Native German Domain: Utility domain Professional skills Solid knowledge in developing...HomeofficeVollzeit
- ...noch jung ist, aber bereits auf einer starken technischen Basis steht. Genau das findest du bei uns: eine moderne Infrastruktur mit Data Warehouse, Airflow, dbt und einem modernen Stack, der dir ermöglicht, vom ersten Tag an wirksam zu werden. Als Data Engineer (m/w...Vollzeit
- ...solution that enables hotels to set the right prices in just seconds. ⏱️ Our state-of-the-art algorithm analyzes both internal hotel data and market trends to recommend pricing strategies that enhance revenue and improve booking rates. With customers spanning the...Homeoffice
- ...Preisen ausgezeichnet. Für den Standort in Mannheim sucht unser Kunde im Rahmen der Festanstellung einen qualifizierten: Senior AI / Data Science Engineer mit Erfahrung im Bereich LLM (m/w/d) Job-ID: CF-00006888 Job-Ort: Mannheim / Remote Remoteanteil / Home Office...FestanstellungHomeoffice
- ...YOUR MISSION We are looking for a world-class Senior Data Engineer to help shape and scale our data platform, powering insights and decision-making across our suite of SaaS digital advertising products. You’ll play a key role in designing and building robust, scalable...HomeofficeVollzeitTeilzeit
- Vorankommen mit Prosoz! In ganz Deutschland begleiten wir Kommunen auf dem Weg in die digitale Zukunft. Als Komplettanbieter liefern wir Lösungen aus einer Hand - von der Software bis hin zur Beratung. Um die digitale Transformation in der kommunalen Verwaltung weiter...Unbefristete ArbeitVollzeitMobiles ArbeitenHomeofficeFlexible Arbeitszeiten
PROSOZ Herten GmbH
HomeofficeVor 2 Tagen - ...andere Kollegen und Kolleginnen fachlich, unterstützt sie in ihrer Weiterentwicklung und bei alltäglichen Projektfragen im Bereich Data Science. Dein Profil Du hast eine angemessene universitäre Ausbildung in einem technischen oder wissenschaftlichen Fach wie (Wirtschafts...Vollzeit
- ...and relevance across Spotify’s Search experiences Collaborate with a cross-functional agile team spanning user research, design, data science, product management, and engineering Prototype and productionize new modeling approaches at scale, serving hundreds of millions...Vollzeit
€ 118.200 - € 159.900
...engineers at each of our career levels. Check out our blog post on this topic and more here. Responsibilities Work with large scale data systems, and infrastructure Help productionize multimodal and semantic retrieval systems at scale, powering Dash’s multimedia and...Homeoffice- ...berufliche Wege zu gehen – und vernetzen Bildung, Arbeitsmarkt und Unternehmen. Deine Aufgaben ~ Vermittlung der Grundlagen des Data Engineerings an Anfänger (Beginner-Level) unter Verwendung von Python, SQL und ETL-Workflows ~ Betreuung der Teilnehmer bei...WeiterbildungTeilzeit
- ...Mach mit! Als Produkt Analyst - Business Data & Insights (m/w/d) , berichtest Du an unseren Head of Product Operations und spielst eine entscheidende Rolle bei der Analyse, Interpretation und Visualisierung von Daten, um die Produktleistung zu verbessern und weitreichende...VollzeitHomeoffice
- ...business challenges. End-to-end AI model lifecycle, including data collection, preprocessing, model training, evaluation, and... ...related field. Proven experience as an AI engineer or data scientist, with a track record of leading successful AI projects. Proficiency...Homeoffice
- VOLLZEIT, UNBEFRISTET Braunschweig, Remote Werde Teil von KOSATEC, einem der erfolgreichsten Unternehmen in Niedersachsen. Die ganze Welt digitalisiert sich gerade und die Nachfrage ist größer als das Angebot. Wenn Du mit uns eine Delle ins Universum schlagen willst...Unbefristete ArbeitVollzeitHomeoffice
KOSATEC Computer GmbH
HomeofficeVor 7 Tagen - ...developers have chosen Mapbox because of the platform’s flexibility, security and privacy compliance. Organizations use Mapbox applications, data, SDKs and APIs to create customized and immersive experiences that delight their customers. What We Do Data forms the...Homeoffice
- ...Job Title: Data Engineering Solutions Design Base Location: Munich, Germany (Fully Remote/Hybrid) Duration: B2b Contract/FTC/FTE Experience: 8-10 Years Language: Native German Domain: Utility domain Professional skills Solid SAP BTP knowledge,...HomeofficeVollzeit
- Vielleicht passen wir nicht zueinander. Möglicherweise suchst du gerade einen Job mit Hierarchie, Titel und Karriereleiter. Dann sind wir vermutlich nicht die Richtigen für dich! Wenn du dagegen gerne auf Augenhöhe arbeitest und Struktur lieber gemeinsam schaffst, statt...HomeofficeVollzeitTeilzeit
- Ihre Aufgaben: Design and develop cloud-native applications on SAP BTP using SAP CAP (Cloud Application Programming Model) Implement side-by-side extensions with a strong focus on CAP and ensure clean-core principles are applied Integrate SAP BTP applications...Homeoffice
- ...Engineer , you will play a key role in shaping the intelligence layer of our platform. Working with billions of mobility and location data points, you will design, implement, and deploy advanced machine learning models that uncover patterns such as commuting behavior,...VollzeitWorkationVon zu Hause
1000 $ pro Monat
...learning models to understand the risk of various classes of businesses. You will be turning vast amounts of structured and unstructured data from many sources (web data, geolocation, satellite imaging, etc.) into novel insights about behavior and risk. Team members are...VollzeitStudentenjob- About us: Talent has no borders. Proxify's mission is to connect top developers around the world with opportunities they deserve. So, it doesn't matter where you are; we are here to help you fast-track your independent career in the right direction. Since our launch...VollzeitHomeoffice
- ...transportation innovation. Joining our engineering team means: Building real-time collaborative routing applications integrated with fleet data and analytics Iterating towards a self-driven product that can educate users through tutorials Delivering an exceptional...HomeofficeStudentenjob
Wollen Sie mehr Stellenangebote erhalten?
Abonnieren Sie und erhalten Sie ähnliche Stellenangebote wie Data Scientist / Data Analyst (m/w/d) (Data Scientist). Seien Sie der Erste, der sich bewirbt!
