ViewTube

Info

At Evidently AI, we are building tools to evaluate, test and monitor LLM and ML-powered systems.

Stats

Joined Invalid Date

0 total views

Open-source LLM tracing, evals and prompt optimization with Evidently

Open-source LLM tracing, evals and prompt optimization with Evidently

270 views

3 months ago

8. Tutorial: Adversarial testing for LLM applications

8. Tutorial: Adversarial testing for LLM applications

627 views

9 months ago

7. Tutorial: Building and evaluating an AI agent

7. Tutorial: Building and evaluating an AI agent

657 views

9 months ago

6.2. Tutorial: Building and evaluating a RAG system

6.2. Tutorial: Building and evaluating a RAG system

966 views

9 months ago

6.1 How to evaluate a RAG system: methods and metrics

6.1 How to evaluate a RAG system: methods and metrics

2,077 views

9 months ago

5. Tutorial: Evaluating LLMs on content generation tasks. Tracing and experiments.

5. Tutorial: Evaluating LLMs on content generation tasks. Tracing and experiments.

666 views

9 months ago

4. Tutorial: Evaluating LLMs on classification tasks

4. Tutorial: Evaluating LLMs on classification tasks

919 views

9 months ago

3. Tutorial: How to create an LLM judge and align with human labels

3. Tutorial: How to create an LLM judge and align with human labels

1,969 views

9 months ago

2.3. Tutorial on LLM evaluation methods: Reference-free evals.

2.3. Tutorial on LLM evaluation methods: Reference-free evals.

1,217 views

9 months ago

2.2. Tutorial on LLM evaluation methods: Reference-based evals.

2.2. Tutorial on LLM evaluation methods: Reference-based evals.

1,308 views

9 months ago

2.1. Tutorial on LLM evaluation methods. Overview and Basic API.

2.1. Tutorial on LLM evaluation methods. Overview and Basic API.

2,286 views

9 months ago

1. Introduction to LLM evaluations in 10 key ideas

1. Introduction to LLM evaluations in 10 key ideas

4,316 views

9 months ago

Course: LLM evaluation for builders

LLM evaluation for builders - Course announcement

LLM evaluation for builders - Course announcement

2,677 views

10 months ago

1. Introduction to LLM evaluations in 10 key ideas

1. Introduction to LLM evaluations in 10 key ideas

4,316 views

9 months ago

2.1. Tutorial on LLM evaluation methods. Overview and Basic API.

2.1. Tutorial on LLM evaluation methods. Overview and Basic API.

2,286 views

9 months ago

2.2. Tutorial on LLM evaluation methods: Reference-based evals.

2.2. Tutorial on LLM evaluation methods: Reference-based evals.

1,308 views

9 months ago

2.3. Tutorial on LLM evaluation methods: Reference-free evals.

2.3. Tutorial on LLM evaluation methods: Reference-free evals.

1,217 views

9 months ago

3. Tutorial: How to create an LLM judge and align with human labels

3. Tutorial: How to create an LLM judge and align with human labels

1,969 views

9 months ago

4. Tutorial: Evaluating LLMs on classification tasks

4. Tutorial: Evaluating LLMs on classification tasks

919 views

9 months ago

5. Tutorial: Evaluating LLMs on content generation tasks. Tracing and experiments.

5. Tutorial: Evaluating LLMs on content generation tasks. Tracing and experiments.

666 views

9 months ago

6.1 How to evaluate a RAG system: methods and metrics

6.1 How to evaluate a RAG system: methods and metrics

2,077 views

9 months ago

6.2. Tutorial: Building and evaluating a RAG system

6.2. Tutorial: Building and evaluating a RAG system

966 views

9 months ago

7. Tutorial: Building and evaluating an AI agent

7. Tutorial: Building and evaluating an AI agent

657 views

9 months ago

8. Tutorial: Adversarial testing for LLM applications

8. Tutorial: Adversarial testing for LLM applications

627 views

9 months ago

LLM evaluation course

Welcome to the LLM evaluation course

Welcome to the LLM evaluation course

3,047 views

1 year ago

What is an LLM-powered product?

What is an LLM-powered product?

1,804 views

1 year ago

LLM evaluation benchmarks

LLM evaluation benchmarks

1,889 views

1 year ago

How to evaluate an LLM application

How to evaluate an LLM application

2,625 views

1 year ago

LLM evaluation datasets: test cases and synthetic data

LLM evaluation datasets: test cases and synthetic data

2,278 views

1 year ago

LLM evaluation methods and metrics

LLM evaluation methods and metrics

6,828 views

1 year ago

LLM-as-a-judge: evaluating LLMs with LLMs

LLM-as-a-judge: evaluating LLMs with LLMs

7,838 views

1 year ago

How to run LLM evals with no code | PRACTICE

How to run LLM evals with no code | PRACTICE

2,213 views

1 year ago

LLM safety and red-teaming

LLM safety and red-teaming

1,147 views

1 year ago

LLM observability in production: tracing and online evals

LLM observability in production: tracing and online evals

996 views

1 year ago

AI agent and RAG evaluation

AI agent and RAG evaluation

1,168 views

1 year ago

A business case for LLM evaluations

A business case for LLM evaluations

696 views

1 year ago

Open-Source ML Observability Course

1.1. ML lifecycle. What can go wrong with ML in production?

1.1. ML lifecycle. What can go wrong with ML in production?

3,197 views

2 years ago

1.2. What is ML monitoring and observability?

1.2. What is ML monitoring and observability?

2,028 views

2 years ago

1.3. ML monitoring metrics. What exactly can you monitor?

1.3. ML monitoring metrics. What exactly can you monitor?

1,664 views

2 years ago

1.4. Key considerations for ML monitoring setup.

1.4. Key considerations for ML monitoring setup.

1,323 views

2 years ago

1.5. ML monitoring architectures.

1.5. ML monitoring architectures.

1,373 views

2 years ago

2.1. How to evaluate ML model quality.

2.1. How to evaluate ML model quality.

1,329 views

2 years ago

2.2. Overview of ML quality metrics. Classification, regression, ranking.

2.2. Overview of ML quality metrics. Classification, regression, ranking.

1,256 views

2 years ago

2.3. Evaluating ML model quality. [CODE PRACTICE].

2.3. Evaluating ML model quality. [CODE PRACTICE].

1,456 views

2 years ago

2.4. Data quality in machine learning.

2.4. Data quality in machine learning.

1,099 views

2 years ago

2.5. Data quality in ML. [CODE PRACTICE].

2.5. Data quality in ML. [CODE PRACTICE].

973 views

2 years ago

2.6. Data and prediction drift in ML.

2.6. Data and prediction drift in ML.

996 views

2 years ago

2.7. Deep dive into data drift detection. [OPTIONAL]

2.7. Deep dive into data drift detection. [OPTIONAL]

1,130 views

2 years ago

LLM-as-a-judge: evaluating LLMs with LLMs

LLM-as-a-judge: evaluating LLMs with LLMs

7,838 views

1 year ago

LLM evaluation methods and metrics

LLM evaluation methods and metrics

6,828 views

1 year ago

Evidently 0.2 - Getting Started Tutorial

Evidently 0.2 - Getting Started Tutorial

6,672 views

3 years ago

Machine Learning Monitoring: What Is Data Drift?

Machine Learning Monitoring: What Is Data Drift?

5,577 views

5 years ago

Machine Learning Monitoring: What Is Concept Drift?

Machine Learning Monitoring: What Is Concept Drift?

5,255 views

4 years ago

ML monitoring with Evidently. A tutorial from CS 329S: Machine Learning Systems Design.

ML monitoring with Evidently. A tutorial from CS 329S: Machine Learning Systems Design.

4,554 views

3 years ago

1. Introduction to LLM evaluations in 10 key ideas

1. Introduction to LLM evaluations in 10 key ideas

4,316 views

9 months ago

How to use Evidently in Jupyter Notebook to evaluate data and prediction drift in ML models

How to use Evidently in Jupyter Notebook to evaluate data and prediction drift in ML models

4,103 views

4 years ago

1.1. ML lifecycle. What can go wrong with ML in production?

1.1. ML lifecycle. What can go wrong with ML in production?

3,197 views

2 years ago

Welcome to the LLM evaluation course

Welcome to the LLM evaluation course

3,047 views

1 year ago

LLM evaluation for builders - Course announcement

LLM evaluation for builders - Course announcement

2,677 views

10 months ago

How to evaluate an LLM application

How to evaluate an LLM application

2,625 views

1 year ago