YouTube Faces with Facial Keypoints
Video dataset containing human faces taken from YouTube, with annotations of facial key points for each frame. Ideal for facial movement recognition and modeling tasks.
2200 annotated videos, 800+ identities, with 2D/3D facial keypoint files
CC0: Public Domain
Description
YouTube Faces with Facial Keypoints is a dataset of short videos depicting celebrities, taken from YouTube, and enriched with 2D/3D facial highlights for each frame. Each video is pre-processed: cropped around the face and limited to 240 images to optimize machine learning use. The recordings cover over 800 identities for a total of around 2,200 videos.
What is this dataset for?
- Train facial recognition models from real videos in uncontrolled conditions.
- Analyze and predict facial movements or expressions through time keypoints.
- Perform learning transfer experiments on other facial or animal datasets.
Can it be enriched or improved?
Yes, it is possible to enrich this dataset with emotional labels, groupings by gender or age, or to integrate methods for generating synthetic faces to increase diversity. It can also be used as a basis for training or validating GAN models or facial tracking in real time.
🔎 In summary
🧠 Recommended for
- Computer vision engineers
- Biometric researchers
- AR application developers
🔧 Compatible tools
- OpenCV
- Dlib
- MediaPipe
- PyTorch
- Keras
- Detectron2
💡 Tip
For optimal performance, combine 2D keypoints with optical flows to model dynamic expressions.
Frequently Asked Questions
Are the keypoints provided usable in 3D?
Yes, some files include 3D key points extracted automatically using an advanced library for facial alignment.
Can we train a recognition model with this dataset?
Absolutely, the dataset is designed for cross-video facial recognition and contains enough diversity for this task.
Can the dataset be used in real time for interactive applications?
Yes, as the videos are short and the keypoints are well defined, it can be used to prototype real-time AR/VR applications.




