2020-06-06 01:49:27 +02:00
---
layout: default
title: Home
nav_order: 1
---
![MediaPipe ](images/mediapipe_small.png )
--------------------------------------------------------------------------------
2020-09-28 06:50:43 +02:00
## Live ML anywhere
2020-06-06 01:49:27 +02:00
2020-09-28 06:50:43 +02:00
[MediaPipe ](https://google.github.io/mediapipe/ ) offers cross-platform, customizable
ML solutions for live and streaming media.
2020-06-06 01:49:27 +02:00
![accelerated.png ](images/accelerated_small.png ) | ![cross_platform.png ](images/cross_platform_small.png )
:------------------------------------------------------------------------------------------------------------: | :----------------------------------------------------:
2020-09-28 06:50:43 +02:00
***End-to-End acceleration***: *Built-in fast ML inference and processing accelerated even on common hardware* | ** *Build once, deploy anywhere***: *Unified solution works across Android, iOS, desktop/cloud, web and IoT*
2020-06-06 01:49:27 +02:00
![ready_to_use.png ](images/ready_to_use_small.png ) | ![open_source.png ](images/open_source_small.png )
***Ready-to-use solutions***: *Cutting-edge ML solutions demonstrating full power of the framework* | ** *Free and open source***: *Framework and solutions both under Apache 2.0, fully extensible and customizable*
## ML solutions in MediaPipe
2020-12-10 04:13:05 +01:00
Face Detection | Face Mesh | Iris | Hands | Pose | Holistic
:----------------------------------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------------: | :--------------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------------: | :------:
[![face_detection ](images/mobile/face_detection_android_gpu_small.gif )](https://google.github.io/mediapipe/solutions/face_detection) | [![face_mesh ](images/mobile/face_mesh_android_gpu_small.gif )](https://google.github.io/mediapipe/solutions/face_mesh) | [![iris ](images/mobile/iris_tracking_android_gpu_small.gif )](https://google.github.io/mediapipe/solutions/iris) | [![hand ](images/mobile/hand_tracking_android_gpu_small.gif )](https://google.github.io/mediapipe/solutions/hands) | [![pose ](images/mobile/pose_tracking_android_gpu_small.gif )](https://google.github.io/mediapipe/solutions/pose) | [![hair_segmentation ](images/mobile/holistic_tracking_android_gpu_small.gif )](https://google.github.io/mediapipe/solutions/holistic)
2020-06-06 01:49:27 +02:00
2020-12-10 04:13:05 +01:00
Hair Segmentation | Object Detection | Box Tracking | Instant Motion Tracking | Objectron | KNIFT
:-------------------------------------------------------------------------------------------------------------------------------------: | :----------------------------------------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------------------------------: | :---------------------------------------------------------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------------------------: | :---:
[![hair_segmentation ](images/mobile/hair_segmentation_android_gpu_small.gif )](https://google.github.io/mediapipe/solutions/hair_segmentation) | [![object_detection ](images/mobile/object_detection_android_gpu_small.gif )](https://google.github.io/mediapipe/solutions/object_detection) | [![box_tracking ](images/mobile/object_tracking_android_gpu_small.gif )](https://google.github.io/mediapipe/solutions/box_tracking) | [![instant_motion_tracking ](images/mobile/instant_motion_tracking_android_small.gif )](https://google.github.io/mediapipe/solutions/instant_motion_tracking) | [![objectron ](images/mobile/objectron_chair_android_gpu_small.gif )](https://google.github.io/mediapipe/solutions/objectron) | [![knift ](images/mobile/template_matching_android_cpu_small.gif )](https://google.github.io/mediapipe/solutions/knift)
2020-06-06 01:49:27 +02:00
<!-- []() in the first cell is needed to preserve table formatting in GitHub Pages. -->
<!-- Whenever this table is updated, paste a copy to solutions/solutions.md. -->
2020-12-10 04:13:05 +01:00
[]() | [Android ](https://google.github.io/mediapipe/getting_started/android ) | [iOS ](https://google.github.io/mediapipe/getting_started/ios ) | [C++ ](https://google.github.io/mediapipe/getting_started/cpp ) | [Python ](https://google.github.io/mediapipe/getting_started/python ) | [JS ](https://google.github.io/mediapipe/getting_started/javascript ) | [Coral ](https://github.com/google/mediapipe/tree/master/mediapipe/examples/coral/README.md )
:---------------------------------------------------------------------------------------- | :-------------------------------------------------------------: | :-----------------------------------------------------: | :-----------------------------------------------------: | :-----------------------------------------------------------: | :-----------------------------------------------------------: | :--------------------------------------------------------------------:
2021-02-27 09:21:16 +01:00
[Face Detection ](https://google.github.io/mediapipe/solutions/face_detection ) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅
2020-12-10 04:13:05 +01:00
[Face Mesh ](https://google.github.io/mediapipe/solutions/face_mesh ) | ✅ | ✅ | ✅ | ✅ | ✅ |
[Iris ](https://google.github.io/mediapipe/solutions/iris ) | ✅ | ✅ | ✅ | | |
[Hands ](https://google.github.io/mediapipe/solutions/hands ) | ✅ | ✅ | ✅ | ✅ | ✅ |
[Pose ](https://google.github.io/mediapipe/solutions/pose ) | ✅ | ✅ | ✅ | ✅ | ✅ |
[Holistic ](https://google.github.io/mediapipe/solutions/holistic ) | ✅ | ✅ | ✅ | ✅ | ✅ |
2021-06-03 22:13:30 +02:00
[Selfie Segmentation ](https://google.github.io/mediapipe/solutions/selfie_segmentation ) | ✅ | ✅ | ✅ | ✅ | ✅ |
2020-12-10 04:13:05 +01:00
[Hair Segmentation ](https://google.github.io/mediapipe/solutions/hair_segmentation ) | ✅ | | ✅ | | |
[Object Detection ](https://google.github.io/mediapipe/solutions/object_detection ) | ✅ | ✅ | ✅ | | | ✅
[Box Tracking ](https://google.github.io/mediapipe/solutions/box_tracking ) | ✅ | ✅ | ✅ | | |
[Instant Motion Tracking ](https://google.github.io/mediapipe/solutions/instant_motion_tracking ) | ✅ | | | | |
2021-06-03 22:13:30 +02:00
[Objectron ](https://google.github.io/mediapipe/solutions/objectron ) | ✅ | | ✅ | ✅ | |
2020-12-10 04:13:05 +01:00
[KNIFT ](https://google.github.io/mediapipe/solutions/knift ) | ✅ | | | | |
[AutoFlip ](https://google.github.io/mediapipe/solutions/autoflip ) | | | ✅ | | |
[MediaSequence ](https://google.github.io/mediapipe/solutions/media_sequence ) | | | ✅ | | |
[YouTube 8M ](https://google.github.io/mediapipe/solutions/youtube_8m ) | | | ✅ | | |
2020-06-06 01:49:27 +02:00
2020-09-17 17:43:21 +02:00
See also
[MediaPipe Models and Model Cards ](https://google.github.io/mediapipe/solutions/models )
for ML models released in MediaPipe.
2020-11-05 01:02:35 +01:00
## MediaPipe in Python
2020-12-10 04:13:05 +01:00
MediaPipe offers customizable Python solutions as a prebuilt Python package on
[PyPI ](https://pypi.org/project/mediapipe/ ), which can be installed simply with
`pip install mediapipe` . It also provides tools for users to build their own
solutions. Please see
2020-12-10 05:23:58 +01:00
[MediaPipe in Python ](https://google.github.io/mediapipe/getting_started/python )
2020-12-10 04:13:05 +01:00
for more info.
2020-11-05 01:02:35 +01:00
2020-06-06 01:49:27 +02:00
## MediaPipe on the Web
MediaPipe on the Web is an effort to run the same ML solutions built for mobile
and desktop also in web browsers. The official API is under construction, but
the core technology has been proven effective. Please see
[MediaPipe on the Web ](https://developers.googleblog.com/2020/01/mediapipe-on-web.html )
in Google Developers Blog for details.
You can use the following links to load a demo in the MediaPipe Visualizer, and
over there click the "Runner" icon in the top bar like shown below. The demos
use your webcam video as input, which is processed all locally in real-time and
never leaves your device.
![visualizer_runner ](images/visualizer_runner.png )
* [MediaPipe Face Detection ](https://viz.mediapipe.dev/demo/face_detection )
2020-08-05 07:34:32 +02:00
* [MediaPipe Iris ](https://viz.mediapipe.dev/demo/iris_tracking )
* [MediaPipe Iris: Depth-from-Iris ](https://viz.mediapipe.dev/demo/iris_depth )
2020-06-11 06:10:39 +02:00
* [MediaPipe Hands ](https://viz.mediapipe.dev/demo/hand_tracking )
* [MediaPipe Hands (palm/hand detection only) ](https://viz.mediapipe.dev/demo/hand_detection )
2020-08-13 03:57:56 +02:00
* [MediaPipe Pose ](https://viz.mediapipe.dev/demo/pose_tracking )
2020-06-06 01:49:27 +02:00
* [MediaPipe Hair Segmentation ](https://viz.mediapipe.dev/demo/hair_segmentation )
## Getting started
Learn how to [install ](https://google.github.io/mediapipe/getting_started/install )
MediaPipe and
[build example applications ](https://google.github.io/mediapipe/getting_started/building_examples ),
and start exploring our ready-to-use
[solutions ](https://google.github.io/mediapipe/solutions/solutions ) that you can
further extend and customize.
The source code is hosted in the
[MediaPipe Github repository ](https://github.com/google/mediapipe ), and you can
run code search using
[Google Open Source Code Search ](https://cs.opensource.google/mediapipe/mediapipe ).
## Publications
2020-12-16 05:29:11 +01:00
* [MediaPipe Holistic - Simultaneous Face, Hand and Pose Prediction, on Device ](https://ai.googleblog.com/2020/12/mediapipe-holistic-simultaneous-face.html )
in Google AI Blog
2020-12-10 04:13:05 +01:00
* [Background Features in Google Meet, Powered by Web ML ](https://ai.googleblog.com/2020/10/background-features-in-google-meet.html )
in Google AI Blog
2020-09-28 06:50:43 +02:00
* [MediaPipe 3D Face Transform ](https://developers.googleblog.com/2020/09/mediapipe-3d-face-transform.html )
2020-09-17 17:43:21 +02:00
in Google Developers Blog
2020-09-16 03:31:50 +02:00
* [Instant Motion Tracking With MediaPipe ](https://developers.googleblog.com/2020/08/instant-motion-tracking-with-mediapipe.html )
2020-08-30 05:41:10 +02:00
in Google Developers Blog
2020-08-13 21:02:55 +02:00
* [BlazePose - On-device Real-time Body Pose Tracking ](https://ai.googleblog.com/2020/08/on-device-real-time-body-pose-tracking.html )
2020-08-13 03:57:56 +02:00
in Google AI Blog
* [MediaPipe Iris: Real-time Eye Tracking and Depth Estimation ](https://ai.googleblog.com/2020/08/mediapipe-iris-real-time-iris-tracking.html )
in Google AI Blog
2020-06-06 01:49:27 +02:00
* [MediaPipe KNIFT: Template-based feature matching ](https://developers.googleblog.com/2020/04/mediapipe-knift-template-based-feature-matching.html )
in Google Developers Blog
* [Alfred Camera: Smart camera features using MediaPipe ](https://developers.googleblog.com/2020/03/alfred-camera-smart-camera-features-using-mediapipe.html )
in Google Developers Blog
* [Real-Time 3D Object Detection on Mobile Devices with MediaPipe ](https://ai.googleblog.com/2020/03/real-time-3d-object-detection-on-mobile.html )
in Google AI Blog
* [AutoFlip: An Open Source Framework for Intelligent Video Reframing ](https://ai.googleblog.com/2020/02/autoflip-open-source-framework-for.html )
in Google AI Blog
* [MediaPipe on the Web ](https://developers.googleblog.com/2020/01/mediapipe-on-web.html )
in Google Developers Blog
* [Object Detection and Tracking using MediaPipe ](https://developers.googleblog.com/2019/12/object-detection-and-tracking-using-mediapipe.html )
in Google Developers Blog
* [On-Device, Real-Time Hand Tracking with MediaPipe ](https://ai.googleblog.com/2019/08/on-device-real-time-hand-tracking-with.html )
in Google AI Blog
* [MediaPipe: A Framework for Building Perception Pipelines ](https://arxiv.org/abs/1906.08172 )
## Videos
2020-07-09 02:34:05 +02:00
* [YouTube Channel ](https://www.youtube.com/c/MediaPipe )
2020-06-06 01:49:27 +02:00
## Events
* [MediaPipe Seattle Meetup, Google Building Waterside, 13 Feb 2020 ](https://mediapipe.page.link/seattle2020 )
* [AI Nextcon 2020, 12-16 Feb 2020, Seattle ](http://aisea20.xnextcon.com/ )
* [MediaPipe Madrid Meetup, 16 Dec 2019 ](https://www.meetup.com/Madrid-AI-Developers-Group/events/266329088/ )
* [MediaPipe London Meetup, Google 123 Building, 12 Dec 2019 ](https://www.meetup.com/London-AI-Tech-Talk/events/266329038 )
* [ML Conference, Berlin, 11 Dec 2019 ](https://mlconference.ai/machine-learning-advanced-development/mediapipe-building-real-time-cross-platform-mobile-web-edge-desktop-video-audio-ml-pipelines/ )
* [MediaPipe Berlin Meetup, Google Berlin, 11 Dec 2019 ](https://www.meetup.com/Berlin-AI-Tech-Talk/events/266328794/ )
* [The 3rd Workshop on YouTube-8M Large Scale Video Understanding Workshop,
Seoul, Korea ICCV
2019](https://research.google.com/youtube8m/workshop2019/index.html)
* [AI DevWorld 2019, 10 Oct 2019, San Jose, CA ](https://aidevworld.com )
* [Google Industry Workshop at ICIP 2019, 24 Sept 2019, Taipei, Taiwan ](http://2019.ieeeicip.org/?action=page4&id=14#Google )
([presentation](https://docs.google.com/presentation/d/e/2PACX-1vRIBBbO_LO9v2YmvbHHEt1cwyqH6EjDxiILjuT0foXy1E7g6uyh4CesB2DkkEwlRDO9_lWfuKMZx98T/pub?start=false& loop=false& delayms=3000& slide=id.g556cc1a659_0_5))
* [Open sourced at CVPR 2019, 17~20 June, Long Beach, CA ](https://sites.google.com/corp/view/perception-cv4arvr/mediapipe )
## Community
* [Awesome MediaPipe ](https://mediapipe.org ) - A curated list of awesome
MediaPipe related frameworks, libraries and software
2020-07-30 02:33:39 +02:00
* [Slack community ](https://mediapipe.page.link/joinslack ) for MediaPipe users
2020-06-06 01:49:27 +02:00
* [Discuss ](https://groups.google.com/forum/#!forum/mediapipe ) - General
community discussion around MediaPipe
2020-06-09 22:59:11 +02:00
## Alpha disclaimer
2020-06-06 01:49:27 +02:00
MediaPipe is currently in alpha at v0.7. We may be still making breaking API
changes and expect to get to stable APIs by v1.0.
## Contributing
We welcome contributions. Please follow these
[guidelines ](https://github.com/google/mediapipe/blob/master/CONTRIBUTING.md ).
We use GitHub issues for tracking requests and bugs. Please post questions to
the MediaPipe Stack Overflow with a `mediapipe` tag.