150 lines
19 KiB
Markdown
150 lines
19 KiB
Markdown
---
|
|
layout: default
|
|
title: Home
|
|
nav_order: 1
|
|
---
|
|
|
|
|
|
|
|
--------------------------------------------------------------------------------
|
|
|
|
## Live ML anywhere
|
|
|
|
[MediaPipe](https://google.github.io/mediapipe/) offers cross-platform, customizable
|
|
ML solutions for live and streaming media.
|
|
|
|
 | 
|
|
:------------------------------------------------------------------------------------------------------------: | :----------------------------------------------------:
|
|
***End-to-End acceleration***: *Built-in fast ML inference and processing accelerated even on common hardware* | ***Build once, deploy anywhere***: *Unified solution works across Android, iOS, desktop/cloud, web and IoT*
|
|
 | 
|
|
***Ready-to-use solutions***: *Cutting-edge ML solutions demonstrating full power of the framework* | ***Free and open source***: *Framework and solutions both under Apache 2.0, fully extensible and customizable*
|
|
|
|
## ML solutions in MediaPipe
|
|
|
|
Face Detection | Face Mesh | Iris | Hands | Pose | Holistic
|
|
:----------------------------------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------------: | :--------------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------------: | :------:
|
|
[](https://google.github.io/mediapipe/solutions/face_detection) | [](https://google.github.io/mediapipe/solutions/face_mesh) | [](https://google.github.io/mediapipe/solutions/iris) | [](https://google.github.io/mediapipe/solutions/hands) | [](https://google.github.io/mediapipe/solutions/pose) | [](https://google.github.io/mediapipe/solutions/holistic)
|
|
|
|
Hair Segmentation | Object Detection | Box Tracking | Instant Motion Tracking | Objectron | KNIFT
|
|
:-------------------------------------------------------------------------------------------------------------------------------------: | :----------------------------------------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------------------------------: | :---------------------------------------------------------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------------------------: | :---:
|
|
[](https://google.github.io/mediapipe/solutions/hair_segmentation) | [](https://google.github.io/mediapipe/solutions/object_detection) | [](https://google.github.io/mediapipe/solutions/box_tracking) | [](https://google.github.io/mediapipe/solutions/instant_motion_tracking) | [](https://google.github.io/mediapipe/solutions/objectron) | [](https://google.github.io/mediapipe/solutions/knift)
|
|
|
|
<!-- []() in the first cell is needed to preserve table formatting in GitHub Pages. -->
|
|
<!-- Whenever this table is updated, paste a copy to solutions/solutions.md. -->
|
|
|
|
[]() | [Android](https://google.github.io/mediapipe/getting_started/android) | [iOS](https://google.github.io/mediapipe/getting_started/ios) | [C++](https://google.github.io/mediapipe/getting_started/cpp) | [Python](https://google.github.io/mediapipe/getting_started/python) | [JS](https://google.github.io/mediapipe/getting_started/javascript) | [Coral](https://github.com/google/mediapipe/tree/master/mediapipe/examples/coral/README.md)
|
|
:---------------------------------------------------------------------------------------- | :-------------------------------------------------------------: | :-----------------------------------------------------: | :-----------------------------------------------------: | :-----------------------------------------------------------: | :-----------------------------------------------------------: | :--------------------------------------------------------------------:
|
|
[Face Detection](https://google.github.io/mediapipe/solutions/face_detection) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅
|
|
[Face Mesh](https://google.github.io/mediapipe/solutions/face_mesh) | ✅ | ✅ | ✅ | ✅ | ✅ |
|
|
[Iris](https://google.github.io/mediapipe/solutions/iris) | ✅ | ✅ | ✅ | | |
|
|
[Hands](https://google.github.io/mediapipe/solutions/hands) | ✅ | ✅ | ✅ | ✅ | ✅ |
|
|
[Pose](https://google.github.io/mediapipe/solutions/pose) | ✅ | ✅ | ✅ | ✅ | ✅ |
|
|
[Holistic](https://google.github.io/mediapipe/solutions/holistic) | ✅ | ✅ | ✅ | ✅ | ✅ |
|
|
[Selfie Segmentation](https://google.github.io/mediapipe/solutions/selfie_segmentation) | ✅ | ✅ | ✅ | ✅ | ✅ |
|
|
[Hair Segmentation](https://google.github.io/mediapipe/solutions/hair_segmentation) | ✅ | | ✅ | | |
|
|
[Object Detection](https://google.github.io/mediapipe/solutions/object_detection) | ✅ | ✅ | ✅ | | | ✅
|
|
[Box Tracking](https://google.github.io/mediapipe/solutions/box_tracking) | ✅ | ✅ | ✅ | | |
|
|
[Instant Motion Tracking](https://google.github.io/mediapipe/solutions/instant_motion_tracking) | ✅ | | | | |
|
|
[Objectron](https://google.github.io/mediapipe/solutions/objectron) | ✅ | | ✅ | ✅ | |
|
|
[KNIFT](https://google.github.io/mediapipe/solutions/knift) | ✅ | | | | |
|
|
[AutoFlip](https://google.github.io/mediapipe/solutions/autoflip) | | | ✅ | | |
|
|
[MediaSequence](https://google.github.io/mediapipe/solutions/media_sequence) | | | ✅ | | |
|
|
[YouTube 8M](https://google.github.io/mediapipe/solutions/youtube_8m) | | | ✅ | | |
|
|
|
|
See also
|
|
[MediaPipe Models and Model Cards](https://google.github.io/mediapipe/solutions/models)
|
|
for ML models released in MediaPipe.
|
|
|
|
## Getting started
|
|
|
|
To start using MediaPipe
|
|
[solutions](https://google.github.io/mediapipe/solutions/solutions) with only a few
|
|
lines code, see example code and demos in
|
|
[MediaPipe in Python](https://google.github.io/mediapipe/getting_started/python) and
|
|
[MediaPipe in JavaScript](https://google.github.io/mediapipe/getting_started/javascript).
|
|
|
|
To use MediaPipe in C++, Android and iOS, which allow further customization of
|
|
the [solutions](https://google.github.io/mediapipe/solutions/solutions) as well as
|
|
building your own, learn how to
|
|
[install](https://google.github.io/mediapipe/getting_started/install) MediaPipe and
|
|
start building example applications in
|
|
[C++](https://google.github.io/mediapipe/getting_started/cpp),
|
|
[Android](https://google.github.io/mediapipe/getting_started/android) and
|
|
[iOS](https://google.github.io/mediapipe/getting_started/ios).
|
|
|
|
The source code is hosted in the
|
|
[MediaPipe Github repository](https://github.com/google/mediapipe), and you can
|
|
run code search using
|
|
[Google Open Source Code Search](https://cs.opensource.google/mediapipe/mediapipe).
|
|
|
|
## Publications
|
|
|
|
* [MediaPipe Holistic - Simultaneous Face, Hand and Pose Prediction, on Device](https://ai.googleblog.com/2020/12/mediapipe-holistic-simultaneous-face.html)
|
|
in Google AI Blog
|
|
* [Background Features in Google Meet, Powered by Web ML](https://ai.googleblog.com/2020/10/background-features-in-google-meet.html)
|
|
in Google AI Blog
|
|
* [MediaPipe 3D Face Transform](https://developers.googleblog.com/2020/09/mediapipe-3d-face-transform.html)
|
|
in Google Developers Blog
|
|
* [Instant Motion Tracking With MediaPipe](https://developers.googleblog.com/2020/08/instant-motion-tracking-with-mediapipe.html)
|
|
in Google Developers Blog
|
|
* [BlazePose - On-device Real-time Body Pose Tracking](https://ai.googleblog.com/2020/08/on-device-real-time-body-pose-tracking.html)
|
|
in Google AI Blog
|
|
* [MediaPipe Iris: Real-time Eye Tracking and Depth Estimation](https://ai.googleblog.com/2020/08/mediapipe-iris-real-time-iris-tracking.html)
|
|
in Google AI Blog
|
|
* [MediaPipe KNIFT: Template-based feature matching](https://developers.googleblog.com/2020/04/mediapipe-knift-template-based-feature-matching.html)
|
|
in Google Developers Blog
|
|
* [Alfred Camera: Smart camera features using MediaPipe](https://developers.googleblog.com/2020/03/alfred-camera-smart-camera-features-using-mediapipe.html)
|
|
in Google Developers Blog
|
|
* [Real-Time 3D Object Detection on Mobile Devices with MediaPipe](https://ai.googleblog.com/2020/03/real-time-3d-object-detection-on-mobile.html)
|
|
in Google AI Blog
|
|
* [AutoFlip: An Open Source Framework for Intelligent Video Reframing](https://ai.googleblog.com/2020/02/autoflip-open-source-framework-for.html)
|
|
in Google AI Blog
|
|
* [MediaPipe on the Web](https://developers.googleblog.com/2020/01/mediapipe-on-web.html)
|
|
in Google Developers Blog
|
|
* [Object Detection and Tracking using MediaPipe](https://developers.googleblog.com/2019/12/object-detection-and-tracking-using-mediapipe.html)
|
|
in Google Developers Blog
|
|
* [On-Device, Real-Time Hand Tracking with MediaPipe](https://ai.googleblog.com/2019/08/on-device-real-time-hand-tracking-with.html)
|
|
in Google AI Blog
|
|
* [MediaPipe: A Framework for Building Perception Pipelines](https://arxiv.org/abs/1906.08172)
|
|
|
|
## Videos
|
|
|
|
* [YouTube Channel](https://www.youtube.com/c/MediaPipe)
|
|
|
|
## Events
|
|
|
|
* [MediaPipe Seattle Meetup, Google Building Waterside, 13 Feb 2020](https://mediapipe.page.link/seattle2020)
|
|
* [AI Nextcon 2020, 12-16 Feb 2020, Seattle](http://aisea20.xnextcon.com/)
|
|
* [MediaPipe Madrid Meetup, 16 Dec 2019](https://www.meetup.com/Madrid-AI-Developers-Group/events/266329088/)
|
|
* [MediaPipe London Meetup, Google 123 Building, 12 Dec 2019](https://www.meetup.com/London-AI-Tech-Talk/events/266329038)
|
|
* [ML Conference, Berlin, 11 Dec 2019](https://mlconference.ai/machine-learning-advanced-development/mediapipe-building-real-time-cross-platform-mobile-web-edge-desktop-video-audio-ml-pipelines/)
|
|
* [MediaPipe Berlin Meetup, Google Berlin, 11 Dec 2019](https://www.meetup.com/Berlin-AI-Tech-Talk/events/266328794/)
|
|
* [The 3rd Workshop on YouTube-8M Large Scale Video Understanding Workshop,
|
|
Seoul, Korea ICCV
|
|
2019](https://research.google.com/youtube8m/workshop2019/index.html)
|
|
* [AI DevWorld 2019, 10 Oct 2019, San Jose, CA](https://aidevworld.com)
|
|
* [Google Industry Workshop at ICIP 2019, 24 Sept 2019, Taipei, Taiwan](http://2019.ieeeicip.org/?action=page4&id=14#Google)
|
|
([presentation](https://docs.google.com/presentation/d/e/2PACX-1vRIBBbO_LO9v2YmvbHHEt1cwyqH6EjDxiILjuT0foXy1E7g6uyh4CesB2DkkEwlRDO9_lWfuKMZx98T/pub?start=false&loop=false&delayms=3000&slide=id.g556cc1a659_0_5))
|
|
* [Open sourced at CVPR 2019, 17~20 June, Long Beach, CA](https://sites.google.com/corp/view/perception-cv4arvr/mediapipe)
|
|
|
|
## Community
|
|
|
|
* [Awesome MediaPipe](https://mediapipe.org) - A curated list of awesome
|
|
MediaPipe related frameworks, libraries and software
|
|
* [Slack community](https://mediapipe.page.link/joinslack) for MediaPipe users
|
|
* [Discuss](https://groups.google.com/forum/#!forum/mediapipe) - General
|
|
community discussion around MediaPipe
|
|
|
|
## Alpha disclaimer
|
|
|
|
MediaPipe is currently in alpha at v0.7. We may be still making breaking API
|
|
changes and expect to get to stable APIs by v1.0.
|
|
|
|
## Contributing
|
|
|
|
We welcome contributions. Please follow these
|
|
[guidelines](https://github.com/google/mediapipe/blob/master/CONTRIBUTING.md).
|
|
|
|
We use GitHub issues for tracking requests and bugs. Please post questions to
|
|
the MediaPipe Stack Overflow with a `mediapipe` tag.
|