2020-06-06 01:49:27 +02:00
---
layout: default
title: Home
nav_order: 1
---
--------------------------------------------------------------------------------
2020-09-28 06:50:43 +02:00
## Live ML anywhere
2020-06-06 01:49:27 +02:00
2020-09-28 06:50:43 +02:00
[MediaPipe ](https://google.github.io/mediapipe/ ) offers cross-platform, customizable
ML solutions for live and streaming media.
2020-06-06 01:49:27 +02:00
 | 
:------------------------------------------------------------------------------------------------------------: | :----------------------------------------------------:
2020-09-28 06:50:43 +02:00
***End-to-End acceleration***: *Built-in fast ML inference and processing accelerated even on common hardware* | ** *Build once, deploy anywhere***: *Unified solution works across Android, iOS, desktop/cloud, web and IoT*
2020-06-06 01:49:27 +02:00
 | 
***Ready-to-use solutions***: *Cutting-edge ML solutions demonstrating full power of the framework* | ** *Free and open source***: *Framework and solutions both under Apache 2.0, fully extensible and customizable*
## ML solutions in MediaPipe
2020-12-10 04:13:05 +01:00
Face Detection | Face Mesh | Iris | Hands | Pose | Holistic
:----------------------------------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------------: | :--------------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------------: | :------:
[](https://google.github.io/mediapipe/solutions/face_detection) | [](https://google.github.io/mediapipe/solutions/face_mesh) | [](https://google.github.io/mediapipe/solutions/iris) | [](https://google.github.io/mediapipe/solutions/hands) | [](https://google.github.io/mediapipe/solutions/pose) | [](https://google.github.io/mediapipe/solutions/holistic)
2020-06-06 01:49:27 +02:00
2020-12-10 04:13:05 +01:00
Hair Segmentation | Object Detection | Box Tracking | Instant Motion Tracking | Objectron | KNIFT
:-------------------------------------------------------------------------------------------------------------------------------------: | :----------------------------------------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------------------------------: | :---------------------------------------------------------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------------------------: | :---:
[](https://google.github.io/mediapipe/solutions/hair_segmentation) | [](https://google.github.io/mediapipe/solutions/object_detection) | [](https://google.github.io/mediapipe/solutions/box_tracking) | [](https://google.github.io/mediapipe/solutions/instant_motion_tracking) | [](https://google.github.io/mediapipe/solutions/objectron) | [](https://google.github.io/mediapipe/solutions/knift)
2020-06-06 01:49:27 +02:00
<!-- []() in the first cell is needed to preserve table formatting in GitHub Pages. -->
<!-- Whenever this table is updated, paste a copy to solutions/solutions.md. -->
2020-12-10 04:13:05 +01:00
[]() | [Android ](https://google.github.io/mediapipe/getting_started/android ) | [iOS ](https://google.github.io/mediapipe/getting_started/ios ) | [C++ ](https://google.github.io/mediapipe/getting_started/cpp ) | [Python ](https://google.github.io/mediapipe/getting_started/python ) | [JS ](https://google.github.io/mediapipe/getting_started/javascript ) | [Coral ](https://github.com/google/mediapipe/tree/master/mediapipe/examples/coral/README.md )
:---------------------------------------------------------------------------------------- | :-------------------------------------------------------------: | :-----------------------------------------------------: | :-----------------------------------------------------: | :-----------------------------------------------------------: | :-----------------------------------------------------------: | :--------------------------------------------------------------------:
2021-02-27 09:21:16 +01:00
[Face Detection ](https://google.github.io/mediapipe/solutions/face_detection ) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅
2020-12-10 04:13:05 +01:00
[Face Mesh ](https://google.github.io/mediapipe/solutions/face_mesh ) | ✅ | ✅ | ✅ | ✅ | ✅ |
[Iris ](https://google.github.io/mediapipe/solutions/iris ) | ✅ | ✅ | ✅ | | |
[Hands ](https://google.github.io/mediapipe/solutions/hands ) | ✅ | ✅ | ✅ | ✅ | ✅ |
[Pose ](https://google.github.io/mediapipe/solutions/pose ) | ✅ | ✅ | ✅ | ✅ | ✅ |
[Holistic ](https://google.github.io/mediapipe/solutions/holistic ) | ✅ | ✅ | ✅ | ✅ | ✅ |
2021-06-03 22:13:30 +02:00
[Selfie Segmentation ](https://google.github.io/mediapipe/solutions/selfie_segmentation ) | ✅ | ✅ | ✅ | ✅ | ✅ |
2020-12-10 04:13:05 +01:00
[Hair Segmentation ](https://google.github.io/mediapipe/solutions/hair_segmentation ) | ✅ | | ✅ | | |
[Object Detection ](https://google.github.io/mediapipe/solutions/object_detection ) | ✅ | ✅ | ✅ | | | ✅
[Box Tracking ](https://google.github.io/mediapipe/solutions/box_tracking ) | ✅ | ✅ | ✅ | | |
[Instant Motion Tracking ](https://google.github.io/mediapipe/solutions/instant_motion_tracking ) | ✅ | | | | |
2021-07-24 02:09:32 +02:00
[Objectron ](https://google.github.io/mediapipe/solutions/objectron ) | ✅ | | ✅ | ✅ | ✅ |
2020-12-10 04:13:05 +01:00
[KNIFT ](https://google.github.io/mediapipe/solutions/knift ) | ✅ | | | | |
[AutoFlip ](https://google.github.io/mediapipe/solutions/autoflip ) | | | ✅ | | |
[MediaSequence ](https://google.github.io/mediapipe/solutions/media_sequence ) | | | ✅ | | |
[YouTube 8M ](https://google.github.io/mediapipe/solutions/youtube_8m ) | | | ✅ | | |
2020-06-06 01:49:27 +02:00
2020-09-17 17:43:21 +02:00
See also
[MediaPipe Models and Model Cards ](https://google.github.io/mediapipe/solutions/models )
for ML models released in MediaPipe.
2019-06-17 01:03:25 +02:00
## Getting started
2021-06-24 23:10:25 +02:00
To start using MediaPipe
[solutions ](https://google.github.io/mediapipe/solutions/solutions ) with only a few
lines code, see example code and demos in
[MediaPipe in Python ](https://google.github.io/mediapipe/getting_started/python ) and
[MediaPipe in JavaScript ](https://google.github.io/mediapipe/getting_started/javascript ).
To use MediaPipe in C++, Android and iOS, which allow further customization of
the [solutions ](https://google.github.io/mediapipe/solutions/solutions ) as well as
building your own, learn how to
[install ](https://google.github.io/mediapipe/getting_started/install ) MediaPipe and
start building example applications in
[C++ ](https://google.github.io/mediapipe/getting_started/cpp ),
[Android ](https://google.github.io/mediapipe/getting_started/android ) and
[iOS ](https://google.github.io/mediapipe/getting_started/ios ).
2019-06-25 01:03:03 +02:00
2020-06-06 01:49:27 +02:00
The source code is hosted in the
[MediaPipe Github repository ](https://github.com/google/mediapipe ), and you can
run code search using
[Google Open Source Code Search ](https://cs.opensource.google/mediapipe/mediapipe ).
2019-06-17 01:03:25 +02:00
2020-06-06 01:49:27 +02:00
## Publications
2019-06-25 01:03:03 +02:00
2021-07-24 02:09:32 +02:00
* [Bringing artworks to life with AR ](https://developers.googleblog.com/2021/07/bringing-artworks-to-life-with-ar.html )
in Google Developers Blog
* [Prosthesis control via Mirru App using MediaPipe hand tracking ](https://developers.googleblog.com/2021/05/control-your-mirru-prosthesis-with-mediapipe-hand-tracking.html )
in Google Developers Blog
* [SignAll SDK: Sign language interface using MediaPipe is now available for
developers](https://developers.googleblog.com/2021/04/signall-sdk-sign-language-interface-using-mediapipe-now-available.html)
in Google Developers Blog
2020-12-16 05:29:11 +01:00
* [MediaPipe Holistic - Simultaneous Face, Hand and Pose Prediction, on Device ](https://ai.googleblog.com/2020/12/mediapipe-holistic-simultaneous-face.html )
in Google AI Blog
2020-12-10 04:13:05 +01:00
* [Background Features in Google Meet, Powered by Web ML ](https://ai.googleblog.com/2020/10/background-features-in-google-meet.html )
in Google AI Blog
2020-09-28 06:50:43 +02:00
* [MediaPipe 3D Face Transform ](https://developers.googleblog.com/2020/09/mediapipe-3d-face-transform.html )
2020-09-17 17:43:21 +02:00
in Google Developers Blog
2020-09-16 03:31:50 +02:00
* [Instant Motion Tracking With MediaPipe ](https://developers.googleblog.com/2020/08/instant-motion-tracking-with-mediapipe.html )
2020-08-30 05:41:10 +02:00
in Google Developers Blog
2020-08-13 21:02:55 +02:00
* [BlazePose - On-device Real-time Body Pose Tracking ](https://ai.googleblog.com/2020/08/on-device-real-time-body-pose-tracking.html )
2020-08-13 03:57:56 +02:00
in Google AI Blog
* [MediaPipe Iris: Real-time Eye Tracking and Depth Estimation ](https://ai.googleblog.com/2020/08/mediapipe-iris-real-time-iris-tracking.html )
in Google AI Blog
2020-06-06 01:49:27 +02:00
* [MediaPipe KNIFT: Template-based feature matching ](https://developers.googleblog.com/2020/04/mediapipe-knift-template-based-feature-matching.html )
in Google Developers Blog
* [Alfred Camera: Smart camera features using MediaPipe ](https://developers.googleblog.com/2020/03/alfred-camera-smart-camera-features-using-mediapipe.html )
in Google Developers Blog
* [Real-Time 3D Object Detection on Mobile Devices with MediaPipe ](https://ai.googleblog.com/2020/03/real-time-3d-object-detection-on-mobile.html )
in Google AI Blog
* [AutoFlip: An Open Source Framework for Intelligent Video Reframing ](https://ai.googleblog.com/2020/02/autoflip-open-source-framework-for.html )
in Google AI Blog
* [MediaPipe on the Web ](https://developers.googleblog.com/2020/01/mediapipe-on-web.html )
in Google Developers Blog
* [Object Detection and Tracking using MediaPipe ](https://developers.googleblog.com/2019/12/object-detection-and-tracking-using-mediapipe.html )
in Google Developers Blog
* [On-Device, Real-Time Hand Tracking with MediaPipe ](https://ai.googleblog.com/2019/08/on-device-real-time-hand-tracking-with.html )
in Google AI Blog
* [MediaPipe: A Framework for Building Perception Pipelines ](https://arxiv.org/abs/1906.08172 )
2020-04-14 02:04:17 +02:00
2020-02-10 22:27:13 +01:00
## Videos
2019-06-17 01:03:25 +02:00
2020-07-09 02:34:05 +02:00
* [YouTube Channel ](https://www.youtube.com/c/MediaPipe )
2019-06-25 01:03:03 +02:00
## Events
2020-06-06 01:49:27 +02:00
* [MediaPipe Seattle Meetup, Google Building Waterside, 13 Feb 2020 ](https://mediapipe.page.link/seattle2020 )
* [AI Nextcon 2020, 12-16 Feb 2020, Seattle ](http://aisea20.xnextcon.com/ )
* [MediaPipe Madrid Meetup, 16 Dec 2019 ](https://www.meetup.com/Madrid-AI-Developers-Group/events/266329088/ )
* [MediaPipe London Meetup, Google 123 Building, 12 Dec 2019 ](https://www.meetup.com/London-AI-Tech-Talk/events/266329038 )
* [ML Conference, Berlin, 11 Dec 2019 ](https://mlconference.ai/machine-learning-advanced-development/mediapipe-building-real-time-cross-platform-mobile-web-edge-desktop-video-audio-ml-pipelines/ )
* [MediaPipe Berlin Meetup, Google Berlin, 11 Dec 2019 ](https://www.meetup.com/Berlin-AI-Tech-Talk/events/266328794/ )
* [The 3rd Workshop on YouTube-8M Large Scale Video Understanding Workshop,
Seoul, Korea ICCV
2019](https://research.google.com/youtube8m/workshop2019/index.html)
* [AI DevWorld 2019, 10 Oct 2019, San Jose, CA ](https://aidevworld.com )
* [Google Industry Workshop at ICIP 2019, 24 Sept 2019, Taipei, Taiwan ](http://2019.ieeeicip.org/?action=page4&id=14#Google )
([presentation](https://docs.google.com/presentation/d/e/2PACX-1vRIBBbO_LO9v2YmvbHHEt1cwyqH6EjDxiILjuT0foXy1E7g6uyh4CesB2DkkEwlRDO9_lWfuKMZx98T/pub?start=false& loop=false& delayms=3000& slide=id.g556cc1a659_0_5))
* [Open sourced at CVPR 2019, 17~20 June, Long Beach, CA ](https://sites.google.com/corp/view/perception-cv4arvr/mediapipe )
2019-06-25 01:03:03 +02:00
2020-05-21 18:46:31 +02:00
## Community
2020-06-06 01:49:27 +02:00
2022-03-21 20:07:37 +01:00
* [Awesome MediaPipe ](https://mediapipe.page.link/awesome-mediapipe ) - A
curated list of awesome MediaPipe related frameworks, libraries and software
2020-07-30 02:33:39 +02:00
* [Slack community ](https://mediapipe.page.link/joinslack ) for MediaPipe users
2020-06-06 01:49:27 +02:00
* [Discuss ](https://groups.google.com/forum/#!forum/mediapipe ) - General
community discussion around MediaPipe
2020-02-10 22:27:13 +01:00
2020-06-09 22:59:11 +02:00
## Alpha disclaimer
2020-06-06 01:49:27 +02:00
MediaPipe is currently in alpha at v0.7. We may be still making breaking API
changes and expect to get to stable APIs by v1.0.
2019-06-17 01:03:25 +02:00
## Contributing
2020-06-06 01:49:27 +02:00
We welcome contributions. Please follow these
[guidelines ](https://github.com/google/mediapipe/blob/master/CONTRIBUTING.md ).
We use GitHub issues for tracking requests and bugs. Please post questions to
the MediaPipe Stack Overflow with a `mediapipe` tag.
2022-05-17 13:57:54 +02:00
## Steps to add an image_flip_calculator
Objective of this exercise is to create a custom calculator which can do some custom prcessing of the image('flipping') and then insert this calculator in the mediapipe graph pipe line.
Description: Calculators are the blocks of code which reperesent a node in a subgraph in mediapipe computational graphs.
1. Goto /mediapipe/calculators/image directory , which contains several image manipulation calculators, place your custom calculator code in a .cc file right here.
2. Edit the BUILD file in the same image folder by creating a < cc_library > entry for your calculator (the name is 'custom_calculator' in this case, mentioning the name the calculator src file in last step in the < srcs > section).
3. Edit the /mediapipe/modules/pose_landmark/pose_landmark_cpu.pbtxt , creating a < node > entry for your calculator by giving it a name ('CustomImageFlipCalculator' in this case, same as that of the class defined by the calculator in step 1. ) whose input willbe the inputstream of the graph and output will connect to the node previously connected to the original input stream)
4. The node created in the step 3 will connect to you custom_calculator by making an entry in the BUILD file in /mediapipe/modules/pose_landmark/ ; edit the file by finding the entry which mentions name < PoseLandmarkCpu > in the < register_as > section. < PoseLandmarkCpu > is the name of the sub_graph described by the pose_landmark_cpu.pbtxt.
In the 'deps' section, add the calculator entry as dependency to the subgraph(in this case "//mediapipe/calculators/image:custom_calculator").
5. BUILD your custom calculator by running
"bazel build -c opt --define MEDIAPIPE_DISABLE_GPU=1 mediapipe/calculators/image:custom_calculator" , and also for the pose_detection by running
"bazel build -c opt --define MEDIAPIPE_DISABLE_GPU=1 mediapipe/examples/desktop/pose_tracking:pose_tracking_cpu", and then run the pose detection desktop example.
