mediapipe/docs/examples.md
MediaPipe Team cd2b69d58c Project import generated by Copybara.
GitOrigin-RevId: f72a0f86c2c2acdb1920973c718a9e26ed3ec4b6
2020-06-08 12:08:33 -04:00

3.0 KiB

nav_exclude
true

Examples

Below are code samples on how to run MediaPipe on both mobile and desktop. We currently support MediaPipe APIs on mobile for Android only but will add support for Objective-C shortly.

Mobile

Hello World! on Android

This should be the first mobile Android example users go through in detail. It teaches the following:

  • Introduction of a simple MediaPipe graph running on mobile GPUs for Sobel edge detection.
  • Building a simple baseline Android application that displays "Hello World!".
  • Adding camera preview support into the baseline application using the Android CameraX API.
  • Incorporating the Sobel edge detection graph to process the live camera preview and display the processed video in real-time.

Hello World! on iOS

This is the iOS version of Sobel edge detection example.

Face Detection

Face Mesh

Hand

Hair Segmentation

Object Detection

Box Tracking

Objectron: 3D Object Detection

KNIFT: Template-based Feature Matching

Desktop

Hello World for C++

This shows how to run a simple graph using the MediaPipe C++ APIs.

Face Detection

Face Mesh

Hand

Hair Segmentation

Object Detection

Box Tracking

AutoFlip - Semantic-aware Video Cropping

Preparing Data Sets with MediaSequence

This shows how to use MediaPipe for media processing to prepare video data sets for training a TensorFlow model.

Feature Extraction and Model Inference for YouTube-8M Challenge

This shows how to use MediaPipe to prepare training data for the YouTube-8M Challenge and do the model inference with the baseline model.

Google Coral (ML acceleration with Google EdgeTPU)

Face Detection

Object Detection

Web Browser

See more details here and Google Developer blog post.

Face Detection in Browser

Hand Detection in Browser

Hand Tracking in Browser

Hair Segmentation in Browser