ux-mediapipe

Rust and mediapipe.

Mediapipe is a framework for building AI-powered computer vision and augmented reality applications. It provides high level libraries exposing some of its solutions for common problems. This package makes some of these solutions available in Rust. In order to use it we must build a custom mediapipe C++ library.

requirements

• bazel

setup

Clone the modified Mediapipe repo:

git clone https://github.com/julesyoungberg/mediapipe.git
cd mediapipe

Build & install the mediagraph library.

mac os

bazel build --define MEDIAPIPE_DISABLE_GPU=1 mediapipe:libmediagraph.dylib
sudo cp bazel-bin/mediapipe/libmediagraph.dylib /usr/local/lib/libmediagraph.dylib
cp mediapipe/mediagraph.h /usr/local/include/mediagraph.h

linux (untested)

bazel build --define MEDIAPIPE_DISABLE_GPU=1 mediapipe:mediagraph
cp bazel-bin/mediapipe/libmediagraph.so /usr/local/lib/libmediagraph.so
cp mediapipe/mediagraph.h /usr/local/include/mediagraph.h

examples

Examples are located in the ./examples directory. Run them with

cargo run --release --example hello

usage

Add the following to your dependencies list in Cargo.toml:

ux-mediapipe = { git = "https://github.com/julesyoungberg/ux-mediapipe" }

Mediapipe relies on tflite files which must be available at ./mediapipe/modules/. The easiest way to do this is

mkdir mediapipe
cp -R ../mediapipe/mediapipe/modules ./mediapipe/modules

The path to mediapipe may be different depending on where you've cloned it.

Also this copies all of mediapipe's tflite files rather than only the few needed.