|
||
---|---|---|
.. | ||
audio_classifier | ||
audio_embedder | ||
core | ||
BUILD | ||
index.ts | ||
README.md | ||
types.ts |
MediaPipe Tasks Vision Package
This package contains the audio tasks for MediaPipe.
Audio Classifier
The MediaPipe Audio Classifier task performs classification on audio data.
const audio = await FilesetResolver.forAudioTasks(
"https://cdn.jsdelivr.net/npm/@mediapipe/tasks-audio/wasm"
);
const audioClassifier = await AudioClassifier.createFromModelPath(audio,
"https://storage.googleapis.com/mediapipe-models/audio_classifier/yamnet/float32/1/yamnet.tflite
);
const classifications = audioClassifier.classify(audioData);
For more information, refer to the Audio Classifier documentation.
Audio Embedding
The MediaPipe Audio Embedding task extracts embeddings from audio data.
const audio = await FilesetResolver.forAudioTasks(
"https://cdn.jsdelivr.net/npm/@mediapipe/tasks-audio/wasm"
);
const audioEmbedder = await AudioEmbedder.createFromModelPath(audio,
"https://storage.googleapis.com/mediapipe-assets/yamnet_embedding_metadata.tflite?generation=1668295071595506"
);
const embeddings = audioEmbedder.embed(audioData);