Commit Graph

1494 Commits

Author SHA1 Message Date
MediaPipe Team
190be2e1bd Internal change
PiperOrigin-RevId: 521911790
2023-04-04 17:44:29 -07:00
MediaPipe Team
f8b2aa0633 Internal change
PiperOrigin-RevId: 521909998
2023-04-04 17:35:57 -07:00
MediaPipe Team
9554836145 Update java image segmenter to always output confidence masks and optionally output category mask.
PiperOrigin-RevId: 521852718
2023-04-04 13:39:33 -07:00
MediaPipe Team
55bcfcb4f5 Internal change
PiperOrigin-RevId: 521834742
2023-04-04 12:30:54 -07:00
Sebastian Schmidt
a98f6bf231 FaceDetector Web API
PiperOrigin-RevId: 521816795
2023-04-04 11:23:00 -07:00
MediaPipe Team
33cad24a5a Update java image segmenter to always output confidence masks and optionally output category mask.
PiperOrigin-RevId: 521804641
2023-04-04 10:41:59 -07:00
Copybara-Service
7c2930102d Merge pull request #4192 from kinaryml:face-stylizer-python
PiperOrigin-RevId: 521781683
2023-04-04 09:18:19 -07:00
MediaPipe Team
65a98be809 Fixed comment and added note.
PiperOrigin-RevId: 521772542
2023-04-04 08:40:04 -07:00
MediaPipe Team
ec1d84aff7 Internal change
PiperOrigin-RevId: 521718577
2023-04-04 03:59:47 -07:00
MediaPipe Team
e95f465d58 Internal change
PiperOrigin-RevId: 521716263
2023-04-04 03:44:56 -07:00
MediaPipe Team
53fa35e40c Add FrameBuffer view on ImageFrame.
PiperOrigin-RevId: 521689386
2023-04-04 01:19:07 -07:00
MediaPipe Team
367ccbfdf3 update ImageSegmenterGraph to always output confidence mask and optionally output category mask
PiperOrigin-RevId: 521679910
2023-04-04 00:25:22 -07:00
MediaPipe Team
7c7eb74ef2 Internal change
PiperOrigin-RevId: 521586389
2023-04-03 16:00:24 -07:00
jqtang
3c05df9c46 Merge pull request #4235 from priankakariatyml:ios-object-detection-containers
PiperOrigin-RevId: 521553151
2023-04-03 15:12:06 -07:00
Sebastian Schmidt
e84799ee37 Internal change
PiperOrigin-RevId: 521483663
2023-04-03 09:45:42 -07:00
Prianka Liz Kariat
048cc51e13 Added new line 2023-04-03 20:15:35 +05:30
Prianka Liz Kariat
1ab9b138ef Added MPPObjectDetectorOptions 2023-04-03 20:14:41 +05:30
Prianka Liz Kariat
67fcf9196e Added MPPObjectDetectionResult 2023-04-03 20:14:26 +05:30
Prianka Liz Kariat
4943029d62 Added MPPDetectionHelpers 2023-04-03 20:11:44 +05:30
Prianka Liz Kariat
9421249de1 Added MPPDetection 2023-04-03 20:07:45 +05:30
MediaPipe Team
cfe91f3c8c Internal change
PiperOrigin-RevId: 521424672
2023-04-03 04:46:59 -07:00
MediaPipe Team
4a490cd27c This CL fixes the multiple typos in the new task api solution
PiperOrigin-RevId: 521407588
2023-04-03 03:05:29 -07:00
MediaPipe Team
b5bbed8ebb Internal change
PiperOrigin-RevId: 521406957
2023-04-03 03:01:23 -07:00
MediaPipe Team
696bedcaa1 Internal change
PiperOrigin-RevId: 521327449
2023-04-02 17:43:47 -07:00
MediaPipe Team
1fa9b2c985 Internal change
PiperOrigin-RevId: 521279971
2023-04-02 08:32:09 -07:00
MediaPipe Team
50a49fd16c Internal change
PiperOrigin-RevId: 521226781
2023-04-01 22:29:07 -07:00
MediaPipe Team
d9f940f8b2 Model Maker object detector change learning_rate_boundaries to learning_rate_epoch_boundaries.
PiperOrigin-RevId: 521024056
2023-03-31 15:19:26 -07:00
MediaPipe Team
1ff80f906c draw mouth to shoulder line after connection, to align with python viz code
PiperOrigin-RevId: 520935390
2023-03-31 09:05:10 -07:00
MediaPipe Team
4dcb9a2201 Internal change
PiperOrigin-RevId: 520875109
2023-03-31 03:06:43 -07:00
MediaPipe Team
5fe4e1ad0e Internal change
PiperOrigin-RevId: 520861522
2023-03-31 01:39:07 -07:00
Alan Kelly
6a6786673e Do not explicitly set XNNPACK delegate flags.
XNNPACK is now enabled by default for all types so the behaviour remains identical.

PiperOrigin-RevId: 520855384
2023-03-31 00:59:29 -07:00
MediaPipe Team
88d68341de Migrate face stylizer model files to GCS to use downloadable models in model maker.
PiperOrigin-RevId: 520848629
2023-03-31 00:11:51 -07:00
MediaPipe Team
4ce87866da Add landmarks smoothing filter when requested face num is 1.
PiperOrigin-RevId: 520825046
2023-03-30 21:30:24 -07:00
MediaPipe Team
ea9083c89d visualize blaze pose for controlnet
PiperOrigin-RevId: 520823020
2023-03-30 21:20:06 -07:00
Sebastian Schmidt
145fc1ed38 Don't overwrite detection options if not specified in setOptions()
PiperOrigin-RevId: 520790479
2023-03-30 17:56:05 -07:00
Jiuqiang Tang
508c72ddc9 Internal changes
PiperOrigin-RevId: 520775988
2023-03-30 16:45:34 -07:00
MediaPipe Team
1eeb89e95f Add the model configuration and training hyperparameters for BlazeFaceStylizer.
PiperOrigin-RevId: 520767282
2023-03-30 16:07:11 -07:00
MediaPipe Team
f8f7126bdd Internal change
PiperOrigin-RevId: 520726897
2023-03-30 13:27:19 -07:00
MediaPipe Team
d43579fe3e Internal change
PiperOrigin-RevId: 520717805
2023-03-30 12:56:44 -07:00
MediaPipe Team
99ba7dd787 Rewrite audio buffer conversion in Eigen primitives
PiperOrigin-RevId: 520717550
2023-03-30 12:52:22 -07:00
Jiuqiang Tang
984073bf73 Fix the "'<>' with anonymous inner classes is not supported" error.
PiperOrigin-RevId: 520705926
2023-03-30 12:05:08 -07:00
MediaPipe Team
d7fd5b0cf5 Fix incorrect rotation handling in C++ vision tasks
PiperOrigin-RevId: 520670536
2023-03-30 10:05:25 -07:00
MediaPipe Team
0e951b8add Internal change
PiperOrigin-RevId: 520636929
2023-03-30 07:48:07 -07:00
MediaPipe Team
15d81576aa Change getLabels method to public
PiperOrigin-RevId: 520537239
2023-03-29 22:12:52 -07:00
Sebastian Schmidt
f9eb3defa0 Internal change
PiperOrigin-RevId: 520523622
2023-03-29 21:04:07 -07:00
Sebastian Schmidt
ac52859f1d Gracefully fail resource path lookup for Python on Windows
PiperOrigin-RevId: 520513921
2023-03-29 20:14:29 -07:00
Sebastian Schmidt
ee1807d8e3 Don't use Bazel runfiles on for Python on Windows
PiperOrigin-RevId: 520504539
2023-03-29 19:10:07 -07:00
Sebastian Schmidt
eaa708a18d Enable TextClassifier and TextEmbedder on Windows Python
PiperOrigin-RevId: 520498308
2023-03-29 18:26:53 -07:00
Sebastian Schmidt
df67b35348 Internal change
PiperOrigin-RevId: 520486540
2023-03-29 17:27:16 -07:00
Sebastian Schmidt
6be4aedcf7 Use mediapipe_proto_library for all MediaPipe Protos
PiperOrigin-RevId: 520451054
2023-03-29 15:00:59 -07:00
MediaPipe Team
0c8f691a36 Internal changes
PiperOrigin-RevId: 520411557
2023-03-29 12:35:20 -07:00
MediaPipe Team
8e9207a7de Internal change
PiperOrigin-RevId: 520373147
2023-03-29 10:24:10 -07:00
Sebastian Schmidt
b3d999704f FaceStylizer Java API
PiperOrigin-RevId: 520344417
2023-03-29 08:37:50 -07:00
MediaPipe Team
316bd05e86 Internal change
PiperOrigin-RevId: 520263349
2023-03-29 01:35:04 -07:00
Sebastian Schmidt
dc132a5629 Don't use Bazel runfiles on for Python on Windows
PiperOrigin-RevId: 520174325
2023-03-28 17:04:16 -07:00
MediaPipe Team
9ee02481b1 Fix object detector pascal voc dataloader issue
PiperOrigin-RevId: 520160549
2023-03-28 16:06:44 -07:00
Jiuqiang Tang
1e77725a15 Add necessary java lite proto source code to mediapipe tasks aar for the face landmarker task.
PiperOrigin-RevId: 520143851
2023-03-28 15:01:50 -07:00
Sebastian Schmidt
62d86494b0 Allow users to pass canvas: undefined
PiperOrigin-RevId: 520142520
2023-03-28 14:56:19 -07:00
Jiuqiang Tang
bda2639376 Switch to use the isPresent() API since the isEmpty() is only available since java 11: https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/util/Optional.html#isEmpty().
PiperOrigin-RevId: 520099308
2023-03-28 12:20:55 -07:00
Sebastian Schmidt
5c295da6ff Return custom error if model download fails
PiperOrigin-RevId: 520066065
2023-03-28 10:30:03 -07:00
Jiuqiang Tang
d4ec485971 Add face landmarker and face geometry java lite proto source code into mediapipe tasks AAR.
PiperOrigin-RevId: 520049667
2023-03-28 09:29:45 -07:00
MediaPipe Team
b4e1f0236a Add EndLoopImageCalculator
PiperOrigin-RevId: 520033132
2023-03-28 08:20:56 -07:00
MediaPipe Team
0ea7b220f4 Add a function to convert CoreAudio buffers into a MediaPipe time series matrix
PiperOrigin-RevId: 519968274
2023-03-28 02:36:36 -07:00
MediaPipe Team
a18a62ef04 Make AnnotationOverlayCalculator compatible with GLES2/WebGL1 by using GL_RGB as internal format instead of GL_RGB8 for the texture that OpenCV renders into.
PiperOrigin-RevId: 519933934
2023-03-27 23:13:16 -07:00
Jiuqiang Tang
94db96fa5e Add MatrixDataProto.java to mediapipe aar.
PiperOrigin-RevId: 519925872
2023-03-27 22:22:17 -07:00
Sebastian Schmidt
105e7b7467 Add no-copy Image getter for JNIS
PiperOrigin-RevId: 519909198
2023-03-27 20:59:23 -07:00
Copybara-Service
59b3150fff Merge pull request #4194 from priankakariatyml:ios-image-classifier-tests
PiperOrigin-RevId: 519907148
2023-03-27 20:46:18 -07:00
MediaPipe Team
004265bbbd remove the check that data streams need to be > 0 since we have a use case of:
input_stream: "ALLOW:"
output_stream: "STATE_CHANGE"
PiperOrigin-RevId: 519891414
2023-03-27 19:14:24 -07:00
MediaPipe Team
5f8831660f Internal MediaPipe Tasks change.
PiperOrigin-RevId: 519878741
2023-03-27 17:55:28 -07:00
Jiuqiang Tang
c3b4fa5627 Expose face detector and face landmarker as public MediaPipe Tasks Python API.
PiperOrigin-RevId: 519822084
2023-03-27 14:03:21 -07:00
Sebastian Schmidt
7dd5f9b6c6 Add face_landmarker to vision types
PiperOrigin-RevId: 519815735
2023-03-27 13:39:51 -07:00
MediaPipe Team
1fdc82d7ec Internal change
PiperOrigin-RevId: 519805707
2023-03-27 13:02:37 -07:00
MediaPipe Team
7fdec2ecdf FaceLandmarker Java API
PiperOrigin-RevId: 519704560
2023-03-27 06:35:03 -07:00
MediaPipe Team
9f888435b7 Internal change
PiperOrigin-RevId: 519674123
2023-03-27 03:40:24 -07:00
MediaPipe Team
5ccf986513 This CL fixes the multiple typos in the new task api solution
PiperOrigin-RevId: 519634122
2023-03-26 23:57:38 -07:00
kinaryml
e364aeb359 Revised Interactive Segmenter API and added more tests 2023-03-25 00:44:30 -07:00
MediaPipe Team
97c271644a Open Source Object Detector
PiperOrigin-RevId: 519201221
2023-03-24 11:53:18 -07:00
Sebastian Schmidt
58a98bc7da Add FaceLandmarker Web API
PiperOrigin-RevId: 519198210
2023-03-24 11:41:24 -07:00
Jiuqiang Tang
d6256362ec Internal change
PiperOrigin-RevId: 519186057
2023-03-24 10:56:50 -07:00
Sebastian Schmidt
9f6b2cd577 Add convertFromClassifications() helper
PiperOrigin-RevId: 519181016
2023-03-24 10:39:17 -07:00
Sebastian Schmidt
cec878df2b Add Matrix output type
PiperOrigin-RevId: 519158476
2023-03-24 09:11:03 -07:00
MediaPipe Team
53e4e92505 Support single channel golden images.
PiperOrigin-RevId: 519158051
2023-03-24 09:06:41 -07:00
MediaPipe Team
c26965c842 Internal change
PiperOrigin-RevId: 519150182
2023-03-24 08:34:11 -07:00
MediaPipe Team
712ea6f15b Internal change
PiperOrigin-RevId: 519013105
2023-03-23 18:08:55 -07:00
Hadon Nash
8a55f11952 Internal change
PiperOrigin-RevId: 519010016
2023-03-23 17:51:26 -07:00
Sebastian Schmidt
6aab4e013d Typo Fix
PiperOrigin-RevId: 518994598
2023-03-23 16:35:23 -07:00
MediaPipe Team
27a5a6d433 Internal Changes
PiperOrigin-RevId: 518976200
2023-03-23 15:20:50 -07:00
MediaPipe Team
948e17f404 Internal change
PiperOrigin-RevId: 518906661
2023-03-23 10:57:43 -07:00
Sebastian Schmidt
8e5eadbd4e Add WebGLTexture output for ImageSegmenter
PiperOrigin-RevId: 518886135
2023-03-23 09:47:35 -07:00
Sebastian Schmidt
1c9e6894f3 Allow users to pass canvas element
PiperOrigin-RevId: 518870611
2023-03-23 08:46:21 -07:00
Prianka Liz Kariat
58adb69c44 Removed unwanted iOS tests 2023-03-23 20:16:30 +05:30
Prianka Liz Kariat
8682a3ffd9 Updated formatted 2023-03-23 19:58:03 +05:30
Prianka Liz Kariat
da8b60700b Added flow limiter calculator to iOS vision tasks 2023-03-23 19:53:35 +05:30
Prianka Liz Kariat
f51736e32d Added flow limiting for live stream mode in MPPImageClassifier 2023-03-23 19:52:14 +05:30
Prianka Liz Kariat
59e0b1ba74 Added stream info for some modes in MPPImageClassifier 2023-03-23 19:51:25 +05:30
Prianka Liz Kariat
aa760855ee Updated formatting 2023-03-23 19:48:50 +05:30
Prianka Liz Kariat
1685664bdb Fixed formatting 2023-03-23 19:45:53 +05:30
Prianka Liz Kariat
55483776ab Fixed Issue with Flow Limiter in MPPTaskInfo 2023-03-23 19:44:56 +05:30
Prianka Liz Kariat
d4b60a781e Added MPPImageClassifier Objective C Tests 2023-03-23 18:44:01 +05:30
Prianka Liz Kariat
48190e6600 Updated method signatures in MPPImage+TestUtils 2023-03-23 18:43:30 +05:30
Prianka Liz Kariat
8077743bfc Linked in Opencv ios framework with vision tasks. 2023-03-23 18:42:57 +05:30
Prianka Liz Kariat
1904632282 Fixed incorrect method call for image mode 2023-03-23 18:42:12 +05:30
Prianka Liz Kariat
960e7a6283 Fixed incorrect method call in MPPImageClassifier for Image Mode 2023-03-23 18:41:50 +05:30
Prianka Liz Kariat
1c4be91a3a Fixed stream names in MPPImageClassifier 2023-03-23 18:41:27 +05:30
Prianka Liz Kariat
ddce041725 Fixed incorrect stride value in MPPImageUtils 2023-03-23 18:40:53 +05:30
Prianka Liz Kariat
3227635ea0 Fixed bug in roi assignment 2023-03-23 18:40:15 +05:30
Prianka Liz Kariat
6e62c113fb Fixed iOS running mode display strings 2023-03-23 18:39:54 +05:30
MediaPipe Team
5998e96eed Internal change
PiperOrigin-RevId: 518814155
2023-03-23 03:35:43 -07:00
MediaPipe Team
58fa1e2ec3 Internal change
PiperOrigin-RevId: 518813508
2023-03-23 03:31:46 -07:00
kinaryml
6304756c93 Added Interactive Segmenter Python API and some tests 2023-03-23 02:00:18 -07:00
Prianka Liz Kariat
2e4e17d837 Added MPPImage Utils for tests 2023-03-23 13:13:03 +05:30
MediaPipe Team
eac6348fd3 Open-sources a LanguageDetector C++ API.
PiperOrigin-RevId: 518758730
2023-03-22 21:54:35 -07:00
kinaryml
29a4041353 Fixed a typo in docstring 2023-03-22 21:51:45 -07:00
kinaryml
ca18b95510 Updated BUILD 2023-03-22 21:50:40 -07:00
kinaryml
8cba65c229 Updated BUILD 2023-03-22 21:50:07 -07:00
kinaryml
613bcf99f4 Removed model 2023-03-22 21:49:11 -07:00
kinaryml
c0320b556c Removed unit tests 2023-03-22 21:47:38 -07:00
kinaryml
da70497f35 Updated Face Stylizer implementation and tests 2023-03-22 21:15:04 -07:00
Kinar R
3afe4cafc4
Merge branch 'master' into face-stylizer-python 2023-03-23 09:27:52 +05:30
Sebastian Schmidt
1a7be8a4c1 Internal change
PiperOrigin-RevId: 518747623
2023-03-22 20:44:34 -07:00
MediaPipe Team
37111e8fa5 Internal change
PiperOrigin-RevId: 518657355
2023-03-22 13:29:29 -07:00
Sebastian Schmidt
eda8cb6b42 Typo fix
PiperOrigin-RevId: 518603982
2023-03-22 10:20:06 -07:00
MediaPipe Team
cb2ee87705 Internal change
PiperOrigin-RevId: 518591192
2023-03-22 09:34:23 -07:00
Jiuqiang Tang
21e0ff3d4e Skip unnecessary cpu<->gpu conversion if the input and output are already on the same storage.
PiperOrigin-RevId: 518573284
2023-03-22 08:22:38 -07:00
MediaPipe Team
18b4caa7f3 Internal change
PiperOrigin-RevId: 518559368
2023-03-22 07:14:18 -07:00
Kinar R
3c39aca52b
Merge branch 'google:master' into audio-record-api-python 2023-03-22 11:46:28 +05:30
kinaryml
444cd00ee6 Moved audio_record.py to tasks/python/audio/core 2023-03-21 23:15:55 -07:00
Copybara-Service
5d2a719b54 Merge pull request #4027 from kinaryml:cosine-sim-python
PiperOrigin-RevId: 518431807
2023-03-21 17:59:48 -07:00
Sebastian Schmidt
788e8d8777 Fix crash when FaceLandmarker does not return a result
PiperOrigin-RevId: 518410060
2023-03-21 16:21:58 -07:00
Sebastian Schmidt
bbd21e9a6d Add the FaceStylizer Web API
PiperOrigin-RevId: 518409812
2023-03-21 16:17:28 -07:00
Jiuqiang Tang
b71e1d14d3 Add missing dependency library targets to mediapipe_task_aar.
PiperOrigin-RevId: 518384666
2023-03-21 14:38:11 -07:00
Sebastian Schmidt
8bbf2621a4 Typo fix
PiperOrigin-RevId: 518380030
2023-03-21 14:31:49 -07:00
Sebastian Schmidt
a5fc1d4baf Use Uint8ClampedArray for pixel output
PiperOrigin-RevId: 518362677
2023-03-21 13:22:10 -07:00
MediaPipe Team
7d26daf723 Make sure calling GraphTextureFrame::getTextureName()+::release() on a non-GL thread doesn't result in a crash.
PiperOrigin-RevId: 518359778
2023-03-21 13:12:03 -07:00
MediaPipe Team
88effb19e5 Add build variants for _gms to some MediaPipe libraries that use TFLite
This change alters some cc_library to cc_library_with_tflite to add _gms variants to some select MediaPipe libraries. This CL also makes minimal changes in the code to make the _gms variants buildable.

PiperOrigin-RevId: 518336242
2023-03-21 11:48:09 -07:00
Jiuqiang Tang
384f77b5c3 Fix the proto src file names.
PiperOrigin-RevId: 518332541
2023-03-21 11:34:39 -07:00
MediaPipe Team
c2a3e99545 Internal change
PiperOrigin-RevId: 518330697
2023-03-21 11:29:04 -07:00
MediaPipe Team
2be66e8eb0 Add interactive segmenter java API
PiperOrigin-RevId: 518303391
2023-03-21 09:59:19 -07:00
Copybara-Service
6e0542c16a Merge pull request #4141 from priankakariatyml:ios-image-classifier-impl-files
PiperOrigin-RevId: 518138209
2023-03-20 19:05:37 -07:00
Jiuqiang Tang
5a924669b7 Temporarily disabling checking whether the executor is not set in a subgraph node. This is a workaround to allow the MediaPipe InferenceCalculator to have its own executor.
PiperOrigin-RevId: 518117759
2023-03-20 17:10:55 -07:00
Sebastian Schmidt
2651d30ebf Add ImageData output to GraphRunner
PiperOrigin-RevId: 517994561
2023-03-20 09:46:27 -07:00
Copybara-Service
54e4dfc853 Merge pull request #4177 from kinaryml:face-landmarker-python
PiperOrigin-RevId: 517979421
2023-03-20 08:47:47 -07:00
MediaPipe Team
47fa1a9578 Internal change
PiperOrigin-RevId: 517886450
2023-03-20 00:25:47 -07:00
MediaPipe Team
524acaaaa7 internal change
PiperOrigin-RevId: 517823184
2023-03-19 16:07:32 -07:00
Jiuqiang Tang
f06e4224b8 Allow ModelResourcesCalculator to use file_pointer_meta.
PiperOrigin-RevId: 517742722
2023-03-19 01:33:52 -07:00
Jiuqiang Tang
6634d22161 Add LabelMapProto.java source code to MediaPipe AAR.
PiperOrigin-RevId: 517563190
2023-03-17 19:49:53 -07:00
Jiuqiang Tang
6785bcc47d Add java_package and java_outer_classname to label_map.proto.
PiperOrigin-RevId: 517563000
2023-03-17 19:45:45 -07:00
Jiuqiang Tang
065f1f38aa Fix the vision tasks aar build rule to solve the "cannot find symbol" error:
```
mediapipe/tasks/java/com/google/mediapipe/tasks/vision/imagesegmenter/ImageSegmenter.java:28: error: cannot find symbol
import com.google.mediapipe.tasks.TensorsToSegmentationCalculatorOptionsProto;
```

PiperOrigin-RevId: 517542284
2023-03-17 17:02:22 -07:00
Jiuqiang Tang
0805d61bfe Add the source code TensorsToSegmentationCalculatorOptionsProto.java into tasks core's maven package.
PiperOrigin-RevId: 517516701
2023-03-17 15:01:33 -07:00
MediaPipe Team
3dede1a9a5 Add label_map filtering into filter_detection drishti calculator.
PiperOrigin-RevId: 517515046
2023-03-17 14:53:48 -07:00