Commit Graph

337 Commits

Author SHA1 Message Date
kinaryml
d327b3649d Fixed some typos in methods and comments 2022-11-08 23:47:58 -08:00
kinaryml
dd6fdedd5f Added some sanity tests 2022-11-08 23:15:58 -08:00
Kinar R
36c50ff8f3
Merge branch 'google:master' into image-embedder-python 2022-11-09 12:41:55 +05:30
kinaryml
7e251bc6b6 Merge branch 'hand-landmarker-python' of https://github.com/kinaryml/mediapipe into hand-landmarker-python 2022-11-08 23:07:30 -08:00
Kinar R
812fa2cc70
Merge branch 'google:master' into hand-landmarker-python 2022-11-09 12:37:06 +05:30
kinaryml
46f135e54d Renamed HandLandmarksDetectionResult to HandLandmarkerResult 2022-11-08 23:06:28 -08:00
MediaPipe Team
b4e1833dd0 Internal change
PiperOrigin-RevId: 487125366
2022-11-08 20:35:46 -08:00
Sebastian Schmidt
669d539551 NPM package definitions for MediaPipe Tasks
PiperOrigin-RevId: 487071334
2022-11-08 15:46:05 -08:00
Lu Wang
253ff0f85c Update the Java doc for model asset for BaseOptions
PiperOrigin-RevId: 487059371
2022-11-08 14:57:27 -08:00
MediaPipe Team
b3d19fa1af Use model bundle writer when exporting models in gesture recognizer
PiperOrigin-RevId: 487042776
2022-11-08 13:52:08 -08:00
MediaPipe Team
0363d60511 Open-sources TextEmbedder.
PiperOrigin-RevId: 487041832
2022-11-08 13:48:49 -08:00
Kinar R
37930609ff
Update landmark_detection_result.py 2022-11-09 02:58:38 +05:30
kinaryml
96e2eb38c7 Merge branch 'hand-landmarker-python' of https://github.com/kinaryml/mediapipe into hand-landmarker-python 2022-11-08 11:27:13 -08:00
kinaryml
77cc4c53ab Updated the 'test_create_from_options_fails_with_invalid_model_path' test case 2022-11-08 11:26:02 -08:00
Kinar R
6dd6d8921f
Merge branch 'google:master' into hand-landmarker-python 2022-11-09 00:52:20 +05:30
MediaPipe Team
7a1e55b872 Adds unit tests for TextEmbedder.
PiperOrigin-RevId: 486997035
2022-11-08 11:01:04 -08:00
kinaryml
72f08c6878 Used loops instead of list comprehension 2022-11-08 10:57:12 -08:00
kinaryml
647b94240d Updated docstring 2022-11-08 10:54:44 -08:00
Jiuqiang Tang
ff6ca706c6 Internal change
PiperOrigin-RevId: 486994334
2022-11-08 10:52:51 -08:00
kinaryml
88ab9d4922 Used loops instead of complex list comprehensions 2022-11-08 10:52:26 -08:00
kinaryml
c0265ca2ac Fixed some typos 2022-11-08 10:44:21 -08:00
kinaryml
e8d771baf3 Updated landmark_detection_result 2022-11-08 10:37:37 -08:00
Jiuqiang Tang
5c8b95666a Update "test_create_from_options_fails_with_invalid_model_path" of all tasks python api tests.
PiperOrigin-RevId: 486990017
2022-11-08 10:36:24 -08:00
kinaryml
0fd78c2ec6 Updated classifier python tasks to use the new classification_result dataclass 2022-11-08 10:28:24 -08:00
MediaPipe Team
5e6842aa5c Migrate Java ImageClassifier / TextClassifier to new result format.
PiperOrigin-RevId: 486976459
2022-11-08 09:47:42 -08:00
Sebastian Schmidt
26066787b3 Allow Web developers to opt into CPU or GPU processing
PiperOrigin-RevId: 486935157
2022-11-08 06:37:38 -08:00
kinaryml
9c9519eeb8 Fixed a to_pb2() bug in the landmark_detection_result container 2022-11-08 02:55:19 -08:00
kinaryml
0402ee383f Added hand landmarker Python API and tests 2022-11-08 01:05:36 -08:00
Yuqi Li
0a08e4768b Metadata Writer: Add metadata writer for Text Classifier.
PiperOrigin-RevId: 486844428
2022-11-07 21:25:44 -08:00
MediaPipe Team
1049ef781d Add image_segmenter namespace and update image segmenter proto for java package.
PiperOrigin-RevId: 486792164
2022-11-07 16:24:16 -08:00
MediaPipe Team
6f38a7a21f Add hand landmarker C++ api.
PiperOrigin-RevId: 486791711
2022-11-07 16:17:42 -08:00
Kinar R
83608d4670
Merge branch 'master' into image-embedder-python 2022-11-08 05:02:46 +05:30
Jiuqiang Tang
571c0b1fef Expose MediaPipe Tasks Audio and Text APIs in MediaPipe PyPI packages.
PiperOrigin-RevId: 486777537
2022-11-07 15:17:57 -08:00
Jiuqiang Tang
63a759accc Implement MediaPipe AudioClassifier Tasks Python API. Adjust the AudioClassifier Tasks C++ API to remove "sample_rate" from its options.
PiperOrigin-RevId: 486763992
2022-11-07 14:28:14 -08:00
Sebastian Schmidt
e994efd40f Add entry points for NPM packages
PiperOrigin-RevId: 486760105
2022-11-07 14:16:29 -08:00
kinaryml
664d9c49e7 Revised image embedder implementation 2022-11-07 13:59:07 -08:00
Kinar R
ba1ee5b404
Merge branch 'master' into image-embedder-python 2022-11-08 02:53:20 +05:30
Sebastian Schmidt
2371051e17 Open Source the remaining Web implementation files
PiperOrigin-RevId: 486701932
2022-11-07 10:34:44 -08:00
Jiuqiang Tang
9f4496db77 Fix typos
PiperOrigin-RevId: 486698923
2022-11-07 10:24:17 -08:00
Jiuqiang Tang
17a2de8cf7 Rename TextClassificationResult to TextClassifierResult.
PiperOrigin-RevId: 486685936
2022-11-07 09:39:01 -08:00
Copybara-Service
4c06303ec7 Merge pull request #3820 from kinaryml:text-classifier-python
PiperOrigin-RevId: 486566800
2022-11-06 22:15:09 -08:00
Jiuqiang Tang
9504c5e6a1 Add a create_from_array classmethod to the AudioData class.
PiperOrigin-RevId: 486310154
2022-11-05 00:09:30 -07:00
kinaryml
b44c49250b Removed unused constant 2022-11-04 22:36:13 -07:00
Kinar R
740d2e47b5
Merge branch 'google:master' into text-classifier-python 2022-11-05 11:03:24 +05:30
Jiuqiang Tang
416f91180b Remove the use of designated initializers.
PiperOrigin-RevId: 486261384
2022-11-04 16:57:21 -07:00
Jiuqiang Tang
c10ebe8476 Remove the use of designated initializers.
PiperOrigin-RevId: 486215798
2022-11-04 13:24:48 -07:00
Kinar R
b1d1ef0124
Merge branch 'google:master' into image-embedder-python 2022-11-05 00:17:26 +05:30
MediaPipe Team
5e1a2fcdbb Update EmbeddingResult format and dependent tasks.
PiperOrigin-RevId: 486186491
2022-11-04 11:20:07 -07:00
Jiuqiang Tang
66e591d4bc Remove the use of designated initializers.
PiperOrigin-RevId: 486185274
2022-11-04 11:15:20 -07:00
Sebastian Schmidt
f05868d8e0 Set up the Open Source build for MediaPipe Tasks Web
PiperOrigin-RevId: 486181061
2022-11-04 10:59:32 -07:00
Jiuqiang Tang
5fd3701cfd Expose ImageSegmenter and GestureRecognizer APIs in PyPI packages.
PiperOrigin-RevId: 486176206
2022-11-04 10:39:21 -07:00
MediaPipe Team
8b2c937b9e Migrate AudioClassifier C++ to use new ClassificationResult struct.
PiperOrigin-RevId: 486162683
2022-11-04 09:46:09 -07:00
MediaPipe Team
62cd67e996 Internal change
PiperOrigin-RevId: 486148328
2022-11-04 08:42:39 -07:00
Jiuqiang Tang
5f5f50d8f7 Implement MediaPipe Tasks Python AudioData.
PiperOrigin-RevId: 486147173
2022-11-04 08:32:30 -07:00
Copybara-Service
5024c815f1 Merge pull request #3813 from kinaryml:image-segmenter-minor-fixes
PiperOrigin-RevId: 486051659
2022-11-03 21:41:37 -07:00
kinaryml
e2d50745ac Revised image embedder implementation 2022-11-03 14:30:21 -07:00
MediaPipe Team
d29c3d7512 Add metadata writer to image_classifier in model_maker
PiperOrigin-RevId: 485926985
2022-11-03 11:30:38 -07:00
kinaryml
492607152a Reverted changes to rect 2022-11-03 10:56:38 -07:00
Kinar R
5a68ba84b6
Merge branch 'master' into image-embedder-python 2022-11-03 23:24:31 +05:30
Jiuqiang Tang
b472d8ff66 Add the missing __init__.py file.
PiperOrigin-RevId: 485892501
2022-11-03 09:24:12 -07:00
Copybara-Service
716e59f90c Merge pull request #3801 from kinaryml:gesture-recognizer-python
PiperOrigin-RevId: 485884796
2022-11-03 08:52:17 -07:00
kinaryml
14e18a03d6 Removed unused custom classifier options in tests 2022-11-03 02:54:57 -07:00
kinaryml
de619e2702 Removed a comment 2022-11-03 02:33:50 -07:00
kinaryml
2001e2b77c Removed unused file 2022-11-03 02:32:55 -07:00
kinaryml
6e9a070dd1 Added text classifier implementation and tests 2022-11-03 02:29:40 -07:00
kinaryml
35a04522fa Moved the OutputType and Activation classes to ImageSegmenter's inner classes 2022-11-03 00:46:00 -07:00
MediaPipe Team
ddf37d014e Fix test utils bug when two file names have same ending.
PiperOrigin-RevId: 485780917
2022-11-02 22:33:36 -07:00
Jiuqiang Tang
01d87f0867 Expose MediaPipe Tasks in MediaPipe PyPI packages.
PiperOrigin-RevId: 485690163
2022-11-02 14:07:47 -07:00
MediaPipe Team
d61ab92b90 Add classification result structs and use then in ImageClassifier & TextClassifier.
PiperOrigin-RevId: 485567133
2022-11-02 05:13:12 -07:00
MediaPipe Team
aab5f84aae Internal change
PiperOrigin-RevId: 485553891
2022-11-02 03:49:48 -07:00
MediaPipe Team
475e6b4fd5 Modify ClassificationAggregationCalculator to output new unified formats.
PiperOrigin-RevId: 485546547
2022-11-02 03:11:20 -07:00
MediaPipe Team
ecd93ff080 Internal changes
PiperOrigin-RevId: 485445138
2022-11-01 16:18:06 -07:00
Kinar R
3a2f30185f
Merge branch 'master' into gesture-recognizer-python 2022-11-02 04:11:18 +05:30
kinaryml
c5765ac836 Refactored Rect to use top-left coordinates and appropriately updated the Image Classifier and Gesture Recognizer APIs/tests 2022-11-01 15:37:00 -07:00
Yuqi Li
e719f7b4e2 Model Maker Gesture Recognizer: add metadata writer and create model bundle.
PiperOrigin-RevId: 485426865
2022-11-01 15:02:45 -07:00
Copybara-Service
6e0397b226 Merge pull request #3800 from kinaryml:python-test-proto-equals
PiperOrigin-RevId: 485340924
2022-11-01 09:42:19 -07:00
Jiuqiang Tang
e4899c8207 MediaPipe Python audio base layer.
PiperOrigin-RevId: 485329470
2022-11-01 08:53:36 -07:00
kinaryml
a913255080 Removed min score thres from tests 2022-10-31 23:07:05 -07:00
kinaryml
d3b472e888 Add allow_list/deny_list support 2022-10-31 22:16:37 -07:00
Kinar R
1aaaca1e12
Merge branch 'google:master' into gesture-recognizer-python 2022-11-01 08:16:43 +05:30
Jiuqiang Tang
86951e048d Remove the unused TaskRunner from the mediapipe tasks python code.
PiperOrigin-RevId: 485181210
2022-10-31 16:54:30 -07:00
MediaPipe Team
9f8b5e5c11 Add allow_list/deny_list to gesture recognizer options.
PiperOrigin-RevId: 485141209
2022-10-31 13:57:06 -07:00
kinaryml
2b5a077579 Updated comments 2022-10-31 05:48:45 -07:00
kinaryml
d635b4281e Added a test for the canned classification of the gesture victory 2022-10-31 05:47:28 -07:00
kinaryml
888ddd4b74 Removed unused classifier options proto 2022-10-31 05:37:24 -07:00
kinaryml
19be9e9012 Revised gesture recognizer implementation 2022-10-31 05:34:31 -07:00
Kinar R
5ec87c8bd2
Merge branch 'master' into gesture-recognizer-python 2022-10-31 16:47:43 +05:30
Copybara-Service
7bcf322625 Merge pull request #3739 from kinaryml:image-segmenter-python-impl
PiperOrigin-RevId: 484922757
2022-10-30 17:11:42 -07:00
kinaryml
fb4872b068 Refactored code and removed some issues 2022-10-30 15:42:26 -07:00
MediaPipe Team
be13a76928 Integrate canned and custom gesture classifier.
PiperOrigin-RevId: 484914164
2022-10-30 15:36:09 -07:00
kinaryml
4b66599419 Updated docstring in gesture_recognizer 2022-10-30 09:10:15 -07:00
kinaryml
f62cfd1690 Removed classification proto to use the existing category dataclass instead and removed NormalizedLandmarkList and LandmarkList dataclasses 2022-10-30 08:23:14 -07:00
Kinar R
334f641463
Merge branch 'master' into image-segmenter-python-impl 2022-10-28 22:50:33 +05:30
Kinar R
0f7c5d5e90
Merge branch 'google:master' into gesture-recognizer-python 2022-10-28 14:08:52 +05:30
kinaryml
b81b5a9035 Added a test for min_gesture_confidence 2022-10-28 01:38:15 -07:00
MediaPipe Team
fc1d75cc99 Add CombinedPredictionCalculator.
PiperOrigin-RevId: 484301880
2022-10-27 11:16:12 -07:00
kinaryml
8194513934 Updated docstrings and removed the redundant private helper method 2022-10-26 23:56:54 -07:00
Jiuqiang Tang
a941c5cdd1 Create MediaPipe "tasks-text" AAR.
PiperOrigin-RevId: 484004494
2022-10-26 10:18:22 -07:00
MediaPipe Team
254f786624 Add an option to set image preprocessing backend as gpu.
PiperOrigin-RevId: 483888202
2022-10-26 00:46:19 -07:00
kinaryml
f8a98ccba4 Added a test utility method to compare protos directly 2022-10-25 23:38:32 -07:00
kinaryml
fbf7ba6f1a Reverted some changes to rect 2022-10-25 23:15:16 -07:00
kinaryml
75af46d273 Revised API to align with recent changes 2022-10-25 23:13:12 -07:00
Kinar R
0de97497fa
Merge branch 'master' into gesture-recognizer-python 2022-10-26 11:37:12 +05:30
Copybara-Service
ae5b09e2b2 Merge pull request #3738 from kinaryml:image-classification-python-impl
PiperOrigin-RevId: 483818404
2022-10-25 17:26:32 -07:00
MediaPipe Team
21abfc9125 Update gpu origin.
PiperOrigin-RevId: 483742652
2022-10-25 12:14:28 -07:00
kinaryml
8762d15c81 Added remaining tests for the GestureRecognizer Python MediaPipe Tasks API 2022-10-25 11:11:15 -07:00
kinaryml
18eb089d39 Added a simple test to verify gesture recognition results 2022-10-25 07:38:04 -07:00
MediaPipe Team
94cd134809 Add support for image rotation in Java vision tasks.
PiperOrigin-RevId: 483493729
2022-10-24 15:01:23 -07:00
Jiuqiang Tang
2cf9523468 Fix the java_package name.
PiperOrigin-RevId: 483428848
2022-10-24 10:55:16 -07:00
MediaPipe Team
2f2baeff68 Add support for rotation in ImageEmbedder & ImageSegmenter C++ APIs
PiperOrigin-RevId: 483416498
2022-10-24 10:14:05 -07:00
MediaPipe Team
0fd69e8d83 Open-source some tokenizer unit tests.
PiperOrigin-RevId: 483399326
2022-10-24 09:12:52 -07:00
kinaryml
9a1a9d4c13 Added files needed for the GestureRecognizer API implementation 2022-10-24 06:08:27 -07:00
Jiuqiang Tang
de93d06f87 Implement build rules and targets to create MediaPipe Tasks AARs
PiperOrigin-RevId: 483297891
2022-10-24 00:45:32 -07:00
Yuqi Li
ab17be9294 Metadata Writer: Add Metadata Writer for image classifier.
PiperOrigin-RevId: 483282627
2022-10-23 23:05:32 -07:00
MediaPipe Team
ec2a34d2a4 Replace pytype_struct_contrib_test by py_strict_test. Also remove unnecessary BUILD attributes.
PiperOrigin-RevId: 483237371
2022-10-23 16:45:02 -07:00
kinaryml
ebb2686fb4 Moved OutputType and Activation to image_segmenter 2022-10-22 03:34:26 -07:00
MediaPipe Team
d8006a2f87 Use model bundle for gesture recognizer.
PiperOrigin-RevId: 482960305
2022-10-21 21:54:34 -07:00
MediaPipe Team
404323f631 Add Mediapipe Tasks Gesture Recognizer benchmarks
PiperOrigin-RevId: 482935780
2022-10-21 18:33:49 -07:00
Jiuqiang Tang
abed54ea30 Rename the mediapipe java image container from Image to MPImage.
PiperOrigin-RevId: 482933122
2022-10-21 18:17:35 -07:00
MediaPipe Team
7196db275e Internal change
PiperOrigin-RevId: 482925717
2022-10-21 17:28:49 -07:00
MediaPipe Team
ea1d85d811 Update model_task_graph to support multiple local model resources.
PiperOrigin-RevId: 482917453
2022-10-21 16:42:58 -07:00
MediaPipe Team
4a6c23a76a Internal change
PiperOrigin-RevId: 482906478
2022-10-21 15:48:54 -07:00
kinaryml
024a6866a7 Removed some unneeded aliases 2022-10-21 13:39:59 -07:00
Kinar R
1748663a5a
Merge branch 'google:master' into image-segmenter-python-impl 2022-10-22 02:04:57 +05:30
kinaryml
5231a0ad9f Removed SegmenterOptions dataclasses to enumerate options within ImageSegmenterOptions instead 2022-10-21 13:34:30 -07:00
Sebastian Schmidt
55a536e55e Typo fix in Landmark
PiperOrigin-RevId: 482854764
2022-10-21 12:13:12 -07:00
Sebastian Schmidt
fe77c5489f Fix comments in GestureRecognizer
PiperOrigin-RevId: 482854253
2022-10-21 12:09:36 -07:00
Jiuqiang Tang
ed938a9214 Replace the usage of InvalidProtocolBufferException with IOException.
PiperOrigin-RevId: 482844446
2022-10-21 11:30:28 -07:00
MediaPipe Team
4b5df1cb96 Add support for rotations in GestureRecognizer C++ API.
PiperOrigin-RevId: 482533599
2022-10-20 10:42:42 -07:00
kinaryml
71d5b69544 Added files for the image embedder implementation and a simple test 2022-10-20 02:29:14 -07:00
MediaPipe Team
467cd34feb Internal change
PiperOrigin-RevId: 482401089
2022-10-19 23:49:51 -07:00
MediaPipe Team
41d6f6d005 Adds a Java API for TextClassifier.
PiperOrigin-RevId: 482394706
2022-10-19 23:05:34 -07:00
MediaPipe Team
c260074abb Rename "Bound" struct to "Rect" and remove unused "Landmark" struct.
PiperOrigin-RevId: 482255889
2022-10-19 11:22:56 -07:00
MediaPipe Team
70df9e2419 Open-source the TextClassifier C++ API.
PiperOrigin-RevId: 482218721
2022-10-19 09:03:29 -07:00
MediaPipe Team
cfd5a20618 Open-sources the TextPreprocessingSubgraph.
PiperOrigin-RevId: 482048438
2022-10-18 16:14:33 -07:00
Yuqi Li
bc47589c9b Add model bundle in hand landmark task.
PiperOrigin-RevId: 481960266
2022-10-18 10:38:43 -07:00
kinaryml
91b60da1dc Updated name for a test case 2022-10-18 05:35:05 -07:00
kinaryml
f166eb32e8 Updated names of test case methods 2022-10-18 04:34:17 -07:00
kinaryml
69f4daf9bc Removed unused BUILD 2022-10-18 04:31:35 -07:00
kinaryml
f84e0bc1c6 Revised API implementation and added more tests for segment_for_video and segment_async 2022-10-18 04:24:12 -07:00
Kinar R
36ac0689d7
Merge branch 'google:master' into image-segmenter-python-impl 2022-10-18 15:13:44 +05:30
MediaPipe Team
ba93bab286 Fix ObjectDetector C++ flow limiter and improve documentation.
PiperOrigin-RevId: 481774191
2022-10-17 16:57:38 -07:00
Yuqi Li
660f1812c2 Internal change
PiperOrigin-RevId: 481515490
2022-10-16 17:23:01 -07:00
Jiuqiang Tang
2def7c8203 Add ".proto" suffix to gesture recognizer and object detector proto java package name. This aligns with the convention of image classifier and tasks core protos.
PiperOrigin-RevId: 481451842
2022-10-16 03:43:21 -07:00
MediaPipe Team
17202af6f7 Adds a preprocessor for Universal Sentence Encoder models.
PiperOrigin-RevId: 481293992
2022-10-14 21:38:28 -07:00
Yuqi Li
eb52b72707 Internal change
PiperOrigin-RevId: 481255129
2022-10-14 16:13:13 -07:00
MediaPipe Team
42543f7ad6 Internal change
PiperOrigin-RevId: 481227358
2022-10-14 14:01:11 -07:00
MediaPipe Team
6f3e8381ed Add support for rotation in ObjectDetector C++ API
PiperOrigin-RevId: 481167472
2022-10-14 09:47:54 -07:00
Kinar R
f160f28039
Merge branch 'google:master' into image-classification-python-impl 2022-10-14 15:31:01 +05:30
kinaryml
803210a86b Simplified async test cases to invoke the classifier in context 2022-10-14 03:00:29 -07:00