Commit Graph

552 Commits

Author SHA1 Message Date
Jiuqiang Tang
6f66a7fde4 Rename GestureRecognitionResult to GestureRecognizerResult.
PiperOrigin-RevId: 487306292
2022-11-09 11:49:29 -08:00
kinaryml
17bb174444 Refactored embeddings to embedding_result 2022-11-09 11:42:32 -08:00
Jiuqiang Tang
4e568a1c3d Expose HandLandmarker API in PyPI packages.
PiperOrigin-RevId: 487294501
2022-11-09 11:06:33 -08:00
Sebastian Schmidt
84895316d2 Add pre-compiled WASM files to NPM packages
PiperOrigin-RevId: 487283112
2022-11-09 10:28:09 -08:00
Copybara-Service
0a5534204f Merge pull request #3829 from kinaryml:hand-landmarker-python
PiperOrigin-RevId: 487281485
2022-11-09 10:23:38 -08:00
kinaryml
dc30cf9732 Updated embeddings container to use a timestamp and made parameters - head_index,head_name optional 2022-11-08 23:51:55 -08:00
kinaryml
d327b3649d Fixed some typos in methods and comments 2022-11-08 23:47:58 -08:00
kinaryml
dd6fdedd5f Added some sanity tests 2022-11-08 23:15:58 -08:00
Kinar R
36c50ff8f3
Merge branch 'google:master' into image-embedder-python 2022-11-09 12:41:55 +05:30
kinaryml
7e251bc6b6 Merge branch 'hand-landmarker-python' of https://github.com/kinaryml/mediapipe into hand-landmarker-python 2022-11-08 23:07:30 -08:00
Kinar R
812fa2cc70
Merge branch 'google:master' into hand-landmarker-python 2022-11-09 12:37:06 +05:30
kinaryml
46f135e54d Renamed HandLandmarksDetectionResult to HandLandmarkerResult 2022-11-08 23:06:28 -08:00
MediaPipe Team
b4e1833dd0 Internal change
PiperOrigin-RevId: 487125366
2022-11-08 20:35:46 -08:00
MediaPipe Team
a5bcb97d88 Adds an AverageWordVecModel.
PiperOrigin-RevId: 487104909
2022-11-08 18:29:21 -08:00
MediaPipe Team
c31aaa94a6 Adds a BertClassifier.
PiperOrigin-RevId: 487086744
2022-11-08 16:49:46 -08:00
Sebastian Schmidt
669d539551 NPM package definitions for MediaPipe Tasks
PiperOrigin-RevId: 487071334
2022-11-08 15:46:05 -08:00
Lu Wang
253ff0f85c Update the Java doc for model asset for BaseOptions
PiperOrigin-RevId: 487059371
2022-11-08 14:57:27 -08:00
MediaPipe Team
0917e8cb8e Support continual training image classifier from saved checkpoint files.
PiperOrigin-RevId: 487057612
2022-11-08 14:50:04 -08:00
MediaPipe Team
b3d19fa1af Use model bundle writer when exporting models in gesture recognizer
PiperOrigin-RevId: 487042776
2022-11-08 13:52:08 -08:00
MediaPipe Team
0363d60511 Open-sources TextEmbedder.
PiperOrigin-RevId: 487041832
2022-11-08 13:48:49 -08:00
Kinar R
37930609ff
Update landmark_detection_result.py 2022-11-09 02:58:38 +05:30
MediaPipe Team
ace098f370 Add proper Cast for MultiPort
PiperOrigin-RevId: 487012509
2022-11-08 11:57:03 -08:00
kinaryml
96e2eb38c7 Merge branch 'hand-landmarker-python' of https://github.com/kinaryml/mediapipe into hand-landmarker-python 2022-11-08 11:27:13 -08:00
kinaryml
77cc4c53ab Updated the 'test_create_from_options_fails_with_invalid_model_path' test case 2022-11-08 11:26:02 -08:00
Kinar R
6dd6d8921f
Merge branch 'google:master' into hand-landmarker-python 2022-11-09 00:52:20 +05:30
MediaPipe Team
7a1e55b872 Adds unit tests for TextEmbedder.
PiperOrigin-RevId: 486997035
2022-11-08 11:01:04 -08:00
kinaryml
72f08c6878 Used loops instead of list comprehension 2022-11-08 10:57:12 -08:00
kinaryml
647b94240d Updated docstring 2022-11-08 10:54:44 -08:00
Jiuqiang Tang
ff6ca706c6 Internal change
PiperOrigin-RevId: 486994334
2022-11-08 10:52:51 -08:00
kinaryml
88ab9d4922 Used loops instead of complex list comprehensions 2022-11-08 10:52:26 -08:00
kinaryml
c0265ca2ac Fixed some typos 2022-11-08 10:44:21 -08:00
kinaryml
e8d771baf3 Updated landmark_detection_result 2022-11-08 10:37:37 -08:00
Jiuqiang Tang
5c8b95666a Update "test_create_from_options_fails_with_invalid_model_path" of all tasks python api tests.
PiperOrigin-RevId: 486990017
2022-11-08 10:36:24 -08:00
kinaryml
0fd78c2ec6 Updated classifier python tasks to use the new classification_result dataclass 2022-11-08 10:28:24 -08:00
MediaPipe Team
5e6842aa5c Migrate Java ImageClassifier / TextClassifier to new result format.
PiperOrigin-RevId: 486976459
2022-11-08 09:47:42 -08:00
Sebastian Schmidt
26066787b3 Allow Web developers to opt into CPU or GPU processing
PiperOrigin-RevId: 486935157
2022-11-08 06:37:38 -08:00
kinaryml
9c9519eeb8 Fixed a to_pb2() bug in the landmark_detection_result container 2022-11-08 02:55:19 -08:00
kinaryml
0402ee383f Added hand landmarker Python API and tests 2022-11-08 01:05:36 -08:00
MediaPipe Team
4a6562d423 internal
PiperOrigin-RevId: 486853812
2022-11-07 22:39:23 -08:00
MediaPipe Team
24d03451c7 Internal change - migration
PiperOrigin-RevId: 486853689
2022-11-07 22:36:22 -08:00
Yuqi Li
0a08e4768b Metadata Writer: Add metadata writer for Text Classifier.
PiperOrigin-RevId: 486844428
2022-11-07 21:25:44 -08:00
Jiuqiang Tang
b14178d305 Temporarily exclude "audio_classifier_graph" from "builtin_task_graphs" on Windows.
PiperOrigin-RevId: 486806337
2022-11-07 17:27:33 -08:00
MediaPipe Team
716c7e3b8a Internal change
PiperOrigin-RevId: 486805777
2022-11-07 17:23:46 -08:00
MediaPipe Team
c3bb4bb5da Refactor image classifier Create API by defining an ImageClassifierOption which wraps the model_spec, model_options, and hparams. Also migrate the definition of HParams by extending it from BaseHParams.
PiperOrigin-RevId: 486796657
2022-11-07 16:39:35 -08:00
MediaPipe Team
1049ef781d Add image_segmenter namespace and update image segmenter proto for java package.
PiperOrigin-RevId: 486792164
2022-11-07 16:24:16 -08:00
Camillo Lugaresi
1a151d9ffb Internal change
PiperOrigin-RevId: 486792117
2022-11-07 16:21:15 -08:00
MediaPipe Team
6f38a7a21f Add hand landmarker C++ api.
PiperOrigin-RevId: 486791711
2022-11-07 16:17:42 -08:00
Kinar R
83608d4670
Merge branch 'master' into image-embedder-python 2022-11-08 05:02:46 +05:30
Jiuqiang Tang
571c0b1fef Expose MediaPipe Tasks Audio and Text APIs in MediaPipe PyPI packages.
PiperOrigin-RevId: 486777537
2022-11-07 15:17:57 -08:00
Jiuqiang Tang
63a759accc Implement MediaPipe AudioClassifier Tasks Python API. Adjust the AudioClassifier Tasks C++ API to remove "sample_rate" from its options.
PiperOrigin-RevId: 486763992
2022-11-07 14:28:14 -08:00
MediaPipe Team
51dbd9779c Introduce Stream/SidePacket aliases for Source/SideSource
PiperOrigin-RevId: 486761126
2022-11-07 14:20:08 -08:00
Sebastian Schmidt
e994efd40f Add entry points for NPM packages
PiperOrigin-RevId: 486760105
2022-11-07 14:16:29 -08:00
kinaryml
664d9c49e7 Revised image embedder implementation 2022-11-07 13:59:07 -08:00
Kinar R
ba1ee5b404
Merge branch 'master' into image-embedder-python 2022-11-08 02:53:20 +05:30
MediaPipe Team
6b54cae34c Internal change - cleanup
PiperOrigin-RevId: 486721059
2022-11-07 11:42:50 -08:00
Sebastian Schmidt
2371051e17 Open Source the remaining Web implementation files
PiperOrigin-RevId: 486701932
2022-11-07 10:34:44 -08:00
Jiuqiang Tang
c02f3933d4 Temporarily exclude "text_classifier_graph" from "builtin_task_graphs" on Windows.
PiperOrigin-RevId: 486700027
2022-11-07 10:28:28 -08:00
Jiuqiang Tang
9f4496db77 Fix typos
PiperOrigin-RevId: 486698923
2022-11-07 10:24:17 -08:00
Jiuqiang Tang
17a2de8cf7 Rename TextClassificationResult to TextClassifierResult.
PiperOrigin-RevId: 486685936
2022-11-07 09:39:01 -08:00
Copybara-Service
4c06303ec7 Merge pull request #3820 from kinaryml:text-classifier-python
PiperOrigin-RevId: 486566800
2022-11-06 22:15:09 -08:00
MediaPipe Team
4b0423e3a2 Internal change
PiperOrigin-RevId: 486547910
2022-11-06 19:34:24 -08:00
Jiuqiang Tang
9504c5e6a1 Add a create_from_array classmethod to the AudioData class.
PiperOrigin-RevId: 486310154
2022-11-05 00:09:30 -07:00
kinaryml
b44c49250b Removed unused constant 2022-11-04 22:36:13 -07:00
Kinar R
740d2e47b5
Merge branch 'google:master' into text-classifier-python 2022-11-05 11:03:24 +05:30
Hadon Nash
91782a2772 Internal change
PiperOrigin-RevId: 486283316
2022-11-04 19:48:18 -07:00
Jiuqiang Tang
416f91180b Remove the use of designated initializers.
PiperOrigin-RevId: 486261384
2022-11-04 16:57:21 -07:00
Jiuqiang Tang
35f635d8ff Add an argument to packet_creator.create_matrix to allow the input matrix to be transposed first.
PiperOrigin-RevId: 486258078
2022-11-04 16:39:32 -07:00
Jiuqiang Tang
c10ebe8476 Remove the use of designated initializers.
PiperOrigin-RevId: 486215798
2022-11-04 13:24:48 -07:00
Kinar R
b1d1ef0124
Merge branch 'google:master' into image-embedder-python 2022-11-05 00:17:26 +05:30
MediaPipe Team
5e1a2fcdbb Update EmbeddingResult format and dependent tasks.
PiperOrigin-RevId: 486186491
2022-11-04 11:20:07 -07:00
Jiuqiang Tang
66e591d4bc Remove the use of designated initializers.
PiperOrigin-RevId: 486185274
2022-11-04 11:15:20 -07:00
Sebastian Schmidt
f05868d8e0 Set up the Open Source build for MediaPipe Tasks Web
PiperOrigin-RevId: 486181061
2022-11-04 10:59:32 -07:00
Jiuqiang Tang
5fd3701cfd Expose ImageSegmenter and GestureRecognizer APIs in PyPI packages.
PiperOrigin-RevId: 486176206
2022-11-04 10:39:21 -07:00
MediaPipe Team
8b2c937b9e Migrate AudioClassifier C++ to use new ClassificationResult struct.
PiperOrigin-RevId: 486162683
2022-11-04 09:46:09 -07:00
MediaPipe Team
62cd67e996 Internal change
PiperOrigin-RevId: 486148328
2022-11-04 08:42:39 -07:00
Jiuqiang Tang
5f5f50d8f7 Implement MediaPipe Tasks Python AudioData.
PiperOrigin-RevId: 486147173
2022-11-04 08:32:30 -07:00
Copybara-Service
5024c815f1 Merge pull request #3813 from kinaryml:image-segmenter-minor-fixes
PiperOrigin-RevId: 486051659
2022-11-03 21:41:37 -07:00
MediaPipe Team
b2cc2cc60c Internal changes
PiperOrigin-RevId: 486014305
2022-11-03 17:23:20 -07:00
MediaPipe Team
06cb73fc81 Modified internal dependencies.
PiperOrigin-RevId: 485992876
2022-11-03 15:44:36 -07:00
kinaryml
e2d50745ac Revised image embedder implementation 2022-11-03 14:30:21 -07:00
MediaPipe Team
d29c3d7512 Add metadata writer to image_classifier in model_maker
PiperOrigin-RevId: 485926985
2022-11-03 11:30:38 -07:00
kinaryml
492607152a Reverted changes to rect 2022-11-03 10:56:38 -07:00
Kinar R
5a68ba84b6
Merge branch 'master' into image-embedder-python 2022-11-03 23:24:31 +05:30
Jiuqiang Tang
b472d8ff66 Add the missing __init__.py file.
PiperOrigin-RevId: 485892501
2022-11-03 09:24:12 -07:00
Copybara-Service
716e59f90c Merge pull request #3801 from kinaryml:gesture-recognizer-python
PiperOrigin-RevId: 485884796
2022-11-03 08:52:17 -07:00
kinaryml
14e18a03d6 Removed unused custom classifier options in tests 2022-11-03 02:54:57 -07:00
kinaryml
de619e2702 Removed a comment 2022-11-03 02:33:50 -07:00
kinaryml
2001e2b77c Removed unused file 2022-11-03 02:32:55 -07:00
kinaryml
6e9a070dd1 Added text classifier implementation and tests 2022-11-03 02:29:40 -07:00
kinaryml
35a04522fa Moved the OutputType and Activation classes to ImageSegmenter's inner classes 2022-11-03 00:46:00 -07:00
MediaPipe Team
ddf37d014e Fix test utils bug when two file names have same ending.
PiperOrigin-RevId: 485780917
2022-11-02 22:33:36 -07:00
Jiuqiang Tang
ac6aa9ce10 Fix a bug in the AndroidPacketCreator's createImage method.
PiperOrigin-RevId: 485716828
2022-11-02 15:56:49 -07:00
Jiuqiang Tang
01d87f0867 Expose MediaPipe Tasks in MediaPipe PyPI packages.
PiperOrigin-RevId: 485690163
2022-11-02 14:07:47 -07:00
MediaPipe Team
0bf5110a7e Add a model_maker internal library directory.
PiperOrigin-RevId: 485665201
2022-11-02 12:31:58 -07:00
MediaPipe Team
d61ab92b90 Add classification result structs and use then in ImageClassifier & TextClassifier.
PiperOrigin-RevId: 485567133
2022-11-02 05:13:12 -07:00
MediaPipe Team
aab5f84aae Internal change
PiperOrigin-RevId: 485553891
2022-11-02 03:49:48 -07:00
MediaPipe Team
475e6b4fd5 Modify ClassificationAggregationCalculator to output new unified formats.
PiperOrigin-RevId: 485546547
2022-11-02 03:11:20 -07:00
MediaPipe Team
f1f123d255 Extracted common logics from the ImageToTensorCalculator such that it can be
reused by other calculators.

PiperOrigin-RevId: 485472451
2022-11-01 18:43:46 -07:00
MediaPipe Team
aaf98ea43c Add CPU invoke to Perfetto trace
PiperOrigin-RevId: 485464221
2022-11-01 17:50:39 -07:00
MediaPipe Team
ecd93ff080 Internal changes
PiperOrigin-RevId: 485445138
2022-11-01 16:18:06 -07:00
Kinar R
3a2f30185f
Merge branch 'master' into gesture-recognizer-python 2022-11-02 04:11:18 +05:30
kinaryml
c5765ac836 Refactored Rect to use top-left coordinates and appropriately updated the Image Classifier and Gesture Recognizer APIs/tests 2022-11-01 15:37:00 -07:00
Yuqi Li
e719f7b4e2 Model Maker Gesture Recognizer: add metadata writer and create model bundle.
PiperOrigin-RevId: 485426865
2022-11-01 15:02:45 -07:00
MediaPipe Team
c6a64683f6 Add ConcatenateClassificationListCalculator
PiperOrigin-RevId: 485398597
2022-11-01 13:13:48 -07:00
MediaPipe Team
700971de70 Internal change
PiperOrigin-RevId: 485396135
2022-11-01 13:05:43 -07:00
Copybara-Service
6e0397b226 Merge pull request #3800 from kinaryml:python-test-proto-equals
PiperOrigin-RevId: 485340924
2022-11-01 09:42:19 -07:00
Frederic Rechtenstein
60a19f4fe2 Fix missing space in docstring.
PiperOrigin-RevId: 485337309
2022-11-01 09:27:29 -07:00
Jiuqiang Tang
e4899c8207 MediaPipe Python audio base layer.
PiperOrigin-RevId: 485329470
2022-11-01 08:53:36 -07:00
kinaryml
a913255080 Removed min score thres from tests 2022-10-31 23:07:05 -07:00
kinaryml
d3b472e888 Add allow_list/deny_list support 2022-10-31 22:16:37 -07:00
Kinar R
1aaaca1e12
Merge branch 'google:master' into gesture-recognizer-python 2022-11-01 08:16:43 +05:30
Jiuqiang Tang
86951e048d Remove the unused TaskRunner from the mediapipe tasks python code.
PiperOrigin-RevId: 485181210
2022-10-31 16:54:30 -07:00
MediaPipe Team
9f8b5e5c11 Add allow_list/deny_list to gesture recognizer options.
PiperOrigin-RevId: 485141209
2022-10-31 13:57:06 -07:00
Jiuqiang Tang
4717ac298c Add EndLoopMatrixCalculator
PiperOrigin-RevId: 485097386
2022-10-31 11:08:21 -07:00
kinaryml
2b5a077579 Updated comments 2022-10-31 05:48:45 -07:00
kinaryml
d635b4281e Added a test for the canned classification of the gesture victory 2022-10-31 05:47:28 -07:00
kinaryml
888ddd4b74 Removed unused classifier options proto 2022-10-31 05:37:24 -07:00
kinaryml
19be9e9012 Revised gesture recognizer implementation 2022-10-31 05:34:31 -07:00
Kinar R
5ec87c8bd2
Merge branch 'master' into gesture-recognizer-python 2022-10-31 16:47:43 +05:30
MediaPipe Team
459214e6a3 Rename index_by_label to label_names.
PiperOrigin-RevId: 484956259
2022-10-30 22:26:17 -07:00
Copybara-Service
7bcf322625 Merge pull request #3739 from kinaryml:image-segmenter-python-impl
PiperOrigin-RevId: 484922757
2022-10-30 17:11:42 -07:00
kinaryml
fb4872b068 Refactored code and removed some issues 2022-10-30 15:42:26 -07:00
MediaPipe Team
be13a76928 Integrate canned and custom gesture classifier.
PiperOrigin-RevId: 484914164
2022-10-30 15:36:09 -07:00
kinaryml
4b66599419 Updated docstring in gesture_recognizer 2022-10-30 09:10:15 -07:00
Kinar R
6f485ae3dd
Merge branch 'google:master' into gesture-recognizer-python 2022-10-30 20:55:53 +05:30
kinaryml
f62cfd1690 Removed classification proto to use the existing category dataclass instead and removed NormalizedLandmarkList and LandmarkList dataclasses 2022-10-30 08:23:14 -07:00
Hadon Nash
313b387ced Adding SwitchContainer option "tick_input_stream" to specify which input streams indicate the output timestamps to expect from the contained graphs.
PiperOrigin-RevId: 484615286
2022-10-28 14:04:20 -07:00
Jiuqiang Tang
e16be2e8fa Implement the initial version of TensorsToAudioCalculator that supports ifft and inverse hann windowing.
PiperOrigin-RevId: 484605092
2022-10-28 13:19:43 -07:00
Hadon Nash
c5c639d634 Internal change
PiperOrigin-RevId: 484583911
2022-10-28 11:46:10 -07:00
Jiuqiang Tang
f4f8b11ffc Fix the comment.
PiperOrigin-RevId: 484571254
2022-10-28 10:57:13 -07:00
Kinar R
334f641463
Merge branch 'master' into image-segmenter-python-impl 2022-10-28 22:50:33 +05:30
Kinar R
0f7c5d5e90
Merge branch 'google:master' into gesture-recognizer-python 2022-10-28 14:08:52 +05:30
kinaryml
b81b5a9035 Added a test for min_gesture_confidence 2022-10-28 01:38:15 -07:00
MediaPipe Team
de5fe27e05 Modified internal dependencies.
PiperOrigin-RevId: 484407262
2022-10-27 19:08:19 -07:00
MediaPipe Team
abd1ff66c8 Fix https://github.com/google/mediapipe/issues/3784
PiperOrigin-RevId: 484365654
2022-10-27 15:32:44 -07:00
MediaPipe Team
fc1d75cc99 Add CombinedPredictionCalculator.
PiperOrigin-RevId: 484301880
2022-10-27 11:16:12 -07:00
MediaPipe Team
ee84e447b2 Internal change
PiperOrigin-RevId: 484299808
2022-10-27 11:08:31 -07:00
kinaryml
8194513934 Updated docstrings and removed the redundant private helper method 2022-10-26 23:56:54 -07:00
Jiuqiang Tang
a941c5cdd1 Create MediaPipe "tasks-text" AAR.
PiperOrigin-RevId: 484004494
2022-10-26 10:18:22 -07:00
MediaPipe Team
254f786624 Add an option to set image preprocessing backend as gpu.
PiperOrigin-RevId: 483888202
2022-10-26 00:46:19 -07:00
kinaryml
f8a98ccba4 Added a test utility method to compare protos directly 2022-10-25 23:38:32 -07:00
kinaryml
fbf7ba6f1a Reverted some changes to rect 2022-10-25 23:15:16 -07:00
kinaryml
75af46d273 Revised API to align with recent changes 2022-10-25 23:13:12 -07:00
Kinar R
0de97497fa
Merge branch 'master' into gesture-recognizer-python 2022-10-26 11:37:12 +05:30
Copybara-Service
ae5b09e2b2 Merge pull request #3738 from kinaryml:image-classification-python-impl
PiperOrigin-RevId: 483818404
2022-10-25 17:26:32 -07:00
MediaPipe Team
a28c9d2c26 Set steps_per_epoch to None when calling model.fit() method for image classifier.
PiperOrigin-RevId: 483764377
2022-10-25 13:44:03 -07:00
MediaPipe Team
36bd9abb8f Internal change
PiperOrigin-RevId: 483751427
2022-10-25 12:53:39 -07:00
MediaPipe Team
21abfc9125 Update gpu origin.
PiperOrigin-RevId: 483742652
2022-10-25 12:14:28 -07:00
kinaryml
8762d15c81 Added remaining tests for the GestureRecognizer Python MediaPipe Tasks API 2022-10-25 11:11:15 -07:00
MediaPipe Team
d240c009e2 Remove unnecessary location_data_proto dependency on rect_proto.
PiperOrigin-RevId: 483679555
2022-10-25 08:24:07 -07:00