Commit Graph

429 Commits

Author SHA1 Message Date
kinaryml
4b66599419 Updated docstring in gesture_recognizer 2022-10-30 09:10:15 -07:00
Kinar R
6f485ae3dd
Merge branch 'google:master' into gesture-recognizer-python 2022-10-30 20:55:53 +05:30
kinaryml
f62cfd1690 Removed classification proto to use the existing category dataclass instead and removed NormalizedLandmarkList and LandmarkList dataclasses 2022-10-30 08:23:14 -07:00
Hadon Nash
313b387ced Adding SwitchContainer option "tick_input_stream" to specify which input streams indicate the output timestamps to expect from the contained graphs.
PiperOrigin-RevId: 484615286
2022-10-28 14:04:20 -07:00
Jiuqiang Tang
e16be2e8fa Implement the initial version of TensorsToAudioCalculator that supports ifft and inverse hann windowing.
PiperOrigin-RevId: 484605092
2022-10-28 13:19:43 -07:00
Hadon Nash
c5c639d634 Internal change
PiperOrigin-RevId: 484583911
2022-10-28 11:46:10 -07:00
Jiuqiang Tang
f4f8b11ffc Fix the comment.
PiperOrigin-RevId: 484571254
2022-10-28 10:57:13 -07:00
Kinar R
334f641463
Merge branch 'master' into image-segmenter-python-impl 2022-10-28 22:50:33 +05:30
Kinar R
0f7c5d5e90
Merge branch 'google:master' into gesture-recognizer-python 2022-10-28 14:08:52 +05:30
kinaryml
b81b5a9035 Added a test for min_gesture_confidence 2022-10-28 01:38:15 -07:00
MediaPipe Team
de5fe27e05 Modified internal dependencies.
PiperOrigin-RevId: 484407262
2022-10-27 19:08:19 -07:00
MediaPipe Team
abd1ff66c8 Fix https://github.com/google/mediapipe/issues/3784
PiperOrigin-RevId: 484365654
2022-10-27 15:32:44 -07:00
MediaPipe Team
fc1d75cc99 Add CombinedPredictionCalculator.
PiperOrigin-RevId: 484301880
2022-10-27 11:16:12 -07:00
MediaPipe Team
ee84e447b2 Internal change
PiperOrigin-RevId: 484299808
2022-10-27 11:08:31 -07:00
kinaryml
8194513934 Updated docstrings and removed the redundant private helper method 2022-10-26 23:56:54 -07:00
Jiuqiang Tang
a941c5cdd1 Create MediaPipe "tasks-text" AAR.
PiperOrigin-RevId: 484004494
2022-10-26 10:18:22 -07:00
MediaPipe Team
254f786624 Add an option to set image preprocessing backend as gpu.
PiperOrigin-RevId: 483888202
2022-10-26 00:46:19 -07:00
kinaryml
f8a98ccba4 Added a test utility method to compare protos directly 2022-10-25 23:38:32 -07:00
kinaryml
fbf7ba6f1a Reverted some changes to rect 2022-10-25 23:15:16 -07:00
kinaryml
75af46d273 Revised API to align with recent changes 2022-10-25 23:13:12 -07:00
Kinar R
0de97497fa
Merge branch 'master' into gesture-recognizer-python 2022-10-26 11:37:12 +05:30
Copybara-Service
ae5b09e2b2 Merge pull request #3738 from kinaryml:image-classification-python-impl
PiperOrigin-RevId: 483818404
2022-10-25 17:26:32 -07:00
MediaPipe Team
a28c9d2c26 Set steps_per_epoch to None when calling model.fit() method for image classifier.
PiperOrigin-RevId: 483764377
2022-10-25 13:44:03 -07:00
MediaPipe Team
36bd9abb8f Internal change
PiperOrigin-RevId: 483751427
2022-10-25 12:53:39 -07:00
MediaPipe Team
21abfc9125 Update gpu origin.
PiperOrigin-RevId: 483742652
2022-10-25 12:14:28 -07:00
kinaryml
8762d15c81 Added remaining tests for the GestureRecognizer Python MediaPipe Tasks API 2022-10-25 11:11:15 -07:00
MediaPipe Team
d240c009e2 Remove unnecessary location_data_proto dependency on rect_proto.
PiperOrigin-RevId: 483679555
2022-10-25 08:24:07 -07:00
kinaryml
18eb089d39 Added a simple test to verify gesture recognition results 2022-10-25 07:38:04 -07:00
MediaPipe Team
6b0a7fb281 Reverting back to special handling for Egl Thread Exit on Android
PiperOrigin-RevId: 483505151
2022-10-24 15:45:35 -07:00
MediaPipe Team
94cd134809 Add support for image rotation in Java vision tasks.
PiperOrigin-RevId: 483493729
2022-10-24 15:01:23 -07:00
MediaPipe Team
3d88b1797a Switch CHECK to a status in resource handling code. Expand error message.
PiperOrigin-RevId: 483438131
2022-10-24 11:27:15 -07:00
Jiuqiang Tang
2cf9523468 Fix the java_package name.
PiperOrigin-RevId: 483428848
2022-10-24 10:55:16 -07:00
MediaPipe Team
2f2baeff68 Add support for rotation in ImageEmbedder & ImageSegmenter C++ APIs
PiperOrigin-RevId: 483416498
2022-10-24 10:14:05 -07:00
MediaPipe Team
0fd69e8d83 Open-source some tokenizer unit tests.
PiperOrigin-RevId: 483399326
2022-10-24 09:12:52 -07:00
kinaryml
9a1a9d4c13 Added files needed for the GestureRecognizer API implementation 2022-10-24 06:08:27 -07:00
MediaPipe Team
af051dcb62 internal change
PiperOrigin-RevId: 483308781
2022-10-24 01:39:23 -07:00
Jiuqiang Tang
de93d06f87 Implement build rules and targets to create MediaPipe Tasks AARs
PiperOrigin-RevId: 483297891
2022-10-24 00:45:32 -07:00
Yuqi Li
ab17be9294 Metadata Writer: Add Metadata Writer for image classifier.
PiperOrigin-RevId: 483282627
2022-10-23 23:05:32 -07:00
MediaPipe Team
ec2a34d2a4 Replace pytype_struct_contrib_test by py_strict_test. Also remove unnecessary BUILD attributes.
PiperOrigin-RevId: 483237371
2022-10-23 16:45:02 -07:00
MediaPipe Team
ab0193bbb7 Internal change
PiperOrigin-RevId: 483078695
2022-10-22 15:55:46 -07:00
kinaryml
ebb2686fb4 Moved OutputType and Activation to image_segmenter 2022-10-22 03:34:26 -07:00
MediaPipe Team
d8006a2f87 Use model bundle for gesture recognizer.
PiperOrigin-RevId: 482960305
2022-10-21 21:54:34 -07:00
MediaPipe Team
404323f631 Add Mediapipe Tasks Gesture Recognizer benchmarks
PiperOrigin-RevId: 482935780
2022-10-21 18:33:49 -07:00
Jiuqiang Tang
abed54ea30 Rename the mediapipe java image container from Image to MPImage.
PiperOrigin-RevId: 482933122
2022-10-21 18:17:35 -07:00
MediaPipe Team
7196db275e Internal change
PiperOrigin-RevId: 482925717
2022-10-21 17:28:49 -07:00
MediaPipe Team
ea1d85d811 Update model_task_graph to support multiple local model resources.
PiperOrigin-RevId: 482917453
2022-10-21 16:42:58 -07:00
MediaPipe Team
4a6c23a76a Internal change
PiperOrigin-RevId: 482906478
2022-10-21 15:48:54 -07:00
MediaPipe Team
d0437b7f91 Add tensor_index and tensor_name fields to ClassificationList
PiperOrigin-RevId: 482901854
2022-10-21 15:27:35 -07:00
kinaryml
024a6866a7 Removed some unneeded aliases 2022-10-21 13:39:59 -07:00
MediaPipe Team
36d69971a7 Internal change
PiperOrigin-RevId: 482875698
2022-10-21 13:36:41 -07:00
Kinar R
1748663a5a
Merge branch 'google:master' into image-segmenter-python-impl 2022-10-22 02:04:57 +05:30
kinaryml
5231a0ad9f Removed SegmenterOptions dataclasses to enumerate options within ImageSegmenterOptions instead 2022-10-21 13:34:30 -07:00
Jiuqiang Tang
e1a9615e1a Add "alwayslink = 1" to "universal_sentence_encoder_preprocessor_calculator".
PiperOrigin-RevId: 482864252
2022-10-21 12:48:36 -07:00
MediaPipe Team
e453c3b206 Migrates image_preprocessing from core to vision.
PiperOrigin-RevId: 482856336
2022-10-21 12:16:54 -07:00
Sebastian Schmidt
55a536e55e Typo fix in Landmark
PiperOrigin-RevId: 482854764
2022-10-21 12:13:12 -07:00
Sebastian Schmidt
fe77c5489f Fix comments in GestureRecognizer
PiperOrigin-RevId: 482854253
2022-10-21 12:09:36 -07:00
Jiuqiang Tang
ed938a9214 Replace the usage of InvalidProtocolBufferException with IOException.
PiperOrigin-RevId: 482844446
2022-10-21 11:30:28 -07:00
MediaPipe Team
55ba23ce9a Cleans up unused function from image_classifier's Dataset.
PiperOrigin-RevId: 482703775
2022-10-20 23:59:20 -07:00
MediaPipe Team
348c4e6652 Add a test to test saving and loading the gesture recognizer model.
Also update the loss function init method to resolve a bug when loading model.

PiperOrigin-RevId: 482702020
2022-10-20 23:45:26 -07:00
MediaPipe Team
086fc442fd Internal change
PiperOrigin-RevId: 482697999
2022-10-20 23:15:17 -07:00
MediaPipe Team
9e2a9bb4be Internal change
PiperOrigin-RevId: 482565462
2022-10-20 12:33:30 -07:00
MediaPipe Team
4b5df1cb96 Add support for rotations in GestureRecognizer C++ API.
PiperOrigin-RevId: 482533599
2022-10-20 10:42:42 -07:00
MediaPipe Team
e71638cf67 Add an export_tflite API to gesture recognizer model maker library.
PiperOrigin-RevId: 482527017
2022-10-20 10:21:34 -07:00
kinaryml
71d5b69544 Added files for the image embedder implementation and a simple test 2022-10-20 02:29:14 -07:00
MediaPipe Team
467cd34feb Internal change
PiperOrigin-RevId: 482401089
2022-10-19 23:49:51 -07:00
MediaPipe Team
41d6f6d005 Adds a Java API for TextClassifier.
PiperOrigin-RevId: 482394706
2022-10-19 23:05:34 -07:00
MediaPipe Team
3d588bae8b Internal change
PiperOrigin-RevId: 482259130
2022-10-19 11:34:32 -07:00
MediaPipe Team
c260074abb Rename "Bound" struct to "Rect" and remove unused "Landmark" struct.
PiperOrigin-RevId: 482255889
2022-10-19 11:22:56 -07:00
MediaPipe Team
8426428de3 Internal cleanup for text-domain unit tests.
PiperOrigin-RevId: 482241566
2022-10-19 10:31:21 -07:00
MediaPipe Team
a18f91e04f Open-sources UniversalSentenceEncoderPreprocessorCalculator.
PiperOrigin-RevId: 482222697
2022-10-19 09:20:38 -07:00
MediaPipe Team
70df9e2419 Open-source the TextClassifier C++ API.
PiperOrigin-RevId: 482218721
2022-10-19 09:03:29 -07:00
MediaPipe Team
7a6ae97a0e Internal change
PiperOrigin-RevId: 482135978
2022-10-19 01:23:58 -07:00
MediaPipe Team
cfd5a20618 Open-sources the TextPreprocessingSubgraph.
PiperOrigin-RevId: 482048438
2022-10-18 16:14:33 -07:00
Sebastian Schmidt
0b55fbda34 Fix compilation error on Windows
PiperOrigin-RevId: 482037921
2022-10-18 15:31:22 -07:00
Hadon Nash
7785603fbe Adding BypassCalculator for use with SwitchContainer.
PiperOrigin-RevId: 482030395
2022-10-18 14:59:25 -07:00
MediaPipe Team
e86cd39521 Use unused pixel format attribute variable as intended
Based on the comments and the context, we should be trying to use the specified attributes in orders to initialize the pixel_format_ variable.

PiperOrigin-RevId: 482011065
2022-10-18 13:51:24 -07:00
MediaPipe Team
43345160c5 Add ImageFrame and GlTexture view providers to Ahwb GpuBuffer storage
- ImageFrame views are backed by CPU locks of the AHWB.
- GlTextureViews are managed through a GlTextureBuffer connected to the AHWB allocation.

This improves the latency of heterogeneous access sequences, but makes `ImageFrame > ImageFrame` sequences slower due to CPU locking.

PiperOrigin-RevId: 481982546
2022-10-18 11:59:29 -07:00
MediaPipe Team
f2821d840d Improve image classifier model maker documentation and replace the legacy code.
PiperOrigin-RevId: 481979922
2022-10-18 11:47:37 -07:00
MediaPipe Team
51879ae81a Remove unnecessary architectures from image classifier ModelSpec
PiperOrigin-RevId: 481974529
2022-10-18 11:29:11 -07:00
Yuqi Li
bc47589c9b Add model bundle in hand landmark task.
PiperOrigin-RevId: 481960266
2022-10-18 10:38:43 -07:00
Sebastian Schmidt
6bb5ff989d Fix #ifdef statement
PiperOrigin-RevId: 481952827
2022-10-18 10:13:09 -07:00
MediaPipe Team
47de64fc10 Open-sources TextToTensorCalculator.
PiperOrigin-RevId: 481927522
2022-10-18 08:28:53 -07:00
kinaryml
91b60da1dc Updated name for a test case 2022-10-18 05:35:05 -07:00
kinaryml
f166eb32e8 Updated names of test case methods 2022-10-18 04:34:17 -07:00
kinaryml
69f4daf9bc Removed unused BUILD 2022-10-18 04:31:35 -07:00
kinaryml
4932844410 Reverted changes to BUILD 2022-10-18 04:29:28 -07:00
kinaryml
f84e0bc1c6 Revised API implementation and added more tests for segment_for_video and segment_async 2022-10-18 04:24:12 -07:00
Kinar R
36ac0689d7
Merge branch 'google:master' into image-segmenter-python-impl 2022-10-18 15:13:44 +05:30
MediaPipe Team
ba93bab286 Fix ObjectDetector C++ flow limiter and improve documentation.
PiperOrigin-RevId: 481774191
2022-10-17 16:57:38 -07:00
Sebastian Schmidt
b09c0e9938 Internal change
PiperOrigin-RevId: 481761007
2022-10-17 15:56:55 -07:00
MediaPipe Team
58e5cc3c88 Changed the image to tensor converter interface such that the "Convert"
function assumes the Tensor is preallocated before calling the function.

PiperOrigin-RevId: 481752678
2022-10-17 15:20:25 -07:00
Camillo Lugaresi
a5e4219590 Internal change
PiperOrigin-RevId: 481742662
2022-10-17 14:39:17 -07:00
MediaPipe Team
cd32543786 Open-sources the bert_preprocessor_calculator_test.
PiperOrigin-RevId: 481724320
2022-10-17 13:30:11 -07:00
MediaPipe Team
5e543c506f Fix unused variable warnings
Remove some unused variables and add unused attribute to other variables

PiperOrigin-RevId: 481706551
2022-10-17 12:14:55 -07:00
MediaPipe Team
f6c2f86086 Fix -Wunused-variable warnings
Remove unused variables. Add __unused attribute to variable used in assert clause. Move variable to inside header guard when only used in header guard.

PiperOrigin-RevId: 481699164
2022-10-17 11:48:17 -07:00
Yuqi Li
660f1812c2 Internal change
PiperOrigin-RevId: 481515490
2022-10-16 17:23:01 -07:00
Jiuqiang Tang
2def7c8203 Add ".proto" suffix to gesture recognizer and object detector proto java package name. This aligns with the convention of image classifier and tasks core protos.
PiperOrigin-RevId: 481451842
2022-10-16 03:43:21 -07:00
MediaPipe Team
f7da95a130 Fix a typo in the description string
PiperOrigin-RevId: 481421713
2022-10-15 22:40:34 -07:00
MediaPipe Team
17202af6f7 Adds a preprocessor for Universal Sentence Encoder models.
PiperOrigin-RevId: 481293992
2022-10-14 21:38:28 -07:00
MediaPipe Team
5f3d5728e8 Open-source the regex_preprocessing_calculator
PiperOrigin-RevId: 481256045
2022-10-14 16:18:20 -07:00
Yuqi Li
eb52b72707 Internal change
PiperOrigin-RevId: 481255129
2022-10-14 16:13:13 -07:00
MediaPipe Team
ca28a19822 Open-source bert_preprocessor_calculator
PiperOrigin-RevId: 481246966
2022-10-14 15:31:31 -07:00
MediaPipe Team
42543f7ad6 Internal change
PiperOrigin-RevId: 481227358
2022-10-14 14:01:11 -07:00
Camillo Lugaresi
364b8e8106 Internal change
PiperOrigin-RevId: 481210917
2022-10-14 12:47:48 -07:00
MediaPipe Team
e283c10970 Internal change
PiperOrigin-RevId: 481186706
2022-10-14 11:04:43 -07:00
MediaPipe Team
0428550d75 Open source model_maker/python/core/tasks and model_maker/python/vision/image_classifier
PiperOrigin-RevId: 481182271
2022-10-14 10:47:34 -07:00
MediaPipe Team
6f3e8381ed Add support for rotation in ObjectDetector C++ API
PiperOrigin-RevId: 481167472
2022-10-14 09:47:54 -07:00
Kinar R
f160f28039
Merge branch 'google:master' into image-classification-python-impl 2022-10-14 15:31:01 +05:30
kinaryml
803210a86b Simplified async test cases to invoke the classifier in context 2022-10-14 03:00:29 -07:00
Jiuqiang Tang
0ebe6ccf59 Add filegroups to mediapipe java src dirs.
PiperOrigin-RevId: 481080348
2022-10-14 01:02:48 -07:00
Jiuqiang Tang
b632e645f5 Merge all BUILD files in the subdirectories of java/com/google/mediapipe/tasks/vision into one BUILD file.
PiperOrigin-RevId: 481074268
2022-10-14 00:15:40 -07:00
MediaPipe Team
9353ed6cce Java gesture recognizer Tasks API and unit test.
PiperOrigin-RevId: 480978244
2022-10-13 14:06:23 -07:00
MediaPipe Team
12c323ffde Exports gesture recognizer related proto as Java package.
PiperOrigin-RevId: 480735444
2022-10-12 15:41:31 -07:00
MediaPipe Team
179824a21d Use string_view when adding nodes/generators #cleanup
PiperOrigin-RevId: 480721234
2022-10-12 14:42:19 -07:00
MediaPipe Team
02746d0700 Remove unused includes.
PiperOrigin-RevId: 480720274
2022-10-12 14:38:04 -07:00
MediaPipe Team
a9fea36cb3 Put Destination::base_ into private section. (Cleanup.)
PiperOrigin-RevId: 480678168
2022-10-12 11:43:03 -07:00
MediaPipe Team
ae4b2ae577 Add support for input image rotation in ImageClassifier.
PiperOrigin-RevId: 480676070
2022-10-12 11:35:20 -07:00
MediaPipe Team
51a7606083 Add Java ImageClassifier API.
PiperOrigin-RevId: 480656683
2022-10-12 10:22:16 -07:00
Jiuqiang Tang
cbbd4718a0 Update mediapipe_aar.bzl to put more mediapipe framework java proto classes into AARs.
PiperOrigin-RevId: 480583365
2022-10-12 03:46:52 -07:00
Jiuqiang Tang
f9a4e472eb Add AndroidManifest.xml into third_party/mediapipe/tasks/java/com/google/mediapipe/tasks/core
PiperOrigin-RevId: 480567195
2022-10-12 02:05:15 -07:00
MediaPipe Team
77de8b0bb0 Split RotationMode proto target for reuse.
PiperOrigin-RevId: 480548644
2022-10-12 00:33:01 -07:00
kinaryml
6771fe69e9 Included checks for image sizes while running in async and roi mode 2022-10-11 22:52:18 -07:00
kinaryml
7726205d85 Added a test to run classify_async in region of interest mode 2022-10-11 22:42:50 -07:00
kinaryml
8ea0018397 Added a check to see if the output packet is empty in the API and updated tests 2022-10-11 22:34:56 -07:00
MediaPipe Team
64deb791dc Fix empty packet bug with no hands detected.
PiperOrigin-RevId: 480469392
2022-10-11 15:38:43 -07:00
MediaPipe Team
1b611c66bb Improve quantization support in model_maker/image_classifier
PiperOrigin-RevId: 480455944
2022-10-11 14:40:02 -07:00
MediaPipe Team
f4fd1063a7 Add helper methods to load saved model from external files in model maker.
PiperOrigin-RevId: 480444918
2022-10-11 13:58:05 -07:00
MediaPipe Team
6fa455f40e Dataclasses for text classifier
PiperOrigin-RevId: 480178697
2022-10-10 14:33:31 -07:00
kinaryml
0a8dbc7576 Added remaining parameters to initialize the Rect data class 2022-10-10 13:58:37 -07:00
Yuqi Li
cbc7eb661b Add metadata_info.py for metadata writer.
PiperOrigin-RevId: 480146881
2022-10-10 12:13:46 -07:00
kinaryml
c2672d040f Updated error message for the invalid model path test case 2022-10-10 08:19:12 -07:00
Kinar R
a29035b91e
Merge branch 'google:master' into image-classification-python-impl 2022-10-10 20:46:18 +05:30
kinaryml
44e6f8e1a1 Updated image classifier to use a region of interest parameter 2022-10-10 08:15:40 -07:00
MediaPipe Team
62d2ae601e Internal change
PiperOrigin-RevId: 480034669
2022-10-10 02:54:18 -07:00
MediaPipe Team
1ab332835a Add a string-to-bool test model to TextClassifier.
PiperOrigin-RevId: 479803799
2022-10-08 09:44:08 -07:00
kinaryml
cb806071ba Added more tests and updated the APIs to use a new constant 2022-10-07 22:26:49 -07:00
MediaPipe Team
08ae99688c Java result class for gesture recognizer Tasks API.
PiperOrigin-RevId: 479731746
2022-10-07 22:02:07 -07:00
MediaPipe Team
635dc0a24e Internal change
PiperOrigin-RevId: 479724318
2022-10-07 20:44:07 -07:00
Yuqi Li
65e1d722eb Update external files to support file_pointer_meta.
PiperOrigin-RevId: 479695361
2022-10-07 16:46:24 -07:00
MediaPipe Team
b616bc4427 Migrate landmarks deduplication to mediapipe tasks.
PiperOrigin-RevId: 479681836
2022-10-07 15:34:30 -07:00
MediaPipe Team
d90daa859f Internal change
PiperOrigin-RevId: 479544054
2022-10-07 04:09:01 -07:00
MediaPipe Team
db524adf0d Internal change
PiperOrigin-RevId: 479450607
2022-10-06 17:22:01 -07:00
MediaPipe Team
65d001c6a0 Change gesture classification output type to ClassificationList.
PiperOrigin-RevId: 479441969
2022-10-06 16:38:07 -07:00
MediaPipe Team
71a4680a16 Update Destination with Cast to make it aligned with Source.
PiperOrigin-RevId: 479433889
2022-10-06 15:58:48 -07:00
MediaPipe Team
d0707227e4 Remove no-op/unnecessary Multi(Source|Destination)Impl.
PiperOrigin-RevId: 479426473
2022-10-06 15:27:31 -07:00
MediaPipe Team
1b0ab6f9b8 Internal change.
PiperOrigin-RevId: 479410627
2022-10-06 14:18:27 -07:00
Yuqi Li
f49fb9ad57 move unzip logits from metadata_extractor to zip_utils.
PiperOrigin-RevId: 479346238
2022-10-06 10:20:46 -07:00
Jiuqiang Tang
e270ef660d Internal change
PiperOrigin-RevId: 479295433
2022-10-06 06:09:00 -07:00
MediaPipe Team
b72219f1e5 Internal change
PiperOrigin-RevId: 479235176
2022-10-05 23:56:30 -07:00
Yuqi Li
42978d3e69 MediaPipe MedataExtractor: use absl::Cleanup for unzClose / unzCloseCurrentFile.
PiperOrigin-RevId: 479211019
2022-10-05 20:42:48 -07:00