cassdlcm/mediapipe
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
2,755 Commits 10 Branches 56 Tags 829 MiB
c698414c71
Commit Graph

2438 Commits

Author SHA1 Message Date
Prianka Liz Kariat
75daf4e756 Updated iOS hand landmarker documentation to use swift names 2023-09-08 19:16:15 +05:30
Prianka Liz Kariat
18f16f6bb5 Updated iOS gesture recognizer documentation to use Swift names 2023-09-08 19:15:56 +05:30
Prianka Liz Kariat
900e637b6a Fixed typos in iOS documentation 2023-09-08 19:15:32 +05:30
MediaPipe Team
886a118232 landmarks_to_detection stream utility function. 
PiperOrigin-RevId: 563633314
 2023-09-07 21:40:45 -07:00
MediaPipe Team
7549677408 Internal update 
PiperOrigin-RevId: 563553758
 2023-09-07 14:58:39 -07:00
MediaPipe Team
80b762a281 No public description 
PiperOrigin-RevId: 563543098
 2023-09-07 14:19:08 -07:00
Sebastian Schmidt
6c38483b37 Add externs to js_library targets 
PiperOrigin-RevId: 563500180
 2023-09-07 11:52:30 -07:00
vrabaud
55536c4382 No public description 
PiperOrigin-RevId: 563333271
 2023-09-07 00:00:38 -07:00
MediaPipe Team
5f4a6e313e Format improvement. 
PiperOrigin-RevId: 563321343
 2023-09-06 23:02:05 -07:00
MediaPipe Team
3ce457006f Remove video and streaming mode for face stylizer. 
PiperOrigin-RevId: 563312344
 2023-09-06 22:20:43 -07:00
MediaPipe Team
a9da6d325c Move stream API landmarks_projection to third_party. 
PiperOrigin-RevId: 563246209
 2023-09-06 16:21:09 -07:00
MediaPipe Team
7252f6f2e7 Remove video and stream model in face stylizer. 
PiperOrigin-RevId: 563233996
 2023-09-06 15:33:58 -07:00
MediaPipe Team
b40b3973fb Add notes/warnings for calculators which use dedicated GL contexts. 
PiperOrigin-RevId: 563167765
 2023-09-06 11:40:21 -07:00
MediaPipe Team
e58ec2d039 No public description 
PiperOrigin-RevId: 563163901
 2023-09-06 11:30:53 -07:00
MediaPipe Team
967007f250 No public description 
PiperOrigin-RevId: 563145860
 2023-09-06 10:35:52 -07:00
Prianka Liz Kariat
1ffa999abb Replaced the old iOS vision task runner with the refactored task runner 2023-09-06 18:55:03 +05:30
MediaPipe Team
e39119ae53 Add missing cache writing implementation in InferenceCalculatorAdvancedGL 
Add missing implementation for absl::Status SaveGpuCachesBasedOnBehavior(tflite::gpu::TFLiteGPURunner* gpu_runner) const for non android/chromeos.

PiperOrigin-RevId: 562973338
 2023-09-05 20:51:36 -07:00
MediaPipe Team
bf32d1acb2 No public description 
PiperOrigin-RevId: 562915674
 2023-09-05 15:52:21 -07:00
MediaPipe Team
4e52e96973 No public description 
PiperOrigin-RevId: 562865700
 2023-09-05 13:03:27 -07:00
Sebastian Schmidt
2aefa2308b Internal 
PiperOrigin-RevId: 562834129
 2023-09-05 11:10:55 -07:00
Copybara-Service
a87613aa6c Merge pull request #4750 from priankakariatyml:ios-vision-task-runner-refactor-impl-part2 
PiperOrigin-RevId: 562823970
 2023-09-05 10:39:19 -07:00
Fergus Henderson
a19da25565 Some spelling and grammar fixes in the comments. 
PiperOrigin-RevId: 562802023
 2023-09-05 09:28:50 -07:00
MediaPipe Team
be0cde8c2e No public description 
PiperOrigin-RevId: 562724334
 2023-09-05 03:39:37 -07:00
MediaPipe Team
cac462c486 Add allow_custom_ops to model_util.convert_to_tflite and enable custom ops for face stylizer. 
PiperOrigin-RevId: 562212965
 2023-09-02 09:56:40 -07:00
MediaPipe Team
d6119957a4 No public description 
PiperOrigin-RevId: 562075110
 2023-09-01 16:31:33 -07:00
MediaPipe Team
ab70d92752 No public description 
PiperOrigin-RevId: 562071599
 2023-09-01 16:14:06 -07:00
MediaPipe Team
23057ac146 Update PackMediaSequenceCalculator to support setting clip/media/string, clip/media/confidence and clip/label/index. 
The input stream is provided as drishti::Detection.

PiperOrigin-RevId: 562070790
 2023-09-01 16:08:52 -07:00
Copybara-Service
e7d071ab39 Merge pull request #4745 from priankakariatyml:ios-image-segmenter-impl 
PiperOrigin-RevId: 562020873
 2023-09-01 12:34:30 -07:00
MediaPipe Team
6c43d37e5a Provide API/options to show intermediate results and generating progress for Java Image Generator. 
PiperOrigin-RevId: 562014712
 2023-09-01 12:32:26 -07:00
MediaPipe Team
ceb8cd3c78 internal update. 
PiperOrigin-RevId: 561995330
 2023-09-01 10:57:40 -07:00
MediaPipe Team
823493ee82 Internal update. 
PiperOrigin-RevId: 561995055
 2023-09-01 10:53:00 -07:00
MediaPipe Team
007824594b Rollback of "Enable defining and using internal executors in subgraphs." 
PiperOrigin-RevId: 561921927
 2023-09-01 04:57:34 -07:00
Prianka Liz Kariat
40da111ba7 Updated iOS object detector to use refactored vision task runner 2023-09-01 14:07:42 +05:30
Prianka Liz Kariat
188321ace4 Updated iOS hand landmarker to use refactored vision task runner 2023-09-01 14:07:25 +05:30
Prianka Liz Kariat
020ca5eb77 Updated iOS gesture recognizer to use refactored vision task runner 2023-09-01 14:07:07 +05:30
Prianka Liz Kariat
fe9c7a47e9 Updated iOS face landmarker to use refactored vision task runner 2023-09-01 14:06:50 +05:30
MediaPipe Team
de0c7f2a30 Make cache writes optional in InferenceCalculatorAdvancedGL 
Previously, caches were always written, and an error would cause the graph to close abruptly. This prevented services with read-only access to the cache from using the calculator.

The new behavior allows services to choose whether or not to write caches.

PiperOrigin-RevId: 561866791
 2023-08-31 23:31:27 -07:00
MediaPipe Team
dea6ccba25 Remove unnecessary includes in threadpool_std_thread_impl.cc. 
The windows.h was causing conflicts with LOG. Also the the posix headers weren't needed because the code doesn't use OS specific code anymore.

PiperOrigin-RevId: 561848229
 2023-08-31 21:52:22 -07:00
Sebastian Schmidt
9bb852c33d Add libimagegenerator_gpu.so 
PiperOrigin-RevId: 561800710
 2023-08-31 17:10:00 -07:00
Copybara-Service
827c2983bd Merge pull request #4743 from priankakariatyml:ios-vision-task-runner-refactor-impl 
PiperOrigin-RevId: 561796747
 2023-08-31 16:53:14 -07:00
MediaPipe Team
81732944c4 No public description 
PiperOrigin-RevId: 561775271
 2023-08-31 15:22:43 -07:00
MediaPipe Team
afcb9c4216 No public description 
PiperOrigin-RevId: 561773992
 2023-08-31 15:17:51 -07:00
MediaPipe Team
62e682363c Remove reference pointer to prevent using a constant reference in the looped iteration variable 
PiperOrigin-RevId: 561758116
 2023-08-31 14:17:51 -07:00
MediaPipe Team
7c2d654d67 Convert CHECK macro to ABSL_CHECK. 
Chrome can't use Absl's CHECK because of collisions with its own version.

PiperOrigin-RevId: 561740965
 2023-08-31 13:20:29 -07:00
Prianka Liz Kariat
d16cb72438 Fixed method call in MPPImageSegmenter.mm 2023-08-31 18:04:09 +05:30
Prianka Liz Kariat
9f01540191 Changed order of methods in MPPImageSegmenter.mm 2023-08-31 18:02:34 +05:30
Prianka Liz Kariat
ba685567dd Updated iOS image classifier to use refactored vision task runner 2023-08-31 17:56:36 +05:30
Prianka Liz Kariat
e7a0ed84e6 Updated iOS face detector to use refactored vision task runner 2023-08-31 17:37:15 +05:30
Prianka Liz Kariat
ec87f068c1 Renamed option in MPPImageSegmenterOptions 2023-08-31 17:31:54 +05:30
Prianka Liz Kariat
bac3efdf6a Fixed typo in MPPImageSegmenter.h 2023-08-31 17:31:17 +05:30
Prianka Liz Kariat
5a1564e04c Updated image segmenter bazel target to add MPPImageSegmenter.mm 2023-08-31 14:22:17 +05:30
Prianka Liz Kariat
0863d8def5 Added iOS image segmenter implementation file 2023-08-31 14:04:34 +05:30
Prianka Liz Kariat
f74f7b8657 Fixed typo 2023-08-31 14:04:17 +05:30
Prianka Liz Kariat
47e7ec47a2 Changed delegate method to optional 2023-08-31 14:04:09 +05:30
Copybara-Service
30802b80cd Merge pull request #4735 from priankakariatyml:ios-doc-updates 
PiperOrigin-RevId: 561469442
 2023-08-30 15:39:20 -07:00
MediaPipe Team
612162d765 Check if the image contains valid face that can be aligned for stylization. If not, throw an exception for invalid input image. This is applied to both input stylized face and raw face. 
PiperOrigin-RevId: 561439600
 2023-08-30 13:54:11 -07:00
MediaPipe Team
c92570f844 Use ABSL_LOG in MediaPipe. 
This is needed in Chrome builds to avoid collisions with its own LOG.

PiperOrigin-RevId: 561436864
 2023-08-30 13:43:49 -07:00
Jiuqiang Tang
f60da2120d Internal changes 
PiperOrigin-RevId: 561398473
 2023-08-30 11:26:57 -07:00
MediaPipe Team
5434b840f6 Improving throttling logs by providing a node info corresponding to a throttling stream. 
PiperOrigin-RevId: 561396272
 2023-08-30 11:21:31 -07:00
MediaPipe Team
45b0271ded No public description 
PiperOrigin-RevId: 561379537
 2023-08-30 10:27:02 -07:00
Prianka Liz Kariat
3e90e8d464 Fixed directory creation issues in build_ios_framework.sh 2023-08-30 16:28:17 +05:30
Prianka Liz Kariat
763bc8c71c Fixed typos 2023-08-30 16:27:52 +05:30
Prianka Liz Kariat
298578e10e Added gesture recognizer and hand landmarker to iOS vision framework 2023-08-30 14:51:05 +05:30
MediaPipe Team
6c2638592e Internal update. 
PiperOrigin-RevId: 561184322
 2023-08-29 17:34:35 -07:00
MediaPipe Team
e18e749e3e Internal update 
PiperOrigin-RevId: 561148365
 2023-08-29 15:04:33 -07:00
MediaPipe Team
01fbbd9f67 No public description 
PiperOrigin-RevId: 561067189
 2023-08-29 10:18:06 -07:00
MediaPipe Team
f56b8a13a3 Add a custom op resolver for fused batch norm. 
PiperOrigin-RevId: 560795170
 2023-08-28 13:04:10 -07:00
MediaPipe Team
442940cd55 No public description 
PiperOrigin-RevId: 560743684
 2023-08-28 10:08:49 -07:00
MediaPipe Team
b22dcf9ce6 No public description 
PiperOrigin-RevId: 560652313
 2023-08-28 02:50:07 -07:00
MediaPipe Team
d6dce193fc Internal update 
PiperOrigin-RevId: 560147650
 2023-08-25 11:22:58 -07:00
Copybara-Service
5d2d8f9ab2 Merge pull request #4721 from priankakariatyml:ios-doc-updates 
PiperOrigin-RevId: 560133185
 2023-08-25 10:37:51 -07:00
Prianka Liz Kariat
3f0ec5969b Updated iOS docs to use swift names in place of objective c names 2023-08-25 18:06:50 +05:30
MediaPipe Team
6e6978cdbf New image test utilities and memory management fixes. 
PiperOrigin-RevId: 559926378
 2023-08-24 18:02:55 -07:00
MediaPipe Team
dd09c8d3f7 Update port includes with IWYU to fix clang warnings in code where corresponding ports are used. 
PiperOrigin-RevId: 559920115
 2023-08-24 17:33:34 -07:00
Zu Kim
c56f45bce5 Change the image label input from Classification to Detection. 
PiperOrigin-RevId: 559828139
 2023-08-24 12:08:25 -07:00
Richard Levasseur
f2e9a553d6 No public description 
PiperOrigin-RevId: 559787614
 2023-08-24 10:06:00 -07:00
Sebastian Schmidt
4fb52bb7ef Add 'types' to package.json 
Fixes gttps://github.com/google/mediapipe/issues/4659

PiperOrigin-RevId: 559785635
 2023-08-24 09:58:44 -07:00
MediaPipe Team
4b1b6ae7fb Move stream API rect_transformation to third_party. 
PiperOrigin-RevId: 559652775
 2023-08-23 23:11:47 -07:00
MediaPipe Team
b2446c6ca8 No public description 
PiperOrigin-RevId: 559566037
 2023-08-23 15:50:34 -07:00
Sebastian Schmidt
f3d069175c Add C++ converters for C Text Classifier API 
PiperOrigin-RevId: 559519880
 2023-08-23 13:08:40 -07:00
MediaPipe Team
f645c59746 Move stream API image_size to third_party. 
PiperOrigin-RevId: 559475476
 2023-08-23 10:45:18 -07:00
Nevena Kotlaja
8689f4f595 No public description 
PiperOrigin-RevId: 559466191
 2023-08-23 10:21:28 -07:00
MediaPipe Team
2ebdb01d43 ImageGenerator Java API 
PiperOrigin-RevId: 559310074
 2023-08-22 21:42:16 -07:00
MediaPipe Team
90781669cb No public description 
PiperOrigin-RevId: 559275983
 2023-08-22 18:04:11 -07:00
MediaPipe Team
3443fe4c8e No public description 
PiperOrigin-RevId: 559211117
 2023-08-22 13:43:27 -07:00
MediaPipe Team
8c4b971c14 Add an API in model_task_graph to create or use cached model resources. 
PiperOrigin-RevId: 559174528
 2023-08-22 11:34:54 -07:00
MediaPipe Team
bcb83302bf Add pose landmarks constants 
PiperOrigin-RevId: 559153433
 2023-08-22 10:32:10 -07:00
MediaPipe Team
7517b56476 No public description 
PiperOrigin-RevId: 559133490
 2023-08-22 09:26:33 -07:00
MediaPipe Team
edb0a64d0e Move stream API loopback to third_party. 
PiperOrigin-RevId: 559037020
 2023-08-22 01:44:24 -07:00
MediaPipe Team
9bc8b3bb4f Update the header information for EnsureMinimumDefaultExecutorStackSize. 
PiperOrigin-RevId: 558981535
 2023-08-21 21:26:32 -07:00
MediaPipe Team
7ba4edc372 Internal Change 
PiperOrigin-RevId: 558937644
 2023-08-21 16:55:44 -07:00
MediaPipe Team
7f8150776a Add an API to run inference with face stylizer TF model. 
PiperOrigin-RevId: 558926645
 2023-08-21 16:08:58 -07:00
MediaPipe Team
bbf168ddda Add a new from_image API to create face stylizer dataset from a single image. Also deprecate the from_folder API since we only support one-shot use case now. 
PiperOrigin-RevId: 558912896
 2023-08-21 15:14:36 -07:00
MediaPipe Team
ae9e945e0c Change SegmentationOptions.builder() to be public 
PiperOrigin-RevId: 558864872
 2023-08-21 12:18:17 -07:00
MediaPipe Team
737c103940 Add output size as parameters in Java ImageSegmenter 
PiperOrigin-RevId: 558834692
 2023-08-21 10:45:08 -07:00
MediaPipe Team
cd9d32e797 update pose rendering 
PiperOrigin-RevId: 558424354
 2023-08-19 10:40:26 -07:00
MediaPipe Team
a44c810921 Update PackMediaSequenceCalculator to support adding clip/media/id to the MediaSequence. 
As the media ID is usually a video ID which is provided to the graph as a side packet, in this graph it expects it to be provided as as a input side packet instead of an input stream.

PiperOrigin-RevId: 558266967
 2023-08-18 15:48:40 -07:00
MediaPipe Team
fda0d19337 Adds option to use tensor_ahwb in Android vendor processes 
PiperOrigin-RevId: 558086646
 2023-08-18 02:31:58 -07:00
Chris McClanahan
a04a3a1c81 internal fix 
PiperOrigin-RevId: 557934477
 2023-08-17 14:20:58 -07:00
Copybara-Service
6866d338e0 Merge pull request #4645 from priankakariatyml:ios-vision-task-runner-refactoring 
PiperOrigin-RevId: 557894034
 2023-08-17 12:02:07 -07:00
MediaPipe Team
b213256cbd Change supported_ops to a Tuple instead of List to match the API definition. 
PiperOrigin-RevId: 557890361
 2023-08-17 11:48:56 -07:00
Sebastian Schmidt
990bfd2e3e Don't access "document" in WebWorker 
Fixes https://github.com/google/mediapipe/issues/4694

PiperOrigin-RevId: 557885230
 2023-08-17 11:32:55 -07:00
Prianka Liz Kariat
22dc08be0e Removed convenience initializer from refactored MPPVisionTaskRunner 2023-08-17 14:15:14 +05:30
MediaPipe Team
ed0c8d8d8b Swap left and right hand labels. 
PiperOrigin-RevId: 557625660
 2023-08-16 15:51:19 -07:00
MediaPipe Team
13bb65db96 Internal Changes 
PiperOrigin-RevId: 557563669
 2023-08-16 12:16:16 -07:00
MediaPipe Team
9e45e2b6e9 Setting training for the encoder and decoder when converting to TFLite. 
Also add selected TF ops to TFLite converter.

PiperOrigin-RevId: 557520277
 2023-08-16 10:02:29 -07:00
MediaPipe Team
ee217ceb67 Fix MediaPipe build in Chromium. 
When building Chromium with Clang on Windows, it needs the template specializations to be declared as well.

PiperOrigin-RevId: 557508703
 2023-08-16 09:23:15 -07:00
Sebastian Schmidt
251ffc21c8 No public description 
PiperOrigin-RevId: 557501469
 2023-08-16 08:58:14 -07:00
MediaPipe Team
ff3f0433d3 Fix image_util shortcut import line 
PiperOrigin-RevId: 557311617
 2023-08-15 18:19:13 -07:00
MediaPipe Team
1c98270ef0 Import image_util for using it in mediapipe face stylizer open sourcing. 
PiperOrigin-RevId: 557254489
 2023-08-15 14:41:57 -07:00
MediaPipe Team
cda0ba04ed Dry-Run mode for static registration to make it easier to find all required static registrations 
PiperOrigin-RevId: 557185347
 2023-08-15 11:03:18 -07:00
MediaPipe Team
c1d7e6023a Expose tool calculators in headers to enable dynamic registration by superusers. 
PiperOrigin-RevId: 557174440
 2023-08-15 10:32:45 -07:00
MediaPipe Team
a392561b31 Internal change 
PiperOrigin-RevId: 557015628
 2023-08-14 22:16:20 -07:00
MediaPipe Team
0da296536b Expose stream handlers in headers to allow dynamic registration for superusers 
PiperOrigin-RevId: 556988288
 2023-08-14 20:01:50 -07:00
MediaPipe Team
b6f5414b3d Support more GPU formats in tensor converter calculator. 
PiperOrigin-RevId: 556987807
 2023-08-14 19:57:05 -07:00
MediaPipe Team
a183212a13 Header for callback_packet_calculator to allow dynamic registration for superusers 
PiperOrigin-RevId: 556977122
 2023-08-14 18:50:11 -07:00
MediaPipe Team
9c5bdd2eb9 Clarify deprecated GraphStatus usage in Close documentation 
PiperOrigin-RevId: 556963967
 2023-08-14 17:53:32 -07:00
MediaPipe Team
dd940707ca Provide a way to disable static registration using MEDIAPIPE_DISABLE_STATIC_REGISTRATION 
PiperOrigin-RevId: 556963956
 2023-08-14 17:48:25 -07:00
MediaPipe Team
6605fdb16f add end loop calculator for image size 
PiperOrigin-RevId: 556955370
 2023-08-14 17:09:02 -07:00
MediaPipe Team
a8bee6baf3 Updates the runners to support wasm-style binary assets files, and allows their URLs to be explicitly specified as part of the WasmFileset. 
PiperOrigin-RevId: 556903356
 2023-08-14 13:59:53 -07:00
MediaPipe Team
c8ad606e7c Refactor text_classifier preprocessor to move away from using classifier_data_lib 
PiperOrigin-RevId: 556859900
 2023-08-14 11:41:09 -07:00
MediaPipe Team
3ac3b03ed5 Migrate packet messages auto registration to rely on MEDIAPIPE_STATIC_REGISTRATOR_TEMPLATE 
PiperOrigin-RevId: 556063007
 2023-08-11 13:14:29 -07:00
Yuqi Li
c448d54aa7 add metadata writer into face stylizer. 
PiperOrigin-RevId: 555596257
 2023-08-10 12:09:27 -07:00
MediaPipe Team
91f15d8e4a Enable run inference with a TFLite model containing multiple subgraphs. It uses the subgraph 0 as the default primary subgraph for inference. It will also log a warning in the case that there are more than one subgraph in the model. 
PiperOrigin-RevId: 555579131
 2023-08-10 11:30:32 -07:00
MediaPipe Team
a9c7e22ca4 apply affine transform before drawing, in order to keep constant line width regardless of face cropping. 
PiperOrigin-RevId: 555173659
 2023-08-09 08:42:57 -07:00
MediaPipe Team
00e0314040 Remove unsafe cast. 
PiperOrigin-RevId: 555007705
 2023-08-08 18:50:11 -07:00
MediaPipe Team
f9a0244c5b No public description 
PiperOrigin-RevId: 555005770
 2023-08-08 18:38:34 -07:00
MediaPipe Team
e558a71597 Include calculator_context.h and calculator_contract.h from calculator_framework.h 
PiperOrigin-RevId: 554931086
 2023-08-08 13:54:59 -07:00
MediaPipe Team
39b31e51a9 No public description 
PiperOrigin-RevId: 554673463
 2023-08-07 20:15:34 -07:00
MediaPipe Team
032ed973b6 Add setGpuBufferVerticalFlip to GraphRunner TS API 
PiperOrigin-RevId: 554667869
 2023-08-07 19:44:21 -07:00
MediaPipe Team
c1c51c2fe7 Internal 
PiperOrigin-RevId: 554595324
 2023-08-07 14:36:42 -07:00
Zu Kim
22054cd468 Set confidence score of the bounding box label. 
PiperOrigin-RevId: 554508925
 2023-08-07 10:01:59 -07:00
MediaPipe Team
e10bcd1bfd No public description 
PiperOrigin-RevId: 554084475
 2023-08-05 08:36:24 -07:00
Zu Kim
460346ed13 Add a support for label annotations (image/label/string and image/label/confidence). Also fixed some clang tidy issues. 
PiperOrigin-RevId: 553900667
 2023-08-04 13:43:44 -07:00
MediaPipe Team
11508f2291 Internal Change 
PiperOrigin-RevId: 553652444
 2023-08-03 18:49:35 -07:00
MediaPipe Team
360959e325 Replace some size EXPECTs by ASSERTs 
PiperOrigin-RevId: 553555650
 2023-08-03 12:27:52 -07:00
MediaPipe Team
a0b91e4062 Add a GpuOrigin parameter to TensorConverterCalculator 
The parameter superseeds flip_vertically. GpuOrigin works more generally than flip_vertically because CONVENTIONAL works on both iOS (no flip) and Android (yes flip). If not set, the calculator falls back to flip_vertically for backwards compatibility.

Note that web demos actually use TOP_LEFT image orientation, so they shouldn't be flipped, but they still are by CONVENTIONAL. That's being discussed right now.

PiperOrigin-RevId: 553400525
 2023-08-03 01:40:13 -07:00
MediaPipe Team
9325af0af3 vlog default executor and its config usage 
PiperOrigin-RevId: 553298440
 2023-08-02 17:01:05 -07:00
MediaPipe Team
e56636b6d1 internal change 
PiperOrigin-RevId: 553250547
 2023-08-02 14:06:16 -07:00
MediaPipe Team
366a3290cf Change to add the w_avg latent code to style encoding before layer swapping. This is a bug in the previous code. Also set training=True for encoder since this affect the encoding performance. 
PiperOrigin-RevId: 553234376
 2023-08-02 13:11:22 -07:00
MediaPipe Team
6e54d8c204 Log stack traces for combined CalculatorGraph statuses 
PiperOrigin-RevId: 553111356
 2023-08-02 05:10:52 -07:00
MediaPipe Team
557ed0b1ea Add tensorflow-addons to model_maker requirements.txt 
PiperOrigin-RevId: 552610011
 2023-07-31 15:36:25 -07:00
MediaPipe Team
6f916a001c Fix crash in SavePngTestOutput 
Do not call SavePngTestOutput in CompareAndSaveImageOutput in case diff_img is null. This can happen if for instance the expected and the actual image have non-matching format or size. Currently, this crashes.
Support single channel golden images.

PiperOrigin-RevId: 552519834
 2023-07-31 10:20:06 -07:00
MediaPipe Team
8e313b4b0c Fix typo in model maker requirements.txt 
PiperOrigin-RevId: 551973577
 2023-07-28 16:07:12 -07:00
Sebastian Schmidt
b4bcfab4f5 Remove extra letter from text classifier API 
PiperOrigin-RevId: 551942087
 2023-07-28 13:56:56 -07:00
MediaPipe Team
3f7752561b No public description 
PiperOrigin-RevId: 551914786
 2023-07-28 12:05:38 -07:00
MediaPipe Team
9edb059d9f No public description 
PiperOrigin-RevId: 551868738
 2023-07-28 09:09:39 -07:00
MediaPipe Team
7db0c1944b Internal change 
PiperOrigin-RevId: 551789915
 2023-07-28 02:29:52 -07:00
MediaPipe Team
db9a72a5df Internal Changes 
PiperOrigin-RevId: 551674542
 2023-07-27 16:35:35 -07:00
MediaPipe Team
5c007558f8 internal change. 
PiperOrigin-RevId: 551645248
 2023-07-27 14:45:18 -07:00
Sebastian Schmidt
4d5c6bd33a Internal 
PiperOrigin-RevId: 551625147
 2023-07-27 13:33:14 -07:00
Sebastian Schmidt
fdea10d230 Add C Headers for Text Classifier 
PiperOrigin-RevId: 551618765
 2023-07-27 13:09:49 -07:00
Sebastian Schmidt
7d9cb4ee67 No public description 
PiperOrigin-RevId: 551586945
 2023-07-27 11:17:54 -07:00
MediaPipe Team
f3f9e71ccb No public description 
PiperOrigin-RevId: 551549511
 2023-07-27 09:15:46 -07:00
MediaPipe Team
6de275834d internal change. 
PiperOrigin-RevId: 551366789
 2023-07-26 17:59:06 -07:00
Sebastian Schmidt
c9d79a0076 Rollback of "Fix duplicate condition error in :resource_util" 
PiperOrigin-RevId: 551332734
 2023-07-26 15:31:51 -07:00
MediaPipe Team
fa5c1b03d2 No public description 
PiperOrigin-RevId: 551277242
 2023-07-26 12:08:33 -07:00
Sebastian Schmidt
750f498b14 Internal 
PiperOrigin-RevId: 551247471
 2023-07-26 10:33:19 -07:00
Prianka Liz Kariat
d2a86341bd Added refactored iOS vision task runner sources 2023-07-26 20:02:00 +05:30
MediaPipe Team
1f6851c577 C++ Image segmenter add output size parameters. 
PiperOrigin-RevId: 550995124
 2023-07-25 14:22:11 -07:00
MediaPipe Team
bd7888cc0c 1. Move evaluation onto GPU/TPU hardware if available. 
2. Move desired_precision and desired_recall from evaluate to hyperparameters so recall@precision metrics will be reported for both training and evaluation. This also fixes a bug where recompiling the model with the previously initialized metric objects would not properly reset the metric states.
3. Remove redundant label_names from create_... class methods in text_classifier. This information is already provided by the datasets.
4. Change loss function to FocalLoss.
5. Re-enable text_classifier unit tests using ExBert
6. Add input names to avoid flaky auto-assigned input names.

PiperOrigin-RevId: 550992146
 2023-07-25 14:12:26 -07:00
MediaPipe Team
85c3fed70a Add class weights to core hyperparameters and classifier library. 
PiperOrigin-RevId: 550962843
 2023-07-25 12:29:46 -07:00
MediaPipe Team
62538a9496 No public description 
PiperOrigin-RevId: 550954023
 2023-07-25 11:57:08 -07:00
MediaPipe Team
113c9b30c2 No public description 
PiperOrigin-RevId: 550616150
 2023-07-24 11:09:31 -07:00
Copybara-Service
66cceddb5e Merge pull request #4639 from priankakariatyml:ios-image-segmenter-container-utils 
PiperOrigin-RevId: 550608973
 2023-07-24 10:46:56 -07:00
Prianka Liz Kariat
72c62f7d5d Added iOS Image Segmenter Header 2023-07-24 20:38:16 +05:30
MediaPipe Team
25b01784de Fix documentation 
PiperOrigin-RevId: 549968822
 2023-07-21 09:33:48 -07:00
MediaPipe Team
9af637b125 Java API add visibility and presence for landmarks. 
PiperOrigin-RevId: 549709256
 2023-07-20 12:42:01 -07:00
Prianka Liz Kariat
540f4f7fe6 Fixed swift name of iOS face landmarker delegate 2023-07-20 15:57:37 +05:30
Prianka Liz Kariat
3198ccf6a5 Added missing headers in ios vision framework build 2023-07-20 15:57:16 +05:30
Steven Hickson
e47af74b15 Adding support for 2 things in tensors_to_image_calculator: 
1) 1 channel support for conversion after inference.
2) multitask support by allowing for different tensor outputs.

PiperOrigin-RevId: 549412331
 2023-07-19 13:41:46 -07:00
MediaPipe Team
085840388b Move waitOnCpu and waitOnGpu out of the synchronized block, which can cause deadlock. 
PiperOrigin-RevId: 549217916
 2023-07-18 23:42:01 -07:00
MediaPipe Team
4e72fcf0cb Replace CHECK with RET_CHECK in GetContract() implementation from six calculators. 
PiperOrigin-RevId: 549158984
 2023-07-18 17:38:44 -07:00
MediaPipe Team
4c60fe7365 add pose landmarks connections in C++ API 
PiperOrigin-RevId: 549108310
 2023-07-18 14:21:02 -07:00
MediaPipe Team
9b00582f21 add hand landmarks connections in C++ API. 
PiperOrigin-RevId: 549108307
 2023-07-18 14:16:27 -07:00
MediaPipe Team
cb915858fa Internal change 
PiperOrigin-RevId: 549052451
 2023-07-18 11:01:37 -07:00
Jiuqiang Tang
0c01187cf5 Internal change 
PiperOrigin-RevId: 548886447
 2023-07-17 21:57:24 -07:00
MediaPipe Team
ef12ce8575 Internal change 
PiperOrigin-RevId: 548821518
 2023-07-17 15:56:05 -07:00
MediaPipe Team
f1f9f80cd9 Internal change 
PiperOrigin-RevId: 548746432
 2023-07-17 11:18:00 -07:00
MediaPipe Team
17bc1a5ab5 Internal change 
PiperOrigin-RevId: 548196034
 2023-07-14 12:39:45 -07:00
MediaPipe Team
2fae07375c Discard outdated packets earlier in MuxInputStreamHandler. 
In our pipeline, a deadlock is detected because the packets in deselected
data streams get piled up. In the current implementation, those packets only get
removed in FillInputSet(), but we should also do that in GetNodeReadiness().

PiperOrigin-RevId: 548051369
 2023-07-14 01:12:14 -07:00
MediaPipe Team
723e91cec1 Generalize non-define registration with MEDIAPIPE_STATIC_REGISTRATOR_TEMPLATE 
PiperOrigin-RevId: 547929982
 2023-07-13 14:52:37 -07:00
MediaPipe Team
c2c67c20fa Internal change 
PiperOrigin-RevId: 547924907
 2023-07-13 14:37:40 -07:00
Sebastian Schmidt
327feb42d1 Support WASM asset loading for MediaPipe Task Web 
PiperOrigin-RevId: 547882566
 2023-07-13 12:26:59 -07:00
MediaPipe Team
8b59567cb7 Add proto3 Any proto support for Java task api 
PiperOrigin-RevId: 547836041
 2023-07-13 10:10:17 -07:00
MediaPipe Team
251c5421f6 Internal change 
PiperOrigin-RevId: 547735699
 2023-07-13 02:53:16 -07:00
MediaPipe Team
450c933cb5 MEDIAPIPE_NODE/SUBGRAPH_IMPLEMENTATION to use common define for registration 
PiperOrigin-RevId: 547669538
 2023-07-12 20:10:15 -07:00
MediaPipe Team
cc2aa4f4cc InferenceCalculatorAdvancedGL save cache in Open(). 
PiperOrigin-RevId: 547652481
 2023-07-12 18:09:51 -07:00
MediaPipe Team
a2cd3e7f95 Internal change 
PiperOrigin-RevId: 547614484
 2023-07-12 15:17:40 -07:00
MediaPipe Team
37b68714b8 Internal change 
PiperOrigin-RevId: 547424721
 2023-07-12 01:32:51 -07:00
MediaPipe Team
3e93cbc838 Internal change 
PiperOrigin-RevId: 547404737
 2023-07-12 00:04:40 -07:00
Yilei Yang
917af2ce6b Internal change 
PiperOrigin-RevId: 547346939
 2023-07-11 17:52:07 -07:00
Sebastian Schmidt
f2f49b9fc8 Add angle to BoundingBox 
PiperOrigin-RevId: 547321781
 2023-07-11 16:00:35 -07:00
MediaPipe Team
aabf61f28d Internal Change 
PiperOrigin-RevId: 547299595
 2023-07-11 14:35:18 -07:00
MediaPipe Team
56bc019819 Model Maker allow core dataset library to handle datasets with unknown sizes. 
PiperOrigin-RevId: 547268411
 2023-07-11 12:47:37 -07:00
MediaPipe Team
4788fddde9 Internal Change 
PiperOrigin-RevId: 547265380
 2023-07-11 12:34:32 -07:00
MediaPipe Team
e4ec4d2526 Internal change 
PiperOrigin-RevId: 547258228
 2023-07-11 12:05:58 -07:00
MediaPipe Team
bf6561ce91 add symmetric color style option 
PiperOrigin-RevId: 547069284
 2023-07-10 21:41:01 -07:00
MediaPipe Team
0bde987a38 Removed internal dependency on OpenCV 3.x, migrating it to OpenCV 4.x 
PiperOrigin-RevId: 546945166
 2023-07-10 12:17:54 -07:00
Copybara-Service
df3f4167ae Merge pull request #4600 from priankakariatyml:ios-orientation-fix 
PiperOrigin-RevId: 546358930
 2023-07-07 12:56:39 -07:00
MediaPipe Team
d45b15ef84 Add face landmarks connections for C++. 
PiperOrigin-RevId: 546345842
 2023-07-07 12:08:09 -07:00
Prianka Liz Kariat
cae10ea115 Updated documentation of MPImage 2023-07-07 22:03:15 +05:30
Prianka Liz Kariat
7556a3f1b4 Changed left and right image orientation angles to match iOS UIImageOrientation 2023-07-07 19:57:44 +05:30
MediaPipe Team
cb1035a9ee Internal change 
PiperOrigin-RevId: 546090489
 2023-07-06 14:24:31 -07:00
Yoni Ben-Meshulam
0a198d1f6a Fix a typo in proto doc. 
PiperOrigin-RevId: 546049240
 2023-07-06 14:20:09 -07:00
MediaPipe Team
15ee1210e5 Internal change 
PiperOrigin-RevId: 546035969
 2023-07-06 10:58:20 -07:00
Copybara-Service
a851863e9c Merge pull request #4590 from priankakariatyml:ios-image-segmenter-container-utils 
PiperOrigin-RevId: 546018332
 2023-07-06 09:57:59 -07:00
Prianka Liz Kariat
823d5b39af Fixed typo 2023-07-06 18:46:01 +05:30
Sebastian Schmidt
9861b3c8a8 Fix bounds calculation in RefineLandmarksFromHeatMapCalculator 
Fixes https://github.com/google/mediapipe/issues/4414

PiperOrigin-RevId: 545794151
 2023-07-05 14:58:36 -07:00
MediaPipe Team
74f484d96d Internal change 
PiperOrigin-RevId: 545658434
 2023-07-05 07:09:40 -07:00
MediaPipe Team
dbe8e40124 Internal change 
PiperOrigin-RevId: 545045282
 2023-07-03 10:04:19 -07:00
Prianka Liz Kariat
9b7e233fe3 Added Image Segmenter Result Helpers 2023-07-03 20:48:29 +05:30
Prianka Liz Kariat
cebb0a2c2e Added iOS Image Segmenter Options Helpers 2023-07-03 20:48:15 +05:30
MediaPipe Team
7ba21e9a9a Revert Add location info in registry (debug mode only) 
PiperOrigin-RevId: 544842663
 2023-07-01 01:11:02 -07:00
MediaPipe Team
422556c4a3 Internal change 
PiperOrigin-RevId: 544663494
 2023-06-30 08:34:32 -07:00
Jiuqiang Tang
6c7aa8a0d6 Internal change 
PiperOrigin-RevId: 544563029
 2023-06-29 23:05:37 -07:00
MediaPipe Team
687075e5b8 Add gpu to cpu fallback for tensors_to_detections_calculator. 
PiperOrigin-RevId: 544480883
 2023-06-29 15:36:33 -07:00
MediaPipe Team
0ea54b1461 Add delegate options to base options for java API. and add unit tset for BaseOptions. 
PiperOrigin-RevId: 544458644
 2023-06-29 14:13:46 -07:00
MediaPipe Team
e15d5a797b Do not send PreviousLoopback output packets to closed streams 
PiperOrigin-RevId: 544449979
 2023-06-29 13:44:56 -07:00
MediaPipe Team
52cea59d41 Add keys for the context that better match the featurelist for text. 
PiperOrigin-RevId: 544430289
 2023-06-29 12:29:49 -07:00
MediaPipe Team
0bb4ee8941 Add MobileNetV2_I320 and MobileNetMultiHWAVG_I384 to support larger input image sizes. 
PiperOrigin-RevId: 544393692
 2023-06-29 10:24:52 -07:00
MediaPipe Team
8278dbc38f Exposes OpenCV photo lib. 
PiperOrigin-RevId: 544092832
 2023-06-28 10:22:07 -07:00
MediaPipe Team
1ee55d1f1b Support ExBert training and option to select between AdamW and LAMB optimizers for BertClassifier 
PiperOrigin-RevId: 543905014
 2023-06-27 18:05:15 -07:00
MediaPipe Team
bed624f3b6 Shows the recently added warning when WaitUntilIdle is called with source nodes only once. Otherwise, it is very spammy as it's shown every frame. Moreover, display the names of the sources, so the warning is more actionable. 
PiperOrigin-RevId: 543676454
 2023-06-27 02:03:04 -07:00
MediaPipe Team
c8c5f3d062 Internal change 
PiperOrigin-RevId: 543602625
 2023-06-26 18:57:21 -07:00
MediaPipe Team
9de1b2577f Internal update 
PiperOrigin-RevId: 543508346
 2023-06-26 12:26:51 -07:00
MediaPipe Team
570880190b Internal change for proto library outputs. 
PiperOrigin-RevId: 543368974
 2023-06-26 01:52:50 -07:00
Copybara-Service
5d19a46956 Merge pull request #4561 from priankakariatyml:ios-segmentation-mask 
PiperOrigin-RevId: 543295371
 2023-06-25 17:37:35 -07:00
Copybara-Service
80a02f8f38 Merge pull request #4566 from priankakariatyml:ios-image-segmenter-containers 
PiperOrigin-RevId: 542931120
 2023-06-23 12:42:56 -07:00
Prianka Liz Kariat
3d79d58286 Updated variable name 2023-06-23 20:18:41 +05:30
Prianka Liz Kariat
bfb68491af Added copying of running mode in NSCopying implementation in iOS tasks 2023-06-23 20:13:29 +05:30
Prianka Liz Kariat
5dce8f283d Updated image segmenter delegate method to be required 2023-06-23 20:10:42 +05:30
Prianka Liz Kariat
7623c5a941 Added iOS Image Segmenter Options 2023-06-23 20:09:18 +05:30
Prianka Liz Kariat
7fe365489d Added iOS Image Segmenter Result 2023-06-23 20:09:05 +05:30
MediaPipe Team
a8899da45a Fix -Wsign-compare warning in api2/builder.h 
PiperOrigin-RevId: 542673286
 2023-06-22 14:49:23 -07:00
MediaPipe Team
4e862995ba Fix typo 
PiperOrigin-RevId: 542660548
 2023-06-22 14:02:16 -07:00
MediaPipe Team
2f5fc16a38 Fix timestamp computation when copying within first block. 
When computing the last copied sample's timestamp, first_block_offset_ needs to be taken into account.

PiperOrigin-RevId: 542643291
 2023-06-22 13:03:36 -07:00
Jiuqiang Tang
98d493f37a Add MatrixData as a packet option for ConstantSidePacketCalculatorOptions. 
PiperOrigin-RevId: 542616847
 2023-06-22 11:28:07 -07:00
MediaPipe Team
ba7e0e0e50 Add a face alignment preprocessor to face stylizer. 
PiperOrigin-RevId: 542559764
 2023-06-22 07:59:52 -07:00
Prianka Liz Kariat
7f39153ff3 Added MPPMask Tests 2023-06-22 17:44:07 +05:30
MediaPipe Team
825e3a8af0 Speed up TimeSeriesFramerCalculator. 
Currently, TimeSeriesFramerCalculator constructs a distinct Matrix object for every input sample, which is inefficient. This CL revises buffering to keep each input packet's worth of samples as one grouped Matrix. A benchmark is added, showing a speed up of about 20x.

```
name                               old      new
BM_TimeSeriesFramerCalculator  48.45ms   2.26ms
```

PiperOrigin-RevId: 542462618
 2023-06-21 23:03:54 -07:00
MediaPipe Team
0d2548cd65 Internal change 
PiperOrigin-RevId: 542392817
 2023-06-21 16:23:43 -07:00
MediaPipe Team
c86d80a031 Internal Changes 
PiperOrigin-RevId: 542387813
 2023-06-21 16:02:54 -07:00
MediaPipe Team
895c685df6 1. Model maker core classifier change _metric_function field to _metric_functions in order to support having multiple metrics. 
2. Add SparsePrecision, SparseRecall, BinarySparsePrecisionAtRecall, and BinarySparseRecallAtPrecision to the shared metrics library.
3. Add SparsePrecision, SparseRecall to text classifier, and have the option to evaluate the model with BinarySparsePrecisionAtRecall and BinarySparseRecallAtPrecision

PiperOrigin-RevId: 542376451
 2023-06-21 15:19:29 -07:00
MediaPipe Team
7edb6b8fcb add concatenate image vector calculator 
PiperOrigin-RevId: 542084345
 2023-06-20 16:40:11 -07:00
MediaPipe Team
0b6ff84e3c update face drawing function. 
PiperOrigin-RevId: 542083042
 2023-06-20 16:34:27 -07:00
Sebastian Schmidt
ef6aeb8828 Allow passing of HParams to MediaPipe training docker 
PiperOrigin-RevId: 542052304
 2023-06-20 14:39:38 -07:00
MediaPipe Team
86bc764b6e This will fix typos in tasks internal files. 
PiperOrigin-RevId: 541945726
 2023-06-20 09:18:01 -07:00
Copybara-Service
bd3a8d885d Merge pull request #4538 from priankakariatyml:ios-segmentation-mask 
PiperOrigin-RevId: 541944396
 2023-06-20 09:12:53 -07:00
MediaPipe Team
35c79b755e update face drawing function. 
PiperOrigin-RevId: 541055040
 2023-06-16 17:46:11 -07:00