cassdlcm/mediapipe
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
2,480 Commits 10 Branches 56 Tags 829 MiB
ec87f068c1
Commit Graph

2190 Commits

Author SHA1 Message Date
Chris McClanahan
a04a3a1c81 internal fix 
PiperOrigin-RevId: 557934477
 2023-08-17 14:20:58 -07:00
Copybara-Service
6866d338e0 Merge pull request #4645 from priankakariatyml:ios-vision-task-runner-refactoring 
PiperOrigin-RevId: 557894034
 2023-08-17 12:02:07 -07:00
MediaPipe Team
b213256cbd Change supported_ops to a Tuple instead of List to match the API definition. 
PiperOrigin-RevId: 557890361
 2023-08-17 11:48:56 -07:00
Sebastian Schmidt
990bfd2e3e Don't access "document" in WebWorker 
Fixes https://github.com/google/mediapipe/issues/4694

PiperOrigin-RevId: 557885230
 2023-08-17 11:32:55 -07:00
Prianka Liz Kariat
22dc08be0e Removed convenience initializer from refactored MPPVisionTaskRunner 2023-08-17 14:15:14 +05:30
MediaPipe Team
ed0c8d8d8b Swap left and right hand labels. 
PiperOrigin-RevId: 557625660
 2023-08-16 15:51:19 -07:00
MediaPipe Team
13bb65db96 Internal Changes 
PiperOrigin-RevId: 557563669
 2023-08-16 12:16:16 -07:00
MediaPipe Team
9e45e2b6e9 Setting training for the encoder and decoder when converting to TFLite. 
Also add selected TF ops to TFLite converter.

PiperOrigin-RevId: 557520277
 2023-08-16 10:02:29 -07:00
MediaPipe Team
ee217ceb67 Fix MediaPipe build in Chromium. 
When building Chromium with Clang on Windows, it needs the template specializations to be declared as well.

PiperOrigin-RevId: 557508703
 2023-08-16 09:23:15 -07:00
Sebastian Schmidt
251ffc21c8 No public description 
PiperOrigin-RevId: 557501469
 2023-08-16 08:58:14 -07:00
MediaPipe Team
ff3f0433d3 Fix image_util shortcut import line 
PiperOrigin-RevId: 557311617
 2023-08-15 18:19:13 -07:00
MediaPipe Team
1c98270ef0 Import image_util for using it in mediapipe face stylizer open sourcing. 
PiperOrigin-RevId: 557254489
 2023-08-15 14:41:57 -07:00
MediaPipe Team
cda0ba04ed Dry-Run mode for static registration to make it easier to find all required static registrations 
PiperOrigin-RevId: 557185347
 2023-08-15 11:03:18 -07:00
MediaPipe Team
c1d7e6023a Expose tool calculators in headers to enable dynamic registration by superusers. 
PiperOrigin-RevId: 557174440
 2023-08-15 10:32:45 -07:00
MediaPipe Team
a392561b31 Internal change 
PiperOrigin-RevId: 557015628
 2023-08-14 22:16:20 -07:00
MediaPipe Team
0da296536b Expose stream handlers in headers to allow dynamic registration for superusers 
PiperOrigin-RevId: 556988288
 2023-08-14 20:01:50 -07:00
MediaPipe Team
b6f5414b3d Support more GPU formats in tensor converter calculator. 
PiperOrigin-RevId: 556987807
 2023-08-14 19:57:05 -07:00
MediaPipe Team
a183212a13 Header for callback_packet_calculator to allow dynamic registration for superusers 
PiperOrigin-RevId: 556977122
 2023-08-14 18:50:11 -07:00
MediaPipe Team
9c5bdd2eb9 Clarify deprecated GraphStatus usage in Close documentation 
PiperOrigin-RevId: 556963967
 2023-08-14 17:53:32 -07:00
MediaPipe Team
dd940707ca Provide a way to disable static registration using MEDIAPIPE_DISABLE_STATIC_REGISTRATION 
PiperOrigin-RevId: 556963956
 2023-08-14 17:48:25 -07:00
MediaPipe Team
6605fdb16f add end loop calculator for image size 
PiperOrigin-RevId: 556955370
 2023-08-14 17:09:02 -07:00
MediaPipe Team
a8bee6baf3 Updates the runners to support wasm-style binary assets files, and allows their URLs to be explicitly specified as part of the WasmFileset. 
PiperOrigin-RevId: 556903356
 2023-08-14 13:59:53 -07:00
MediaPipe Team
c8ad606e7c Refactor text_classifier preprocessor to move away from using classifier_data_lib 
PiperOrigin-RevId: 556859900
 2023-08-14 11:41:09 -07:00
MediaPipe Team
3ac3b03ed5 Migrate packet messages auto registration to rely on MEDIAPIPE_STATIC_REGISTRATOR_TEMPLATE 
PiperOrigin-RevId: 556063007
 2023-08-11 13:14:29 -07:00
Yuqi Li
c448d54aa7 add metadata writer into face stylizer. 
PiperOrigin-RevId: 555596257
 2023-08-10 12:09:27 -07:00
MediaPipe Team
91f15d8e4a Enable run inference with a TFLite model containing multiple subgraphs. It uses the subgraph 0 as the default primary subgraph for inference. It will also log a warning in the case that there are more than one subgraph in the model. 
PiperOrigin-RevId: 555579131
 2023-08-10 11:30:32 -07:00
MediaPipe Team
a9c7e22ca4 apply affine transform before drawing, in order to keep constant line width regardless of face cropping. 
PiperOrigin-RevId: 555173659
 2023-08-09 08:42:57 -07:00
MediaPipe Team
00e0314040 Remove unsafe cast. 
PiperOrigin-RevId: 555007705
 2023-08-08 18:50:11 -07:00
MediaPipe Team
f9a0244c5b No public description 
PiperOrigin-RevId: 555005770
 2023-08-08 18:38:34 -07:00
MediaPipe Team
e558a71597 Include calculator_context.h and calculator_contract.h from calculator_framework.h 
PiperOrigin-RevId: 554931086
 2023-08-08 13:54:59 -07:00
MediaPipe Team
39b31e51a9 No public description 
PiperOrigin-RevId: 554673463
 2023-08-07 20:15:34 -07:00
MediaPipe Team
032ed973b6 Add setGpuBufferVerticalFlip to GraphRunner TS API 
PiperOrigin-RevId: 554667869
 2023-08-07 19:44:21 -07:00
MediaPipe Team
c1c51c2fe7 Internal 
PiperOrigin-RevId: 554595324
 2023-08-07 14:36:42 -07:00
Zu Kim
22054cd468 Set confidence score of the bounding box label. 
PiperOrigin-RevId: 554508925
 2023-08-07 10:01:59 -07:00
MediaPipe Team
e10bcd1bfd No public description 
PiperOrigin-RevId: 554084475
 2023-08-05 08:36:24 -07:00
Zu Kim
460346ed13 Add a support for label annotations (image/label/string and image/label/confidence). Also fixed some clang tidy issues. 
PiperOrigin-RevId: 553900667
 2023-08-04 13:43:44 -07:00
MediaPipe Team
11508f2291 Internal Change 
PiperOrigin-RevId: 553652444
 2023-08-03 18:49:35 -07:00
MediaPipe Team
360959e325 Replace some size EXPECTs by ASSERTs 
PiperOrigin-RevId: 553555650
 2023-08-03 12:27:52 -07:00
MediaPipe Team
a0b91e4062 Add a GpuOrigin parameter to TensorConverterCalculator 
The parameter superseeds flip_vertically. GpuOrigin works more generally than flip_vertically because CONVENTIONAL works on both iOS (no flip) and Android (yes flip). If not set, the calculator falls back to flip_vertically for backwards compatibility.

Note that web demos actually use TOP_LEFT image orientation, so they shouldn't be flipped, but they still are by CONVENTIONAL. That's being discussed right now.

PiperOrigin-RevId: 553400525
 2023-08-03 01:40:13 -07:00
MediaPipe Team
9325af0af3 vlog default executor and its config usage 
PiperOrigin-RevId: 553298440
 2023-08-02 17:01:05 -07:00
MediaPipe Team
e56636b6d1 internal change 
PiperOrigin-RevId: 553250547
 2023-08-02 14:06:16 -07:00
MediaPipe Team
366a3290cf Change to add the w_avg latent code to style encoding before layer swapping. This is a bug in the previous code. Also set training=True for encoder since this affect the encoding performance. 
PiperOrigin-RevId: 553234376
 2023-08-02 13:11:22 -07:00
MediaPipe Team
6e54d8c204 Log stack traces for combined CalculatorGraph statuses 
PiperOrigin-RevId: 553111356
 2023-08-02 05:10:52 -07:00
MediaPipe Team
557ed0b1ea Add tensorflow-addons to model_maker requirements.txt 
PiperOrigin-RevId: 552610011
 2023-07-31 15:36:25 -07:00
MediaPipe Team
6f916a001c Fix crash in SavePngTestOutput 
Do not call SavePngTestOutput in CompareAndSaveImageOutput in case diff_img is null. This can happen if for instance the expected and the actual image have non-matching format or size. Currently, this crashes.
Support single channel golden images.

PiperOrigin-RevId: 552519834
 2023-07-31 10:20:06 -07:00
MediaPipe Team
8e313b4b0c Fix typo in model maker requirements.txt 
PiperOrigin-RevId: 551973577
 2023-07-28 16:07:12 -07:00
Sebastian Schmidt
b4bcfab4f5 Remove extra letter from text classifier API 
PiperOrigin-RevId: 551942087
 2023-07-28 13:56:56 -07:00
MediaPipe Team
3f7752561b No public description 
PiperOrigin-RevId: 551914786
 2023-07-28 12:05:38 -07:00
MediaPipe Team
9edb059d9f No public description 
PiperOrigin-RevId: 551868738
 2023-07-28 09:09:39 -07:00
MediaPipe Team
7db0c1944b Internal change 
PiperOrigin-RevId: 551789915
 2023-07-28 02:29:52 -07:00
MediaPipe Team
db9a72a5df Internal Changes 
PiperOrigin-RevId: 551674542
 2023-07-27 16:35:35 -07:00
MediaPipe Team
5c007558f8 internal change. 
PiperOrigin-RevId: 551645248
 2023-07-27 14:45:18 -07:00
Sebastian Schmidt
4d5c6bd33a Internal 
PiperOrigin-RevId: 551625147
 2023-07-27 13:33:14 -07:00
Sebastian Schmidt
fdea10d230 Add C Headers for Text Classifier 
PiperOrigin-RevId: 551618765
 2023-07-27 13:09:49 -07:00
Sebastian Schmidt
7d9cb4ee67 No public description 
PiperOrigin-RevId: 551586945
 2023-07-27 11:17:54 -07:00
MediaPipe Team
f3f9e71ccb No public description 
PiperOrigin-RevId: 551549511
 2023-07-27 09:15:46 -07:00
MediaPipe Team
6de275834d internal change. 
PiperOrigin-RevId: 551366789
 2023-07-26 17:59:06 -07:00
Sebastian Schmidt
c9d79a0076 Rollback of "Fix duplicate condition error in :resource_util" 
PiperOrigin-RevId: 551332734
 2023-07-26 15:31:51 -07:00
MediaPipe Team
fa5c1b03d2 No public description 
PiperOrigin-RevId: 551277242
 2023-07-26 12:08:33 -07:00
Sebastian Schmidt
750f498b14 Internal 
PiperOrigin-RevId: 551247471
 2023-07-26 10:33:19 -07:00
Prianka Liz Kariat
d2a86341bd Added refactored iOS vision task runner sources 2023-07-26 20:02:00 +05:30
MediaPipe Team
1f6851c577 C++ Image segmenter add output size parameters. 
PiperOrigin-RevId: 550995124
 2023-07-25 14:22:11 -07:00
MediaPipe Team
bd7888cc0c 1. Move evaluation onto GPU/TPU hardware if available. 
2. Move desired_precision and desired_recall from evaluate to hyperparameters so recall@precision metrics will be reported for both training and evaluation. This also fixes a bug where recompiling the model with the previously initialized metric objects would not properly reset the metric states.
3. Remove redundant label_names from create_... class methods in text_classifier. This information is already provided by the datasets.
4. Change loss function to FocalLoss.
5. Re-enable text_classifier unit tests using ExBert
6. Add input names to avoid flaky auto-assigned input names.

PiperOrigin-RevId: 550992146
 2023-07-25 14:12:26 -07:00
MediaPipe Team
85c3fed70a Add class weights to core hyperparameters and classifier library. 
PiperOrigin-RevId: 550962843
 2023-07-25 12:29:46 -07:00
MediaPipe Team
62538a9496 No public description 
PiperOrigin-RevId: 550954023
 2023-07-25 11:57:08 -07:00
MediaPipe Team
113c9b30c2 No public description 
PiperOrigin-RevId: 550616150
 2023-07-24 11:09:31 -07:00
Copybara-Service
66cceddb5e Merge pull request #4639 from priankakariatyml:ios-image-segmenter-container-utils 
PiperOrigin-RevId: 550608973
 2023-07-24 10:46:56 -07:00
Prianka Liz Kariat
72c62f7d5d Added iOS Image Segmenter Header 2023-07-24 20:38:16 +05:30
MediaPipe Team
25b01784de Fix documentation 
PiperOrigin-RevId: 549968822
 2023-07-21 09:33:48 -07:00
MediaPipe Team
9af637b125 Java API add visibility and presence for landmarks. 
PiperOrigin-RevId: 549709256
 2023-07-20 12:42:01 -07:00
Prianka Liz Kariat
540f4f7fe6 Fixed swift name of iOS face landmarker delegate 2023-07-20 15:57:37 +05:30
Prianka Liz Kariat
3198ccf6a5 Added missing headers in ios vision framework build 2023-07-20 15:57:16 +05:30
Steven Hickson
e47af74b15 Adding support for 2 things in tensors_to_image_calculator: 
1) 1 channel support for conversion after inference.
2) multitask support by allowing for different tensor outputs.

PiperOrigin-RevId: 549412331
 2023-07-19 13:41:46 -07:00
MediaPipe Team
085840388b Move waitOnCpu and waitOnGpu out of the synchronized block, which can cause deadlock. 
PiperOrigin-RevId: 549217916
 2023-07-18 23:42:01 -07:00
MediaPipe Team
4e72fcf0cb Replace CHECK with RET_CHECK in GetContract() implementation from six calculators. 
PiperOrigin-RevId: 549158984
 2023-07-18 17:38:44 -07:00
MediaPipe Team
4c60fe7365 add pose landmarks connections in C++ API 
PiperOrigin-RevId: 549108310
 2023-07-18 14:21:02 -07:00
MediaPipe Team
9b00582f21 add hand landmarks connections in C++ API. 
PiperOrigin-RevId: 549108307
 2023-07-18 14:16:27 -07:00
MediaPipe Team
cb915858fa Internal change 
PiperOrigin-RevId: 549052451
 2023-07-18 11:01:37 -07:00
Jiuqiang Tang
0c01187cf5 Internal change 
PiperOrigin-RevId: 548886447
 2023-07-17 21:57:24 -07:00
MediaPipe Team
ef12ce8575 Internal change 
PiperOrigin-RevId: 548821518
 2023-07-17 15:56:05 -07:00
MediaPipe Team
f1f9f80cd9 Internal change 
PiperOrigin-RevId: 548746432
 2023-07-17 11:18:00 -07:00
MediaPipe Team
17bc1a5ab5 Internal change 
PiperOrigin-RevId: 548196034
 2023-07-14 12:39:45 -07:00
MediaPipe Team
2fae07375c Discard outdated packets earlier in MuxInputStreamHandler. 
In our pipeline, a deadlock is detected because the packets in deselected
data streams get piled up. In the current implementation, those packets only get
removed in FillInputSet(), but we should also do that in GetNodeReadiness().

PiperOrigin-RevId: 548051369
 2023-07-14 01:12:14 -07:00
MediaPipe Team
723e91cec1 Generalize non-define registration with MEDIAPIPE_STATIC_REGISTRATOR_TEMPLATE 
PiperOrigin-RevId: 547929982
 2023-07-13 14:52:37 -07:00
MediaPipe Team
c2c67c20fa Internal change 
PiperOrigin-RevId: 547924907
 2023-07-13 14:37:40 -07:00
Sebastian Schmidt
327feb42d1 Support WASM asset loading for MediaPipe Task Web 
PiperOrigin-RevId: 547882566
 2023-07-13 12:26:59 -07:00
MediaPipe Team
8b59567cb7 Add proto3 Any proto support for Java task api 
PiperOrigin-RevId: 547836041
 2023-07-13 10:10:17 -07:00
MediaPipe Team
251c5421f6 Internal change 
PiperOrigin-RevId: 547735699
 2023-07-13 02:53:16 -07:00
MediaPipe Team
450c933cb5 MEDIAPIPE_NODE/SUBGRAPH_IMPLEMENTATION to use common define for registration 
PiperOrigin-RevId: 547669538
 2023-07-12 20:10:15 -07:00
MediaPipe Team
cc2aa4f4cc InferenceCalculatorAdvancedGL save cache in Open(). 
PiperOrigin-RevId: 547652481
 2023-07-12 18:09:51 -07:00
MediaPipe Team
a2cd3e7f95 Internal change 
PiperOrigin-RevId: 547614484
 2023-07-12 15:17:40 -07:00
MediaPipe Team
37b68714b8 Internal change 
PiperOrigin-RevId: 547424721
 2023-07-12 01:32:51 -07:00
MediaPipe Team
3e93cbc838 Internal change 
PiperOrigin-RevId: 547404737
 2023-07-12 00:04:40 -07:00
Yilei Yang
917af2ce6b Internal change 
PiperOrigin-RevId: 547346939
 2023-07-11 17:52:07 -07:00
Sebastian Schmidt
f2f49b9fc8 Add angle to BoundingBox 
PiperOrigin-RevId: 547321781
 2023-07-11 16:00:35 -07:00
MediaPipe Team
aabf61f28d Internal Change 
PiperOrigin-RevId: 547299595
 2023-07-11 14:35:18 -07:00
MediaPipe Team
56bc019819 Model Maker allow core dataset library to handle datasets with unknown sizes. 
PiperOrigin-RevId: 547268411
 2023-07-11 12:47:37 -07:00
MediaPipe Team
4788fddde9 Internal Change 
PiperOrigin-RevId: 547265380
 2023-07-11 12:34:32 -07:00
MediaPipe Team
e4ec4d2526 Internal change 
PiperOrigin-RevId: 547258228
 2023-07-11 12:05:58 -07:00
MediaPipe Team
bf6561ce91 add symmetric color style option 
PiperOrigin-RevId: 547069284
 2023-07-10 21:41:01 -07:00