Camillo Lugaresi
2f4bb5d545
Use utility framebuffer in ViewDoneWritingSimulatorWorkaround
...
This code needs a FBO to bind the texture.
Fixes invalid results when running under simulator.
PiperOrigin-RevId: 499241867
2023-01-03 09:38:19 -08:00
Sebastian Schmidt
9252a025e5
Use custom gesture options in GestureRecognizer
...
PiperOrigin-RevId: 498567432
2022-12-30 05:01:02 -08:00
MediaPipe Team
60c6b155f6
Save an integer id in graph profiler objects to distinguish between different profiler instances during benchmarking.
...
PiperOrigin-RevId: 498409363
2022-12-29 10:18:10 -08:00
MediaPipe Team
aaa16eca1f
Sets the graph service packets before initializing (and validating the graph) in the objc graph wrapper.
...
PiperOrigin-RevId: 498393761
2022-12-29 08:36:03 -08:00
Nikolay Chirkov
2d9a969d10
Tensor1: memorize size_alignment when tracking the ahwb usage.
...
When CPU/GPU buffer allocated and the tracker selects Ahwb storage to be used then the properly recorded alignment must be used.
PiperOrigin-RevId: 498264759
2022-12-28 16:09:02 -08:00
Nikolay Chirkov
1924f1cdff
Tensor: Fix use_ahwb_ flag and tests on local device involved.
...
PiperOrigin-RevId: 498249332
2022-12-28 14:29:43 -08:00
Sebastian Schmidt
9580f04571
Apply most graph options synchronously
...
PiperOrigin-RevId: 498244085
2022-12-28 13:58:46 -08:00
MediaPipe Team
7e36a5e2ae
Set filecmp.cmp(shallow=False) in model_maker unit tests.
...
PiperOrigin-RevId: 498218578
2022-12-28 11:25:28 -08:00
MediaPipe Team
5a5ff5393a
Internal change
...
PiperOrigin-RevId: 497269082
2022-12-27 10:50:41 -08:00
Hadon Nash
557cd050f3
Deprecating RealTimeFlowLimiterCalculator in favor of FlowLimiterCalculator.
...
PiperOrigin-RevId: 497260577
2022-12-22 16:29:14 -08:00
MediaPipe Team
5a71b551e5
Remove duplicate and non-public api for model_maker
...
PiperOrigin-RevId: 497251246
2022-12-22 15:31:12 -08:00
MediaPipe Team
36f054dfbe
Internal model maker change
...
PiperOrigin-RevId: 497196512
2022-12-22 10:43:15 -08:00
MediaPipe Team
5b90afda70
Internal change
...
PiperOrigin-RevId: 497191969
2022-12-22 10:23:34 -08:00
MediaPipe Team
9673841605
Internal visibility update
...
PiperOrigin-RevId: 497185157
2022-12-22 09:51:52 -08:00
Prianka Liz Kariat
48eeae4d9d
Formatted code
2022-12-22 12:16:43 +05:30
Prianka Liz Kariat
613ed58890
Inverted condition check in MPPTaskInfo
2022-12-22 12:16:33 +05:30
Prianka Liz Kariat
e47256ae55
Clearing proto before assigining new values in MPPClassifierOptions Helpers
2022-12-22 12:10:23 +05:30
MediaPipe Team
69b6d9d970
Internal change
...
PiperOrigin-RevId: 497043596
2022-12-21 17:44:36 -08:00
Prianka Liz Kariat
e559613b9d
Updated comments in MPPClassifierOptions.h
2022-12-22 02:02:48 +05:30
Prianka Liz Kariat
b4a7644428
Updated comments
2022-12-22 02:01:04 +05:30
Prianka Liz Kariat
20c3388ab6
Updated category allowlist and denylist names
2022-12-22 01:59:38 +05:30
Prianka Liz Kariat
c185dc9ad7
Renamed label to category in classifier options
2022-12-22 01:19:01 +05:30
Prianka Liz Kariat
e1dfcf03cf
Updated comments in MPPClassifierOptions.h
2022-12-22 01:12:34 +05:30
Prianka Liz Kariat
66ee8d47c0
Resorted options
2022-12-22 01:10:07 +05:30
Prianka Liz Kariat
673b38dfe8
Updated comments
2022-12-22 01:08:13 +05:30
Prianka Liz Kariat
54d36dfeda
Update MPPClassifierOptions.h
2022-12-22 01:05:50 +05:30
Prianka Liz Kariat
7ae4b7e639
Updated error domain
2022-12-22 01:05:01 +05:30
Prianka Liz Kariat
99c11ff974
Updated comments
2022-12-22 01:03:39 +05:30
Prianka Liz Kariat
1de3694175
Updated comments
2022-12-22 01:02:07 +05:30
Prianka Liz Kariat
1491b3f5a2
Updated comments
2022-12-22 01:00:36 +05:30
Prianka Liz Kariat
20f2e136c5
Updated empty spaces
2022-12-22 00:59:22 +05:30
Prianka Liz Kariat
2943d1668e
Updated comments
2022-12-22 00:51:20 +05:30
Prianka Liz Kariat
481f4e960e
Updated comments
2022-12-22 00:49:44 +05:30
Prianka Liz Kariat
ae28948ca1
Marked designated initializers
2022-12-22 00:49:24 +05:30
Jiuqiang Tang
714a6e555b
Enable creating mediapipe image c++ packet directly from an Android media image object when its format is RGBA_8888.
...
PiperOrigin-RevId: 496923491
2022-12-21 08:07:53 -08:00
MediaPipe Team
1341720d6d
Internal change
...
PiperOrigin-RevId: 496854337
2022-12-21 00:55:32 -08:00
MediaPipe Team
5c0f548f5f
Switches to tf.keras.optimizers.experimental.AdamW instead of the legacy AdamW.
...
PiperOrigin-RevId: 496821354
2022-12-20 20:53:13 -08:00
Jiuqiang Tang
151e447614
Internal changes
...
PiperOrigin-RevId: 496793199
2022-12-20 17:52:17 -08:00
MediaPipe Team
64406a9bf2
Internal change
...
PiperOrigin-RevId: 496781536
2022-12-20 16:41:49 -08:00
Sebastian Schmidt
d2f738793c
Use uppercase options name for "delegate"
...
PiperOrigin-RevId: 496764089
2022-12-20 15:18:17 -08:00
MediaPipe Team
a7b52d2c52
Internal changes
...
PiperOrigin-RevId: 496754449
2022-12-20 14:37:18 -08:00
Prianka Liz Kariat
ff901a80a5
Added targets in core
2022-12-21 01:24:11 +05:30
Prianka Liz Kariat
4fedea60a9
Added text packet creator
2022-12-21 01:24:02 +05:30
Prianka Liz Kariat
e9fc3713f0
Added iOS task runner
2022-12-21 01:23:51 +05:30
Prianka Liz Kariat
64cf5e9b4e
Added iOS task options protocol
2022-12-21 01:23:41 +05:30
Prianka Liz Kariat
6d02108bf5
Added task info
2022-12-21 01:23:29 +05:30
Prianka Liz Kariat
c56ef735d7
Added classifier options helpers
2022-12-21 01:22:57 +05:30
Prianka Liz Kariat
03bfbca539
Added classifier options
2022-12-21 01:22:44 +05:30
Prianka Liz Kariat
e997a19289
Added common utils and string helpers
2022-12-21 01:22:32 +05:30
MediaPipe Team
e405c2b67d
Internal change
...
PiperOrigin-RevId: 496702117
2022-12-20 11:04:42 -08:00
MediaPipe Team
8c013647c8
Internal change
...
PiperOrigin-RevId: 496629682
2022-12-20 04:49:15 -08:00
MediaPipe Team
4682416f0f
Internal change
...
PiperOrigin-RevId: 496568835
2022-12-19 22:10:15 -08:00
Jiuqiang Tang
9067804005
Fix the missing logging component issue of mediapipe tasks core.
...
PiperOrigin-RevId: 496548340
2022-12-19 19:41:11 -08:00
MediaPipe Team
994eb28d2c
Chain SetName calls where possible
...
PiperOrigin-RevId: 496534328
2022-12-19 18:07:38 -08:00
MediaPipe Team
f5f2fee0b9
Switch to Cast where possible and reduce usage of operator[](port).
...
PiperOrigin-RevId: 496527250
2022-12-19 17:22:36 -08:00
MediaPipe Team
6842f2c7c6
Use the proper namespace for builder test
...
PiperOrigin-RevId: 496526588
2022-12-19 17:14:14 -08:00
MediaPipe Team
ea0bebc226
Add BGR -> RGB color conversion to ColorConvertCalculator.
...
PiperOrigin-RevId: 496497002
2022-12-19 14:51:05 -08:00
Nikolay Chirkov
ef3fa67bf4
Automatic selection of the tensor's storage type by recording previously requested views.
...
PiperOrigin-RevId: 496466136
2022-12-19 12:37:50 -08:00
MediaPipe Team
3e6cd5d2bf
Add support for customizing gesture recognizer layers
...
PiperOrigin-RevId: 496456160
2022-12-19 11:57:09 -08:00
Sebastian Schmidt
4822476974
Internal change
...
PiperOrigin-RevId: 496443946
2022-12-19 11:07:09 -08:00
Jiuqiang Tang
7ce4bb72d4
Replace numpy.float with the builtin float type as numpy removes its own float type in v1.24.
...
PiperOrigin-RevId: 496412858
2022-12-19 09:02:51 -08:00
MediaPipe Team
b45554623a
Fix typo in GetVectorItemCalculator doc
...
PiperOrigin-RevId: 495951016
2022-12-16 13:42:50 -08:00
Copybara-Service
a864f4e9b3
Merge pull request #3927 from priankakariatyml:ios-options
...
PiperOrigin-RevId: 495898311
2022-12-16 09:59:10 -08:00
Nikolay Chirkov
d5562241cc
Tensor: Interoperability GPU/Cpu -> Ahwb by transforming the underlying storage into Ahwb with releasing previously Cpu/Gpu resources.
...
PiperOrigin-RevId: 495748104
2022-12-15 18:34:27 -08:00
MediaPipe Team
0a1f050f1f
Internal change
...
PiperOrigin-RevId: 495741383
2022-12-15 17:52:43 -08:00
Jiuqiang Tang
6bf5648430
Fix the documentation of the constructor of Image and ImageFrame Python classes.
...
PiperOrigin-RevId: 495739875
2022-12-15 17:42:23 -08:00
Mark McDonald
8d2473c751
Update Image
docs to improve rendering.
...
The [API docs](https://developers.google.com/mediapipe/api/solutions/python/mp/Image ) have a few rendering issues. e.g., the doc generator will turn
```
This block:
Anything here
```
Into a table with heading `This block` and `Anything here` as a plain-text cell.
In order to render code as code, it needs to be in backticks. They can also be in `>>> code()` format, and we can try to run them ([doctests](https://docs.python.org/3/library/doctest.html )).
I'll have a dashboard ready soon that shows areas we can improve.
PiperOrigin-RevId: 495715576
2022-12-15 15:43:36 -08:00
Jiuqiang Tang
fd50b6aa2f
Add a new python unit test to test creating mediapipe Image from cvmat.
...
PiperOrigin-RevId: 495655719
2022-12-15 11:54:51 -08:00
Jiuqiang Tang
299aa03302
Internal change
...
PiperOrigin-RevId: 495613573
2022-12-15 09:24:31 -08:00
Prianka Liz Kariat
5ab17fe686
Removed convenience initializer
2022-12-15 10:28:50 +05:30
Prianka Liz Kariat
163b13d7de
Updated comments
2022-12-15 10:23:27 +05:30
Prianka Liz Kariat
9ab0107584
Added new line
2022-12-15 10:21:22 +05:30
Prianka Liz Kariat
fe7fbc0b38
Fixed comment
2022-12-15 10:21:14 +05:30
Prianka Liz Kariat
bf91c52407
Fixed typos
2022-12-15 10:21:07 +05:30
Nikolay Chirkov
d526b20e19
Internal change.
...
PiperOrigin-RevId: 495483878
2022-12-14 19:54:33 -08:00
MediaPipe Team
e9e173f9fa
Internal change
...
PiperOrigin-RevId: 495468694
2022-12-14 18:14:55 -08:00
Jiuqiang Tang
174f2869a3
Internal changes
...
PiperOrigin-RevId: 495322170
2022-12-14 08:33:45 -08:00
Prianka Liz Kariat
c0fed7df31
Added target for task result
2022-12-14 19:15:01 +05:30
Prianka Liz Kariat
0aedff0659
Added target for task options
2022-12-14 19:14:49 +05:30
Prianka Liz Kariat
22bb87d9e0
Added iOS task result
2022-12-14 19:14:11 +05:30
Prianka Liz Kariat
e9fb6c28f5
Added task options
2022-12-14 19:14:02 +05:30
Prianka Liz Kariat
7efb3bcf81
Added iOS task error codes
2022-12-14 19:13:41 +05:30
Camillo Lugaresi
db6ea38cf6
Internal change
...
PiperOrigin-RevId: 495236576
2022-12-14 00:40:01 -08:00
Camillo Lugaresi
6fa0a58529
Internal change
...
PiperOrigin-RevId: 495235951
2022-12-14 00:36:16 -08:00
Hadon Nash
b9d020cb7d
Internal change
...
PiperOrigin-RevId: 495163109
2022-12-13 17:00:08 -08:00
MediaPipe Team
904a537b02
Internal change
...
PiperOrigin-RevId: 495151410
2022-12-13 16:11:10 -08:00
MediaPipe Team
d5ff060bfa
Internal change
...
PiperOrigin-RevId: 495149484
2022-12-13 16:04:00 -08:00
Copybara-Service
ea0bd77dbf
Merge pull request #3911 from priankakariatyml:ios-base-options
...
PiperOrigin-RevId: 495119958
2022-12-13 14:02:07 -08:00
Hadon Nash
db404b1a85
Internal change
...
PiperOrigin-RevId: 495058817
2022-12-13 10:23:51 -08:00
Jiuqiang Tang
78597c5b37
Internal changes.
...
PiperOrigin-RevId: 495038477
2022-12-13 09:08:15 -08:00
Sebastian Schmidt
fb21797611
Internal change
...
PiperOrigin-RevId: 494914168
2022-12-12 21:30:31 -08:00
Hadon Nash
421f789ede
Internal change
...
PiperOrigin-RevId: 494420725
2022-12-10 12:33:53 -08:00
Sebastian Schmidt
e9bb51a524
Internal change
...
PiperOrigin-RevId: 494314595
2022-12-09 19:22:06 -08:00
Sebastian Schmidt
69c3c4c181
Internal change
...
PiperOrigin-RevId: 494305195
2022-12-09 18:10:45 -08:00
Jiuqiang Tang
453d67de92
Add MergeDetectionsToVectorCalculator.
...
PiperOrigin-RevId: 494246359
2022-12-09 13:12:57 -08:00
Nikolay Chirkov
db3cb68d91
Internal change.
...
PiperOrigin-RevId: 494166776
2022-12-09 07:29:01 -08:00
MediaPipe Team
5bc1baf96a
Internal change
...
PiperOrigin-RevId: 494150467
2022-12-09 05:57:12 -08:00
MediaPipe Team
4c4df2cf18
Internal change for profiling
...
PiperOrigin-RevId: 494135244
2022-12-09 04:13:02 -08:00
MediaPipe Team
3aeec84ac0
Internal change for profiling
...
PiperOrigin-RevId: 494126771
2022-12-09 03:21:10 -08:00
Nikolay Chirkov
bea0caae65
Tensor: Cpu -> Ahwb storage transfer
...
PiperOrigin-RevId: 494033280
2022-12-08 17:06:56 -08:00
Sebastian Schmidt
05535db5f7
Fix assertion failure in Hair Segmentation demo
...
PiperOrigin-RevId: 494004801
2022-12-08 15:03:39 -08:00
MediaPipe Team
b4e1969e43
Add pip package builder for model_maker
...
PiperOrigin-RevId: 493989013
2022-12-08 14:03:15 -08:00
Nikolay Chirkov
0fbaa8dc8a
Internal change.
...
PiperOrigin-RevId: 493973435
2022-12-08 13:01:52 -08:00
MediaPipe Team
a641ea12e1
Update gesture recognizer to new mediapipe tasks pipeline
...
PiperOrigin-RevId: 493950564
2022-12-08 11:32:42 -08:00
Jiuqiang Tang
13f8fa5139
Retire the visibility group "//mediapipe/framework:mediapipe_internal" in the "mediapipe/calculators/tensor" dir.
...
PiperOrigin-RevId: 493895834
2022-12-08 08:03:47 -08:00
Prianka Liz Kariat
66dbd9969a
Updated license text
2022-12-08 10:25:01 +05:30
Prianka Liz Kariat
d1820320b1
Added base options
2022-12-08 10:23:53 +05:30
Sebastian Schmidt
9ae2e43b70
Open Source the remaining MediaPipe Tasks tests for Web
...
PiperOrigin-RevId: 493769657
2022-12-07 19:19:27 -08:00
Adam Cozzette
24c8fa97e9
Internal change
...
PiperOrigin-RevId: 493768013
2022-12-07 19:06:00 -08:00
MediaPipe Team
700c7b4b22
Internal refactoring for TextEmbedder.
...
PiperOrigin-RevId: 493766612
2022-12-07 18:56:27 -08:00
MediaPipe Team
a0efcb47f2
internal change
...
PiperOrigin-RevId: 493742399
2022-12-07 16:38:42 -08:00
MediaPipe Team
a59f0a9924
Make java/C++/python tasks API public visible.
...
PiperOrigin-RevId: 493730506
2022-12-07 15:51:04 -08:00
MediaPipe Team
91664eb254
Object Detector deduplication
...
PiperOrigin-RevId: 493716159
2022-12-07 14:54:30 -08:00
Jiuqiang Tang
ef1507ed5d
Retire the visibility group "//mediapipe/framework:mediapipe_internal".
...
PiperOrigin-RevId: 493713823
2022-12-07 14:45:49 -08:00
Nikolay Chirkov
7faee517c4
Tensor: Move general CPU/SSBO tensor storage into Ahwb-backed CPU/SSBO storage.
...
PiperOrigin-RevId: 493710495
2022-12-07 14:32:42 -08:00
Nikolay Chirkov
ea74db86dd
Tensor: clang tidy fixes.
...
PiperOrigin-RevId: 493703073
2022-12-07 14:06:29 -08:00
Jiuqiang Tang
955f090f9f
Retire the visibility group "//mediapipe/framework:mediapipe_internal".
...
PiperOrigin-RevId: 493687025
2022-12-07 13:08:33 -08:00
Sebastian Schmidt
2811e0c5c8
Open Source the first set of MediaPipe Tasks tests for Web
...
PiperOrigin-RevId: 493673279
2022-12-07 12:15:34 -08:00
Jiuqiang Tang
3c0ddf16b4
Fix an incorrect model sanity check in the object detector graph.
...
PiperOrigin-RevId: 493663592
2022-12-07 11:38:54 -08:00
Jiuqiang Tang
80c605459c
Open up framework visibility.
...
PiperOrigin-RevId: 493660013
2022-12-07 11:26:16 -08:00
Sebastian Schmidt
d84eec387b
Add missing import to InferenceCalculator.proto
...
PiperOrigin-RevId: 493649869
2022-12-07 10:52:17 -08:00
Khanh LeViet
d9688b769f
Hide internal APIs from mediapipe pip package's API docs.
...
PiperOrigin-RevId: 493607984
2022-12-07 08:15:25 -08:00
Nikolay Chirkov
aad797197b
TensorV1 EGL.h include fix.
...
PiperOrigin-RevId: 493596083
2022-12-07 07:16:59 -08:00
Camillo Lugaresi
523d16dffa
Make GpuBuffer a shared_ptr to a storage collection
...
PiperOrigin-RevId: 493519590
2022-12-06 23:56:19 -08:00
Sebastian Schmidt
1167f61f98
Remove generic Options template argument from TaskRunner
...
PiperOrigin-RevId: 493462947
2022-12-06 18:04:31 -08:00
MediaPipe Team
576c6da173
Internal change
...
PiperOrigin-RevId: 493427500
2022-12-06 15:24:32 -08:00
Sebastian Schmidt
fca0f5806b
Create Build Rules for Apple Frameworks
...
PiperOrigin-RevId: 493426040
2022-12-06 15:18:45 -08:00
Sebastian Schmidt
0f32072804
Move ISSUE_TEMPLATAE files to .github folder
...
PiperOrigin-RevId: 493405734
2022-12-06 14:03:26 -08:00
Khanh LeViet
cdc14522e2
Added issue templates for MP Preview.
...
PiperOrigin-RevId: 493389856
2022-12-06 13:03:10 -08:00
Jiuqiang Tang
6deef1a5f1
Allow specifying tag_suffix in the templated CreateModelResources method.
...
PiperOrigin-RevId: 493375701
2022-12-06 12:10:06 -08:00
Jiuqiang Tang
c6e6f9e0b9
Fix aar breakage caused by missing "//mediapipe/tasks/cc/vision/image_segmenter/proto:segmenter_options_java_proto_lite".
...
PiperOrigin-RevId: 493357585
2022-12-06 11:08:01 -08:00
Sebastian Schmidt
ab0b0ab558
Change visibility for MP Tasks Web to public
...
PiperOrigin-RevId: 493343996
2022-12-06 10:26:16 -08:00
Jiuqiang Tang
fb0b96115f
Open up mediapipe core calculators' visibility.
...
PiperOrigin-RevId: 493314353
2022-12-06 08:40:57 -08:00
Camillo Lugaresi
b0b38a0013
Internal change
...
PiperOrigin-RevId: 493313240
2022-12-06 08:31:46 -08:00
Jiuqiang Tang
1761cdcef4
Fix aar breakage caused by missing "//mediapipe/tasks/java/com/google/mediapipe/tasks/components/containers:normalized_landmark".
...
PiperOrigin-RevId: 493204770
2022-12-05 22:16:46 -08:00
MediaPipe Team
af43687f2e
Open-sources a unit test.
...
PiperOrigin-RevId: 493184055
2022-12-05 20:11:07 -08:00
MediaPipe Team
3174b20fbe
Move segmentation calculator and options out of 'components' folder.
...
PiperOrigin-RevId: 493157929
2022-12-05 17:37:49 -08:00
Jiuqiang Tang
1e76d47a71
Checks if a custom global resource provider is used as the first step of loading the model resources on all platforms.
...
PiperOrigin-RevId: 493141519
2022-12-05 16:20:20 -08:00
MediaPipe Team
3ad03bee0b
Adds missing visibility rule.
...
PiperOrigin-RevId: 493118880
2022-12-05 14:50:35 -08:00
MediaPipe Team
69b27b246a
Adds a public function for creating TaskRunner instances.
...
PiperOrigin-RevId: 493109736
2022-12-05 14:18:17 -08:00
Adam Cozzette
4f8eaee20f
Internal change
...
PiperOrigin-RevId: 493065632
2022-12-05 11:35:33 -08:00
MediaPipe Team
35bb18945f
Better handling of empty packets in vector calculators.
...
PiperOrigin-RevId: 493000695
2022-12-05 07:25:14 -08:00
Sebastian Schmidt
e457039fc6
Don't inherit from GraphRunner
...
PiperOrigin-RevId: 492584486
2022-12-02 16:20:19 -08:00
Sebastian Schmidt
da9587033d
Move shared code to TaskRunner
...
PiperOrigin-RevId: 492534879
2022-12-02 12:42:45 -08:00
Sebastian Schmidt
dabc2af15b
Fix base bath loading in Fileset resolver
...
PiperOrigin-RevId: 492526041
2022-12-02 12:06:48 -08:00
MediaPipe Team
768d2dc548
Separate web and java api landmark and world landmark to two classes. This makes the platforms interface consistent.
...
PiperOrigin-RevId: 492332990
2022-12-01 16:49:47 -08:00
Jiuqiang Tang
ead41132a8
Load model file content from model file path with the help of GetResourceContents in browsers.
...
This can handle the model files that are provided via a custom ResourceProviderFn.
PiperOrigin-RevId: 492308453
2022-12-01 15:03:57 -08:00
Jiuqiang Tang
af990c3da1
Open up the visibility of "//mediapipe/java/com/google/mediapipe/framework/image:image".
...
PiperOrigin-RevId: 492308109
2022-12-01 15:00:25 -08:00
Khanh LeViet
fd79f18aeb
Make BaseOptions to pass absolute path to C++ layer.
...
PiperOrigin-RevId: 492296573
2022-12-01 14:14:51 -08:00
Camillo Lugaresi
40eb0e6385
Internal change
...
PiperOrigin-RevId: 492276913
2022-12-01 12:59:41 -08:00
Hadon Nash
1e2cb2b359
Internal change
...
PiperOrigin-RevId: 492253867
2022-12-01 11:34:55 -08:00
MediaPipe Team
02aa162c9e
Rename gesture_recognizer test_data to testdata to be consistent with rest of model_maker
...
PiperOrigin-RevId: 492246728
2022-12-01 11:13:19 -08:00
Sebastian Schmidt
e685ac9344
Re-use classifier options for ObjectDetector
...
PiperOrigin-RevId: 492206856
2022-12-01 08:48:09 -08:00
Jiuqiang Tang
3ee37800e2
Depending on "inference_calculator_cpu" when the mediapipe tasks can only support cpu inference.
...
PiperOrigin-RevId: 492205954
2022-12-01 08:43:30 -08:00
Jiuqiang Tang
e7eee27c1c
Remove the deleted library "mediapipe/tasks/java/com/google/mediapipe/tasks/components/processors:embedderoptions" from mediapipe_tasks_aar's android_library deps list.
...
PiperOrigin-RevId: 492200061
2022-12-01 08:17:12 -08:00
Sebastian Schmidt
a430939fe4
Document RunningMode
...
PiperOrigin-RevId: 492193299
2022-12-01 07:45:12 -08:00
MediaPipe Team
01010fa248
Internal change
...
PiperOrigin-RevId: 492188196
2022-12-01 07:17:19 -08:00
MediaPipe Team
29c7702984
Inline formerly nested 'ClassifierOptions' in Java classifier APIs.
...
PiperOrigin-RevId: 492173060
2022-12-01 05:52:15 -08:00
Jiuqiang Tang
460aee7933
Make mediapipe_tasks_aar's android_library depend on "//third_party:androidx_annotation".
...
PiperOrigin-RevId: 492092487
2022-11-30 20:45:02 -08:00
Camillo Lugaresi
fcd2d2c5af
Internal change
...
PiperOrigin-RevId: 491733850
2022-11-29 14:14:37 -08:00
Michael Hays
88173948ee
Internal change
...
PiperOrigin-RevId: 491724816
2022-11-29 13:39:35 -08:00
Sebastian Schmidt
09740130e8
Use naturalWidth and naturalHeight for image data
...
PiperOrigin-RevId: 491694147
2022-11-29 11:35:03 -08:00
Jiuqiang Tang
c8a413bb4e
Open up mediapipe framework's visibility.
...
PiperOrigin-RevId: 491672877
2022-11-29 10:19:44 -08:00
Camillo Lugaresi
cc11b45228
Remove unneeded GPU_SHARED side packet for GlSurfaceSink
...
PiperOrigin-RevId: 491487092
2022-11-28 17:55:30 -08:00
Camillo Lugaresi
fc526374ab
Use GpuResources in GpuTestBase and update GpuBufferMultiPoolTest
...
PiperOrigin-RevId: 491486495
2022-11-28 17:51:03 -08:00
MediaPipe Team
e987b69f39
Add alternative method to determine unique kernel cache path
...
PiperOrigin-RevId: 491476293
2022-11-28 16:52:16 -08:00
MediaPipe Team
7b74fd53f5
Verify that kernel cache is only used when OpenCL is active
...
PiperOrigin-RevId: 491463306
2022-11-28 15:47:55 -08:00
MediaPipe Team
26a7ca5c64
fix typo and minor formatting issues
...
PiperOrigin-RevId: 491453662
2022-11-28 15:05:28 -08:00
MediaPipe Team
b65c40b302
Internal change
...
PiperOrigin-RevId: 491441446
2022-11-28 14:17:23 -08:00
Sebastian Schmidt
342f95fa20
Typo fix
...
PiperOrigin-RevId: 491434987
2022-11-28 13:54:09 -08:00
MediaPipe Team
c48ca1f674
internal change
...
PiperOrigin-RevId: 491429214
2022-11-28 13:33:57 -08:00
Sebastian Schmidt
153edc59a1
Add support for browsers without SIMD
...
PiperOrigin-RevId: 491371277
2022-11-28 09:54:22 -08:00
MediaPipe Team
395d9d8ea2
Instantiate GetDetectionVectorItemCalculator variant of GetVectorItemCalculator<>.
...
PiperOrigin-RevId: 491123314
2022-11-27 00:07:10 -08:00
Camillo Lugaresi
0bdb48ceb1
Use kUtilityFramebuffer in GlCalculatorHelper
...
All calculators using the same context can share a single framebuffer object.
PiperOrigin-RevId: 490605074
2022-11-23 16:19:31 -08:00
MediaPipe Team
41a7f9d7d6
Internal change
...
PiperOrigin-RevId: 490595529
2022-11-23 15:24:50 -08:00
MediaPipe Team
bfa57310c4
Move TextPreprocessing to "processors" folder.
...
PiperOrigin-RevId: 490532670
2022-11-23 10:19:45 -08:00
Camillo Lugaresi
54d1744c8f
Remove DrishtiGraphGPUData, add MetalSharedResources
...
This class is unused except by the Metal helper; let's narrow it down and simplify gpu_shared_data.
PiperOrigin-RevId: 490531767
2022-11-23 10:15:17 -08:00
Camillo Lugaresi
3c53ec2cdb
Do not expose DrishtiGraphGPUData.h in public header
...
This class is an implementation detail.
PiperOrigin-RevId: 490530823
2022-11-23 10:11:32 -08:00
MediaPipe Team
b5189758f7
Move ImagePreprocessing to "processors" folder.
...
PiperOrigin-RevId: 490444821
2022-11-23 02:08:37 -08:00
Sebastian Schmidt
c5ce523697
Add cosine APIs to Embedder tasks
...
PiperOrigin-RevId: 490444597
2022-11-23 02:04:44 -08:00
Sebastian Schmidt
05681fc0e1
Internal
...
PiperOrigin-RevId: 490439195
2022-11-23 01:29:37 -08:00
Camillo Lugaresi
a55839de51
This storage only needs a "done writing" callback on simulator, so only set it there
...
- When not on simulator, we pass nullptr instead of a do-nothing callback.
- The callback is no longer a method, but a function. Only the CVPixelBuffer is captured.
PiperOrigin-RevId: 490380248
2022-11-22 18:09:09 -08:00
Sebastian Schmidt
3bbc0e9af9
Internal change
...
PiperOrigin-RevId: 490375672
2022-11-22 17:39:54 -08:00
MediaPipe Team
837225c53d
Internal change
...
PiperOrigin-RevId: 490374976
2022-11-22 17:36:15 -08:00
Camillo Lugaresi
8ba9d87e66
Update ImageFrameToGpuBufferCalculator to use api2 and GpuBuffer conversions
...
PiperOrigin-RevId: 490374387
2022-11-22 17:32:33 -08:00
MediaPipe Team
fac97554df
Small TS audio API improvement
...
PiperOrigin-RevId: 490374083
2022-11-22 17:27:47 -08:00
Camillo Lugaresi
efa9e737f8
Use current context if available in ConvertToImageFrame
...
If we're already running in a GlContext, there's no need to go back to the producer context, which may be different.
PiperOrigin-RevId: 490373829
2022-11-22 17:24:03 -08:00
MediaPipe Team
7ce4aa6592
Internal change
...
PiperOrigin-RevId: 490366250
2022-11-22 16:40:38 -08:00
Camillo Lugaresi
515d00fc22
Internal change
...
PiperOrigin-RevId: 490349260
2022-11-22 15:18:21 -08:00
vrabaud
872d1afda7
Internal change
...
PiperOrigin-RevId: 490196129
2022-11-22 03:12:38 -08:00
Camillo Lugaresi
d648926155
Just reset the fb binding to 0 in ReadTexture
...
This saves a get operation. We already have precedent in lots of other MediaPipe code where we just reset bindings to 0.
PiperOrigin-RevId: 490170691
2022-11-22 00:36:54 -08:00
Camillo Lugaresi
bacbac8d92
Use kUtilityFramebuffer in ReadTexture
...
This avoids creating a temporary framebuffer each time.
PiperOrigin-RevId: 490163892
2022-11-21 23:59:44 -08:00
Camillo Lugaresi
a8b7761022
Define a kUtilityFramebuffer context attachment
...
A framebuffer object is often needed to render to a texture or read data from it. Currently we create one in each GlCalculatorHelper, but that is redundant (we only need one per context, and multiple calculators can share the same context). Other times, the code that needs to use this doesn't own a helper. For both reasons, this should be attached to the context.
We could just make this a member of GlContext since it's so common. However, I figured we might as well use the attachment system.
PiperOrigin-RevId: 490160214
2022-11-21 23:29:27 -08:00
Camillo Lugaresi
54a684717f
Internal change
...
PiperOrigin-RevId: 490159674
2022-11-21 23:24:16 -08:00
MediaPipe Team
d43d0ff615
Internal change
...
PiperOrigin-RevId: 490089940
2022-11-21 15:47:45 -08:00
MediaPipe Team
adddf2c2ab
Extracted common test helper functions out from the unittest into a sharable
...
library. Also migrated away from OpenCVX.
PiperOrigin-RevId: 490074410
2022-11-21 14:39:56 -08:00
MediaPipe Team
652423a23d
Internal change
...
PiperOrigin-RevId: 490053179
2022-11-21 13:06:47 -08:00
MediaPipe Team
7f0134eecb
Internal change
...
PiperOrigin-RevId: 490041386
2022-11-21 12:16:00 -08:00
MediaPipe Team
7acbf557a1
Cleanup after migration to new classification output format.
...
PiperOrigin-RevId: 489921603
2022-11-21 01:57:05 -08:00
MediaPipe Team
13c6b9a8c6
Allow kernel cache path to be specified without trailing path delimiter
...
PiperOrigin-RevId: 489891079
2022-11-20 22:20:18 -08:00
Camillo Lugaresi
3ac7f6a216
Simplify image creation in PacketCreator
...
Use more existing functions, remove redundant code, remove direct use of RuntimeException.
PiperOrigin-RevId: 489868983
2022-11-20 19:32:21 -08:00
MediaPipe Team
6cf464636b
Internal change
...
PiperOrigin-RevId: 489842199
2022-11-20 14:26:22 -08:00
Scott Zhu
a367753eda
Internal change
...
PiperOrigin-RevId: 489824381
2022-11-20 10:41:20 -08:00
MediaPipe Team
bdf4078e89
Internal change
...
PiperOrigin-RevId: 489752009
2022-11-19 21:14:24 -08:00
Camillo Lugaresi
a33cb1e05e
Check that Java buffer supports direct access before using it
...
If the buffer is not created with allocateDirect, JNI APIs will return a data pointer of nullptr and a capacity of -1. This can cause a crash when we access it.
Also clean up the code to raise exceptions instead of just logging errors and returning nullptr.
PiperOrigin-RevId: 489751312
2022-11-19 21:04:48 -08:00
MediaPipe Team
977ee4272e
Add public visibility to the model maker public API.
...
PiperOrigin-RevId: 489701768
2022-11-19 10:53:21 -08:00
Sebastian Schmidt
bbcbd5fc6c
Audio Embedder for Web
...
PiperOrigin-RevId: 489669966
2022-11-19 04:49:24 -08:00
Sebastian Schmidt
e853f04b79
Create AudioTaskRunner
...
PiperOrigin-RevId: 489613573
2022-11-18 19:55:08 -08:00
Camillo Lugaresi
eb8ef1ace0
Use shared_from_this in GlTextureBuffer::GetReadView, GetWriteView
...
This ensures that the callbacks in GlTextureView won't call an expired object, even if user code holds a GlTextureView after releasing the buffer.
Note that GlTextureBuffer is not always held by a shared_ptr, but it always is when GpuBuffer calls GetRead/WriteView on it. An alternative solution would have been to have GpuBuffer pass its shared_ptr<GlTextureBuffer> to the view method, which could have been implemented with some compile-time logic to detect whether the method expects such an argument. However, that doesn't seem necessary.
PiperOrigin-RevId: 489611843
2022-11-18 19:42:34 -08:00
MediaPipe Team
bbd5da7971
Added the gray scale image support for the ImageToTensorCalculator on CPU.
...
PiperOrigin-RevId: 489593917
2022-11-18 17:12:57 -08:00
MediaPipe Team
524ac3ca61
Internal change for Model Maker
...
PiperOrigin-RevId: 489540387
2022-11-18 12:48:30 -08:00
Jiuqiang Tang
1b594a0310
Return error status when any tflite input and output tensor doesn't have valid dimensionality information that is needed to allocate Gl/Metal buffer before calling ModifyGraphWithDelegate.
...
PiperOrigin-RevId: 489539740
2022-11-18 12:44:55 -08:00
Sebastian Schmidt
71ae496a20
Add AudioEmbedder documentation
...
PiperOrigin-RevId: 489532283
2022-11-18 12:12:41 -08:00
MediaPipe Team
e2052a6a51
Rename embedding postprocessor "configure" method for consistency with classification postprocessor.
...
PiperOrigin-RevId: 489518257
2022-11-18 11:13:10 -08:00
Adam Cozzette
ac212c1507
Internal change
...
PiperOrigin-RevId: 489502255
2022-11-18 10:08:26 -08:00
MediaPipe Team
03d388fecf
Add hand landmark named index constants
...
PiperOrigin-RevId: 489498248
2022-11-18 09:52:44 -08:00
MediaPipe Team
2f361e2f47
Internal change
...
PiperOrigin-RevId: 489486417
2022-11-18 08:53:43 -08:00
Jiuqiang Tang
e046982a3c
Internal change
...
PiperOrigin-RevId: 489484898
2022-11-18 08:47:09 -08:00
Hadon Nash
ae44012c0c
Allowing BypassCalculator to accept InputSidePackets.
...
PiperOrigin-RevId: 489483992
2022-11-18 08:43:02 -08:00
Camillo Lugaresi
efcdedbd59
Remove redundant _ios targets
...
PiperOrigin-RevId: 489355333
2022-11-17 18:16:58 -08:00
Copybara-Service
cd056e114a
Merge pull request #3866 from kinaryml:fix-tasks-api-python-311-errors
...
PiperOrigin-RevId: 489346167
2022-11-17 17:20:23 -08:00
MediaPipe Team
6f3cb340e1
Internal change
...
PiperOrigin-RevId: 489345940
2022-11-17 17:16:25 -08:00
MediaPipe Team
ab3a5f0fbf
Make MuxCalculator with DefaultInputStreamHandler to handle graph closure gracefully
...
PiperOrigin-RevId: 489336722
2022-11-17 16:30:35 -08:00
MediaPipe Team
a7bd725e65
Internal change
...
PiperOrigin-RevId: 489331826
2022-11-17 16:09:15 -08:00
MediaPipe Team
1fb0902aa0
Update gesture_recognizer test
...
PiperOrigin-RevId: 489301508
2022-11-17 14:04:30 -08:00
Sebastian Schmidt
3ccf7308e0
Add shared options for Text and Audio Tasks
...
PiperOrigin-RevId: 489186644
2022-11-17 05:28:27 -08:00
Hadon Nash
ea4989b6f1
Internal change
...
PiperOrigin-RevId: 489135553
2022-11-17 00:07:59 -08:00
kinaryml
5a6837d034
Fix errors that will occur in python 3.11
2022-11-16 22:08:52 -08:00
Sebastian Schmidt
899c87466e
Add MP Tasks entrypoints
...
PiperOrigin-RevId: 489110875
2022-11-16 20:57:33 -08:00
Camillo Lugaresi
6fc277ee1c
Internal change
...
PiperOrigin-RevId: 489091534
2022-11-16 18:38:03 -08:00
Sebastian Schmidt
e66e88802c
Change NPM Bundle to ESM
...
PiperOrigin-RevId: 489091370
2022-11-16 18:34:53 -08:00
MediaPipe Team
90eb4a19d8
Internal change
...
PiperOrigin-RevId: 489088227
2022-11-16 18:16:32 -08:00
MediaPipe Team
b6b72d5e4e
Add MuxCalculator test case where graph is being closed while SELECT has not been received.
...
PiperOrigin-RevId: 489061902
2022-11-16 15:56:43 -08:00
Sebastian Schmidt
3cdf0f6536
Fix a crash that occurred when a model returns fewer vector elements than before
...
PiperOrigin-RevId: 489041814
2022-11-16 14:38:37 -08:00
MediaPipe Team
74474d859e
Update image_classifier demo with new ImageClassifierOption changes
...
PiperOrigin-RevId: 489031381
2022-11-16 14:00:39 -08:00
MediaPipe Team
cdd44e77b7
Internal change
...
PiperOrigin-RevId: 488969539
2022-11-16 10:07:40 -08:00
MediaPipe Team
dc9578d226
Internal change
...
PiperOrigin-RevId: 488946809
2022-11-16 08:30:20 -08:00
Sebastian Schmidt
f7aef677fc
Add running mode to all vision tasks
...
PiperOrigin-RevId: 488816785
2022-11-15 19:02:21 -08:00
Camillo Lugaresi
febfc2029b
Annotate plane argument
...
PiperOrigin-RevId: 488813363
2022-11-15 18:53:09 -08:00
Camillo Lugaresi
63e2089639
Deprecate a bunch of old stuff in GlCalculatorHelper
...
PiperOrigin-RevId: 488813296
2022-11-15 18:51:56 -08:00
Camillo Lugaresi
1979801a92
Remove GlCalculatorHelperImpl; merge with GlCalculatorHelper
...
Originally, there were multiple implementations of GlCalculatorHelperImpl, depending on the platform and underlying GL APIs. These have all been refactored into other components, and the remaining code in this class is unified and much reduced in size. We can get rid of this implementation detail now.
PiperOrigin-RevId: 488813220
2022-11-15 18:50:45 -08:00
Camillo Lugaresi
8b319e963a
Add comment explaining ViewProvider
...
This was only documented via examples (e.g. ViewProvider<GlTextureView>), but it's better to explain it properly in the header where the base case is defined.
PiperOrigin-RevId: 488813144
2022-11-15 18:48:54 -08:00
Camillo Lugaresi
a28ccb0964
Remove unnecessary forward declarations
...
PiperOrigin-RevId: 488813066
2022-11-15 18:43:36 -08:00
Camillo Lugaresi
13b4b825d7
Remove std::shared_ptr<GpuBuffer> argument from GetRead/WriteView
...
PiperOrigin-RevId: 488813004
2022-11-15 18:41:53 -08:00
Camillo Lugaresi
1c0a1d0aab
Remove shared_ptr<GpuBuffer> member from GlTextureView
...
This only exists to support GlTexture's GetFrame API. It can be moved into GlTexture.
PiperOrigin-RevId: 488812896
2022-11-15 18:40:15 -08:00
Camillo Lugaresi
767cc2ee3c
More comments on gpu_buffer_storage
...
This gives a basic explanation of the role of storages and views, and provides some details on how to implement a new storage type.
PiperOrigin-RevId: 488812807
2022-11-15 18:38:29 -08:00
Camillo Lugaresi
4c874fe4cd
Allow conversion of GlTextureBuffer to CVPixelBufferRef
...
This means that, if an iOS application sends in a GlTextureBuffer but expects a CVPixelBufferRef as output, everything will work even if the graph just forwards the same input. Also, access by Metal calculators will also work transparently.
PiperOrigin-RevId: 488812748
2022-11-15 18:36:45 -08:00
Camillo Lugaresi
fe66de3714
Internal change
...
PiperOrigin-RevId: 488812677
2022-11-15 18:32:54 -08:00
MediaPipe Team
2f77bf44e3
Use train_data to evaluate accuracy of unit test for gesture_recognizer due to limited dataset size.
...
PiperOrigin-RevId: 488808942
2022-11-15 18:10:28 -08:00
Camillo Lugaresi
b308c0dd5e
Implement CVPixelBufferRef access as a view.
...
PiperOrigin-RevId: 488798216
2022-11-15 17:18:07 -08:00