cassdlcm/mediapipe
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,146 Commits 10 Branches 56 Tags 829 MiB
1f848c4d69
Commit Graph

1001 Commits

Author SHA1 Message Date
Hadon Nash
66634bbef8 Internal change 
PiperOrigin-RevId: 503011674
 2023-01-18 16:38:11 -08:00
MediaPipe Team
e56fa8f258 Source/SideSource -> Stream/SidePacket 
PiperOrigin-RevId: 502923931
 2023-01-18 11:02:41 -08:00
Nikolay Chirkov
5687d19dec Tensor: remove unused and unimplemented SetPreferredStorageType methods. 
PiperOrigin-RevId: 502893019
 2023-01-18 09:09:20 -08:00
Jiuqiang Tang
29484702ce Add process_timestamp_bounds into RectToRenderScaleCalculatorOptions. 
PiperOrigin-RevId: 502877541
 2023-01-18 08:02:47 -08:00
MediaPipe Team
3688757d17 Fix load_metadata_buffer for empty metadata 
PiperOrigin-RevId: 502870428
 2023-01-18 07:28:42 -08:00
Sebastian Schmidt
e484bd681e Export all input and output types 
PiperOrigin-RevId: 502764544
 2023-01-17 20:57:16 -08:00
Sebastian Schmidt
d5e60eb658 Internal change 
PiperOrigin-RevId: 502764352
 2023-01-17 20:53:34 -08:00
Camillo Lugaresi
7894c92ab7 Internal change 
PiperOrigin-RevId: 502709070
 2023-01-17 15:51:07 -08:00
Sebastian Schmidt
088249eb36 Export all input and output types 
PiperOrigin-RevId: 502649430
 2023-01-17 11:59:33 -08:00
Jiuqiang Tang
7a4b450c50 Resolve the error "call to 'abs' is ambiguous". 
PiperOrigin-RevId: 502630518
 2023-01-17 10:53:14 -08:00
Jiuqiang Tang
7974171c3d Merge classificationResultList() and classificationResult() to be classificationResults(), and similar for embeddingResults(). 
PiperOrigin-RevId: 502601043
 2023-01-17 09:06:49 -08:00
Camillo Lugaresi
c1f5920ecf Add web performance tracing to the MEDIAPIPE_PROFILING repertoire 
This records the MEDIAPIPE_PROFILING tracing annotations to the browser's trace using the user timing API. See https://developer.mozilla.org/en-US/docs/Web/API/User_Timing_API

To enable, build with --define MEDIAPIPE_WEB_PROFILING=1 --define DRISHTI_PROFILING=1

PiperOrigin-RevId: 502422030
 2023-01-16 12:59:18 -08:00
MediaPipe Team
ffd8486d0d Add a stub WriteProfile method to GraphProfilerStub. 
PiperOrigin-RevId: 502388455
 2023-01-16 08:38:05 -08:00
Prianka Liz Kariat
67735a6fd3 Added category indices in iOS failure description 2023-01-16 14:01:10 +05:30
Prianka Liz Kariat
cf945d3aeb Removed unused variable 2023-01-16 13:59:51 +05:30
Prianka Liz Kariat
a0b3e620e4 Removed unused methods 2023-01-16 13:12:27 +05:30
Prianka Liz Kariat
f7fc8a6eca Updated method names in tests 2023-01-16 13:05:29 +05:30
Prianka Liz Kariat
8ecf77f760 Updated comment style in methods 2023-01-16 13:02:33 +05:30
Prianka Liz Kariat
30533be321 Reformatted comments 2023-01-16 13:00:10 +05:30
MediaPipe Team
92a2e02ace Internal change 
PiperOrigin-RevId: 501971410
 2023-01-13 17:05:19 -08:00
Sebastian Schmidt
aef4cca406 Copy README.md to NPM package root 
PiperOrigin-RevId: 501929871
 2023-01-13 13:48:02 -08:00
Sebastian Schmidt
f997c0ab1a Reject RegionOfInterest in not supported tasks 
PiperOrigin-RevId: 501872455
 2023-01-13 09:53:57 -08:00
MediaPipe Team
69757d7924 Internal change 
PiperOrigin-RevId: 501862194
 2023-01-13 09:05:48 -08:00
Prianka Liz Kariat
95f9f0fb88 Updated formatting 2023-01-13 21:18:10 +05:30
Prianka Liz Kariat
c4c07acc1e Updated comments of MPPCommonUtils 2023-01-13 21:18:01 +05:30
Prianka Liz Kariat
2a53d78ae4 Added swift and objective tests for iOS text classifier 2023-01-13 21:05:44 +05:30
Prianka Liz Kariat
9e0b85c9b5 Added module name for iOS text classifier 2023-01-13 21:05:17 +05:30
Prianka Liz Kariat
c40356c628 Added ios.bzl 2023-01-13 21:04:56 +05:30
Prianka Liz Kariat
0a707256e3 Updates to method signatures of iOS text classifier 2023-01-13 21:04:43 +05:30
Prianka Liz Kariat
fa30100059 Changed swift name of MPPCategory 2023-01-13 21:04:17 +05:30
Prianka Liz Kariat
5642980ab0 Updated iOS error implementation to mimic java 2023-01-13 21:04:03 +05:30
Copybara-Service
4e19a5a0dc Merge pull request #3988 from priankakariatyml:ios-text-classifier-impl 
PiperOrigin-RevId: 501739316
 2023-01-12 20:25:02 -08:00
Jiuqiang Tang
8156da3418 ClassificationAggregationCalculator should fill in the timestamp_ms field of the classification results in the stream mode. 
Per user feedback, the consistency between the packet timestamp and the timestamp field of the classification result helps reducing the confusion.

PiperOrigin-RevId: 501657922
 2023-01-12 13:54:55 -08:00
MediaPipe Team
1683d572ed Internal change 
PiperOrigin-RevId: 501600938
 2023-01-12 10:22:00 -08:00
MediaPipe Team
74b60780c7 Internal change 
PiperOrigin-RevId: 501594400
 2023-01-12 10:00:44 -08:00
Jiuqiang Tang
5c74ed2ae5 EmbeddingAggregationCalculator should fill in the timestamp_ms field of the embedding results in the stream mode. 
Per user feedback, the consistency between the packet timestamp and the timestamp field of the embedding result helps reducing the confusion.

PiperOrigin-RevId: 501572379
 2023-01-12 08:30:07 -08:00
MediaPipe Team
9cbb76939d Adds smaller MobileBERT model. 
PiperOrigin-RevId: 501451414
 2023-01-11 20:35:39 -08:00
Nikolay Chirkov
8830eefa0b Internal change. 
PiperOrigin-RevId: 501403332
 2023-01-11 16:07:22 -08:00
MediaPipe Team
36be94f861 Internal change 
PiperOrigin-RevId: 501378130
 2023-01-11 14:24:00 -08:00
MediaPipe Team
5612af68cd Propagate compatible_with for drishti_proto_library 
PiperOrigin-RevId: 501356895
 2023-01-11 13:01:57 -08:00
MediaPipe Team
0e56bd38f3 Fix for CHECK failure due to pointer description sometimes being larger than allocated string space 
PiperOrigin-RevId: 501355568
 2023-01-11 12:58:37 -08:00
Prianka Liz Kariat
c7e36f8720 Re-ordered dependencies in build file 2023-01-11 20:31:46 +05:30
Prianka Liz Kariat
fe05a8d201 Reformatted code 2023-01-11 20:24:17 +05:30
Prianka Liz Kariat
b1ded2f700 Added iOS text classifier 2023-01-11 20:22:33 +05:30
Prianka Liz Kariat
a0220de233 Added iOS text classifier result helpers 2023-01-11 20:22:20 +05:30
Prianka Liz Kariat
54161cc1ab Added iOS text classifier options helpers 2023-01-11 20:22:02 +05:30
Prianka Liz Kariat
1161ebce9d Added iOS text classifier result 2023-01-11 16:22:09 +05:30
Prianka Liz Kariat
ed6abbbe43 Added iOS text classifier options 2023-01-11 16:21:28 +05:30
Nikolay Chirkov
54268594dd Internal change. 
PiperOrigin-RevId: 501136760
 2023-01-10 17:38:13 -08:00
Copybara-Service
e869e57cb4 Merge pull request #3975 from priankakariatyml:ios-base-options-helpers 
PiperOrigin-RevId: 501073613
 2023-01-10 13:07:47 -08:00
Jiuqiang Tang
25abd122b3 Support AudioRecord in MediaPipe audio tasks in Java. 
PiperOrigin-RevId: 501019327
 2023-01-10 09:45:40 -08:00
Copybara-Service
b747fc481b Merge pull request #3973 from priankakariatyml:ios-task-classifier-result 
PiperOrigin-RevId: 501005242
 2023-01-10 08:47:45 -08:00
Jiuqiang Tang
6032604f94 Hide base task api classes for MediaPipe Tasks Python from API docs 
PiperOrigin-RevId: 501004802
 2023-01-10 08:43:51 -08:00
Sebastian Schmidt
d7ee875356 Fix spacing issue in test name 
PiperOrigin-RevId: 500833769
 2023-01-09 16:20:08 -08:00
Liam Miller-Cushon
76a7c9d5d4 Internal change 
PiperOrigin-RevId: 500813290
 2023-01-09 14:49:45 -08:00
MediaPipe Team
704964be33 Fix accidental suppressions of GLSL linker error reporting 
PiperOrigin-RevId: 500802177
 2023-01-09 14:05:47 -08:00
Sebastian Schmidt
0831023114 Use uppercase enum constants for RunningMode 
PiperOrigin-RevId: 500760402
 2023-01-09 11:11:21 -08:00
MediaPipe Team
d40fa6b16d Internal Model Maker change. 
PiperOrigin-RevId: 500758488
 2023-01-09 11:04:45 -08:00
Sebastian Schmidt
73f4636292 Create README.md files to NPM packages 
PiperOrigin-RevId: 500750516
 2023-01-09 10:36:49 -08:00
MediaPipe Team
c6cf598774 Minor fix for max_queue_size documentation 
PiperOrigin-RevId: 500738798
 2023-01-09 09:54:09 -08:00
Sebastian Schmidt
2b9299959c Internal change 
PiperOrigin-RevId: 500730237
 2023-01-09 09:22:02 -08:00
Sebastian Schmidt
1bbe065647 Simplify default options for GestureRecognize 
PiperOrigin-RevId: 500729643
 2023-01-09 09:18:08 -08:00
Nikolay Chirkov
e0a254789a Internal change. 
PiperOrigin-RevId: 500331015
 2023-01-06 22:15:18 -08:00
Sebastian Schmidt
7f043b7de1 Allow split_vector_calculator to be build with iOS and MEDIAPIPE_DISABLE_GPU 
PiperOrigin-RevId: 500327774
 2023-01-06 21:45:15 -08:00
Sebastian Schmidt
c9ebc6fa60 Use synthetic timestamps in Web when none provided 
PiperOrigin-RevId: 500327275
 2023-01-06 21:41:30 -08:00
Sebastian Schmidt
ed0054836a Allow task to recover after a failed graph start 
PiperOrigin-RevId: 500324587
 2023-01-06 21:06:47 -08:00
Sebastian Schmidt
b4ede6db7b Fix typo in Category.java 
PiperOrigin-RevId: 500324008
 2023-01-06 21:02:16 -08:00
Sebastian Schmidt
9055effddd Add ImageProcessingOptions to all Vision Tasks 
PiperOrigin-RevId: 500323261
 2023-01-06 20:57:39 -08:00
Copybara-Service
e11ba95adf Merge pull request #3974 from priankakariatyml:ios-task-updates 
PiperOrigin-RevId: 500323180
 2023-01-06 20:53:33 -08:00
Sebastian Schmidt
9b34a105cf Do not depend on Image methods in TaskRunner 
PiperOrigin-RevId: 500299571
 2023-01-06 18:20:36 -08:00
MediaPipe Team
2cce88080e Internal change 
PiperOrigin-RevId: 500271109
 2023-01-06 15:29:19 -08:00
Prianka Liz Kariat
14e3de49ad Added MPPTextTaskRunner 2023-01-06 16:37:31 +05:30
Prianka Liz Kariat
b91b485035 Added MPPBaseOptions Helpers 2023-01-06 16:36:28 +05:30
Prianka Liz Kariat
b6bcc35ade Added provision for packets callback in iOS task runner 2023-01-06 16:36:15 +05:30
Prianka Liz Kariat
c6bae99a2f Updated formatting in MPPTextPacketCreator.mm 2023-01-06 16:25:56 +05:30
Prianka Liz Kariat
bc1b069edf Updated property name in MPPTaskResult 2023-01-06 16:24:41 +05:30
Prianka Liz Kariat
16f9831c3f Updated formatting in MPPTaskOptions.m 2023-01-06 16:23:37 +05:30
Prianka Liz Kariat
61d16b284b Updated comments in MPPTaskOptions.h 2023-01-06 16:23:22 +05:30
Prianka Liz Kariat
27ce2ec00f Updated C++ types to camel case in MPPTaskInfo 2023-01-06 16:22:11 +05:30
Prianka Liz Kariat
f37689fc33 Updated documentation for MPPCommonUtils.m 2023-01-06 16:15:53 +05:30
Prianka Liz Kariat
4e38c7e623 Updated documentation for MPPCommon.h 2023-01-06 16:15:32 +05:30
Prianka Liz Kariat
8f74a175d8 Removed MPPClassifierOptions and helpers 2023-01-06 16:08:06 +05:30
Prianka Liz Kariat
89aad67a87 Added iOS helpers for classification result containers 2023-01-06 16:07:50 +05:30
Prianka Liz Kariat
33df6c042f Added iOS result containers for classification tasks 2023-01-06 16:07:11 +05:30
Sebastian Schmidt
667fd81ddc Internal change 
PiperOrigin-RevId: 499956657
 2023-01-05 11:43:43 -08:00
Sebastian Schmidt
81a46bb31a Internal change 
PiperOrigin-RevId: 499902323
 2023-01-05 09:14:07 -08:00
Nikolay Chirkov
35293d88bc Tensor: move into tensor sub-directory. 
PiperOrigin-RevId: 499896489
 2023-01-05 08:56:37 -08:00
MediaPipe Team
463cbb60ee Fix RGBA vs RGB selection when creating GLTexture. 
PiperOrigin-RevId: 499877590
 2023-01-05 07:58:07 -08:00
MediaPipe Team
43bf02443c Option to remove overlapping values computed for different timestamps. 
PiperOrigin-RevId: 499635143
 2023-01-04 17:35:25 -08:00
MediaPipe Team
24cc0672c4 Internal change 
PiperOrigin-RevId: 499529022
 2023-01-04 10:59:35 -08:00
MediaPipe Team
e3131d7d78 Internal change 
PiperOrigin-RevId: 499521620
 2023-01-04 10:33:04 -08:00
Nikolay Chirkov
9a70af1464 Internal change. 
PiperOrigin-RevId: 499496793
 2023-01-04 08:54:29 -08:00
Nikolay Chirkov
a4ea606eac Internal change. 
PiperOrigin-RevId: 499490514
 2023-01-04 08:23:56 -08:00
MediaPipe Team
add5600d0d Internal change 
PiperOrigin-RevId: 499351795
 2023-01-03 17:20:46 -08:00
MediaPipe Team
e7dc989f71 Internal Change 
PiperOrigin-RevId: 499313491
 2023-01-03 14:14:21 -08:00
Copybara-Service
a7bb0aba8f Merge pull request #3937 from priankakariatyml:ios-task-files 
PiperOrigin-RevId: 499296662
 2023-01-03 13:04:55 -08:00
Sebastian Schmidt
75b87e0e32 Internal change 
PiperOrigin-RevId: 499283559
 2023-01-03 12:12:24 -08:00
Sebastian Schmidt
68f247a5c7 Internal change 
PiperOrigin-RevId: 499282085
 2023-01-03 12:05:43 -08:00
Sebastian Schmidt
987f4dc1ed Make addJsamineCustomFloatEqualityTest configurable 
PiperOrigin-RevId: 499263931
 2023-01-03 10:55:58 -08:00
MediaPipe Team
f53c0eacee Extend tag conversion behavior to also convert : (in addition to the 
current `/`, `-`, and `.`) to `_`.

PiperOrigin-RevId: 499243005
 2023-01-03 09:41:45 -08:00
Camillo Lugaresi
2f4bb5d545 Use utility framebuffer in ViewDoneWritingSimulatorWorkaround 
This code needs a FBO to bind the texture.

Fixes invalid results when running under simulator.

PiperOrigin-RevId: 499241867
 2023-01-03 09:38:19 -08:00
Sebastian Schmidt
9252a025e5 Use custom gesture options in GestureRecognizer 
PiperOrigin-RevId: 498567432
 2022-12-30 05:01:02 -08:00
MediaPipe Team
60c6b155f6 Save an integer id in graph profiler objects to distinguish between different profiler instances during benchmarking. 
PiperOrigin-RevId: 498409363
 2022-12-29 10:18:10 -08:00
MediaPipe Team
aaa16eca1f Sets the graph service packets before initializing (and validating the graph) in the objc graph wrapper. 
PiperOrigin-RevId: 498393761
 2022-12-29 08:36:03 -08:00
Nikolay Chirkov
2d9a969d10 Tensor1: memorize size_alignment when tracking the ahwb usage. 
When CPU/GPU buffer allocated and the tracker selects Ahwb storage to be used then the properly recorded alignment must be used.

PiperOrigin-RevId: 498264759
 2022-12-28 16:09:02 -08:00
Nikolay Chirkov
1924f1cdff Tensor: Fix use_ahwb_ flag and tests on local device involved. 
PiperOrigin-RevId: 498249332
 2022-12-28 14:29:43 -08:00
Sebastian Schmidt
9580f04571 Apply most graph options synchronously 
PiperOrigin-RevId: 498244085
 2022-12-28 13:58:46 -08:00
MediaPipe Team
7e36a5e2ae Set filecmp.cmp(shallow=False) in model_maker unit tests. 
PiperOrigin-RevId: 498218578
 2022-12-28 11:25:28 -08:00
MediaPipe Team
5a5ff5393a Internal change 
PiperOrigin-RevId: 497269082
 2022-12-27 10:50:41 -08:00
Hadon Nash
557cd050f3 Deprecating RealTimeFlowLimiterCalculator in favor of FlowLimiterCalculator. 
PiperOrigin-RevId: 497260577
 2022-12-22 16:29:14 -08:00
MediaPipe Team
5a71b551e5 Remove duplicate and non-public api for model_maker 
PiperOrigin-RevId: 497251246
 2022-12-22 15:31:12 -08:00
MediaPipe Team
36f054dfbe Internal model maker change 
PiperOrigin-RevId: 497196512
 2022-12-22 10:43:15 -08:00
MediaPipe Team
5b90afda70 Internal change 
PiperOrigin-RevId: 497191969
 2022-12-22 10:23:34 -08:00
MediaPipe Team
9673841605 Internal visibility update 
PiperOrigin-RevId: 497185157
 2022-12-22 09:51:52 -08:00
Prianka Liz Kariat
48eeae4d9d Formatted code 2022-12-22 12:16:43 +05:30
Prianka Liz Kariat
613ed58890 Inverted condition check in MPPTaskInfo 2022-12-22 12:16:33 +05:30
Prianka Liz Kariat
e47256ae55 Clearing proto before assigining new values in MPPClassifierOptions Helpers 2022-12-22 12:10:23 +05:30
MediaPipe Team
69b6d9d970 Internal change 
PiperOrigin-RevId: 497043596
 2022-12-21 17:44:36 -08:00
Prianka Liz Kariat
e559613b9d Updated comments in MPPClassifierOptions.h 2022-12-22 02:02:48 +05:30
Prianka Liz Kariat
b4a7644428 Updated comments 2022-12-22 02:01:04 +05:30
Prianka Liz Kariat
20c3388ab6 Updated category allowlist and denylist names 2022-12-22 01:59:38 +05:30
Prianka Liz Kariat
c185dc9ad7 Renamed label to category in classifier options 2022-12-22 01:19:01 +05:30
Prianka Liz Kariat
e1dfcf03cf Updated comments in MPPClassifierOptions.h 2022-12-22 01:12:34 +05:30
Prianka Liz Kariat
66ee8d47c0 Resorted options 2022-12-22 01:10:07 +05:30
Prianka Liz Kariat
673b38dfe8 Updated comments 2022-12-22 01:08:13 +05:30
Prianka Liz Kariat
54d36dfeda Update MPPClassifierOptions.h 2022-12-22 01:05:50 +05:30
Prianka Liz Kariat
7ae4b7e639 Updated error domain 2022-12-22 01:05:01 +05:30
Prianka Liz Kariat
99c11ff974 Updated comments 2022-12-22 01:03:39 +05:30
Prianka Liz Kariat
1de3694175 Updated comments 2022-12-22 01:02:07 +05:30
Prianka Liz Kariat
1491b3f5a2 Updated comments 2022-12-22 01:00:36 +05:30
Prianka Liz Kariat
20f2e136c5 Updated empty spaces 2022-12-22 00:59:22 +05:30
Prianka Liz Kariat
2943d1668e Updated comments 2022-12-22 00:51:20 +05:30
Prianka Liz Kariat
481f4e960e Updated comments 2022-12-22 00:49:44 +05:30
Prianka Liz Kariat
ae28948ca1 Marked designated initializers 2022-12-22 00:49:24 +05:30
Jiuqiang Tang
714a6e555b Enable creating mediapipe image c++ packet directly from an Android media image object when its format is RGBA_8888. 
PiperOrigin-RevId: 496923491
 2022-12-21 08:07:53 -08:00
MediaPipe Team
1341720d6d Internal change 
PiperOrigin-RevId: 496854337
 2022-12-21 00:55:32 -08:00
MediaPipe Team
5c0f548f5f Switches to tf.keras.optimizers.experimental.AdamW instead of the legacy AdamW. 
PiperOrigin-RevId: 496821354
 2022-12-20 20:53:13 -08:00
Jiuqiang Tang
151e447614 Internal changes 
PiperOrigin-RevId: 496793199
 2022-12-20 17:52:17 -08:00
MediaPipe Team
64406a9bf2 Internal change 
PiperOrigin-RevId: 496781536
 2022-12-20 16:41:49 -08:00
Sebastian Schmidt
d2f738793c Use uppercase options name for "delegate" 
PiperOrigin-RevId: 496764089
 2022-12-20 15:18:17 -08:00
MediaPipe Team
a7b52d2c52 Internal changes 
PiperOrigin-RevId: 496754449
 2022-12-20 14:37:18 -08:00
Prianka Liz Kariat
ff901a80a5 Added targets in core 2022-12-21 01:24:11 +05:30
Prianka Liz Kariat
4fedea60a9 Added text packet creator 2022-12-21 01:24:02 +05:30
Prianka Liz Kariat
e9fc3713f0 Added iOS task runner 2022-12-21 01:23:51 +05:30
Prianka Liz Kariat
64cf5e9b4e Added iOS task options protocol 2022-12-21 01:23:41 +05:30
Prianka Liz Kariat
6d02108bf5 Added task info 2022-12-21 01:23:29 +05:30
Prianka Liz Kariat
c56ef735d7 Added classifier options helpers 2022-12-21 01:22:57 +05:30
Prianka Liz Kariat
03bfbca539 Added classifier options 2022-12-21 01:22:44 +05:30
Prianka Liz Kariat
e997a19289 Added common utils and string helpers 2022-12-21 01:22:32 +05:30
MediaPipe Team
e405c2b67d Internal change 
PiperOrigin-RevId: 496702117
 2022-12-20 11:04:42 -08:00