cassdlcm/mediapipe
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,774 Commits 10 Branches 56 Tags 829 MiB
eb62479190
Commit Graph

1556 Commits

Author SHA1 Message Date
MediaPipe Team
d0aa98bd5f Internal change 
PiperOrigin-RevId: 510570555
 2023-02-17 18:50:05 -08:00
MediaPipe Team
68ba9a6ebf [ImageTransformationCalculator]Add option to specify padding color 
PiperOrigin-RevId: 510541473
 2023-02-17 15:57:19 -08:00
MediaPipe Team
37a825c98d graph utils functions. 
PiperOrigin-RevId: 510513793
 2023-02-17 13:54:46 -08:00
MediaPipe Team
1a60a0e2d6 Use box_output_format to decide keypoint order 
PiperOrigin-RevId: 510464960
 2023-02-17 10:30:57 -08:00
MediaPipe Team
4ed9f507ad Internal change 
PiperOrigin-RevId: 510281435
 2023-02-16 17:01:56 -08:00
Hadon Nash
5f6bbdbce5 Internal change 
PiperOrigin-RevId: 510243967
 2023-02-16 14:26:46 -08:00
MediaPipe Team
1b66fc2802 Fix Typo. 
PiperOrigin-RevId: 510156746
 2023-02-16 08:55:56 -08:00
MediaPipe Team
ba10ae8410 Add mediapipe tasks face blendshapes graph 
PiperOrigin-RevId: 509995915
 2023-02-15 19:26:56 -08:00
MediaPipe Team
bdd1c24990 Refactor common methods into vision/core/image_utils.py and vision/core/test_utils.py 
PiperOrigin-RevId: 509968910
 2023-02-15 16:54:38 -08:00
MediaPipe Team
3d4ed305bc Make Tensor::Move() forward quantization parameters. 
PiperOrigin-RevId: 509951145
 2023-02-15 15:40:22 -08:00
MediaPipe Team
796a96d842 Add support for [xmin, ymin, xmax, ymax] style of bbox output 
PiperOrigin-RevId: 509942540
 2023-02-15 15:06:52 -08:00
Prianka Liz Kariat
5e5a1a733f Updated imports 2023-02-16 01:37:50 +05:30
Prianka Liz Kariat
dce81342b6 Updated imports of MPPImageUtils 2023-02-16 01:35:27 +05:30
Prianka Liz Kariat
ae05c78443 Updated formatting 2023-02-16 01:33:33 +05:30
Prianka Liz Kariat
42e35503d9 Removed unwanted declarations in namespace 2023-02-16 01:31:51 +05:30
Prianka Liz Kariat
a503fb53e0 Updated MPPVisionTaskRunner 2023-02-16 01:31:29 +05:30
Prianka Liz Kariat
a0253274cc Added MPPVisionPacketCreator 2023-02-16 01:31:09 +05:30
Prianka Liz Kariat
8c3e3456a3 Added MPPImageClassifierOptions 2023-02-16 01:26:10 +05:30
Prianka Liz Kariat
825b30bccd Added MPPImageClassifierResult 2023-02-16 01:25:57 +05:30
Prianka Liz Kariat
a128810564 Updated MPPImageUtils with methods to create image frame 2023-02-16 01:25:16 +05:30
Sebastian Schmidt
d450a673c0 Open visibility of iOS TextClassifier & TextEmbedder 
PiperOrigin-RevId: 509645638
 2023-02-14 14:53:24 -08:00
MediaPipe Team
5f2261ff59 face landmarks detector graph 
PiperOrigin-RevId: 509630430
 2023-02-14 14:00:37 -08:00
Copybara-Service
d6fd2c52a7 Merge pull request #4093 from priankakariatyml:ios-ml-image-utils 
PiperOrigin-RevId: 509602397
 2023-02-14 12:17:41 -08:00
Sebastian Schmidt
c2260e8877 Use mediapipe_proto_library for gl_context_options_proto 
PiperOrigin-RevId: 509601125
 2023-02-14 12:13:01 -08:00
MediaPipe Team
c66b7e83f0 ssd anchors calculator add fixed anchors. 
PiperOrigin-RevId: 509574814
 2023-02-14 10:43:23 -08:00
Prianka Liz Kariat
55e5377c08 Updated formatting 2023-02-14 20:51:51 +05:30
Prianka Liz Kariat
3a7aa29226 Updated note about packets callback in vision task runner 2023-02-14 20:49:14 +05:30
Prianka Liz Kariat
4e1fa82d50 Added designated initializer in vision task runner 2023-02-14 20:40:21 +05:30
Prianka Liz Kariat
a490255c17 Updated formatting 2023-02-14 20:40:06 +05:30
Prianka Liz Kariat
17ff493a9d Updated formatting 2023-02-14 20:39:25 +05:30
Prianka Liz Kariat
b940a19462 Merge branch 'master' into ios-ml-image-utils 2023-02-14 20:34:55 +05:30
Copybara-Service
a578a702ec Merge pull request #4075 from priankakariatyml:ios-ml-image 
PiperOrigin-RevId: 509465929
 2023-02-14 02:19:35 -08:00
MediaPipe Team
513ab7abba Internal change 
PiperOrigin-RevId: 509338497
 2023-02-13 14:47:34 -08:00
Sebastian Schmidt
deae714a5c Enable Python Audio Classifier & Embedder on Windows 
PiperOrigin-RevId: 509243198
 2023-02-13 09:06:19 -08:00
Prianka Liz Kariat
1cd3c05fc5 Added default case to running mode check 2023-02-13 19:58:14 +05:30
Prianka Liz Kariat
328fe4ed39 Added vision task runner 2023-02-13 19:55:12 +05:30
Prianka Liz Kariat
1623b591b7 Added MPPRunningMode 2023-02-13 19:52:00 +05:30
Prianka Liz Kariat
e2f1d07c8b Updated target definition for MPPImage 2023-02-13 19:44:09 +05:30
Prianka Liz Kariat
02734b3add Added MPPImageUtils 2023-02-13 19:43:49 +05:30
Prianka Liz Kariat
acba3ab26d Bug fixes in MPPImage 2023-02-13 19:41:15 +05:30
MediaPipe Team
626f92caea Move BuildInputImageTensorSpecs to utils 
PiperOrigin-RevId: 508829724
 2023-02-10 21:57:13 -08:00
MediaPipe Team
2c82f67097 Add location info in registry (debug mode only) 
PiperOrigin-RevId: 508786558
 2023-02-10 16:58:44 -08:00
Hadon Nash
e719d2d423 Internal change 
PiperOrigin-RevId: 508766449
 2023-02-10 15:23:01 -08:00
Aden Grue
09ad961421 Internal change 
PiperOrigin-RevId: 508701833
 2023-02-10 10:54:55 -08:00
MediaPipe Team
39a943e91e Request ModelResourcesGraphService for all Task API web graphs. 
PiperOrigin-RevId: 508681004
 2023-02-10 09:36:03 -08:00
MediaPipe Team
915d2c7417 Internal text task change. 
PiperOrigin-RevId: 508568811
 2023-02-09 22:31:14 -08:00
MediaPipe Team
d61b7dbef8 Updated the Begin/EndLoopCalculator to be able to handle mediapipe::Tensor 
type.

PiperOrigin-RevId: 508552066
 2023-02-09 20:33:40 -08:00
MediaPipe Team
1eb54bdaa6 Internal change 
PiperOrigin-RevId: 508533812
 2023-02-09 18:49:01 -08:00
MediaPipe Team
1f848c4d69 Fix typo in CalculatorGraph error message 
PiperOrigin-RevId: 508517972
 2023-02-09 17:29:33 -08:00
MediaPipe Team
fd764dae0a Depends on TFLite shim header. 
PiperOrigin-RevId: 508491302
 2023-02-09 15:29:47 -08:00
MediaPipe Team
99fc975f49 Add download model on demand to text classifier 
PiperOrigin-RevId: 508441452
 2023-02-09 12:15:17 -08:00
MediaPipe Team
28f728bed5 Change gesture_recognizer to download model files on-demand from GCS. 
PiperOrigin-RevId: 508424508
 2023-02-09 11:13:06 -08:00
MediaPipe Team
c3907229fe Use case: add metadata to headerless graph input audio streams. 
PiperOrigin-RevId: 508389799
 2023-02-09 09:07:02 -08:00
MediaPipe Team
598d44a27d Internal change 
PiperOrigin-RevId: 508284935
 2023-02-08 23:31:41 -08:00
MediaPipe Team
6ea2d579e1 Internal change 
PiperOrigin-RevId: 508173086
 2023-02-08 13:51:14 -08:00
Rachel Hornung
4b28ced8fd #MediaSequence Prevent undefined index access in metadata reconciliation. 
Reconciliation required feature_lists.feature_list[0].value.feature[0].float_list.size_>=1, now we skip keys where size_=0.

PiperOrigin-RevId: 508095655
 2023-02-08 09:06:02 -08:00
Prianka Liz Kariat
0e944cb764 Merged ios-ml-image with master 2023-02-08 21:43:39 +05:30
Prianka Liz Kariat
e1ca81c352 Added objective c tests for MPPImage 2023-02-08 21:40:41 +05:30
Prianka Liz Kariat
a82ffcd97c Updated mppimage target 2023-02-08 21:40:23 +05:30
Prianka Liz Kariat
445876d96b Updated formatting 2023-02-08 21:35:15 +05:30
Copybara-Service
fd6dfcfcab Merge pull request #4066 from priankakariatyml:ios-ml-image 
PiperOrigin-RevId: 507844473
 2023-02-07 11:52:37 -08:00
Sebastian Schmidt
712a22101f Do not use designated initializer 
PiperOrigin-RevId: 507805920
 2023-02-07 09:37:46 -08:00
Prianka Liz Kariat
be829eb276 Updated name of MPPTaskImage 2023-02-07 19:17:00 +05:30
Jiuqiang Tang
01c6a8b49b Add volume_gain_db option into AudioToTensorCalculator. 
PiperOrigin-RevId: 507748012
 2023-02-07 05:14:42 -08:00
Copybara-Service
28c07430ba Merge pull request #4052 from priankakariatyml:ios-text-embedder 
PiperOrigin-RevId: 507602101
 2023-02-06 15:42:48 -08:00
Chris McClanahan
e2ef78433f Add more filtering methods to detection filter calculator. 
PiperOrigin-RevId: 507581281
 2023-02-06 14:19:40 -08:00
Jiuqiang Tang
f4b0cf1cff Internal change 
PiperOrigin-RevId: 507540898
 2023-02-06 11:48:51 -08:00
Sebastian Schmidt
daf0a76c87 Update TensorFlow to latest 
PiperOrigin-RevId: 507505016
 2023-02-06 09:44:19 -08:00
MediaPipe Team
5a77339780 Internal change 
PiperOrigin-RevId: 507495569
 2023-02-06 09:05:12 -08:00
Prianka Liz Kariat
a3889c946d Updated list of designated initializers 2023-02-06 16:40:36 +05:30
Prianka Liz Kariat
0e4f0fbf9b Updated file name for MPPTaskImage 2023-02-06 16:39:17 +05:30
Prianka Liz Kariat
4da91896af Updated swift name for ImageSource Type 2023-02-06 16:36:33 +05:30
Prianka Liz Kariat
a5ac5b9eec Updated type name of image source 2023-02-06 16:35:27 +05:30
Prianka Liz Kariat
cbccd472ab Added MPPTaskImage for iOS vision tasks 2023-02-06 16:29:53 +05:30
MediaPipe Team
4d8af4315f Rollback: Add PacketSharingOwnership, a safer replacement for PointToForeign. 
PiperOrigin-RevId: 507288476
 2023-02-05 08:59:09 -08:00
Jiuqiang Tang
8e097ea9c3 Internal changes 
PiperOrigin-RevId: 507016761
 2023-02-03 16:07:42 -08:00
Sebastian Schmidt
680cfcc99b Update MP Tasks to observe timestamp bounds 
PiperOrigin-RevId: 507006313
 2023-02-03 15:21:41 -08:00
MediaPipe Team
01834a5cdf Internal change 
PiperOrigin-RevId: 506982474
 2023-02-03 13:39:02 -08:00
Sebastian Schmidt
046efddf8b Add Empty Packet support to GraphRunner 
PiperOrigin-RevId: 506963970
 2023-02-03 12:17:00 -08:00
MediaPipe Team
632a3602dd Internal text tasks change. 
PiperOrigin-RevId: 506957718
 2023-02-03 11:52:09 -08:00
MediaPipe Team
386445c8dd Add ViewProvider<FrameBuffer> to YuvImage storage backend. 
PiperOrigin-RevId: 506881556
 2023-02-03 05:58:29 -08:00
Prianka Liz Kariat
eeaa011998 Updated documentation of iOS text embedder tests 2023-02-03 18:06:05 +05:30
Prianka Liz Kariat
e290f9cf30 Added a note about swift test coverage in iOS text embedder tests 2023-02-03 18:05:49 +05:30
Prianka Liz Kariat
3b55fb9f6a Added iOS test for quantized embedding 2023-02-03 13:42:32 +05:30
Prianka Liz Kariat
b5b10e7681 Added iOS test for different themes in text embedder 2023-02-03 13:10:13 +05:30
Prianka Liz Kariat
a512e6b5f5 Updated MPPTextEmbedder Documentation 2023-02-03 12:49:00 +05:30
Prianka Liz Kariat
6ca1efdd55 Updated MPPTextEmbedder Documentation 2023-02-03 12:48:06 +05:30
MediaPipe Team
e485961c2d fixes spelling mistake 
PiperOrigin-RevId: 506697863
 2023-02-02 12:49:30 -08:00
Prianka Liz Kariat
20002f191a Changed documentation 2023-02-02 18:38:19 +05:30
Prianka Liz Kariat
d625918995 Added swift tests for text embedder 2023-02-02 18:36:55 +05:30
Prianka Liz Kariat
474e994a5f Added text embedder objective c tests 2023-02-02 17:30:05 +05:30
Prianka Liz Kariat
867520af1c Added cosine similarity to MPPTextEmbedder 2023-02-02 17:29:51 +05:30
Prianka Liz Kariat
84e1c93ffb Added MPPCosineSimilarity 2023-02-02 17:22:56 +05:30
Sebastian Schmidt
286dde97ad Make TextEmbedder and TextClassifier tests pass on Windows 
PiperOrigin-RevId: 506421383
 2023-02-01 14:22:04 -08:00
Copybara-Service
bdd77b0d61 Merge pull request #4048 from priankakariatyml:ios-text-embedder 
PiperOrigin-RevId: 506407904
 2023-02-01 13:32:58 -08:00
Sebastian Schmidt
0f3cf9c56a Add "noasan" to MPPTextClassifierObjcTest 
PiperOrigin-RevId: 506366650
 2023-02-01 11:06:17 -08:00
Sebastian Schmidt
83e33b4dbe Internal change 
PiperOrigin-RevId: 506345436
 2023-02-01 09:55:19 -08:00
Juhyun Lee
0919a6c0a3 Log which InferenceCalculator impl is used at runtime. 
PiperOrigin-RevId: 506343086
 2023-02-01 09:45:36 -08:00
MediaPipe Team
3ee377f671 Internal change 
PiperOrigin-RevId: 506312863
 2023-02-01 07:42:20 -08:00
Prianka Liz Kariat
bd507b2d7b Updated MPPEmbeddingHelpers to reflect type change of quantized embeddings 2023-02-01 19:27:05 +05:30
Prianka Liz Kariat
cd1cb87ff6 Merge branch 'master' into ios-text-embedder 2023-02-01 19:11:01 +05:30
Prianka Liz Kariat
85c310d01c Updated formatting 2023-02-01 18:52:55 +05:30
Prianka Liz Kariat
d588f73a6d Added MPPTextEmbedder 2023-02-01 18:51:30 +05:30
Prianka Liz Kariat
38eac174e9 Added MPPTextEmbedderResultHelpers 2023-02-01 18:51:01 +05:30
Prianka Liz Kariat
42e712e911 Added MPPTextEmbedderOptionsHelpers 2023-02-01 18:50:14 +05:30
Prianka Liz Kariat
69809e2181 Updated formatting 2023-02-01 18:48:10 +05:30
Prianka Liz Kariat
ffc9f1d47e Added MPPEmbeddingResultHelpers 2023-02-01 18:47:23 +05:30
Prianka Liz Kariat
24bd104b0f Added MPPEmbedding Helpers 2023-02-01 18:46:11 +05:30
MediaPipe Team
d283e6a05a Support downloading model files on-demand from GCS in model_maker 
PiperOrigin-RevId: 506174708
 2023-01-31 18:43:35 -08:00
MediaPipe Team
b53acf6267 Internal change 
PiperOrigin-RevId: 506059384
 2023-01-31 11:20:13 -08:00
MediaPipe Team
5730dec260 Internal change 
PiperOrigin-RevId: 506053206
 2023-01-31 11:03:41 -08:00
Copybara-Service
0863a8a1e7 Merge pull request #4030 from priankakariatyml:ios-text-embedder 
PiperOrigin-RevId: 506048365
 2023-01-31 10:47:19 -08:00
MediaPipe Team
591eb204a6 Internal change 
PiperOrigin-RevId: 506027661
 2023-01-31 09:36:56 -08:00
Sebastian Schmidt
be3bddc620 Add Text Embedder tests for text with different themes 
PiperOrigin-RevId: 506023265
 2023-01-31 09:23:30 -08:00
MediaPipe Team
f9f6acffed Make NORM_RECT optional for GestureRecognizerGraph and add PALM_DETECTION output PORT 
PiperOrigin-RevId: 505712542
 2023-01-30 09:17:38 -08:00
Prianka Liz Kariat
8c21dc02a6 Updated to types of float and quantized embedding 2023-01-30 11:42:33 +05:30
MediaPipe Team
ee2f940e1f Make TensorToVectorFloatCalculator compatible with unaligned tensors. 
No performance impact is expected, since the unaligned Eigen::TensorMap is used only to populate a std::vector<float>.

PiperOrigin-RevId: 505251810
 2023-01-27 18:08:03 -08:00
MediaPipe Team
a6f6be9512 Fix incorrect uint8 -> int8 conversion in JS cosine similarity. 
PiperOrigin-RevId: 505135368
 2023-01-27 09:21:58 -08:00
MediaPipe Team
1df4511e9d Add YuvImage as a GpuBuffer storage backend. 
PiperOrigin-RevId: 505128789
 2023-01-27 08:51:31 -08:00
MediaPipe Team
e059d55d29 Correctly check refCount in finalize. 
PiperOrigin-RevId: 505057866
 2023-01-27 01:52:48 -08:00
Prianka Liz Kariat
8531803462 Updated documentation of embedding containers 2023-01-27 11:08:39 +05:30
Sebastian Schmidt
c29ab7f083 Internal change 
PiperOrigin-RevId: 504928797
 2023-01-26 13:36:45 -08:00
Sebastian Schmidt
4d38557f11 Add MediaPipe Image Segmenter task for Web 
PiperOrigin-RevId: 504912518
 2023-01-26 12:31:54 -08:00
MediaPipe Team
29001234d5 Replace SourceOrNodeOutput with Source. 
PiperOrigin-RevId: 504883990
 2023-01-26 10:46:12 -08:00
MediaPipe Team
2547f07c77 Add FrameBuffer format. 
PiperOrigin-RevId: 504838580
 2023-01-26 07:40:52 -08:00
Jiuqiang Tang
0566e0e7ca Fix the output stream tag of the end loop calculator in the example code. 
PiperOrigin-RevId: 504708273
 2023-01-25 17:52:55 -08:00
MediaPipe Team
be546d22fc Update test to reflect the recommended graph construction style: 
First, graph inputs and their names:
  - Makes it clear what inputs graph has
  - Indirectly demands for type specification e.g. Stream<AnyType> a = graph.In(0); vs Stream<int> a = graph.In(0).Cast<int>();
Then graph nodes
  - Nodes are added and used as they needed
  - One node is not mixed in other nodes, only its outputs
  - Indirectly demands for type specification e.g. Stream<AnyType> a = node.Out(0); vs Stream<int> a = node.Out(0).Cast<int>();
Then graph outputs
  - Makes it clear what outputs graph has

The recommended structure keep C++ graph similar to pbtxt representation.

PiperOrigin-RevId: 504701023
 2023-01-25 17:13:17 -08:00
Sebastian Schmidt
1538740dcb Formatting fix 
PiperOrigin-RevId: 504599712
 2023-01-25 10:33:09 -08:00
Prianka Liz Kariat
61f7739ff6 Updated documentation 2023-01-25 20:20:22 +05:30
Prianka Liz Kariat
d01f75a295 Added iOS text embedder result files 2023-01-25 20:19:57 +05:30
Prianka Liz Kariat
168ea0a9ea Added MPPTextEmbedderResult 2023-01-25 20:19:40 +05:30
Prianka Liz Kariat
60e72bf165 Added MPPTextEmbedderOptions 2023-01-25 20:19:27 +05:30
Prianka Liz Kariat
db5ee6689f Added MPPEmbeddingResult 2023-01-25 20:17:04 +05:30
Prianka Liz Kariat
7d62402768 Added MPPEmbedding 2023-01-25 20:16:54 +05:30
MediaPipe Team
afb0182935 Internal model maker change. 
PiperOrigin-RevId: 504472342
 2023-01-24 23:16:21 -08:00
Sebastian Schmidt
5dc81c4c27 Remove unused import on strings.h 
PiperOrigin-RevId: 504397437
 2023-01-24 15:56:15 -08:00
Yuqi Li
679dbb3fd8 nit: update the metadata_schema.fbs file path. 
PiperOrigin-RevId: 504380873
 2023-01-24 14:46:25 -08:00
Sebastian Schmidt
ce9fec806c Internal change 
PiperOrigin-RevId: 504341886
 2023-01-24 12:18:15 -08:00
Mike Kruskal
9cde57d830 Internal change 
PiperOrigin-RevId: 504341832
 2023-01-24 12:14:02 -08:00
Kinar R
2dc790dbd9
Merge branch 'google:master' into cosine-sim-python 2023-01-25 00:25:23 +05:30
MediaPipe Team
4e135ccdb9 Internal Model Maker change. 
PiperOrigin-RevId: 504315641
 2023-01-24 10:38:25 -08:00
MediaPipe Team
2465e47b01 Stream/SidePacket == and != operators 
PiperOrigin-RevId: 504114182
 2023-01-23 16:43:23 -08:00
MediaPipe Team
873d7181bf Add mediapipe tasks face detector graph 
PiperOrigin-RevId: 504078951
 2023-01-23 14:15:21 -08:00
Sebastian Schmidt
ccd1461add Don't error in ExternalFile handler on Windows if FileContent is provided 
PiperOrigin-RevId: 504069137
 2023-01-23 13:38:41 -08:00
MediaPipe Team
69d354fc89 Use c++ struct as hand landmark detection results. 
PiperOrigin-RevId: 504048095
 2023-01-23 12:12:09 -08:00
Nikolay Chirkov
1124569c29 Tensor: Make tensor not requiring "-x objective-c++" option. 
In this case tensor.h is compiled differently for C++ and Objective-C++ that violates ODR (once definition rule). Tensor has no virtual methods conditionally compiled but some Metal-related data members. Instead, unique_ptr to MtlResources that is declared as forward structure is unconditionally defined in the tensor class. MtlResources is defined differently in cc-file only that compiled just once per project so no ODR violation is here.

PiperOrigin-RevId: 504029286
 2023-01-23 11:00:35 -08:00
MediaPipe Team
921b6a6bef This CL will fix the typo from _PALM_LANMARKS to _PALM_LANDMARKS. 
PiperOrigin-RevId: 503352055
 2023-01-19 22:14:16 -08:00
Copybara-Service
4b9a52dc34 Merge pull request #3995 from priankakariatyml:ios-text-classifier-tests 
PiperOrigin-RevId: 503242486
 2023-01-19 12:59:49 -08:00
Sebastian Schmidt
db1a89324e Add mediapipe::Image output to the graph runner 
PiperOrigin-RevId: 503204918
 2023-01-19 10:41:13 -08:00
Sebastian Schmidt
a02097ea08 Fix comments 
PiperOrigin-RevId: 503195768
 2023-01-19 10:08:44 -08:00
Adam Cozzette
7a7cc77a81 Internal change 
PiperOrigin-RevId: 503157344
 2023-01-19 07:20:04 -08:00
MediaPipe Team
e2dedcbfe5 Add SQRT_HANN window type to both SpectrogramCalculator and InverseSpectrogramCalculator. 
PiperOrigin-RevId: 503041493
 2023-01-18 19:42:13 -08:00
Hadon Nash
97af47ebf5 Internal change 
PiperOrigin-RevId: 503035081
 2023-01-18 18:53:42 -08:00
Hadon Nash
66634bbef8 Internal change 
PiperOrigin-RevId: 503011674
 2023-01-18 16:38:11 -08:00
MediaPipe Team
e56fa8f258 Source/SideSource -> Stream/SidePacket 
PiperOrigin-RevId: 502923931
 2023-01-18 11:02:41 -08:00
Nikolay Chirkov
5687d19dec Tensor: remove unused and unimplemented SetPreferredStorageType methods. 
PiperOrigin-RevId: 502893019
 2023-01-18 09:09:20 -08:00
Jiuqiang Tang
29484702ce Add process_timestamp_bounds into RectToRenderScaleCalculatorOptions. 
PiperOrigin-RevId: 502877541
 2023-01-18 08:02:47 -08:00
MediaPipe Team
3688757d17 Fix load_metadata_buffer for empty metadata 
PiperOrigin-RevId: 502870428
 2023-01-18 07:28:42 -08:00
Sebastian Schmidt
e484bd681e Export all input and output types 
PiperOrigin-RevId: 502764544
 2023-01-17 20:57:16 -08:00
Sebastian Schmidt
d5e60eb658 Internal change 
PiperOrigin-RevId: 502764352
 2023-01-17 20:53:34 -08:00
Camillo Lugaresi
7894c92ab7 Internal change 
PiperOrigin-RevId: 502709070
 2023-01-17 15:51:07 -08:00
Sebastian Schmidt
088249eb36 Export all input and output types 
PiperOrigin-RevId: 502649430
 2023-01-17 11:59:33 -08:00
Jiuqiang Tang
7a4b450c50 Resolve the error "call to 'abs' is ambiguous". 
PiperOrigin-RevId: 502630518
 2023-01-17 10:53:14 -08:00
Jiuqiang Tang
7974171c3d Merge classificationResultList() and classificationResult() to be classificationResults(), and similar for embeddingResults(). 
PiperOrigin-RevId: 502601043
 2023-01-17 09:06:49 -08:00
Camillo Lugaresi
c1f5920ecf Add web performance tracing to the MEDIAPIPE_PROFILING repertoire 
This records the MEDIAPIPE_PROFILING tracing annotations to the browser's trace using the user timing API. See https://developer.mozilla.org/en-US/docs/Web/API/User_Timing_API

To enable, build with --define MEDIAPIPE_WEB_PROFILING=1 --define DRISHTI_PROFILING=1

PiperOrigin-RevId: 502422030
 2023-01-16 12:59:18 -08:00
MediaPipe Team
ffd8486d0d Add a stub WriteProfile method to GraphProfilerStub. 
PiperOrigin-RevId: 502388455
 2023-01-16 08:38:05 -08:00
Prianka Liz Kariat
67735a6fd3 Added category indices in iOS failure description 2023-01-16 14:01:10 +05:30
Prianka Liz Kariat
cf945d3aeb Removed unused variable 2023-01-16 13:59:51 +05:30
Prianka Liz Kariat
a0b3e620e4 Removed unused methods 2023-01-16 13:12:27 +05:30
Prianka Liz Kariat
f7fc8a6eca Updated method names in tests 2023-01-16 13:05:29 +05:30
Prianka Liz Kariat
8ecf77f760 Updated comment style in methods 2023-01-16 13:02:33 +05:30
Prianka Liz Kariat
30533be321 Reformatted comments 2023-01-16 13:00:10 +05:30
MediaPipe Team
92a2e02ace Internal change 
PiperOrigin-RevId: 501971410
 2023-01-13 17:05:19 -08:00
Sebastian Schmidt
aef4cca406 Copy README.md to NPM package root 
PiperOrigin-RevId: 501929871
 2023-01-13 13:48:02 -08:00
Sebastian Schmidt
f997c0ab1a Reject RegionOfInterest in not supported tasks 
PiperOrigin-RevId: 501872455
 2023-01-13 09:53:57 -08:00
MediaPipe Team
69757d7924 Internal change 
PiperOrigin-RevId: 501862194
 2023-01-13 09:05:48 -08:00
Prianka Liz Kariat
95f9f0fb88 Updated formatting 2023-01-13 21:18:10 +05:30
Prianka Liz Kariat
c4c07acc1e Updated comments of MPPCommonUtils 2023-01-13 21:18:01 +05:30
Prianka Liz Kariat
2a53d78ae4 Added swift and objective tests for iOS text classifier 2023-01-13 21:05:44 +05:30
Prianka Liz Kariat
9e0b85c9b5 Added module name for iOS text classifier 2023-01-13 21:05:17 +05:30
Prianka Liz Kariat
c40356c628 Added ios.bzl 2023-01-13 21:04:56 +05:30
Prianka Liz Kariat
0a707256e3 Updates to method signatures of iOS text classifier 2023-01-13 21:04:43 +05:30
Prianka Liz Kariat
fa30100059 Changed swift name of MPPCategory 2023-01-13 21:04:17 +05:30
Prianka Liz Kariat
5642980ab0 Updated iOS error implementation to mimic java 2023-01-13 21:04:03 +05:30
Copybara-Service
4e19a5a0dc Merge pull request #3988 from priankakariatyml:ios-text-classifier-impl 
PiperOrigin-RevId: 501739316
 2023-01-12 20:25:02 -08:00
Jiuqiang Tang
8156da3418 ClassificationAggregationCalculator should fill in the timestamp_ms field of the classification results in the stream mode. 
Per user feedback, the consistency between the packet timestamp and the timestamp field of the classification result helps reducing the confusion.

PiperOrigin-RevId: 501657922
 2023-01-12 13:54:55 -08:00
MediaPipe Team
1683d572ed Internal change 
PiperOrigin-RevId: 501600938
 2023-01-12 10:22:00 -08:00
MediaPipe Team
74b60780c7 Internal change 
PiperOrigin-RevId: 501594400
 2023-01-12 10:00:44 -08:00
Jiuqiang Tang
5c74ed2ae5 EmbeddingAggregationCalculator should fill in the timestamp_ms field of the embedding results in the stream mode. 
Per user feedback, the consistency between the packet timestamp and the timestamp field of the embedding result helps reducing the confusion.

PiperOrigin-RevId: 501572379
 2023-01-12 08:30:07 -08:00
MediaPipe Team
9cbb76939d Adds smaller MobileBERT model. 
PiperOrigin-RevId: 501451414
 2023-01-11 20:35:39 -08:00
Nikolay Chirkov
8830eefa0b Internal change. 
PiperOrigin-RevId: 501403332
 2023-01-11 16:07:22 -08:00
MediaPipe Team
36be94f861 Internal change 
PiperOrigin-RevId: 501378130
 2023-01-11 14:24:00 -08:00
MediaPipe Team
5612af68cd Propagate compatible_with for drishti_proto_library 
PiperOrigin-RevId: 501356895
 2023-01-11 13:01:57 -08:00
MediaPipe Team
0e56bd38f3 Fix for CHECK failure due to pointer description sometimes being larger than allocated string space 
PiperOrigin-RevId: 501355568
 2023-01-11 12:58:37 -08:00
Prianka Liz Kariat
c7e36f8720 Re-ordered dependencies in build file 2023-01-11 20:31:46 +05:30
Prianka Liz Kariat
fe05a8d201 Reformatted code 2023-01-11 20:24:17 +05:30
Prianka Liz Kariat
b1ded2f700 Added iOS text classifier 2023-01-11 20:22:33 +05:30
Prianka Liz Kariat
a0220de233 Added iOS text classifier result helpers 2023-01-11 20:22:20 +05:30
Prianka Liz Kariat
54161cc1ab Added iOS text classifier options helpers 2023-01-11 20:22:02 +05:30
Prianka Liz Kariat
1161ebce9d Added iOS text classifier result 2023-01-11 16:22:09 +05:30
Prianka Liz Kariat
ed6abbbe43 Added iOS text classifier options 2023-01-11 16:21:28 +05:30
Nikolay Chirkov
54268594dd Internal change. 
PiperOrigin-RevId: 501136760
 2023-01-10 17:38:13 -08:00
Copybara-Service
e869e57cb4 Merge pull request #3975 from priankakariatyml:ios-base-options-helpers 
PiperOrigin-RevId: 501073613
 2023-01-10 13:07:47 -08:00
Jiuqiang Tang
25abd122b3 Support AudioRecord in MediaPipe audio tasks in Java. 
PiperOrigin-RevId: 501019327
 2023-01-10 09:45:40 -08:00
Copybara-Service
b747fc481b Merge pull request #3973 from priankakariatyml:ios-task-classifier-result 
PiperOrigin-RevId: 501005242
 2023-01-10 08:47:45 -08:00
Jiuqiang Tang
6032604f94 Hide base task api classes for MediaPipe Tasks Python from API docs 
PiperOrigin-RevId: 501004802
 2023-01-10 08:43:51 -08:00
Sebastian Schmidt
d7ee875356 Fix spacing issue in test name 
PiperOrigin-RevId: 500833769
 2023-01-09 16:20:08 -08:00
Liam Miller-Cushon
76a7c9d5d4 Internal change 
PiperOrigin-RevId: 500813290
 2023-01-09 14:49:45 -08:00
MediaPipe Team
704964be33 Fix accidental suppressions of GLSL linker error reporting 
PiperOrigin-RevId: 500802177
 2023-01-09 14:05:47 -08:00
Sebastian Schmidt
0831023114 Use uppercase enum constants for RunningMode 
PiperOrigin-RevId: 500760402
 2023-01-09 11:11:21 -08:00
MediaPipe Team
d40fa6b16d Internal Model Maker change. 
PiperOrigin-RevId: 500758488
 2023-01-09 11:04:45 -08:00
Sebastian Schmidt
73f4636292 Create README.md files to NPM packages 
PiperOrigin-RevId: 500750516
 2023-01-09 10:36:49 -08:00
MediaPipe Team
c6cf598774 Minor fix for max_queue_size documentation 
PiperOrigin-RevId: 500738798
 2023-01-09 09:54:09 -08:00
Sebastian Schmidt
2b9299959c Internal change 
PiperOrigin-RevId: 500730237
 2023-01-09 09:22:02 -08:00
Sebastian Schmidt
1bbe065647 Simplify default options for GestureRecognize 
PiperOrigin-RevId: 500729643
 2023-01-09 09:18:08 -08:00
Nikolay Chirkov
e0a254789a Internal change. 
PiperOrigin-RevId: 500331015
 2023-01-06 22:15:18 -08:00
Sebastian Schmidt
7f043b7de1 Allow split_vector_calculator to be build with iOS and MEDIAPIPE_DISABLE_GPU 
PiperOrigin-RevId: 500327774
 2023-01-06 21:45:15 -08:00
Sebastian Schmidt
c9ebc6fa60 Use synthetic timestamps in Web when none provided 
PiperOrigin-RevId: 500327275
 2023-01-06 21:41:30 -08:00
Sebastian Schmidt
ed0054836a Allow task to recover after a failed graph start 
PiperOrigin-RevId: 500324587
 2023-01-06 21:06:47 -08:00
Sebastian Schmidt
b4ede6db7b Fix typo in Category.java 
PiperOrigin-RevId: 500324008
 2023-01-06 21:02:16 -08:00
Sebastian Schmidt
9055effddd Add ImageProcessingOptions to all Vision Tasks 
PiperOrigin-RevId: 500323261
 2023-01-06 20:57:39 -08:00
Copybara-Service
e11ba95adf Merge pull request #3974 from priankakariatyml:ios-task-updates 
PiperOrigin-RevId: 500323180
 2023-01-06 20:53:33 -08:00
Sebastian Schmidt
9b34a105cf Do not depend on Image methods in TaskRunner 
PiperOrigin-RevId: 500299571
 2023-01-06 18:20:36 -08:00
MediaPipe Team
2cce88080e Internal change 
PiperOrigin-RevId: 500271109
 2023-01-06 15:29:19 -08:00
Prianka Liz Kariat
14e3de49ad Added MPPTextTaskRunner 2023-01-06 16:37:31 +05:30
Prianka Liz Kariat
b91b485035 Added MPPBaseOptions Helpers 2023-01-06 16:36:28 +05:30
Prianka Liz Kariat
b6bcc35ade Added provision for packets callback in iOS task runner 2023-01-06 16:36:15 +05:30
Prianka Liz Kariat
c6bae99a2f Updated formatting in MPPTextPacketCreator.mm 2023-01-06 16:25:56 +05:30
Prianka Liz Kariat
bc1b069edf Updated property name in MPPTaskResult 2023-01-06 16:24:41 +05:30
Prianka Liz Kariat
16f9831c3f Updated formatting in MPPTaskOptions.m 2023-01-06 16:23:37 +05:30
Prianka Liz Kariat
61d16b284b Updated comments in MPPTaskOptions.h 2023-01-06 16:23:22 +05:30
Prianka Liz Kariat
27ce2ec00f Updated C++ types to camel case in MPPTaskInfo 2023-01-06 16:22:11 +05:30
Prianka Liz Kariat
f37689fc33 Updated documentation for MPPCommonUtils.m 2023-01-06 16:15:53 +05:30
Prianka Liz Kariat
4e38c7e623 Updated documentation for MPPCommon.h 2023-01-06 16:15:32 +05:30
Prianka Liz Kariat
8f74a175d8 Removed MPPClassifierOptions and helpers 2023-01-06 16:08:06 +05:30
Prianka Liz Kariat
89aad67a87 Added iOS helpers for classification result containers 2023-01-06 16:07:50 +05:30
Prianka Liz Kariat
33df6c042f Added iOS result containers for classification tasks 2023-01-06 16:07:11 +05:30
Sebastian Schmidt
667fd81ddc Internal change 
PiperOrigin-RevId: 499956657
 2023-01-05 11:43:43 -08:00
Sebastian Schmidt
81a46bb31a Internal change 
PiperOrigin-RevId: 499902323
 2023-01-05 09:14:07 -08:00
Nikolay Chirkov
35293d88bc Tensor: move into tensor sub-directory. 
PiperOrigin-RevId: 499896489
 2023-01-05 08:56:37 -08:00
MediaPipe Team
463cbb60ee Fix RGBA vs RGB selection when creating GLTexture. 
PiperOrigin-RevId: 499877590
 2023-01-05 07:58:07 -08:00
MediaPipe Team
43bf02443c Option to remove overlapping values computed for different timestamps. 
PiperOrigin-RevId: 499635143
 2023-01-04 17:35:25 -08:00
MediaPipe Team
24cc0672c4 Internal change 
PiperOrigin-RevId: 499529022
 2023-01-04 10:59:35 -08:00
MediaPipe Team
e3131d7d78 Internal change 
PiperOrigin-RevId: 499521620
 2023-01-04 10:33:04 -08:00
Nikolay Chirkov
9a70af1464 Internal change. 
PiperOrigin-RevId: 499496793
 2023-01-04 08:54:29 -08:00
Nikolay Chirkov
a4ea606eac Internal change. 
PiperOrigin-RevId: 499490514
 2023-01-04 08:23:56 -08:00
MediaPipe Team
add5600d0d Internal change 
PiperOrigin-RevId: 499351795
 2023-01-03 17:20:46 -08:00
MediaPipe Team
e7dc989f71 Internal Change 
PiperOrigin-RevId: 499313491
 2023-01-03 14:14:21 -08:00
Copybara-Service
a7bb0aba8f Merge pull request #3937 from priankakariatyml:ios-task-files 
PiperOrigin-RevId: 499296662
 2023-01-03 13:04:55 -08:00
Sebastian Schmidt
75b87e0e32 Internal change 
PiperOrigin-RevId: 499283559
 2023-01-03 12:12:24 -08:00
Sebastian Schmidt
68f247a5c7 Internal change 
PiperOrigin-RevId: 499282085
 2023-01-03 12:05:43 -08:00
Sebastian Schmidt
987f4dc1ed Make addJsamineCustomFloatEqualityTest configurable 
PiperOrigin-RevId: 499263931
 2023-01-03 10:55:58 -08:00
MediaPipe Team
f53c0eacee Extend tag conversion behavior to also convert : (in addition to the 
current `/`, `-`, and `.`) to `_`.

PiperOrigin-RevId: 499243005
 2023-01-03 09:41:45 -08:00
Camillo Lugaresi
2f4bb5d545 Use utility framebuffer in ViewDoneWritingSimulatorWorkaround 
This code needs a FBO to bind the texture.

Fixes invalid results when running under simulator.

PiperOrigin-RevId: 499241867
 2023-01-03 09:38:19 -08:00
Sebastian Schmidt
9252a025e5 Use custom gesture options in GestureRecognizer 
PiperOrigin-RevId: 498567432
 2022-12-30 05:01:02 -08:00
MediaPipe Team
60c6b155f6 Save an integer id in graph profiler objects to distinguish between different profiler instances during benchmarking. 
PiperOrigin-RevId: 498409363
 2022-12-29 10:18:10 -08:00
MediaPipe Team
aaa16eca1f Sets the graph service packets before initializing (and validating the graph) in the objc graph wrapper. 
PiperOrigin-RevId: 498393761
 2022-12-29 08:36:03 -08:00
Nikolay Chirkov
2d9a969d10 Tensor1: memorize size_alignment when tracking the ahwb usage. 
When CPU/GPU buffer allocated and the tracker selects Ahwb storage to be used then the properly recorded alignment must be used.

PiperOrigin-RevId: 498264759
 2022-12-28 16:09:02 -08:00
Nikolay Chirkov
1924f1cdff Tensor: Fix use_ahwb_ flag and tests on local device involved. 
PiperOrigin-RevId: 498249332
 2022-12-28 14:29:43 -08:00
Sebastian Schmidt
9580f04571 Apply most graph options synchronously 
PiperOrigin-RevId: 498244085
 2022-12-28 13:58:46 -08:00
MediaPipe Team
7e36a5e2ae Set filecmp.cmp(shallow=False) in model_maker unit tests. 
PiperOrigin-RevId: 498218578
 2022-12-28 11:25:28 -08:00
MediaPipe Team
5a5ff5393a Internal change 
PiperOrigin-RevId: 497269082
 2022-12-27 10:50:41 -08:00
Hadon Nash
557cd050f3 Deprecating RealTimeFlowLimiterCalculator in favor of FlowLimiterCalculator. 
PiperOrigin-RevId: 497260577
 2022-12-22 16:29:14 -08:00
MediaPipe Team
5a71b551e5 Remove duplicate and non-public api for model_maker 
PiperOrigin-RevId: 497251246
 2022-12-22 15:31:12 -08:00
MediaPipe Team
36f054dfbe Internal model maker change 
PiperOrigin-RevId: 497196512
 2022-12-22 10:43:15 -08:00
MediaPipe Team
5b90afda70 Internal change 
PiperOrigin-RevId: 497191969
 2022-12-22 10:23:34 -08:00
MediaPipe Team
9673841605 Internal visibility update 
PiperOrigin-RevId: 497185157
 2022-12-22 09:51:52 -08:00
Prianka Liz Kariat
48eeae4d9d Formatted code 2022-12-22 12:16:43 +05:30
Prianka Liz Kariat
613ed58890 Inverted condition check in MPPTaskInfo 2022-12-22 12:16:33 +05:30
Prianka Liz Kariat
e47256ae55 Clearing proto before assigining new values in MPPClassifierOptions Helpers 2022-12-22 12:10:23 +05:30
MediaPipe Team
69b6d9d970 Internal change 
PiperOrigin-RevId: 497043596
 2022-12-21 17:44:36 -08:00
Prianka Liz Kariat
e559613b9d Updated comments in MPPClassifierOptions.h 2022-12-22 02:02:48 +05:30
Prianka Liz Kariat
b4a7644428 Updated comments 2022-12-22 02:01:04 +05:30
Prianka Liz Kariat
20c3388ab6 Updated category allowlist and denylist names 2022-12-22 01:59:38 +05:30
Prianka Liz Kariat
c185dc9ad7 Renamed label to category in classifier options 2022-12-22 01:19:01 +05:30
Prianka Liz Kariat
e1dfcf03cf Updated comments in MPPClassifierOptions.h 2022-12-22 01:12:34 +05:30
Prianka Liz Kariat
66ee8d47c0 Resorted options 2022-12-22 01:10:07 +05:30
Prianka Liz Kariat
673b38dfe8 Updated comments 2022-12-22 01:08:13 +05:30
Prianka Liz Kariat
54d36dfeda Update MPPClassifierOptions.h 2022-12-22 01:05:50 +05:30
Prianka Liz Kariat
7ae4b7e639 Updated error domain 2022-12-22 01:05:01 +05:30
Prianka Liz Kariat
99c11ff974 Updated comments 2022-12-22 01:03:39 +05:30
Prianka Liz Kariat
1de3694175 Updated comments 2022-12-22 01:02:07 +05:30
Prianka Liz Kariat
1491b3f5a2 Updated comments 2022-12-22 01:00:36 +05:30
Prianka Liz Kariat
20f2e136c5 Updated empty spaces 2022-12-22 00:59:22 +05:30
Prianka Liz Kariat
2943d1668e Updated comments 2022-12-22 00:51:20 +05:30
Prianka Liz Kariat
481f4e960e Updated comments 2022-12-22 00:49:44 +05:30
Prianka Liz Kariat
ae28948ca1 Marked designated initializers 2022-12-22 00:49:24 +05:30
Jiuqiang Tang
714a6e555b Enable creating mediapipe image c++ packet directly from an Android media image object when its format is RGBA_8888. 
PiperOrigin-RevId: 496923491
 2022-12-21 08:07:53 -08:00
MediaPipe Team
1341720d6d Internal change 
PiperOrigin-RevId: 496854337
 2022-12-21 00:55:32 -08:00
MediaPipe Team
5c0f548f5f Switches to tf.keras.optimizers.experimental.AdamW instead of the legacy AdamW. 
PiperOrigin-RevId: 496821354
 2022-12-20 20:53:13 -08:00
Jiuqiang Tang
151e447614 Internal changes 
PiperOrigin-RevId: 496793199
 2022-12-20 17:52:17 -08:00
MediaPipe Team
64406a9bf2 Internal change 
PiperOrigin-RevId: 496781536
 2022-12-20 16:41:49 -08:00
Sebastian Schmidt
d2f738793c Use uppercase options name for "delegate" 
PiperOrigin-RevId: 496764089
 2022-12-20 15:18:17 -08:00
MediaPipe Team
a7b52d2c52 Internal changes 
PiperOrigin-RevId: 496754449
 2022-12-20 14:37:18 -08:00
Prianka Liz Kariat
ff901a80a5 Added targets in core 2022-12-21 01:24:11 +05:30
Prianka Liz Kariat
4fedea60a9 Added text packet creator 2022-12-21 01:24:02 +05:30
Prianka Liz Kariat
e9fc3713f0 Added iOS task runner 2022-12-21 01:23:51 +05:30
Prianka Liz Kariat
64cf5e9b4e Added iOS task options protocol 2022-12-21 01:23:41 +05:30
Prianka Liz Kariat
6d02108bf5 Added task info 2022-12-21 01:23:29 +05:30
Prianka Liz Kariat
c56ef735d7 Added classifier options helpers 2022-12-21 01:22:57 +05:30
Prianka Liz Kariat
03bfbca539 Added classifier options 2022-12-21 01:22:44 +05:30
Prianka Liz Kariat
e997a19289 Added common utils and string helpers 2022-12-21 01:22:32 +05:30
MediaPipe Team
e405c2b67d Internal change 
PiperOrigin-RevId: 496702117
 2022-12-20 11:04:42 -08:00
MediaPipe Team
8c013647c8 Internal change 
PiperOrigin-RevId: 496629682
 2022-12-20 04:49:15 -08:00
MediaPipe Team
4682416f0f Internal change 
PiperOrigin-RevId: 496568835
 2022-12-19 22:10:15 -08:00
Jiuqiang Tang
9067804005 Fix the missing logging component issue of mediapipe tasks core. 
PiperOrigin-RevId: 496548340
 2022-12-19 19:41:11 -08:00
MediaPipe Team
994eb28d2c Chain SetName calls where possible 
PiperOrigin-RevId: 496534328
 2022-12-19 18:07:38 -08:00
MediaPipe Team
f5f2fee0b9 Switch to Cast where possible and reduce usage of operator[](port). 
PiperOrigin-RevId: 496527250
 2022-12-19 17:22:36 -08:00
MediaPipe Team
6842f2c7c6 Use the proper namespace for builder test 
PiperOrigin-RevId: 496526588
 2022-12-19 17:14:14 -08:00
MediaPipe Team
ea0bebc226 Add BGR -> RGB color conversion to ColorConvertCalculator. 
PiperOrigin-RevId: 496497002
 2022-12-19 14:51:05 -08:00
Nikolay Chirkov
ef3fa67bf4 Automatic selection of the tensor's storage type by recording previously requested views. 
PiperOrigin-RevId: 496466136
 2022-12-19 12:37:50 -08:00
MediaPipe Team
3e6cd5d2bf Add support for customizing gesture recognizer layers 
PiperOrigin-RevId: 496456160
 2022-12-19 11:57:09 -08:00
Sebastian Schmidt
4822476974 Internal change 
PiperOrigin-RevId: 496443946
 2022-12-19 11:07:09 -08:00
Jiuqiang Tang
7ce4bb72d4 Replace numpy.float with the builtin float type as numpy removes its own float type in v1.24. 
PiperOrigin-RevId: 496412858
 2022-12-19 09:02:51 -08:00
MediaPipe Team
b45554623a Fix typo in GetVectorItemCalculator doc 
PiperOrigin-RevId: 495951016
 2022-12-16 13:42:50 -08:00
Copybara-Service
a864f4e9b3 Merge pull request #3927 from priankakariatyml:ios-options 
PiperOrigin-RevId: 495898311
 2022-12-16 09:59:10 -08:00
Nikolay Chirkov
d5562241cc Tensor: Interoperability GPU/Cpu -> Ahwb by transforming the underlying storage into Ahwb with releasing previously Cpu/Gpu resources. 
PiperOrigin-RevId: 495748104
 2022-12-15 18:34:27 -08:00
MediaPipe Team
0a1f050f1f Internal change 
PiperOrigin-RevId: 495741383
 2022-12-15 17:52:43 -08:00
Jiuqiang Tang
6bf5648430 Fix the documentation of the constructor of Image and ImageFrame Python classes. 
PiperOrigin-RevId: 495739875
 2022-12-15 17:42:23 -08:00
Mark McDonald
8d2473c751 Update Image docs to improve rendering. 
The [API docs](https://developers.google.com/mediapipe/api/solutions/python/mp/Image) have a few rendering issues. e.g., the doc generator will turn
```
This block:
  Anything here
```
Into a table with heading `This block` and `Anything here` as a plain-text cell.

In order to render code as code, it needs to be in backticks. They can also be in `>>> code()` format, and we can try to run them ([doctests](https://docs.python.org/3/library/doctest.html)).

I'll have a dashboard ready soon that shows areas we can improve.

PiperOrigin-RevId: 495715576
 2022-12-15 15:43:36 -08:00
Jiuqiang Tang
fd50b6aa2f Add a new python unit test to test creating mediapipe Image from cvmat. 
PiperOrigin-RevId: 495655719
 2022-12-15 11:54:51 -08:00
Jiuqiang Tang
299aa03302 Internal change 
PiperOrigin-RevId: 495613573
 2022-12-15 09:24:31 -08:00
Prianka Liz Kariat
5ab17fe686 Removed convenience initializer 2022-12-15 10:28:50 +05:30
Prianka Liz Kariat
163b13d7de Updated comments 2022-12-15 10:23:27 +05:30
Prianka Liz Kariat
9ab0107584 Added new line 2022-12-15 10:21:22 +05:30
Prianka Liz Kariat
fe7fbc0b38 Fixed comment 2022-12-15 10:21:14 +05:30
Prianka Liz Kariat
bf91c52407 Fixed typos 2022-12-15 10:21:07 +05:30
Nikolay Chirkov
d526b20e19 Internal change. 
PiperOrigin-RevId: 495483878
 2022-12-14 19:54:33 -08:00
MediaPipe Team
e9e173f9fa Internal change 
PiperOrigin-RevId: 495468694
 2022-12-14 18:14:55 -08:00
Jiuqiang Tang
174f2869a3 Internal changes 
PiperOrigin-RevId: 495322170
 2022-12-14 08:33:45 -08:00
Prianka Liz Kariat
c0fed7df31 Added target for task result 2022-12-14 19:15:01 +05:30
Prianka Liz Kariat
0aedff0659 Added target for task options 2022-12-14 19:14:49 +05:30
Prianka Liz Kariat
22bb87d9e0 Added iOS task result 2022-12-14 19:14:11 +05:30
Prianka Liz Kariat
e9fb6c28f5 Added task options 2022-12-14 19:14:02 +05:30
Prianka Liz Kariat
7efb3bcf81 Added iOS task error codes 2022-12-14 19:13:41 +05:30
Camillo Lugaresi
db6ea38cf6 Internal change 
PiperOrigin-RevId: 495236576
 2022-12-14 00:40:01 -08:00
Camillo Lugaresi
6fa0a58529 Internal change 
PiperOrigin-RevId: 495235951
 2022-12-14 00:36:16 -08:00
Hadon Nash
b9d020cb7d Internal change 
PiperOrigin-RevId: 495163109
 2022-12-13 17:00:08 -08:00
MediaPipe Team
904a537b02 Internal change 
PiperOrigin-RevId: 495151410
 2022-12-13 16:11:10 -08:00
MediaPipe Team
d5ff060bfa Internal change 
PiperOrigin-RevId: 495149484
 2022-12-13 16:04:00 -08:00
Copybara-Service
ea0bd77dbf Merge pull request #3911 from priankakariatyml:ios-base-options 
PiperOrigin-RevId: 495119958
 2022-12-13 14:02:07 -08:00
Hadon Nash
db404b1a85 Internal change 
PiperOrigin-RevId: 495058817
 2022-12-13 10:23:51 -08:00
Jiuqiang Tang
78597c5b37 Internal changes. 
PiperOrigin-RevId: 495038477
 2022-12-13 09:08:15 -08:00
Sebastian Schmidt
fb21797611 Internal change 
PiperOrigin-RevId: 494914168
 2022-12-12 21:30:31 -08:00
Hadon Nash
421f789ede Internal change 
PiperOrigin-RevId: 494420725
 2022-12-10 12:33:53 -08:00
Sebastian Schmidt
e9bb51a524 Internal change 
PiperOrigin-RevId: 494314595
 2022-12-09 19:22:06 -08:00
Sebastian Schmidt
69c3c4c181 Internal change 
PiperOrigin-RevId: 494305195
 2022-12-09 18:10:45 -08:00
Jiuqiang Tang
453d67de92 Add MergeDetectionsToVectorCalculator. 
PiperOrigin-RevId: 494246359
 2022-12-09 13:12:57 -08:00
Nikolay Chirkov
db3cb68d91 Internal change. 
PiperOrigin-RevId: 494166776
 2022-12-09 07:29:01 -08:00
MediaPipe Team
5bc1baf96a Internal change 
PiperOrigin-RevId: 494150467
 2022-12-09 05:57:12 -08:00
MediaPipe Team
4c4df2cf18 Internal change for profiling 
PiperOrigin-RevId: 494135244
 2022-12-09 04:13:02 -08:00
MediaPipe Team
3aeec84ac0 Internal change for profiling 
PiperOrigin-RevId: 494126771
 2022-12-09 03:21:10 -08:00
Nikolay Chirkov
bea0caae65 Tensor: Cpu -> Ahwb storage transfer 
PiperOrigin-RevId: 494033280
 2022-12-08 17:06:56 -08:00
Sebastian Schmidt
05535db5f7 Fix assertion failure in Hair Segmentation demo 
PiperOrigin-RevId: 494004801
 2022-12-08 15:03:39 -08:00
MediaPipe Team
b4e1969e43 Add pip package builder for model_maker 
PiperOrigin-RevId: 493989013
 2022-12-08 14:03:15 -08:00
Nikolay Chirkov
0fbaa8dc8a Internal change. 
PiperOrigin-RevId: 493973435
 2022-12-08 13:01:52 -08:00
MediaPipe Team
a641ea12e1 Update gesture recognizer to new mediapipe tasks pipeline 
PiperOrigin-RevId: 493950564
 2022-12-08 11:32:42 -08:00
Jiuqiang Tang
13f8fa5139 Retire the visibility group "//mediapipe/framework:mediapipe_internal" in the "mediapipe/calculators/tensor" dir. 
PiperOrigin-RevId: 493895834
 2022-12-08 08:03:47 -08:00
Prianka Liz Kariat
66dbd9969a Updated license text 2022-12-08 10:25:01 +05:30
Prianka Liz Kariat
d1820320b1 Added base options 2022-12-08 10:23:53 +05:30
Sebastian Schmidt
9ae2e43b70 Open Source the remaining MediaPipe Tasks tests for Web 
PiperOrigin-RevId: 493769657
 2022-12-07 19:19:27 -08:00
Adam Cozzette
24c8fa97e9 Internal change 
PiperOrigin-RevId: 493768013
 2022-12-07 19:06:00 -08:00
MediaPipe Team
700c7b4b22 Internal refactoring for TextEmbedder. 
PiperOrigin-RevId: 493766612
 2022-12-07 18:56:27 -08:00
MediaPipe Team
a0efcb47f2 internal change 
PiperOrigin-RevId: 493742399
 2022-12-07 16:38:42 -08:00
MediaPipe Team
a59f0a9924 Make java/C++/python tasks API public visible. 
PiperOrigin-RevId: 493730506
 2022-12-07 15:51:04 -08:00
MediaPipe Team
91664eb254 Object Detector deduplication 
PiperOrigin-RevId: 493716159
 2022-12-07 14:54:30 -08:00
Jiuqiang Tang
ef1507ed5d Retire the visibility group "//mediapipe/framework:mediapipe_internal". 
PiperOrigin-RevId: 493713823
 2022-12-07 14:45:49 -08:00
Nikolay Chirkov
7faee517c4 Tensor: Move general CPU/SSBO tensor storage into Ahwb-backed CPU/SSBO storage. 
PiperOrigin-RevId: 493710495
 2022-12-07 14:32:42 -08:00
Nikolay Chirkov
ea74db86dd Tensor: clang tidy fixes. 
PiperOrigin-RevId: 493703073
 2022-12-07 14:06:29 -08:00
Jiuqiang Tang
955f090f9f Retire the visibility group "//mediapipe/framework:mediapipe_internal". 
PiperOrigin-RevId: 493687025
 2022-12-07 13:08:33 -08:00
Sebastian Schmidt
2811e0c5c8 Open Source the first set of MediaPipe Tasks tests for Web 
PiperOrigin-RevId: 493673279
 2022-12-07 12:15:34 -08:00
Jiuqiang Tang
3c0ddf16b4 Fix an incorrect model sanity check in the object detector graph. 
PiperOrigin-RevId: 493663592
 2022-12-07 11:38:54 -08:00
Jiuqiang Tang
80c605459c Open up framework visibility. 
PiperOrigin-RevId: 493660013
 2022-12-07 11:26:16 -08:00
Sebastian Schmidt
d84eec387b Add missing import to InferenceCalculator.proto 
PiperOrigin-RevId: 493649869
 2022-12-07 10:52:17 -08:00
Khanh LeViet
d9688b769f Hide internal APIs from mediapipe pip package's API docs. 
PiperOrigin-RevId: 493607984
 2022-12-07 08:15:25 -08:00
Nikolay Chirkov
aad797197b TensorV1 EGL.h include fix. 
PiperOrigin-RevId: 493596083
 2022-12-07 07:16:59 -08:00
Camillo Lugaresi
523d16dffa Make GpuBuffer a shared_ptr to a storage collection 
PiperOrigin-RevId: 493519590
 2022-12-06 23:56:19 -08:00
Sebastian Schmidt
1167f61f98 Remove generic Options template argument from TaskRunner 
PiperOrigin-RevId: 493462947
 2022-12-06 18:04:31 -08:00
MediaPipe Team
576c6da173 Internal change 
PiperOrigin-RevId: 493427500
 2022-12-06 15:24:32 -08:00
Sebastian Schmidt
fca0f5806b Create Build Rules for Apple Frameworks 
PiperOrigin-RevId: 493426040
 2022-12-06 15:18:45 -08:00
Sebastian Schmidt
0f32072804 Move ISSUE_TEMPLATAE files to .github folder 
PiperOrigin-RevId: 493405734
 2022-12-06 14:03:26 -08:00
Khanh LeViet
cdc14522e2 Added issue templates for MP Preview. 
PiperOrigin-RevId: 493389856
 2022-12-06 13:03:10 -08:00
Jiuqiang Tang
6deef1a5f1 Allow specifying tag_suffix in the templated CreateModelResources method. 
PiperOrigin-RevId: 493375701
 2022-12-06 12:10:06 -08:00
Jiuqiang Tang
c6e6f9e0b9 Fix aar breakage caused by missing "//mediapipe/tasks/cc/vision/image_segmenter/proto:segmenter_options_java_proto_lite". 
PiperOrigin-RevId: 493357585
 2022-12-06 11:08:01 -08:00
Sebastian Schmidt
ab0b0ab558 Change visibility for MP Tasks Web to public 
PiperOrigin-RevId: 493343996
 2022-12-06 10:26:16 -08:00
Jiuqiang Tang
fb0b96115f Open up mediapipe core calculators' visibility. 
PiperOrigin-RevId: 493314353
 2022-12-06 08:40:57 -08:00
Camillo Lugaresi
b0b38a0013 Internal change 
PiperOrigin-RevId: 493313240
 2022-12-06 08:31:46 -08:00
Jiuqiang Tang
1761cdcef4 Fix aar breakage caused by missing "//mediapipe/tasks/java/com/google/mediapipe/tasks/components/containers:normalized_landmark". 
PiperOrigin-RevId: 493204770
 2022-12-05 22:16:46 -08:00
MediaPipe Team
af43687f2e Open-sources a unit test. 
PiperOrigin-RevId: 493184055
 2022-12-05 20:11:07 -08:00
MediaPipe Team
3174b20fbe Move segmentation calculator and options out of 'components' folder. 
PiperOrigin-RevId: 493157929
 2022-12-05 17:37:49 -08:00
Jiuqiang Tang
1e76d47a71 Checks if a custom global resource provider is used as the first step of loading the model resources on all platforms. 
PiperOrigin-RevId: 493141519
 2022-12-05 16:20:20 -08:00
MediaPipe Team
3ad03bee0b Adds missing visibility rule. 
PiperOrigin-RevId: 493118880
 2022-12-05 14:50:35 -08:00
MediaPipe Team
69b27b246a Adds a public function for creating TaskRunner instances. 
PiperOrigin-RevId: 493109736
 2022-12-05 14:18:17 -08:00
Adam Cozzette
4f8eaee20f Internal change 
PiperOrigin-RevId: 493065632
 2022-12-05 11:35:33 -08:00
MediaPipe Team
35bb18945f Better handling of empty packets in vector calculators. 
PiperOrigin-RevId: 493000695
 2022-12-05 07:25:14 -08:00
Sebastian Schmidt
e457039fc6 Don't inherit from GraphRunner 
PiperOrigin-RevId: 492584486
 2022-12-02 16:20:19 -08:00
Sebastian Schmidt
da9587033d Move shared code to TaskRunner 
PiperOrigin-RevId: 492534879
 2022-12-02 12:42:45 -08:00
Sebastian Schmidt
dabc2af15b Fix base bath loading in Fileset resolver 
PiperOrigin-RevId: 492526041
 2022-12-02 12:06:48 -08:00
MediaPipe Team
768d2dc548 Separate web and java api landmark and world landmark to two classes. This makes the platforms interface consistent. 
PiperOrigin-RevId: 492332990
 2022-12-01 16:49:47 -08:00
Jiuqiang Tang
ead41132a8 Load model file content from model file path with the help of GetResourceContents in browsers. 
This can handle the model files that are provided via a custom ResourceProviderFn.

PiperOrigin-RevId: 492308453
 2022-12-01 15:03:57 -08:00
Jiuqiang Tang
af990c3da1 Open up the visibility of "//mediapipe/java/com/google/mediapipe/framework/image:image". 
PiperOrigin-RevId: 492308109
 2022-12-01 15:00:25 -08:00
Khanh LeViet
fd79f18aeb Make BaseOptions to pass absolute path to C++ layer. 
PiperOrigin-RevId: 492296573
 2022-12-01 14:14:51 -08:00
Camillo Lugaresi
40eb0e6385 Internal change 
PiperOrigin-RevId: 492276913
 2022-12-01 12:59:41 -08:00
Hadon Nash
1e2cb2b359 Internal change 
PiperOrigin-RevId: 492253867
 2022-12-01 11:34:55 -08:00
MediaPipe Team
02aa162c9e Rename gesture_recognizer test_data to testdata to be consistent with rest of model_maker 
PiperOrigin-RevId: 492246728
 2022-12-01 11:13:19 -08:00
Sebastian Schmidt
e685ac9344 Re-use classifier options for ObjectDetector 
PiperOrigin-RevId: 492206856
 2022-12-01 08:48:09 -08:00
Jiuqiang Tang
3ee37800e2 Depending on "inference_calculator_cpu" when the mediapipe tasks can only support cpu inference. 
PiperOrigin-RevId: 492205954
 2022-12-01 08:43:30 -08:00
Jiuqiang Tang
e7eee27c1c Remove the deleted library "mediapipe/tasks/java/com/google/mediapipe/tasks/components/processors:embedderoptions" from mediapipe_tasks_aar's android_library deps list. 
PiperOrigin-RevId: 492200061
 2022-12-01 08:17:12 -08:00
Sebastian Schmidt
a430939fe4 Document RunningMode 
PiperOrigin-RevId: 492193299
 2022-12-01 07:45:12 -08:00
MediaPipe Team
01010fa248 Internal change 
PiperOrigin-RevId: 492188196
 2022-12-01 07:17:19 -08:00
MediaPipe Team
29c7702984 Inline formerly nested 'ClassifierOptions' in Java classifier APIs. 
PiperOrigin-RevId: 492173060
 2022-12-01 05:52:15 -08:00
Jiuqiang Tang
460aee7933 Make mediapipe_tasks_aar's android_library depend on "//third_party:androidx_annotation". 
PiperOrigin-RevId: 492092487
 2022-11-30 20:45:02 -08:00
Camillo Lugaresi
fcd2d2c5af Internal change 
PiperOrigin-RevId: 491733850
 2022-11-29 14:14:37 -08:00
Michael Hays
88173948ee Internal change 
PiperOrigin-RevId: 491724816
 2022-11-29 13:39:35 -08:00
Sebastian Schmidt
09740130e8 Use naturalWidth and naturalHeight for image data 
PiperOrigin-RevId: 491694147
 2022-11-29 11:35:03 -08:00
Jiuqiang Tang
c8a413bb4e Open up mediapipe framework's visibility. 
PiperOrigin-RevId: 491672877
 2022-11-29 10:19:44 -08:00
Camillo Lugaresi
cc11b45228 Remove unneeded GPU_SHARED side packet for GlSurfaceSink 
PiperOrigin-RevId: 491487092
 2022-11-28 17:55:30 -08:00
Camillo Lugaresi
fc526374ab Use GpuResources in GpuTestBase and update GpuBufferMultiPoolTest 
PiperOrigin-RevId: 491486495
 2022-11-28 17:51:03 -08:00
MediaPipe Team
e987b69f39 Add alternative method to determine unique kernel cache path 
PiperOrigin-RevId: 491476293
 2022-11-28 16:52:16 -08:00
MediaPipe Team
7b74fd53f5 Verify that kernel cache is only used when OpenCL is active 
PiperOrigin-RevId: 491463306
 2022-11-28 15:47:55 -08:00
MediaPipe Team
26a7ca5c64 fix typo and minor formatting issues 
PiperOrigin-RevId: 491453662
 2022-11-28 15:05:28 -08:00
MediaPipe Team
b65c40b302 Internal change 
PiperOrigin-RevId: 491441446
 2022-11-28 14:17:23 -08:00
Sebastian Schmidt
342f95fa20 Typo fix 
PiperOrigin-RevId: 491434987
 2022-11-28 13:54:09 -08:00
MediaPipe Team
c48ca1f674 internal change 
PiperOrigin-RevId: 491429214
 2022-11-28 13:33:57 -08:00
Sebastian Schmidt
153edc59a1 Add support for browsers without SIMD 
PiperOrigin-RevId: 491371277
 2022-11-28 09:54:22 -08:00
MediaPipe Team
395d9d8ea2 Instantiate GetDetectionVectorItemCalculator variant of GetVectorItemCalculator<>. 
PiperOrigin-RevId: 491123314
 2022-11-27 00:07:10 -08:00
Camillo Lugaresi
0bdb48ceb1 Use kUtilityFramebuffer in GlCalculatorHelper 
All calculators using the same context can share a single framebuffer object.

PiperOrigin-RevId: 490605074
 2022-11-23 16:19:31 -08:00
MediaPipe Team
41a7f9d7d6 Internal change 
PiperOrigin-RevId: 490595529
 2022-11-23 15:24:50 -08:00
MediaPipe Team
bfa57310c4 Move TextPreprocessing to "processors" folder. 
PiperOrigin-RevId: 490532670
 2022-11-23 10:19:45 -08:00
Camillo Lugaresi
54d1744c8f Remove DrishtiGraphGPUData, add MetalSharedResources 
This class is unused except by the Metal helper; let's narrow it down and simplify gpu_shared_data.

PiperOrigin-RevId: 490531767
 2022-11-23 10:15:17 -08:00
Camillo Lugaresi
3c53ec2cdb Do not expose DrishtiGraphGPUData.h in public header 
This class is an implementation detail.

PiperOrigin-RevId: 490530823
 2022-11-23 10:11:32 -08:00
MediaPipe Team
b5189758f7 Move ImagePreprocessing to "processors" folder. 
PiperOrigin-RevId: 490444821
 2022-11-23 02:08:37 -08:00
Sebastian Schmidt
c5ce523697 Add cosine APIs to Embedder tasks 
PiperOrigin-RevId: 490444597
 2022-11-23 02:04:44 -08:00
Sebastian Schmidt
05681fc0e1 Internal 
PiperOrigin-RevId: 490439195
 2022-11-23 01:29:37 -08:00
Camillo Lugaresi
a55839de51 This storage only needs a "done writing" callback on simulator, so only set it there 
- When not on simulator, we pass nullptr instead of a do-nothing callback.
- The callback is no longer a method, but a function. Only the CVPixelBuffer is captured.

PiperOrigin-RevId: 490380248
 2022-11-22 18:09:09 -08:00
Sebastian Schmidt
3bbc0e9af9 Internal change 
PiperOrigin-RevId: 490375672
 2022-11-22 17:39:54 -08:00
MediaPipe Team
837225c53d Internal change 
PiperOrigin-RevId: 490374976
 2022-11-22 17:36:15 -08:00
Camillo Lugaresi
8ba9d87e66 Update ImageFrameToGpuBufferCalculator to use api2 and GpuBuffer conversions 
PiperOrigin-RevId: 490374387
 2022-11-22 17:32:33 -08:00
MediaPipe Team
fac97554df Small TS audio API improvement 
PiperOrigin-RevId: 490374083
 2022-11-22 17:27:47 -08:00
Camillo Lugaresi
efa9e737f8 Use current context if available in ConvertToImageFrame 
If we're already running in a GlContext, there's no need to go back to the producer context, which may be different.

PiperOrigin-RevId: 490373829
 2022-11-22 17:24:03 -08:00
MediaPipe Team
7ce4aa6592 Internal change 
PiperOrigin-RevId: 490366250
 2022-11-22 16:40:38 -08:00
Camillo Lugaresi
515d00fc22 Internal change 
PiperOrigin-RevId: 490349260
 2022-11-22 15:18:21 -08:00
vrabaud
872d1afda7 Internal change 
PiperOrigin-RevId: 490196129
 2022-11-22 03:12:38 -08:00
Camillo Lugaresi
d648926155 Just reset the fb binding to 0 in ReadTexture 
This saves a get operation. We already have precedent in lots of other MediaPipe code where we just reset bindings to 0.

PiperOrigin-RevId: 490170691
 2022-11-22 00:36:54 -08:00
Camillo Lugaresi
bacbac8d92 Use kUtilityFramebuffer in ReadTexture 
This avoids creating a temporary framebuffer each time.

PiperOrigin-RevId: 490163892
 2022-11-21 23:59:44 -08:00
Camillo Lugaresi
a8b7761022 Define a kUtilityFramebuffer context attachment 
A framebuffer object is often needed to render to a texture or read data from it. Currently we create one in each GlCalculatorHelper, but that is redundant (we only need one per context, and multiple calculators can share the same context). Other times, the code that needs to use this doesn't own a helper. For both reasons, this should be attached to the context.

We could just make this a member of GlContext since it's so common. However, I figured we might as well use the attachment system.

PiperOrigin-RevId: 490160214
 2022-11-21 23:29:27 -08:00
Camillo Lugaresi
54a684717f Internal change 
PiperOrigin-RevId: 490159674
 2022-11-21 23:24:16 -08:00
MediaPipe Team
d43d0ff615 Internal change 
PiperOrigin-RevId: 490089940
 2022-11-21 15:47:45 -08:00
MediaPipe Team
adddf2c2ab Extracted common test helper functions out from the unittest into a sharable 
library. Also migrated away from OpenCVX.

PiperOrigin-RevId: 490074410
 2022-11-21 14:39:56 -08:00
MediaPipe Team
652423a23d Internal change 
PiperOrigin-RevId: 490053179
 2022-11-21 13:06:47 -08:00
MediaPipe Team
7f0134eecb Internal change 
PiperOrigin-RevId: 490041386
 2022-11-21 12:16:00 -08:00
MediaPipe Team
7acbf557a1 Cleanup after migration to new classification output format. 
PiperOrigin-RevId: 489921603
 2022-11-21 01:57:05 -08:00
MediaPipe Team
13c6b9a8c6 Allow kernel cache path to be specified without trailing path delimiter 
PiperOrigin-RevId: 489891079
 2022-11-20 22:20:18 -08:00
Camillo Lugaresi
3ac7f6a216 Simplify image creation in PacketCreator 
Use more existing functions, remove redundant code, remove direct use of RuntimeException.

PiperOrigin-RevId: 489868983
 2022-11-20 19:32:21 -08:00
MediaPipe Team
6cf464636b Internal change 
PiperOrigin-RevId: 489842199
 2022-11-20 14:26:22 -08:00
Scott Zhu
a367753eda Internal change 
PiperOrigin-RevId: 489824381
 2022-11-20 10:41:20 -08:00
MediaPipe Team
bdf4078e89 Internal change 
PiperOrigin-RevId: 489752009
 2022-11-19 21:14:24 -08:00
Camillo Lugaresi
a33cb1e05e Check that Java buffer supports direct access before using it 
If the buffer is not created with allocateDirect, JNI APIs will return a data pointer of nullptr and a capacity of -1. This can cause a crash when we access it.

Also clean up the code to raise exceptions instead of just logging errors and returning nullptr.

PiperOrigin-RevId: 489751312
 2022-11-19 21:04:48 -08:00
MediaPipe Team
977ee4272e Add public visibility to the model maker public API. 
PiperOrigin-RevId: 489701768
 2022-11-19 10:53:21 -08:00
Sebastian Schmidt
bbcbd5fc6c Audio Embedder for Web 
PiperOrigin-RevId: 489669966
 2022-11-19 04:49:24 -08:00
Sebastian Schmidt
e853f04b79 Create AudioTaskRunner 
PiperOrigin-RevId: 489613573
 2022-11-18 19:55:08 -08:00
Camillo Lugaresi
eb8ef1ace0 Use shared_from_this in GlTextureBuffer::GetReadView, GetWriteView 
This ensures that the callbacks in GlTextureView won't call an expired object, even if user code holds a GlTextureView after releasing the buffer.

Note that GlTextureBuffer is not always held by a shared_ptr, but it always is when GpuBuffer calls GetRead/WriteView on it. An alternative solution would have been to have GpuBuffer pass its shared_ptr<GlTextureBuffer> to the view method, which could have been implemented with some compile-time logic to detect whether the method expects such an argument. However, that doesn't seem necessary.

PiperOrigin-RevId: 489611843
 2022-11-18 19:42:34 -08:00
MediaPipe Team
bbd5da7971 Added the gray scale image support for the ImageToTensorCalculator on CPU. 
PiperOrigin-RevId: 489593917
 2022-11-18 17:12:57 -08:00
MediaPipe Team
524ac3ca61 Internal change for Model Maker 
PiperOrigin-RevId: 489540387
 2022-11-18 12:48:30 -08:00
Jiuqiang Tang
1b594a0310 Return error status when any tflite input and output tensor doesn't have valid dimensionality information that is needed to allocate Gl/Metal buffer before calling ModifyGraphWithDelegate. 
PiperOrigin-RevId: 489539740
 2022-11-18 12:44:55 -08:00
Sebastian Schmidt
71ae496a20 Add AudioEmbedder documentation 
PiperOrigin-RevId: 489532283
 2022-11-18 12:12:41 -08:00
MediaPipe Team
e2052a6a51 Rename embedding postprocessor "configure" method for consistency with classification postprocessor. 
PiperOrigin-RevId: 489518257
 2022-11-18 11:13:10 -08:00
Adam Cozzette
ac212c1507 Internal change 
PiperOrigin-RevId: 489502255
 2022-11-18 10:08:26 -08:00
MediaPipe Team
03d388fecf Add hand landmark named index constants 
PiperOrigin-RevId: 489498248
 2022-11-18 09:52:44 -08:00
MediaPipe Team
2f361e2f47 Internal change 
PiperOrigin-RevId: 489486417
 2022-11-18 08:53:43 -08:00
Jiuqiang Tang
e046982a3c Internal change 
PiperOrigin-RevId: 489484898
 2022-11-18 08:47:09 -08:00
Hadon Nash
ae44012c0c Allowing BypassCalculator to accept InputSidePackets. 
PiperOrigin-RevId: 489483992
 2022-11-18 08:43:02 -08:00
Camillo Lugaresi
efcdedbd59 Remove redundant _ios targets 
PiperOrigin-RevId: 489355333
 2022-11-17 18:16:58 -08:00
Copybara-Service
cd056e114a Merge pull request #3866 from kinaryml:fix-tasks-api-python-311-errors 
PiperOrigin-RevId: 489346167
 2022-11-17 17:20:23 -08:00
MediaPipe Team
6f3cb340e1 Internal change 
PiperOrigin-RevId: 489345940
 2022-11-17 17:16:25 -08:00
MediaPipe Team
ab3a5f0fbf Make MuxCalculator with DefaultInputStreamHandler to handle graph closure gracefully 
PiperOrigin-RevId: 489336722
 2022-11-17 16:30:35 -08:00
MediaPipe Team
a7bd725e65 Internal change 
PiperOrigin-RevId: 489331826
 2022-11-17 16:09:15 -08:00
kinaryml
ea77a7c25d Undo commenting out remaining tests 2022-11-17 14:06:30 -08:00
MediaPipe Team
1fb0902aa0 Update gesture_recognizer test 
PiperOrigin-RevId: 489301508
 2022-11-17 14:04:30 -08:00
kinaryml
87238705dd Updated cosine similarity utility 2022-11-17 14:03:07 -08:00
Sebastian Schmidt
3ccf7308e0 Add shared options for Text and Audio Tasks 
PiperOrigin-RevId: 489186644
 2022-11-17 05:28:27 -08:00
Hadon Nash
ea4989b6f1 Internal change 
PiperOrigin-RevId: 489135553
 2022-11-17 00:07:59 -08:00
kinaryml
5a6837d034 Fix errors that will occur in python 3.11 2022-11-16 22:08:52 -08:00
Sebastian Schmidt
899c87466e Add MP Tasks entrypoints 
PiperOrigin-RevId: 489110875
 2022-11-16 20:57:33 -08:00
Camillo Lugaresi
6fc277ee1c Internal change 
PiperOrigin-RevId: 489091534
 2022-11-16 18:38:03 -08:00
Sebastian Schmidt
e66e88802c Change NPM Bundle to ESM 
PiperOrigin-RevId: 489091370
 2022-11-16 18:34:53 -08:00
MediaPipe Team
90eb4a19d8 Internal change 
PiperOrigin-RevId: 489088227
 2022-11-16 18:16:32 -08:00
MediaPipe Team
b6b72d5e4e Add MuxCalculator test case where graph is being closed while SELECT has not been received. 
PiperOrigin-RevId: 489061902
 2022-11-16 15:56:43 -08:00
Sebastian Schmidt
3cdf0f6536 Fix a crash that occurred when a model returns fewer vector elements than before 
PiperOrigin-RevId: 489041814
 2022-11-16 14:38:37 -08:00
MediaPipe Team
74474d859e Update image_classifier demo with new ImageClassifierOption changes 
PiperOrigin-RevId: 489031381
 2022-11-16 14:00:39 -08:00
MediaPipe Team
cdd44e77b7 Internal change 
PiperOrigin-RevId: 488969539
 2022-11-16 10:07:40 -08:00
MediaPipe Team
dc9578d226 Internal change 
PiperOrigin-RevId: 488946809
 2022-11-16 08:30:20 -08:00
Sebastian Schmidt
f7aef677fc Add running mode to all vision tasks 
PiperOrigin-RevId: 488816785
 2022-11-15 19:02:21 -08:00
Camillo Lugaresi
febfc2029b Annotate plane argument 
PiperOrigin-RevId: 488813363
 2022-11-15 18:53:09 -08:00
Camillo Lugaresi
63e2089639 Deprecate a bunch of old stuff in GlCalculatorHelper 
PiperOrigin-RevId: 488813296
 2022-11-15 18:51:56 -08:00
Camillo Lugaresi
1979801a92 Remove GlCalculatorHelperImpl; merge with GlCalculatorHelper 
Originally, there were multiple implementations of GlCalculatorHelperImpl, depending on the platform and underlying GL APIs. These have all been refactored into other components, and the remaining code in this class is unified and much reduced in size. We can get rid of this implementation detail now.

PiperOrigin-RevId: 488813220
 2022-11-15 18:50:45 -08:00
Camillo Lugaresi
8b319e963a Add comment explaining ViewProvider 
This was only documented via examples (e.g. ViewProvider<GlTextureView>), but it's better to explain it properly in the header where the base case is defined.

PiperOrigin-RevId: 488813144
 2022-11-15 18:48:54 -08:00
Camillo Lugaresi
a28ccb0964 Remove unnecessary forward declarations 
PiperOrigin-RevId: 488813066
 2022-11-15 18:43:36 -08:00
Camillo Lugaresi
13b4b825d7 Remove std::shared_ptr<GpuBuffer> argument from GetRead/WriteView 
PiperOrigin-RevId: 488813004
 2022-11-15 18:41:53 -08:00
Camillo Lugaresi
1c0a1d0aab Remove shared_ptr<GpuBuffer> member from GlTextureView 
This only exists to support GlTexture's GetFrame API. It can be moved into GlTexture.

PiperOrigin-RevId: 488812896
 2022-11-15 18:40:15 -08:00
Camillo Lugaresi
767cc2ee3c More comments on gpu_buffer_storage 
This gives a basic explanation of the role of storages and views, and provides some details on how to implement a new storage type.

PiperOrigin-RevId: 488812807
 2022-11-15 18:38:29 -08:00
Camillo Lugaresi
4c874fe4cd Allow conversion of GlTextureBuffer to CVPixelBufferRef 
This means that, if an iOS application sends in a GlTextureBuffer but expects a CVPixelBufferRef as output, everything will work even if the graph just forwards the same input. Also, access by Metal calculators will also work transparently.

PiperOrigin-RevId: 488812748
 2022-11-15 18:36:45 -08:00
Camillo Lugaresi
fe66de3714 Internal change 
PiperOrigin-RevId: 488812677
 2022-11-15 18:32:54 -08:00
MediaPipe Team
2f77bf44e3 Use train_data to evaluate accuracy of unit test for gesture_recognizer due to limited dataset size. 
PiperOrigin-RevId: 488808942
 2022-11-15 18:10:28 -08:00
Camillo Lugaresi
b308c0dd5e Implement CVPixelBufferRef access as a view. 
PiperOrigin-RevId: 488798216
 2022-11-15 17:18:07 -08:00
Camillo Lugaresi
4bda012bba Factor out gl_texture_util 
PiperOrigin-RevId: 488797985
 2022-11-15 17:13:22 -08:00
Camillo Lugaresi
77b3edbb67 Internal change 
PiperOrigin-RevId: 488797407
 2022-11-15 17:09:43 -08:00
Camillo Lugaresi
7e19bbe35c Internal change 
PiperOrigin-RevId: 488795920
 2022-11-15 17:01:33 -08:00
Camillo Lugaresi
1beca61650 Register GlTextureBuffer pool with GpuBuffer 
First crack at hooking up pools with the GpuBufferStorage system. Will most likely be superseded later, but for now this works with minimal code impact: just overwrite the factory for a storage type with one that uses the pool.

PiperOrigin-RevId: 488783854
 2022-11-15 16:19:48 -08:00
Camillo Lugaresi
583d27636b Factor out ReusablePool 
PiperOrigin-RevId: 488783477
 2022-11-15 16:18:20 -08:00
Camillo Lugaresi
53d015af08 Generic MultiPool template 
PiperOrigin-RevId: 488783176
 2022-11-15 16:15:42 -08:00
Camillo Lugaresi
b9fa2e3496 Make it possible to override the SimplePool factory used by MultiPool 
This means MultiPool no longer needs a SetFlushPlatformCaches method, which was too specific to the CVPixelBufferPool.

PiperOrigin-RevId: 488783003
 2022-11-15 16:14:27 -08:00
Camillo Lugaresi
267476657d MultiPool options header refactoring 
Passing MultiPool options to the base pool factories means that we don't have to specialize which options we pass to them.

PiperOrigin-RevId: 488782861
 2022-11-15 16:13:05 -08:00
Camillo Lugaresi
7ef3185ecb Allow customizing MultiPool options 
These don't need to be constants.

PiperOrigin-RevId: 488782713
 2022-11-15 16:11:54 -08:00
Camillo Lugaresi
f13903b7c5 Call SimplePool methods directly 
This removes redundant helper functions in GpuBufferMultiPool.

PiperOrigin-RevId: 488782516
 2022-11-15 16:10:34 -08:00
Camillo Lugaresi
0c4522cb9f Move flush hook to CvPixelBufferPoolWrapper constructor 
This unifies the implementation of GpuBufferMultiPool::GetBufferFromSimplePool.

PiperOrigin-RevId: 488782173
 2022-11-15 16:07:17 -08:00
Camillo Lugaresi
a4fe3eb094 Add CreateBufferWithoutPool method to base pools 
This may not fit exactly in a pool class, but it makes it easy for the multi-pool to find the appropriate method by depending only on the type of the base pool. For the CVPixelBuffer case, the buffer type is CFHolder<CVPixelBufferRef>, and it seems even less appropriate to specialize that template to add such a method there. An alternative would be to allow defining a creation function separately.

PiperOrigin-RevId: 488782054
 2022-11-15 16:05:53 -08:00
Camillo Lugaresi
0d273dd11a Factor out CvPixelBufferPoolWrapper 
This is platform-specific and does not need to live in the main multi_pool sources.

PiperOrigin-RevId: 488781934
 2022-11-15 16:04:27 -08:00
Camillo Lugaresi
ab2dd779e7 Factor out CvTextureCacheManager 
This is a platform-specific component that is only used with CVPixelBufferPool.

PiperOrigin-RevId: 488781757
 2022-11-15 16:02:53 -08:00
MediaPipe Team
fae55910f4 Enable absl::string_view kCalculatorName 
PiperOrigin-RevId: 488781493
 2022-11-15 15:59:09 -08:00
Camillo Lugaresi
a520d6cc38 Remove FORCE_CONTIGUOUS_PIXEL_BUFFER_ON_IPHONE_SIMULATOR 
This workaround code is no longer necessary, as per the comment.

PiperOrigin-RevId: 488777606
 2022-11-15 15:41:53 -08:00
Camillo Lugaresi
3c71c64be1 Remove shared_ptr from SimplePool definition 
This makes the types more explicit and will help with factoring out platform-specific code.

PiperOrigin-RevId: 488775470
 2022-11-15 15:32:57 -08:00
Camillo Lugaresi
a67069156e Use flat_hash_map in ResourceCache 
This is the recommended hashmap in most cases.

PiperOrigin-RevId: 488772031
 2022-11-15 15:23:31 -08:00
MediaPipe Team
38b636f7ee Internal change 
PiperOrigin-RevId: 488770794
 2022-11-15 15:19:48 -08:00
Camillo Lugaresi
7a87546c30 Internal change 
PiperOrigin-RevId: 488761646
 2022-11-15 14:39:58 -08:00
MediaPipe Team
e65f21e2d8 Update the docstring to make it consistent with the model option update. 
PiperOrigin-RevId: 488761331
 2022-11-15 14:36:48 -08:00
Sebastian Schmidt
496720308c Migrate remaining MP Tasks Libraries to ts_declarations 
PiperOrigin-RevId: 488752799
 2022-11-15 14:08:15 -08:00
MediaPipe Team
1689112b23 Improve model_util_test code. 
PiperOrigin-RevId: 488752497
 2022-11-15 14:04:39 -08:00
MediaPipe Team
f14645cb06 Model maker gesture recognizer test changes 
PiperOrigin-RevId: 488702055
 2022-11-15 10:50:32 -08:00
MediaPipe Team
ebba119f15 Add Java ImageEmbedder API. 
PiperOrigin-RevId: 488588010
 2022-11-15 01:26:00 -08:00
Camillo Lugaresi
6f54308c25 Internal change 
PiperOrigin-RevId: 488552135
 2022-11-14 21:42:41 -08:00
Jiuqiang Tang
87dff8142c Fix a typo. 
PiperOrigin-RevId: 488519113
 2022-11-14 18:13:50 -08:00
Sebastian Schmidt
9bd8b432c3 Add typings support to d.ts package 
PiperOrigin-RevId: 488519074
 2022-11-14 18:10:25 -08:00
Jiuqiang Tang
f16e63694e Build embedding tasks into tasks AARs. 
PiperOrigin-RevId: 488509942
 2022-11-14 17:18:12 -08:00
Sebastian Schmidt
a12bc3fd0e Add IIFE bundles for NPM packages 
PiperOrigin-RevId: 488504360
 2022-11-14 16:51:58 -08:00
Jiuqiang Tang
794f64db55 Fix the wrong path of "text_embedder_graph_options_java_proto_lite". 
PiperOrigin-RevId: 488490050
 2022-11-14 15:51:05 -08:00
Jiuqiang Tang
cce1751dbf Expose tasks components API in PyPI packages. 
PiperOrigin-RevId: 488487666
 2022-11-14 15:41:11 -08:00
Jiuqiang Tang
e714e656fe Update python documentation. 
PiperOrigin-RevId: 488482142
 2022-11-14 15:18:47 -08:00
Sebastian Schmidt
c027373688 Internal change 
PiperOrigin-RevId: 488481286
 2022-11-14 15:15:22 -08:00
Sebastian Schmidt
11270d0c93 Image Embedder for Web 
PiperOrigin-RevId: 488468214
 2022-11-14 14:26:15 -08:00
Jiuqiang Tang
b4fba6fe61 MediaPipe Tasks AudioEmbedder Java API 
PiperOrigin-RevId: 488456442
 2022-11-14 13:42:55 -08:00
Sebastian Schmidt
ca7b5e9d8b Fix Script loading 
PiperOrigin-RevId: 488440736
 2022-11-14 12:40:41 -08:00
Copybara-Service
9a2af2f2a1 Merge pull request #3853 from kinaryml:audio-embedder-python 
PiperOrigin-RevId: 488434586
 2022-11-14 12:16:45 -08:00
Sebastian Schmidt
b00236e86e Hand Landmarker Web API 
PiperOrigin-RevId: 488434079
 2022-11-14 12:13:27 -08:00
MediaPipe Team
34daba4747 Add Java TextEmbedder API. 
PiperOrigin-RevId: 488427327
 2022-11-14 11:49:56 -08:00
Jiuqiang Tang
b40b2ade14 Fix typos. 
PiperOrigin-RevId: 488416345
 2022-11-14 11:07:59 -08:00
Jiuqiang Tang
4b5c3521af Dividing the timestamp by 1000 when returning a "none" result object from GestureRecognizer and HandLandmarker APIs. 
PiperOrigin-RevId: 488409077
 2022-11-14 10:44:20 -08:00
MediaPipe Team
c7d531ebb2 AddTarget -> ConnectTo and documentation 
PiperOrigin-RevId: 488407930
 2022-11-14 10:40:06 -08:00
MediaPipe Team
05cb40ff79 MediaPipe TextEmbedder task for web 
PiperOrigin-RevId: 488373613
 2022-11-14 08:34:09 -08:00
MediaPipe Team
badaccfb04 Internal change 
PiperOrigin-RevId: 488333493
 2022-11-14 05:05:03 -08:00