cassdlcm/mediapipe
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,323 Commits 10 Branches 56 Tags 829 MiB
517e997179
Commit Graph

1142 Commits

Author SHA1 Message Date
Prianka Liz Kariat
5e5a1a733f Updated imports 2023-02-16 01:37:50 +05:30
Prianka Liz Kariat
dce81342b6 Updated imports of MPPImageUtils 2023-02-16 01:35:27 +05:30
Prianka Liz Kariat
ae05c78443 Updated formatting 2023-02-16 01:33:33 +05:30
Prianka Liz Kariat
42e35503d9 Removed unwanted declarations in namespace 2023-02-16 01:31:51 +05:30
Prianka Liz Kariat
a503fb53e0 Updated MPPVisionTaskRunner 2023-02-16 01:31:29 +05:30
Prianka Liz Kariat
a0253274cc Added MPPVisionPacketCreator 2023-02-16 01:31:09 +05:30
Prianka Liz Kariat
8c3e3456a3 Added MPPImageClassifierOptions 2023-02-16 01:26:10 +05:30
Prianka Liz Kariat
825b30bccd Added MPPImageClassifierResult 2023-02-16 01:25:57 +05:30
Prianka Liz Kariat
a128810564 Updated MPPImageUtils with methods to create image frame 2023-02-16 01:25:16 +05:30
Sebastian Schmidt
d450a673c0 Open visibility of iOS TextClassifier & TextEmbedder 
PiperOrigin-RevId: 509645638
 2023-02-14 14:53:24 -08:00
MediaPipe Team
5f2261ff59 face landmarks detector graph 
PiperOrigin-RevId: 509630430
 2023-02-14 14:00:37 -08:00
Copybara-Service
d6fd2c52a7 Merge pull request #4093 from priankakariatyml:ios-ml-image-utils 
PiperOrigin-RevId: 509602397
 2023-02-14 12:17:41 -08:00
Sebastian Schmidt
c2260e8877 Use mediapipe_proto_library for gl_context_options_proto 
PiperOrigin-RevId: 509601125
 2023-02-14 12:13:01 -08:00
MediaPipe Team
c66b7e83f0 ssd anchors calculator add fixed anchors. 
PiperOrigin-RevId: 509574814
 2023-02-14 10:43:23 -08:00
Prianka Liz Kariat
55e5377c08 Updated formatting 2023-02-14 20:51:51 +05:30
Prianka Liz Kariat
3a7aa29226 Updated note about packets callback in vision task runner 2023-02-14 20:49:14 +05:30
Prianka Liz Kariat
4e1fa82d50 Added designated initializer in vision task runner 2023-02-14 20:40:21 +05:30
Prianka Liz Kariat
a490255c17 Updated formatting 2023-02-14 20:40:06 +05:30
Prianka Liz Kariat
17ff493a9d Updated formatting 2023-02-14 20:39:25 +05:30
Prianka Liz Kariat
b940a19462 Merge branch 'master' into ios-ml-image-utils 2023-02-14 20:34:55 +05:30
Copybara-Service
a578a702ec Merge pull request #4075 from priankakariatyml:ios-ml-image 
PiperOrigin-RevId: 509465929
 2023-02-14 02:19:35 -08:00
MediaPipe Team
513ab7abba Internal change 
PiperOrigin-RevId: 509338497
 2023-02-13 14:47:34 -08:00
Sebastian Schmidt
deae714a5c Enable Python Audio Classifier & Embedder on Windows 
PiperOrigin-RevId: 509243198
 2023-02-13 09:06:19 -08:00
Prianka Liz Kariat
1cd3c05fc5 Added default case to running mode check 2023-02-13 19:58:14 +05:30
Prianka Liz Kariat
328fe4ed39 Added vision task runner 2023-02-13 19:55:12 +05:30
Prianka Liz Kariat
1623b591b7 Added MPPRunningMode 2023-02-13 19:52:00 +05:30
Prianka Liz Kariat
e2f1d07c8b Updated target definition for MPPImage 2023-02-13 19:44:09 +05:30
Prianka Liz Kariat
02734b3add Added MPPImageUtils 2023-02-13 19:43:49 +05:30
Prianka Liz Kariat
acba3ab26d Bug fixes in MPPImage 2023-02-13 19:41:15 +05:30
MediaPipe Team
626f92caea Move BuildInputImageTensorSpecs to utils 
PiperOrigin-RevId: 508829724
 2023-02-10 21:57:13 -08:00
MediaPipe Team
2c82f67097 Add location info in registry (debug mode only) 
PiperOrigin-RevId: 508786558
 2023-02-10 16:58:44 -08:00
Hadon Nash
e719d2d423 Internal change 
PiperOrigin-RevId: 508766449
 2023-02-10 15:23:01 -08:00
Aden Grue
09ad961421 Internal change 
PiperOrigin-RevId: 508701833
 2023-02-10 10:54:55 -08:00
MediaPipe Team
39a943e91e Request ModelResourcesGraphService for all Task API web graphs. 
PiperOrigin-RevId: 508681004
 2023-02-10 09:36:03 -08:00
MediaPipe Team
915d2c7417 Internal text task change. 
PiperOrigin-RevId: 508568811
 2023-02-09 22:31:14 -08:00
MediaPipe Team
d61b7dbef8 Updated the Begin/EndLoopCalculator to be able to handle mediapipe::Tensor 
type.

PiperOrigin-RevId: 508552066
 2023-02-09 20:33:40 -08:00
MediaPipe Team
1eb54bdaa6 Internal change 
PiperOrigin-RevId: 508533812
 2023-02-09 18:49:01 -08:00
MediaPipe Team
1f848c4d69 Fix typo in CalculatorGraph error message 
PiperOrigin-RevId: 508517972
 2023-02-09 17:29:33 -08:00
MediaPipe Team
fd764dae0a Depends on TFLite shim header. 
PiperOrigin-RevId: 508491302
 2023-02-09 15:29:47 -08:00
MediaPipe Team
99fc975f49 Add download model on demand to text classifier 
PiperOrigin-RevId: 508441452
 2023-02-09 12:15:17 -08:00
MediaPipe Team
28f728bed5 Change gesture_recognizer to download model files on-demand from GCS. 
PiperOrigin-RevId: 508424508
 2023-02-09 11:13:06 -08:00
MediaPipe Team
c3907229fe Use case: add metadata to headerless graph input audio streams. 
PiperOrigin-RevId: 508389799
 2023-02-09 09:07:02 -08:00
MediaPipe Team
598d44a27d Internal change 
PiperOrigin-RevId: 508284935
 2023-02-08 23:31:41 -08:00
MediaPipe Team
6ea2d579e1 Internal change 
PiperOrigin-RevId: 508173086
 2023-02-08 13:51:14 -08:00
Rachel Hornung
4b28ced8fd #MediaSequence Prevent undefined index access in metadata reconciliation. 
Reconciliation required feature_lists.feature_list[0].value.feature[0].float_list.size_>=1, now we skip keys where size_=0.

PiperOrigin-RevId: 508095655
 2023-02-08 09:06:02 -08:00
Prianka Liz Kariat
0e944cb764 Merged ios-ml-image with master 2023-02-08 21:43:39 +05:30
Prianka Liz Kariat
e1ca81c352 Added objective c tests for MPPImage 2023-02-08 21:40:41 +05:30
Prianka Liz Kariat
a82ffcd97c Updated mppimage target 2023-02-08 21:40:23 +05:30
Prianka Liz Kariat
445876d96b Updated formatting 2023-02-08 21:35:15 +05:30
Copybara-Service
fd6dfcfcab Merge pull request #4066 from priankakariatyml:ios-ml-image 
PiperOrigin-RevId: 507844473
 2023-02-07 11:52:37 -08:00
Sebastian Schmidt
712a22101f Do not use designated initializer 
PiperOrigin-RevId: 507805920
 2023-02-07 09:37:46 -08:00
Prianka Liz Kariat
be829eb276 Updated name of MPPTaskImage 2023-02-07 19:17:00 +05:30
Jiuqiang Tang
01c6a8b49b Add volume_gain_db option into AudioToTensorCalculator. 
PiperOrigin-RevId: 507748012
 2023-02-07 05:14:42 -08:00
Copybara-Service
28c07430ba Merge pull request #4052 from priankakariatyml:ios-text-embedder 
PiperOrigin-RevId: 507602101
 2023-02-06 15:42:48 -08:00
Chris McClanahan
e2ef78433f Add more filtering methods to detection filter calculator. 
PiperOrigin-RevId: 507581281
 2023-02-06 14:19:40 -08:00
Jiuqiang Tang
f4b0cf1cff Internal change 
PiperOrigin-RevId: 507540898
 2023-02-06 11:48:51 -08:00
Sebastian Schmidt
daf0a76c87 Update TensorFlow to latest 
PiperOrigin-RevId: 507505016
 2023-02-06 09:44:19 -08:00
MediaPipe Team
5a77339780 Internal change 
PiperOrigin-RevId: 507495569
 2023-02-06 09:05:12 -08:00
Prianka Liz Kariat
a3889c946d Updated list of designated initializers 2023-02-06 16:40:36 +05:30
Prianka Liz Kariat
0e4f0fbf9b Updated file name for MPPTaskImage 2023-02-06 16:39:17 +05:30
Prianka Liz Kariat
4da91896af Updated swift name for ImageSource Type 2023-02-06 16:36:33 +05:30
Prianka Liz Kariat
a5ac5b9eec Updated type name of image source 2023-02-06 16:35:27 +05:30
Prianka Liz Kariat
cbccd472ab Added MPPTaskImage for iOS vision tasks 2023-02-06 16:29:53 +05:30
MediaPipe Team
4d8af4315f Rollback: Add PacketSharingOwnership, a safer replacement for PointToForeign. 
PiperOrigin-RevId: 507288476
 2023-02-05 08:59:09 -08:00
Jiuqiang Tang
8e097ea9c3 Internal changes 
PiperOrigin-RevId: 507016761
 2023-02-03 16:07:42 -08:00
Sebastian Schmidt
680cfcc99b Update MP Tasks to observe timestamp bounds 
PiperOrigin-RevId: 507006313
 2023-02-03 15:21:41 -08:00
MediaPipe Team
01834a5cdf Internal change 
PiperOrigin-RevId: 506982474
 2023-02-03 13:39:02 -08:00
Sebastian Schmidt
046efddf8b Add Empty Packet support to GraphRunner 
PiperOrigin-RevId: 506963970
 2023-02-03 12:17:00 -08:00
MediaPipe Team
632a3602dd Internal text tasks change. 
PiperOrigin-RevId: 506957718
 2023-02-03 11:52:09 -08:00
MediaPipe Team
386445c8dd Add ViewProvider<FrameBuffer> to YuvImage storage backend. 
PiperOrigin-RevId: 506881556
 2023-02-03 05:58:29 -08:00
Prianka Liz Kariat
eeaa011998 Updated documentation of iOS text embedder tests 2023-02-03 18:06:05 +05:30
Prianka Liz Kariat
e290f9cf30 Added a note about swift test coverage in iOS text embedder tests 2023-02-03 18:05:49 +05:30
Prianka Liz Kariat
3b55fb9f6a Added iOS test for quantized embedding 2023-02-03 13:42:32 +05:30
Prianka Liz Kariat
b5b10e7681 Added iOS test for different themes in text embedder 2023-02-03 13:10:13 +05:30
Prianka Liz Kariat
a512e6b5f5 Updated MPPTextEmbedder Documentation 2023-02-03 12:49:00 +05:30
Prianka Liz Kariat
6ca1efdd55 Updated MPPTextEmbedder Documentation 2023-02-03 12:48:06 +05:30
MediaPipe Team
e485961c2d fixes spelling mistake 
PiperOrigin-RevId: 506697863
 2023-02-02 12:49:30 -08:00
Prianka Liz Kariat
20002f191a Changed documentation 2023-02-02 18:38:19 +05:30
Prianka Liz Kariat
d625918995 Added swift tests for text embedder 2023-02-02 18:36:55 +05:30
Prianka Liz Kariat
474e994a5f Added text embedder objective c tests 2023-02-02 17:30:05 +05:30
Prianka Liz Kariat
867520af1c Added cosine similarity to MPPTextEmbedder 2023-02-02 17:29:51 +05:30
Prianka Liz Kariat
84e1c93ffb Added MPPCosineSimilarity 2023-02-02 17:22:56 +05:30
Sebastian Schmidt
286dde97ad Make TextEmbedder and TextClassifier tests pass on Windows 
PiperOrigin-RevId: 506421383
 2023-02-01 14:22:04 -08:00
Copybara-Service
bdd77b0d61 Merge pull request #4048 from priankakariatyml:ios-text-embedder 
PiperOrigin-RevId: 506407904
 2023-02-01 13:32:58 -08:00
Sebastian Schmidt
0f3cf9c56a Add "noasan" to MPPTextClassifierObjcTest 
PiperOrigin-RevId: 506366650
 2023-02-01 11:06:17 -08:00
Sebastian Schmidt
83e33b4dbe Internal change 
PiperOrigin-RevId: 506345436
 2023-02-01 09:55:19 -08:00
Juhyun Lee
0919a6c0a3 Log which InferenceCalculator impl is used at runtime. 
PiperOrigin-RevId: 506343086
 2023-02-01 09:45:36 -08:00
MediaPipe Team
3ee377f671 Internal change 
PiperOrigin-RevId: 506312863
 2023-02-01 07:42:20 -08:00
Prianka Liz Kariat
bd507b2d7b Updated MPPEmbeddingHelpers to reflect type change of quantized embeddings 2023-02-01 19:27:05 +05:30
Prianka Liz Kariat
cd1cb87ff6 Merge branch 'master' into ios-text-embedder 2023-02-01 19:11:01 +05:30
Prianka Liz Kariat
85c310d01c Updated formatting 2023-02-01 18:52:55 +05:30
Prianka Liz Kariat
d588f73a6d Added MPPTextEmbedder 2023-02-01 18:51:30 +05:30
Prianka Liz Kariat
38eac174e9 Added MPPTextEmbedderResultHelpers 2023-02-01 18:51:01 +05:30
Prianka Liz Kariat
42e712e911 Added MPPTextEmbedderOptionsHelpers 2023-02-01 18:50:14 +05:30
Prianka Liz Kariat
69809e2181 Updated formatting 2023-02-01 18:48:10 +05:30
Prianka Liz Kariat
ffc9f1d47e Added MPPEmbeddingResultHelpers 2023-02-01 18:47:23 +05:30
Prianka Liz Kariat
24bd104b0f Added MPPEmbedding Helpers 2023-02-01 18:46:11 +05:30
MediaPipe Team
d283e6a05a Support downloading model files on-demand from GCS in model_maker 
PiperOrigin-RevId: 506174708
 2023-01-31 18:43:35 -08:00
MediaPipe Team
b53acf6267 Internal change 
PiperOrigin-RevId: 506059384
 2023-01-31 11:20:13 -08:00
MediaPipe Team
5730dec260 Internal change 
PiperOrigin-RevId: 506053206
 2023-01-31 11:03:41 -08:00
Copybara-Service
0863a8a1e7 Merge pull request #4030 from priankakariatyml:ios-text-embedder 
PiperOrigin-RevId: 506048365
 2023-01-31 10:47:19 -08:00
MediaPipe Team
591eb204a6 Internal change 
PiperOrigin-RevId: 506027661
 2023-01-31 09:36:56 -08:00
Sebastian Schmidt
be3bddc620 Add Text Embedder tests for text with different themes 
PiperOrigin-RevId: 506023265
 2023-01-31 09:23:30 -08:00
MediaPipe Team
f9f6acffed Make NORM_RECT optional for GestureRecognizerGraph and add PALM_DETECTION output PORT 
PiperOrigin-RevId: 505712542
 2023-01-30 09:17:38 -08:00
Prianka Liz Kariat
8c21dc02a6 Updated to types of float and quantized embedding 2023-01-30 11:42:33 +05:30
MediaPipe Team
ee2f940e1f Make TensorToVectorFloatCalculator compatible with unaligned tensors. 
No performance impact is expected, since the unaligned Eigen::TensorMap is used only to populate a std::vector<float>.

PiperOrigin-RevId: 505251810
 2023-01-27 18:08:03 -08:00
MediaPipe Team
a6f6be9512 Fix incorrect uint8 -> int8 conversion in JS cosine similarity. 
PiperOrigin-RevId: 505135368
 2023-01-27 09:21:58 -08:00
MediaPipe Team
1df4511e9d Add YuvImage as a GpuBuffer storage backend. 
PiperOrigin-RevId: 505128789
 2023-01-27 08:51:31 -08:00
MediaPipe Team
e059d55d29 Correctly check refCount in finalize. 
PiperOrigin-RevId: 505057866
 2023-01-27 01:52:48 -08:00
Prianka Liz Kariat
8531803462 Updated documentation of embedding containers 2023-01-27 11:08:39 +05:30
Sebastian Schmidt
c29ab7f083 Internal change 
PiperOrigin-RevId: 504928797
 2023-01-26 13:36:45 -08:00
Sebastian Schmidt
4d38557f11 Add MediaPipe Image Segmenter task for Web 
PiperOrigin-RevId: 504912518
 2023-01-26 12:31:54 -08:00
MediaPipe Team
29001234d5 Replace SourceOrNodeOutput with Source. 
PiperOrigin-RevId: 504883990
 2023-01-26 10:46:12 -08:00
MediaPipe Team
2547f07c77 Add FrameBuffer format. 
PiperOrigin-RevId: 504838580
 2023-01-26 07:40:52 -08:00
Jiuqiang Tang
0566e0e7ca Fix the output stream tag of the end loop calculator in the example code. 
PiperOrigin-RevId: 504708273
 2023-01-25 17:52:55 -08:00
MediaPipe Team
be546d22fc Update test to reflect the recommended graph construction style: 
First, graph inputs and their names:
  - Makes it clear what inputs graph has
  - Indirectly demands for type specification e.g. Stream<AnyType> a = graph.In(0); vs Stream<int> a = graph.In(0).Cast<int>();
Then graph nodes
  - Nodes are added and used as they needed
  - One node is not mixed in other nodes, only its outputs
  - Indirectly demands for type specification e.g. Stream<AnyType> a = node.Out(0); vs Stream<int> a = node.Out(0).Cast<int>();
Then graph outputs
  - Makes it clear what outputs graph has

The recommended structure keep C++ graph similar to pbtxt representation.

PiperOrigin-RevId: 504701023
 2023-01-25 17:13:17 -08:00
Sebastian Schmidt
1538740dcb Formatting fix 
PiperOrigin-RevId: 504599712
 2023-01-25 10:33:09 -08:00
Prianka Liz Kariat
61f7739ff6 Updated documentation 2023-01-25 20:20:22 +05:30
Prianka Liz Kariat
d01f75a295 Added iOS text embedder result files 2023-01-25 20:19:57 +05:30
Prianka Liz Kariat
168ea0a9ea Added MPPTextEmbedderResult 2023-01-25 20:19:40 +05:30
Prianka Liz Kariat
60e72bf165 Added MPPTextEmbedderOptions 2023-01-25 20:19:27 +05:30
Prianka Liz Kariat
db5ee6689f Added MPPEmbeddingResult 2023-01-25 20:17:04 +05:30
Prianka Liz Kariat
7d62402768 Added MPPEmbedding 2023-01-25 20:16:54 +05:30
MediaPipe Team
afb0182935 Internal model maker change. 
PiperOrigin-RevId: 504472342
 2023-01-24 23:16:21 -08:00
Sebastian Schmidt
5dc81c4c27 Remove unused import on strings.h 
PiperOrigin-RevId: 504397437
 2023-01-24 15:56:15 -08:00
Yuqi Li
679dbb3fd8 nit: update the metadata_schema.fbs file path. 
PiperOrigin-RevId: 504380873
 2023-01-24 14:46:25 -08:00
Sebastian Schmidt
ce9fec806c Internal change 
PiperOrigin-RevId: 504341886
 2023-01-24 12:18:15 -08:00
Mike Kruskal
9cde57d830 Internal change 
PiperOrigin-RevId: 504341832
 2023-01-24 12:14:02 -08:00
MediaPipe Team
4e135ccdb9 Internal Model Maker change. 
PiperOrigin-RevId: 504315641
 2023-01-24 10:38:25 -08:00
MediaPipe Team
2465e47b01 Stream/SidePacket == and != operators 
PiperOrigin-RevId: 504114182
 2023-01-23 16:43:23 -08:00
MediaPipe Team
873d7181bf Add mediapipe tasks face detector graph 
PiperOrigin-RevId: 504078951
 2023-01-23 14:15:21 -08:00
Sebastian Schmidt
ccd1461add Don't error in ExternalFile handler on Windows if FileContent is provided 
PiperOrigin-RevId: 504069137
 2023-01-23 13:38:41 -08:00
MediaPipe Team
69d354fc89 Use c++ struct as hand landmark detection results. 
PiperOrigin-RevId: 504048095
 2023-01-23 12:12:09 -08:00
Nikolay Chirkov
1124569c29 Tensor: Make tensor not requiring "-x objective-c++" option. 
In this case tensor.h is compiled differently for C++ and Objective-C++ that violates ODR (once definition rule). Tensor has no virtual methods conditionally compiled but some Metal-related data members. Instead, unique_ptr to MtlResources that is declared as forward structure is unconditionally defined in the tensor class. MtlResources is defined differently in cc-file only that compiled just once per project so no ODR violation is here.

PiperOrigin-RevId: 504029286
 2023-01-23 11:00:35 -08:00
MediaPipe Team
921b6a6bef This CL will fix the typo from _PALM_LANMARKS to _PALM_LANDMARKS. 
PiperOrigin-RevId: 503352055
 2023-01-19 22:14:16 -08:00
Copybara-Service
4b9a52dc34 Merge pull request #3995 from priankakariatyml:ios-text-classifier-tests 
PiperOrigin-RevId: 503242486
 2023-01-19 12:59:49 -08:00
Sebastian Schmidt
db1a89324e Add mediapipe::Image output to the graph runner 
PiperOrigin-RevId: 503204918
 2023-01-19 10:41:13 -08:00
Sebastian Schmidt
a02097ea08 Fix comments 
PiperOrigin-RevId: 503195768
 2023-01-19 10:08:44 -08:00
Adam Cozzette
7a7cc77a81 Internal change 
PiperOrigin-RevId: 503157344
 2023-01-19 07:20:04 -08:00
MediaPipe Team
e2dedcbfe5 Add SQRT_HANN window type to both SpectrogramCalculator and InverseSpectrogramCalculator. 
PiperOrigin-RevId: 503041493
 2023-01-18 19:42:13 -08:00
Hadon Nash
97af47ebf5 Internal change 
PiperOrigin-RevId: 503035081
 2023-01-18 18:53:42 -08:00
Hadon Nash
66634bbef8 Internal change 
PiperOrigin-RevId: 503011674
 2023-01-18 16:38:11 -08:00
MediaPipe Team
e56fa8f258 Source/SideSource -> Stream/SidePacket 
PiperOrigin-RevId: 502923931
 2023-01-18 11:02:41 -08:00
Nikolay Chirkov
5687d19dec Tensor: remove unused and unimplemented SetPreferredStorageType methods. 
PiperOrigin-RevId: 502893019
 2023-01-18 09:09:20 -08:00
Jiuqiang Tang
29484702ce Add process_timestamp_bounds into RectToRenderScaleCalculatorOptions. 
PiperOrigin-RevId: 502877541
 2023-01-18 08:02:47 -08:00
MediaPipe Team
3688757d17 Fix load_metadata_buffer for empty metadata 
PiperOrigin-RevId: 502870428
 2023-01-18 07:28:42 -08:00
Sebastian Schmidt
e484bd681e Export all input and output types 
PiperOrigin-RevId: 502764544
 2023-01-17 20:57:16 -08:00
Sebastian Schmidt
d5e60eb658 Internal change 
PiperOrigin-RevId: 502764352
 2023-01-17 20:53:34 -08:00
Camillo Lugaresi
7894c92ab7 Internal change 
PiperOrigin-RevId: 502709070
 2023-01-17 15:51:07 -08:00
Sebastian Schmidt
088249eb36 Export all input and output types 
PiperOrigin-RevId: 502649430
 2023-01-17 11:59:33 -08:00