cassdlcm/mediapipe
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,146 Commits 10 Branches 56 Tags 829 MiB
1f848c4d69
Commit Graph

1001 Commits

Author SHA1 Message Date
Prianka Liz Kariat
d588f73a6d Added MPPTextEmbedder 2023-02-01 18:51:30 +05:30
Prianka Liz Kariat
38eac174e9 Added MPPTextEmbedderResultHelpers 2023-02-01 18:51:01 +05:30
Prianka Liz Kariat
42e712e911 Added MPPTextEmbedderOptionsHelpers 2023-02-01 18:50:14 +05:30
Prianka Liz Kariat
69809e2181 Updated formatting 2023-02-01 18:48:10 +05:30
Prianka Liz Kariat
ffc9f1d47e Added MPPEmbeddingResultHelpers 2023-02-01 18:47:23 +05:30
Prianka Liz Kariat
24bd104b0f Added MPPEmbedding Helpers 2023-02-01 18:46:11 +05:30
MediaPipe Team
d283e6a05a Support downloading model files on-demand from GCS in model_maker 
PiperOrigin-RevId: 506174708
 2023-01-31 18:43:35 -08:00
MediaPipe Team
b53acf6267 Internal change 
PiperOrigin-RevId: 506059384
 2023-01-31 11:20:13 -08:00
MediaPipe Team
5730dec260 Internal change 
PiperOrigin-RevId: 506053206
 2023-01-31 11:03:41 -08:00
Copybara-Service
0863a8a1e7 Merge pull request #4030 from priankakariatyml:ios-text-embedder 
PiperOrigin-RevId: 506048365
 2023-01-31 10:47:19 -08:00
MediaPipe Team
591eb204a6 Internal change 
PiperOrigin-RevId: 506027661
 2023-01-31 09:36:56 -08:00
Sebastian Schmidt
be3bddc620 Add Text Embedder tests for text with different themes 
PiperOrigin-RevId: 506023265
 2023-01-31 09:23:30 -08:00
MediaPipe Team
f9f6acffed Make NORM_RECT optional for GestureRecognizerGraph and add PALM_DETECTION output PORT 
PiperOrigin-RevId: 505712542
 2023-01-30 09:17:38 -08:00
Prianka Liz Kariat
8c21dc02a6 Updated to types of float and quantized embedding 2023-01-30 11:42:33 +05:30
MediaPipe Team
ee2f940e1f Make TensorToVectorFloatCalculator compatible with unaligned tensors. 
No performance impact is expected, since the unaligned Eigen::TensorMap is used only to populate a std::vector<float>.

PiperOrigin-RevId: 505251810
 2023-01-27 18:08:03 -08:00
MediaPipe Team
a6f6be9512 Fix incorrect uint8 -> int8 conversion in JS cosine similarity. 
PiperOrigin-RevId: 505135368
 2023-01-27 09:21:58 -08:00
MediaPipe Team
1df4511e9d Add YuvImage as a GpuBuffer storage backend. 
PiperOrigin-RevId: 505128789
 2023-01-27 08:51:31 -08:00
MediaPipe Team
e059d55d29 Correctly check refCount in finalize. 
PiperOrigin-RevId: 505057866
 2023-01-27 01:52:48 -08:00
Prianka Liz Kariat
8531803462 Updated documentation of embedding containers 2023-01-27 11:08:39 +05:30
Sebastian Schmidt
c29ab7f083 Internal change 
PiperOrigin-RevId: 504928797
 2023-01-26 13:36:45 -08:00
Sebastian Schmidt
4d38557f11 Add MediaPipe Image Segmenter task for Web 
PiperOrigin-RevId: 504912518
 2023-01-26 12:31:54 -08:00
MediaPipe Team
29001234d5 Replace SourceOrNodeOutput with Source. 
PiperOrigin-RevId: 504883990
 2023-01-26 10:46:12 -08:00
MediaPipe Team
2547f07c77 Add FrameBuffer format. 
PiperOrigin-RevId: 504838580
 2023-01-26 07:40:52 -08:00
Jiuqiang Tang
0566e0e7ca Fix the output stream tag of the end loop calculator in the example code. 
PiperOrigin-RevId: 504708273
 2023-01-25 17:52:55 -08:00
MediaPipe Team
be546d22fc Update test to reflect the recommended graph construction style: 
First, graph inputs and their names:
  - Makes it clear what inputs graph has
  - Indirectly demands for type specification e.g. Stream<AnyType> a = graph.In(0); vs Stream<int> a = graph.In(0).Cast<int>();
Then graph nodes
  - Nodes are added and used as they needed
  - One node is not mixed in other nodes, only its outputs
  - Indirectly demands for type specification e.g. Stream<AnyType> a = node.Out(0); vs Stream<int> a = node.Out(0).Cast<int>();
Then graph outputs
  - Makes it clear what outputs graph has

The recommended structure keep C++ graph similar to pbtxt representation.

PiperOrigin-RevId: 504701023
 2023-01-25 17:13:17 -08:00
Sebastian Schmidt
1538740dcb Formatting fix 
PiperOrigin-RevId: 504599712
 2023-01-25 10:33:09 -08:00
Prianka Liz Kariat
61f7739ff6 Updated documentation 2023-01-25 20:20:22 +05:30
Prianka Liz Kariat
d01f75a295 Added iOS text embedder result files 2023-01-25 20:19:57 +05:30
Prianka Liz Kariat
168ea0a9ea Added MPPTextEmbedderResult 2023-01-25 20:19:40 +05:30
Prianka Liz Kariat
60e72bf165 Added MPPTextEmbedderOptions 2023-01-25 20:19:27 +05:30
Prianka Liz Kariat
db5ee6689f Added MPPEmbeddingResult 2023-01-25 20:17:04 +05:30
Prianka Liz Kariat
7d62402768 Added MPPEmbedding 2023-01-25 20:16:54 +05:30
MediaPipe Team
afb0182935 Internal model maker change. 
PiperOrigin-RevId: 504472342
 2023-01-24 23:16:21 -08:00
Sebastian Schmidt
5dc81c4c27 Remove unused import on strings.h 
PiperOrigin-RevId: 504397437
 2023-01-24 15:56:15 -08:00
Yuqi Li
679dbb3fd8 nit: update the metadata_schema.fbs file path. 
PiperOrigin-RevId: 504380873
 2023-01-24 14:46:25 -08:00
Sebastian Schmidt
ce9fec806c Internal change 
PiperOrigin-RevId: 504341886
 2023-01-24 12:18:15 -08:00
Mike Kruskal
9cde57d830 Internal change 
PiperOrigin-RevId: 504341832
 2023-01-24 12:14:02 -08:00
MediaPipe Team
4e135ccdb9 Internal Model Maker change. 
PiperOrigin-RevId: 504315641
 2023-01-24 10:38:25 -08:00
MediaPipe Team
2465e47b01 Stream/SidePacket == and != operators 
PiperOrigin-RevId: 504114182
 2023-01-23 16:43:23 -08:00
MediaPipe Team
873d7181bf Add mediapipe tasks face detector graph 
PiperOrigin-RevId: 504078951
 2023-01-23 14:15:21 -08:00
Sebastian Schmidt
ccd1461add Don't error in ExternalFile handler on Windows if FileContent is provided 
PiperOrigin-RevId: 504069137
 2023-01-23 13:38:41 -08:00
MediaPipe Team
69d354fc89 Use c++ struct as hand landmark detection results. 
PiperOrigin-RevId: 504048095
 2023-01-23 12:12:09 -08:00
Nikolay Chirkov
1124569c29 Tensor: Make tensor not requiring "-x objective-c++" option. 
In this case tensor.h is compiled differently for C++ and Objective-C++ that violates ODR (once definition rule). Tensor has no virtual methods conditionally compiled but some Metal-related data members. Instead, unique_ptr to MtlResources that is declared as forward structure is unconditionally defined in the tensor class. MtlResources is defined differently in cc-file only that compiled just once per project so no ODR violation is here.

PiperOrigin-RevId: 504029286
 2023-01-23 11:00:35 -08:00
MediaPipe Team
921b6a6bef This CL will fix the typo from _PALM_LANMARKS to _PALM_LANDMARKS. 
PiperOrigin-RevId: 503352055
 2023-01-19 22:14:16 -08:00
Copybara-Service
4b9a52dc34 Merge pull request #3995 from priankakariatyml:ios-text-classifier-tests 
PiperOrigin-RevId: 503242486
 2023-01-19 12:59:49 -08:00
Sebastian Schmidt
db1a89324e Add mediapipe::Image output to the graph runner 
PiperOrigin-RevId: 503204918
 2023-01-19 10:41:13 -08:00
Sebastian Schmidt
a02097ea08 Fix comments 
PiperOrigin-RevId: 503195768
 2023-01-19 10:08:44 -08:00
Adam Cozzette
7a7cc77a81 Internal change 
PiperOrigin-RevId: 503157344
 2023-01-19 07:20:04 -08:00
MediaPipe Team
e2dedcbfe5 Add SQRT_HANN window type to both SpectrogramCalculator and InverseSpectrogramCalculator. 
PiperOrigin-RevId: 503041493
 2023-01-18 19:42:13 -08:00
Hadon Nash
97af47ebf5 Internal change 
PiperOrigin-RevId: 503035081
 2023-01-18 18:53:42 -08:00
Hadon Nash
66634bbef8 Internal change 
PiperOrigin-RevId: 503011674
 2023-01-18 16:38:11 -08:00
MediaPipe Team
e56fa8f258 Source/SideSource -> Stream/SidePacket 
PiperOrigin-RevId: 502923931
 2023-01-18 11:02:41 -08:00
Nikolay Chirkov
5687d19dec Tensor: remove unused and unimplemented SetPreferredStorageType methods. 
PiperOrigin-RevId: 502893019
 2023-01-18 09:09:20 -08:00
Jiuqiang Tang
29484702ce Add process_timestamp_bounds into RectToRenderScaleCalculatorOptions. 
PiperOrigin-RevId: 502877541
 2023-01-18 08:02:47 -08:00
MediaPipe Team
3688757d17 Fix load_metadata_buffer for empty metadata 
PiperOrigin-RevId: 502870428
 2023-01-18 07:28:42 -08:00
Sebastian Schmidt
e484bd681e Export all input and output types 
PiperOrigin-RevId: 502764544
 2023-01-17 20:57:16 -08:00
Sebastian Schmidt
d5e60eb658 Internal change 
PiperOrigin-RevId: 502764352
 2023-01-17 20:53:34 -08:00
Camillo Lugaresi
7894c92ab7 Internal change 
PiperOrigin-RevId: 502709070
 2023-01-17 15:51:07 -08:00
Sebastian Schmidt
088249eb36 Export all input and output types 
PiperOrigin-RevId: 502649430
 2023-01-17 11:59:33 -08:00
Jiuqiang Tang
7a4b450c50 Resolve the error "call to 'abs' is ambiguous". 
PiperOrigin-RevId: 502630518
 2023-01-17 10:53:14 -08:00
Jiuqiang Tang
7974171c3d Merge classificationResultList() and classificationResult() to be classificationResults(), and similar for embeddingResults(). 
PiperOrigin-RevId: 502601043
 2023-01-17 09:06:49 -08:00
Camillo Lugaresi
c1f5920ecf Add web performance tracing to the MEDIAPIPE_PROFILING repertoire 
This records the MEDIAPIPE_PROFILING tracing annotations to the browser's trace using the user timing API. See https://developer.mozilla.org/en-US/docs/Web/API/User_Timing_API

To enable, build with --define MEDIAPIPE_WEB_PROFILING=1 --define DRISHTI_PROFILING=1

PiperOrigin-RevId: 502422030
 2023-01-16 12:59:18 -08:00
MediaPipe Team
ffd8486d0d Add a stub WriteProfile method to GraphProfilerStub. 
PiperOrigin-RevId: 502388455
 2023-01-16 08:38:05 -08:00
Prianka Liz Kariat
67735a6fd3 Added category indices in iOS failure description 2023-01-16 14:01:10 +05:30
Prianka Liz Kariat
cf945d3aeb Removed unused variable 2023-01-16 13:59:51 +05:30
Prianka Liz Kariat
a0b3e620e4 Removed unused methods 2023-01-16 13:12:27 +05:30
Prianka Liz Kariat
f7fc8a6eca Updated method names in tests 2023-01-16 13:05:29 +05:30
Prianka Liz Kariat
8ecf77f760 Updated comment style in methods 2023-01-16 13:02:33 +05:30
Prianka Liz Kariat
30533be321 Reformatted comments 2023-01-16 13:00:10 +05:30
MediaPipe Team
92a2e02ace Internal change 
PiperOrigin-RevId: 501971410
 2023-01-13 17:05:19 -08:00
Sebastian Schmidt
aef4cca406 Copy README.md to NPM package root 
PiperOrigin-RevId: 501929871
 2023-01-13 13:48:02 -08:00
Sebastian Schmidt
f997c0ab1a Reject RegionOfInterest in not supported tasks 
PiperOrigin-RevId: 501872455
 2023-01-13 09:53:57 -08:00
MediaPipe Team
69757d7924 Internal change 
PiperOrigin-RevId: 501862194
 2023-01-13 09:05:48 -08:00
Prianka Liz Kariat
95f9f0fb88 Updated formatting 2023-01-13 21:18:10 +05:30
Prianka Liz Kariat
c4c07acc1e Updated comments of MPPCommonUtils 2023-01-13 21:18:01 +05:30
Prianka Liz Kariat
2a53d78ae4 Added swift and objective tests for iOS text classifier 2023-01-13 21:05:44 +05:30
Prianka Liz Kariat
9e0b85c9b5 Added module name for iOS text classifier 2023-01-13 21:05:17 +05:30
Prianka Liz Kariat
c40356c628 Added ios.bzl 2023-01-13 21:04:56 +05:30
Prianka Liz Kariat
0a707256e3 Updates to method signatures of iOS text classifier 2023-01-13 21:04:43 +05:30
Prianka Liz Kariat
fa30100059 Changed swift name of MPPCategory 2023-01-13 21:04:17 +05:30
Prianka Liz Kariat
5642980ab0 Updated iOS error implementation to mimic java 2023-01-13 21:04:03 +05:30
Copybara-Service
4e19a5a0dc Merge pull request #3988 from priankakariatyml:ios-text-classifier-impl 
PiperOrigin-RevId: 501739316
 2023-01-12 20:25:02 -08:00
Jiuqiang Tang
8156da3418 ClassificationAggregationCalculator should fill in the timestamp_ms field of the classification results in the stream mode. 
Per user feedback, the consistency between the packet timestamp and the timestamp field of the classification result helps reducing the confusion.

PiperOrigin-RevId: 501657922
 2023-01-12 13:54:55 -08:00
MediaPipe Team
1683d572ed Internal change 
PiperOrigin-RevId: 501600938
 2023-01-12 10:22:00 -08:00
MediaPipe Team
74b60780c7 Internal change 
PiperOrigin-RevId: 501594400
 2023-01-12 10:00:44 -08:00
Jiuqiang Tang
5c74ed2ae5 EmbeddingAggregationCalculator should fill in the timestamp_ms field of the embedding results in the stream mode. 
Per user feedback, the consistency between the packet timestamp and the timestamp field of the embedding result helps reducing the confusion.

PiperOrigin-RevId: 501572379
 2023-01-12 08:30:07 -08:00
MediaPipe Team
9cbb76939d Adds smaller MobileBERT model. 
PiperOrigin-RevId: 501451414
 2023-01-11 20:35:39 -08:00
Nikolay Chirkov
8830eefa0b Internal change. 
PiperOrigin-RevId: 501403332
 2023-01-11 16:07:22 -08:00
MediaPipe Team
36be94f861 Internal change 
PiperOrigin-RevId: 501378130
 2023-01-11 14:24:00 -08:00
MediaPipe Team
5612af68cd Propagate compatible_with for drishti_proto_library 
PiperOrigin-RevId: 501356895
 2023-01-11 13:01:57 -08:00
MediaPipe Team
0e56bd38f3 Fix for CHECK failure due to pointer description sometimes being larger than allocated string space 
PiperOrigin-RevId: 501355568
 2023-01-11 12:58:37 -08:00
Prianka Liz Kariat
c7e36f8720 Re-ordered dependencies in build file 2023-01-11 20:31:46 +05:30
Prianka Liz Kariat
fe05a8d201 Reformatted code 2023-01-11 20:24:17 +05:30
Prianka Liz Kariat
b1ded2f700 Added iOS text classifier 2023-01-11 20:22:33 +05:30
Prianka Liz Kariat
a0220de233 Added iOS text classifier result helpers 2023-01-11 20:22:20 +05:30
Prianka Liz Kariat
54161cc1ab Added iOS text classifier options helpers 2023-01-11 20:22:02 +05:30
Prianka Liz Kariat
1161ebce9d Added iOS text classifier result 2023-01-11 16:22:09 +05:30
Prianka Liz Kariat
ed6abbbe43 Added iOS text classifier options 2023-01-11 16:21:28 +05:30
Nikolay Chirkov
54268594dd Internal change. 
PiperOrigin-RevId: 501136760
 2023-01-10 17:38:13 -08:00
Copybara-Service
e869e57cb4 Merge pull request #3975 from priankakariatyml:ios-base-options-helpers 
PiperOrigin-RevId: 501073613
 2023-01-10 13:07:47 -08:00