Commit Graph

1040 Commits

Author SHA1 Message Date
Jiuqiang Tang
01c6a8b49b Add volume_gain_db option into AudioToTensorCalculator.
PiperOrigin-RevId: 507748012
2023-02-07 05:14:42 -08:00
Copybara-Service
28c07430ba Merge pull request #4052 from priankakariatyml:ios-text-embedder
PiperOrigin-RevId: 507602101
2023-02-06 15:42:48 -08:00
Chris McClanahan
e2ef78433f Add more filtering methods to detection filter calculator.
PiperOrigin-RevId: 507581281
2023-02-06 14:19:40 -08:00
Jiuqiang Tang
f4b0cf1cff Internal change
PiperOrigin-RevId: 507540898
2023-02-06 11:48:51 -08:00
Sebastian Schmidt
daf0a76c87 Update TensorFlow to latest
PiperOrigin-RevId: 507505016
2023-02-06 09:44:19 -08:00
MediaPipe Team
5a77339780 Internal change
PiperOrigin-RevId: 507495569
2023-02-06 09:05:12 -08:00
Prianka Liz Kariat
a3889c946d Updated list of designated initializers 2023-02-06 16:40:36 +05:30
Prianka Liz Kariat
0e4f0fbf9b Updated file name for MPPTaskImage 2023-02-06 16:39:17 +05:30
Prianka Liz Kariat
4da91896af Updated swift name for ImageSource Type 2023-02-06 16:36:33 +05:30
Prianka Liz Kariat
a5ac5b9eec Updated type name of image source 2023-02-06 16:35:27 +05:30
Prianka Liz Kariat
cbccd472ab Added MPPTaskImage for iOS vision tasks 2023-02-06 16:29:53 +05:30
MediaPipe Team
4d8af4315f Rollback: Add PacketSharingOwnership, a safer replacement for PointToForeign.
PiperOrigin-RevId: 507288476
2023-02-05 08:59:09 -08:00
Jiuqiang Tang
8e097ea9c3 Internal changes
PiperOrigin-RevId: 507016761
2023-02-03 16:07:42 -08:00
Sebastian Schmidt
680cfcc99b Update MP Tasks to observe timestamp bounds
PiperOrigin-RevId: 507006313
2023-02-03 15:21:41 -08:00
MediaPipe Team
01834a5cdf Internal change
PiperOrigin-RevId: 506982474
2023-02-03 13:39:02 -08:00
Sebastian Schmidt
046efddf8b Add Empty Packet support to GraphRunner
PiperOrigin-RevId: 506963970
2023-02-03 12:17:00 -08:00
MediaPipe Team
632a3602dd Internal text tasks change.
PiperOrigin-RevId: 506957718
2023-02-03 11:52:09 -08:00
MediaPipe Team
386445c8dd Add ViewProvider<FrameBuffer> to YuvImage storage backend.
PiperOrigin-RevId: 506881556
2023-02-03 05:58:29 -08:00
Prianka Liz Kariat
eeaa011998 Updated documentation of iOS text embedder tests 2023-02-03 18:06:05 +05:30
Prianka Liz Kariat
e290f9cf30 Added a note about swift test coverage in iOS text embedder tests 2023-02-03 18:05:49 +05:30
Prianka Liz Kariat
3b55fb9f6a Added iOS test for quantized embedding 2023-02-03 13:42:32 +05:30
Prianka Liz Kariat
b5b10e7681 Added iOS test for different themes in text embedder 2023-02-03 13:10:13 +05:30
Prianka Liz Kariat
a512e6b5f5 Updated MPPTextEmbedder Documentation 2023-02-03 12:49:00 +05:30
Prianka Liz Kariat
6ca1efdd55 Updated MPPTextEmbedder Documentation 2023-02-03 12:48:06 +05:30
MediaPipe Team
e485961c2d fixes spelling mistake
PiperOrigin-RevId: 506697863
2023-02-02 12:49:30 -08:00
Prianka Liz Kariat
20002f191a Changed documentation 2023-02-02 18:38:19 +05:30
Prianka Liz Kariat
d625918995 Added swift tests for text embedder 2023-02-02 18:36:55 +05:30
Prianka Liz Kariat
474e994a5f Added text embedder objective c tests 2023-02-02 17:30:05 +05:30
Prianka Liz Kariat
867520af1c Added cosine similarity to MPPTextEmbedder 2023-02-02 17:29:51 +05:30
Prianka Liz Kariat
84e1c93ffb Added MPPCosineSimilarity 2023-02-02 17:22:56 +05:30
Sebastian Schmidt
286dde97ad Make TextEmbedder and TextClassifier tests pass on Windows
PiperOrigin-RevId: 506421383
2023-02-01 14:22:04 -08:00
Copybara-Service
bdd77b0d61 Merge pull request #4048 from priankakariatyml:ios-text-embedder
PiperOrigin-RevId: 506407904
2023-02-01 13:32:58 -08:00
Sebastian Schmidt
0f3cf9c56a Add "noasan" to MPPTextClassifierObjcTest
PiperOrigin-RevId: 506366650
2023-02-01 11:06:17 -08:00
Sebastian Schmidt
83e33b4dbe Internal change
PiperOrigin-RevId: 506345436
2023-02-01 09:55:19 -08:00
Juhyun Lee
0919a6c0a3 Log which InferenceCalculator impl is used at runtime.
PiperOrigin-RevId: 506343086
2023-02-01 09:45:36 -08:00
MediaPipe Team
3ee377f671 Internal change
PiperOrigin-RevId: 506312863
2023-02-01 07:42:20 -08:00
Prianka Liz Kariat
bd507b2d7b Updated MPPEmbeddingHelpers to reflect type change of quantized embeddings 2023-02-01 19:27:05 +05:30
Prianka Liz Kariat
cd1cb87ff6 Merge branch 'master' into ios-text-embedder 2023-02-01 19:11:01 +05:30
Prianka Liz Kariat
85c310d01c Updated formatting 2023-02-01 18:52:55 +05:30
Prianka Liz Kariat
d588f73a6d Added MPPTextEmbedder 2023-02-01 18:51:30 +05:30
Prianka Liz Kariat
38eac174e9 Added MPPTextEmbedderResultHelpers 2023-02-01 18:51:01 +05:30
Prianka Liz Kariat
42e712e911 Added MPPTextEmbedderOptionsHelpers 2023-02-01 18:50:14 +05:30
Prianka Liz Kariat
69809e2181 Updated formatting 2023-02-01 18:48:10 +05:30
Prianka Liz Kariat
ffc9f1d47e Added MPPEmbeddingResultHelpers 2023-02-01 18:47:23 +05:30
Prianka Liz Kariat
24bd104b0f Added MPPEmbedding Helpers 2023-02-01 18:46:11 +05:30
MediaPipe Team
d283e6a05a Support downloading model files on-demand from GCS in model_maker
PiperOrigin-RevId: 506174708
2023-01-31 18:43:35 -08:00
MediaPipe Team
b53acf6267 Internal change
PiperOrigin-RevId: 506059384
2023-01-31 11:20:13 -08:00
MediaPipe Team
5730dec260 Internal change
PiperOrigin-RevId: 506053206
2023-01-31 11:03:41 -08:00
Copybara-Service
0863a8a1e7 Merge pull request #4030 from priankakariatyml:ios-text-embedder
PiperOrigin-RevId: 506048365
2023-01-31 10:47:19 -08:00
MediaPipe Team
591eb204a6 Internal change
PiperOrigin-RevId: 506027661
2023-01-31 09:36:56 -08:00
Sebastian Schmidt
be3bddc620 Add Text Embedder tests for text with different themes
PiperOrigin-RevId: 506023265
2023-01-31 09:23:30 -08:00
MediaPipe Team
f9f6acffed Make NORM_RECT optional for GestureRecognizerGraph and add PALM_DETECTION output PORT
PiperOrigin-RevId: 505712542
2023-01-30 09:17:38 -08:00
Prianka Liz Kariat
8c21dc02a6 Updated to types of float and quantized embedding 2023-01-30 11:42:33 +05:30
MediaPipe Team
ee2f940e1f Make TensorToVectorFloatCalculator compatible with unaligned tensors.
No performance impact is expected, since the unaligned Eigen::TensorMap is used only to populate a std::vector<float>.

PiperOrigin-RevId: 505251810
2023-01-27 18:08:03 -08:00
MediaPipe Team
a6f6be9512 Fix incorrect uint8 -> int8 conversion in JS cosine similarity.
PiperOrigin-RevId: 505135368
2023-01-27 09:21:58 -08:00
MediaPipe Team
1df4511e9d Add YuvImage as a GpuBuffer storage backend.
PiperOrigin-RevId: 505128789
2023-01-27 08:51:31 -08:00
MediaPipe Team
e059d55d29 Correctly check refCount in finalize.
PiperOrigin-RevId: 505057866
2023-01-27 01:52:48 -08:00
Prianka Liz Kariat
8531803462 Updated documentation of embedding containers 2023-01-27 11:08:39 +05:30
Sebastian Schmidt
c29ab7f083 Internal change
PiperOrigin-RevId: 504928797
2023-01-26 13:36:45 -08:00
Sebastian Schmidt
4d38557f11 Add MediaPipe Image Segmenter task for Web
PiperOrigin-RevId: 504912518
2023-01-26 12:31:54 -08:00
MediaPipe Team
29001234d5 Replace SourceOrNodeOutput with Source.
PiperOrigin-RevId: 504883990
2023-01-26 10:46:12 -08:00
MediaPipe Team
2547f07c77 Add FrameBuffer format.
PiperOrigin-RevId: 504838580
2023-01-26 07:40:52 -08:00
Jiuqiang Tang
0566e0e7ca Fix the output stream tag of the end loop calculator in the example code.
PiperOrigin-RevId: 504708273
2023-01-25 17:52:55 -08:00
MediaPipe Team
be546d22fc Update test to reflect the recommended graph construction style:
First, graph inputs and their names:
  - Makes it clear what inputs graph has
  - Indirectly demands for type specification e.g. Stream<AnyType> a = graph.In(0); vs Stream<int> a = graph.In(0).Cast<int>();
Then graph nodes
  - Nodes are added and used as they needed
  - One node is not mixed in other nodes, only its outputs
  - Indirectly demands for type specification e.g. Stream<AnyType> a = node.Out(0); vs Stream<int> a = node.Out(0).Cast<int>();
Then graph outputs
  - Makes it clear what outputs graph has

The recommended structure keep C++ graph similar to pbtxt representation.

PiperOrigin-RevId: 504701023
2023-01-25 17:13:17 -08:00
Sebastian Schmidt
1538740dcb Formatting fix
PiperOrigin-RevId: 504599712
2023-01-25 10:33:09 -08:00
Prianka Liz Kariat
61f7739ff6 Updated documentation 2023-01-25 20:20:22 +05:30
Prianka Liz Kariat
d01f75a295 Added iOS text embedder result files 2023-01-25 20:19:57 +05:30
Prianka Liz Kariat
168ea0a9ea Added MPPTextEmbedderResult 2023-01-25 20:19:40 +05:30
Prianka Liz Kariat
60e72bf165 Added MPPTextEmbedderOptions 2023-01-25 20:19:27 +05:30
Prianka Liz Kariat
db5ee6689f Added MPPEmbeddingResult 2023-01-25 20:17:04 +05:30
Prianka Liz Kariat
7d62402768 Added MPPEmbedding 2023-01-25 20:16:54 +05:30
MediaPipe Team
afb0182935 Internal model maker change.
PiperOrigin-RevId: 504472342
2023-01-24 23:16:21 -08:00
Sebastian Schmidt
5dc81c4c27 Remove unused import on strings.h
PiperOrigin-RevId: 504397437
2023-01-24 15:56:15 -08:00
Yuqi Li
679dbb3fd8 nit: update the metadata_schema.fbs file path.
PiperOrigin-RevId: 504380873
2023-01-24 14:46:25 -08:00
Sebastian Schmidt
ce9fec806c Internal change
PiperOrigin-RevId: 504341886
2023-01-24 12:18:15 -08:00
Mike Kruskal
9cde57d830 Internal change
PiperOrigin-RevId: 504341832
2023-01-24 12:14:02 -08:00
MediaPipe Team
4e135ccdb9 Internal Model Maker change.
PiperOrigin-RevId: 504315641
2023-01-24 10:38:25 -08:00
MediaPipe Team
2465e47b01 Stream/SidePacket == and != operators
PiperOrigin-RevId: 504114182
2023-01-23 16:43:23 -08:00
MediaPipe Team
873d7181bf Add mediapipe tasks face detector graph
PiperOrigin-RevId: 504078951
2023-01-23 14:15:21 -08:00
Sebastian Schmidt
ccd1461add Don't error in ExternalFile handler on Windows if FileContent is provided
PiperOrigin-RevId: 504069137
2023-01-23 13:38:41 -08:00
MediaPipe Team
69d354fc89 Use c++ struct as hand landmark detection results.
PiperOrigin-RevId: 504048095
2023-01-23 12:12:09 -08:00
Nikolay Chirkov
1124569c29 Tensor: Make tensor not requiring "-x objective-c++" option.
In this case tensor.h is compiled differently for C++ and Objective-C++ that violates ODR (once definition rule). Tensor has no virtual methods conditionally compiled but some Metal-related data members. Instead, unique_ptr to MtlResources that is declared as forward structure is unconditionally defined in the tensor class. MtlResources is defined differently in cc-file only that compiled just once per project so no ODR violation is here.

PiperOrigin-RevId: 504029286
2023-01-23 11:00:35 -08:00
MediaPipe Team
921b6a6bef This CL will fix the typo from _PALM_LANMARKS to _PALM_LANDMARKS.
PiperOrigin-RevId: 503352055
2023-01-19 22:14:16 -08:00
Copybara-Service
4b9a52dc34 Merge pull request #3995 from priankakariatyml:ios-text-classifier-tests
PiperOrigin-RevId: 503242486
2023-01-19 12:59:49 -08:00
Sebastian Schmidt
db1a89324e Add mediapipe::Image output to the graph runner
PiperOrigin-RevId: 503204918
2023-01-19 10:41:13 -08:00
Sebastian Schmidt
a02097ea08 Fix comments
PiperOrigin-RevId: 503195768
2023-01-19 10:08:44 -08:00
Adam Cozzette
7a7cc77a81 Internal change
PiperOrigin-RevId: 503157344
2023-01-19 07:20:04 -08:00
MediaPipe Team
e2dedcbfe5 Add SQRT_HANN window type to both SpectrogramCalculator and InverseSpectrogramCalculator.
PiperOrigin-RevId: 503041493
2023-01-18 19:42:13 -08:00
Hadon Nash
97af47ebf5 Internal change
PiperOrigin-RevId: 503035081
2023-01-18 18:53:42 -08:00
Hadon Nash
66634bbef8 Internal change
PiperOrigin-RevId: 503011674
2023-01-18 16:38:11 -08:00
MediaPipe Team
e56fa8f258 Source/SideSource -> Stream/SidePacket
PiperOrigin-RevId: 502923931
2023-01-18 11:02:41 -08:00
Nikolay Chirkov
5687d19dec Tensor: remove unused and unimplemented SetPreferredStorageType methods.
PiperOrigin-RevId: 502893019
2023-01-18 09:09:20 -08:00
Jiuqiang Tang
29484702ce Add process_timestamp_bounds into RectToRenderScaleCalculatorOptions.
PiperOrigin-RevId: 502877541
2023-01-18 08:02:47 -08:00
MediaPipe Team
3688757d17 Fix load_metadata_buffer for empty metadata
PiperOrigin-RevId: 502870428
2023-01-18 07:28:42 -08:00
Sebastian Schmidt
e484bd681e Export all input and output types
PiperOrigin-RevId: 502764544
2023-01-17 20:57:16 -08:00
Sebastian Schmidt
d5e60eb658 Internal change
PiperOrigin-RevId: 502764352
2023-01-17 20:53:34 -08:00
Camillo Lugaresi
7894c92ab7 Internal change
PiperOrigin-RevId: 502709070
2023-01-17 15:51:07 -08:00
Sebastian Schmidt
088249eb36 Export all input and output types
PiperOrigin-RevId: 502649430
2023-01-17 11:59:33 -08:00
Jiuqiang Tang
7a4b450c50 Resolve the error "call to 'abs' is ambiguous".
PiperOrigin-RevId: 502630518
2023-01-17 10:53:14 -08:00
Jiuqiang Tang
7974171c3d Merge classificationResultList() and classificationResult() to be classificationResults(), and similar for embeddingResults().
PiperOrigin-RevId: 502601043
2023-01-17 09:06:49 -08:00