Commit Graph

647 Commits

Author SHA1 Message Date
Prianka Liz Kariat
acba3ab26d Bug fixes in MPPImage 2023-02-13 19:41:15 +05:30
MediaPipe Team
626f92caea Move BuildInputImageTensorSpecs to utils
PiperOrigin-RevId: 508829724
2023-02-10 21:57:13 -08:00
MediaPipe Team
39a943e91e Request ModelResourcesGraphService for all Task API web graphs.
PiperOrigin-RevId: 508681004
2023-02-10 09:36:03 -08:00
MediaPipe Team
915d2c7417 Internal text task change.
PiperOrigin-RevId: 508568811
2023-02-09 22:31:14 -08:00
MediaPipe Team
1eb54bdaa6 Internal change
PiperOrigin-RevId: 508533812
2023-02-09 18:49:01 -08:00
MediaPipe Team
6ea2d579e1 Internal change
PiperOrigin-RevId: 508173086
2023-02-08 13:51:14 -08:00
Prianka Liz Kariat
0e944cb764 Merged ios-ml-image with master 2023-02-08 21:43:39 +05:30
Prianka Liz Kariat
e1ca81c352 Added objective c tests for MPPImage 2023-02-08 21:40:41 +05:30
Prianka Liz Kariat
a82ffcd97c Updated mppimage target 2023-02-08 21:40:23 +05:30
Prianka Liz Kariat
445876d96b Updated formatting 2023-02-08 21:35:15 +05:30
Copybara-Service
fd6dfcfcab Merge pull request #4066 from priankakariatyml:ios-ml-image
PiperOrigin-RevId: 507844473
2023-02-07 11:52:37 -08:00
Sebastian Schmidt
712a22101f Do not use designated initializer
PiperOrigin-RevId: 507805920
2023-02-07 09:37:46 -08:00
Prianka Liz Kariat
be829eb276 Updated name of MPPTaskImage 2023-02-07 19:17:00 +05:30
Copybara-Service
28c07430ba Merge pull request #4052 from priankakariatyml:ios-text-embedder
PiperOrigin-RevId: 507602101
2023-02-06 15:42:48 -08:00
Jiuqiang Tang
f4b0cf1cff Internal change
PiperOrigin-RevId: 507540898
2023-02-06 11:48:51 -08:00
Sebastian Schmidt
daf0a76c87 Update TensorFlow to latest
PiperOrigin-RevId: 507505016
2023-02-06 09:44:19 -08:00
Prianka Liz Kariat
a3889c946d Updated list of designated initializers 2023-02-06 16:40:36 +05:30
Prianka Liz Kariat
0e4f0fbf9b Updated file name for MPPTaskImage 2023-02-06 16:39:17 +05:30
Prianka Liz Kariat
4da91896af Updated swift name for ImageSource Type 2023-02-06 16:36:33 +05:30
Prianka Liz Kariat
a5ac5b9eec Updated type name of image source 2023-02-06 16:35:27 +05:30
Prianka Liz Kariat
cbccd472ab Added MPPTaskImage for iOS vision tasks 2023-02-06 16:29:53 +05:30
Jiuqiang Tang
8e097ea9c3 Internal changes
PiperOrigin-RevId: 507016761
2023-02-03 16:07:42 -08:00
Sebastian Schmidt
680cfcc99b Update MP Tasks to observe timestamp bounds
PiperOrigin-RevId: 507006313
2023-02-03 15:21:41 -08:00
MediaPipe Team
632a3602dd Internal text tasks change.
PiperOrigin-RevId: 506957718
2023-02-03 11:52:09 -08:00
Prianka Liz Kariat
eeaa011998 Updated documentation of iOS text embedder tests 2023-02-03 18:06:05 +05:30
Prianka Liz Kariat
e290f9cf30 Added a note about swift test coverage in iOS text embedder tests 2023-02-03 18:05:49 +05:30
Prianka Liz Kariat
3b55fb9f6a Added iOS test for quantized embedding 2023-02-03 13:42:32 +05:30
Prianka Liz Kariat
b5b10e7681 Added iOS test for different themes in text embedder 2023-02-03 13:10:13 +05:30
Prianka Liz Kariat
a512e6b5f5 Updated MPPTextEmbedder Documentation 2023-02-03 12:49:00 +05:30
Prianka Liz Kariat
6ca1efdd55 Updated MPPTextEmbedder Documentation 2023-02-03 12:48:06 +05:30
MediaPipe Team
e485961c2d fixes spelling mistake
PiperOrigin-RevId: 506697863
2023-02-02 12:49:30 -08:00
Prianka Liz Kariat
20002f191a Changed documentation 2023-02-02 18:38:19 +05:30
Prianka Liz Kariat
d625918995 Added swift tests for text embedder 2023-02-02 18:36:55 +05:30
Prianka Liz Kariat
474e994a5f Added text embedder objective c tests 2023-02-02 17:30:05 +05:30
Prianka Liz Kariat
867520af1c Added cosine similarity to MPPTextEmbedder 2023-02-02 17:29:51 +05:30
Prianka Liz Kariat
84e1c93ffb Added MPPCosineSimilarity 2023-02-02 17:22:56 +05:30
Sebastian Schmidt
286dde97ad Make TextEmbedder and TextClassifier tests pass on Windows
PiperOrigin-RevId: 506421383
2023-02-01 14:22:04 -08:00
Copybara-Service
bdd77b0d61 Merge pull request #4048 from priankakariatyml:ios-text-embedder
PiperOrigin-RevId: 506407904
2023-02-01 13:32:58 -08:00
Sebastian Schmidt
0f3cf9c56a Add "noasan" to MPPTextClassifierObjcTest
PiperOrigin-RevId: 506366650
2023-02-01 11:06:17 -08:00
Sebastian Schmidt
83e33b4dbe Internal change
PiperOrigin-RevId: 506345436
2023-02-01 09:55:19 -08:00
Prianka Liz Kariat
bd507b2d7b Updated MPPEmbeddingHelpers to reflect type change of quantized embeddings 2023-02-01 19:27:05 +05:30
Prianka Liz Kariat
cd1cb87ff6 Merge branch 'master' into ios-text-embedder 2023-02-01 19:11:01 +05:30
Prianka Liz Kariat
85c310d01c Updated formatting 2023-02-01 18:52:55 +05:30
Prianka Liz Kariat
d588f73a6d Added MPPTextEmbedder 2023-02-01 18:51:30 +05:30
Prianka Liz Kariat
38eac174e9 Added MPPTextEmbedderResultHelpers 2023-02-01 18:51:01 +05:30
Prianka Liz Kariat
42e712e911 Added MPPTextEmbedderOptionsHelpers 2023-02-01 18:50:14 +05:30
Prianka Liz Kariat
69809e2181 Updated formatting 2023-02-01 18:48:10 +05:30
Prianka Liz Kariat
ffc9f1d47e Added MPPEmbeddingResultHelpers 2023-02-01 18:47:23 +05:30
Prianka Liz Kariat
24bd104b0f Added MPPEmbedding Helpers 2023-02-01 18:46:11 +05:30
MediaPipe Team
5730dec260 Internal change
PiperOrigin-RevId: 506053206
2023-01-31 11:03:41 -08:00
Copybara-Service
0863a8a1e7 Merge pull request #4030 from priankakariatyml:ios-text-embedder
PiperOrigin-RevId: 506048365
2023-01-31 10:47:19 -08:00
Sebastian Schmidt
be3bddc620 Add Text Embedder tests for text with different themes
PiperOrigin-RevId: 506023265
2023-01-31 09:23:30 -08:00
MediaPipe Team
f9f6acffed Make NORM_RECT optional for GestureRecognizerGraph and add PALM_DETECTION output PORT
PiperOrigin-RevId: 505712542
2023-01-30 09:17:38 -08:00
Prianka Liz Kariat
8c21dc02a6 Updated to types of float and quantized embedding 2023-01-30 11:42:33 +05:30
MediaPipe Team
a6f6be9512 Fix incorrect uint8 -> int8 conversion in JS cosine similarity.
PiperOrigin-RevId: 505135368
2023-01-27 09:21:58 -08:00
Prianka Liz Kariat
8531803462 Updated documentation of embedding containers 2023-01-27 11:08:39 +05:30
Sebastian Schmidt
4d38557f11 Add MediaPipe Image Segmenter task for Web
PiperOrigin-RevId: 504912518
2023-01-26 12:31:54 -08:00
MediaPipe Team
29001234d5 Replace SourceOrNodeOutput with Source.
PiperOrigin-RevId: 504883990
2023-01-26 10:46:12 -08:00
Sebastian Schmidt
1538740dcb Formatting fix
PiperOrigin-RevId: 504599712
2023-01-25 10:33:09 -08:00
Prianka Liz Kariat
61f7739ff6 Updated documentation 2023-01-25 20:20:22 +05:30
Prianka Liz Kariat
d01f75a295 Added iOS text embedder result files 2023-01-25 20:19:57 +05:30
Prianka Liz Kariat
168ea0a9ea Added MPPTextEmbedderResult 2023-01-25 20:19:40 +05:30
Prianka Liz Kariat
60e72bf165 Added MPPTextEmbedderOptions 2023-01-25 20:19:27 +05:30
Prianka Liz Kariat
db5ee6689f Added MPPEmbeddingResult 2023-01-25 20:17:04 +05:30
Prianka Liz Kariat
7d62402768 Added MPPEmbedding 2023-01-25 20:16:54 +05:30
Sebastian Schmidt
5dc81c4c27 Remove unused import on strings.h
PiperOrigin-RevId: 504397437
2023-01-24 15:56:15 -08:00
Yuqi Li
679dbb3fd8 nit: update the metadata_schema.fbs file path.
PiperOrigin-RevId: 504380873
2023-01-24 14:46:25 -08:00
MediaPipe Team
873d7181bf Add mediapipe tasks face detector graph
PiperOrigin-RevId: 504078951
2023-01-23 14:15:21 -08:00
Sebastian Schmidt
ccd1461add Don't error in ExternalFile handler on Windows if FileContent is provided
PiperOrigin-RevId: 504069137
2023-01-23 13:38:41 -08:00
MediaPipe Team
69d354fc89 Use c++ struct as hand landmark detection results.
PiperOrigin-RevId: 504048095
2023-01-23 12:12:09 -08:00
Nikolay Chirkov
1124569c29 Tensor: Make tensor not requiring "-x objective-c++" option.
In this case tensor.h is compiled differently for C++ and Objective-C++ that violates ODR (once definition rule). Tensor has no virtual methods conditionally compiled but some Metal-related data members. Instead, unique_ptr to MtlResources that is declared as forward structure is unconditionally defined in the tensor class. MtlResources is defined differently in cc-file only that compiled just once per project so no ODR violation is here.

PiperOrigin-RevId: 504029286
2023-01-23 11:00:35 -08:00
Copybara-Service
4b9a52dc34 Merge pull request #3995 from priankakariatyml:ios-text-classifier-tests
PiperOrigin-RevId: 503242486
2023-01-19 12:59:49 -08:00
Sebastian Schmidt
a02097ea08 Fix comments
PiperOrigin-RevId: 503195768
2023-01-19 10:08:44 -08:00
MediaPipe Team
3688757d17 Fix load_metadata_buffer for empty metadata
PiperOrigin-RevId: 502870428
2023-01-18 07:28:42 -08:00
Sebastian Schmidt
e484bd681e Export all input and output types
PiperOrigin-RevId: 502764544
2023-01-17 20:57:16 -08:00
Sebastian Schmidt
d5e60eb658 Internal change
PiperOrigin-RevId: 502764352
2023-01-17 20:53:34 -08:00
Sebastian Schmidt
088249eb36 Export all input and output types
PiperOrigin-RevId: 502649430
2023-01-17 11:59:33 -08:00
Jiuqiang Tang
7a4b450c50 Resolve the error "call to 'abs' is ambiguous".
PiperOrigin-RevId: 502630518
2023-01-17 10:53:14 -08:00
Jiuqiang Tang
7974171c3d Merge classificationResultList() and classificationResult() to be classificationResults(), and similar for embeddingResults().
PiperOrigin-RevId: 502601043
2023-01-17 09:06:49 -08:00
Prianka Liz Kariat
67735a6fd3 Added category indices in iOS failure description 2023-01-16 14:01:10 +05:30
Prianka Liz Kariat
cf945d3aeb Removed unused variable 2023-01-16 13:59:51 +05:30
Prianka Liz Kariat
a0b3e620e4 Removed unused methods 2023-01-16 13:12:27 +05:30
Prianka Liz Kariat
f7fc8a6eca Updated method names in tests 2023-01-16 13:05:29 +05:30
Prianka Liz Kariat
8ecf77f760 Updated comment style in methods 2023-01-16 13:02:33 +05:30
Prianka Liz Kariat
30533be321 Reformatted comments 2023-01-16 13:00:10 +05:30
Sebastian Schmidt
aef4cca406 Copy README.md to NPM package root
PiperOrigin-RevId: 501929871
2023-01-13 13:48:02 -08:00
Sebastian Schmidt
f997c0ab1a Reject RegionOfInterest in not supported tasks
PiperOrigin-RevId: 501872455
2023-01-13 09:53:57 -08:00
Prianka Liz Kariat
95f9f0fb88 Updated formatting 2023-01-13 21:18:10 +05:30
Prianka Liz Kariat
c4c07acc1e Updated comments of MPPCommonUtils 2023-01-13 21:18:01 +05:30
Prianka Liz Kariat
2a53d78ae4 Added swift and objective tests for iOS text classifier 2023-01-13 21:05:44 +05:30
Prianka Liz Kariat
9e0b85c9b5 Added module name for iOS text classifier 2023-01-13 21:05:17 +05:30
Prianka Liz Kariat
c40356c628 Added ios.bzl 2023-01-13 21:04:56 +05:30
Prianka Liz Kariat
0a707256e3 Updates to method signatures of iOS text classifier 2023-01-13 21:04:43 +05:30
Prianka Liz Kariat
fa30100059 Changed swift name of MPPCategory 2023-01-13 21:04:17 +05:30
Prianka Liz Kariat
5642980ab0 Updated iOS error implementation to mimic java 2023-01-13 21:04:03 +05:30
Copybara-Service
4e19a5a0dc Merge pull request #3988 from priankakariatyml:ios-text-classifier-impl
PiperOrigin-RevId: 501739316
2023-01-12 20:25:02 -08:00
Jiuqiang Tang
8156da3418 ClassificationAggregationCalculator should fill in the timestamp_ms field of the classification results in the stream mode.
Per user feedback, the consistency between the packet timestamp and the timestamp field of the classification result helps reducing the confusion.

PiperOrigin-RevId: 501657922
2023-01-12 13:54:55 -08:00
Jiuqiang Tang
5c74ed2ae5 EmbeddingAggregationCalculator should fill in the timestamp_ms field of the embedding results in the stream mode.
Per user feedback, the consistency between the packet timestamp and the timestamp field of the embedding result helps reducing the confusion.

PiperOrigin-RevId: 501572379
2023-01-12 08:30:07 -08:00
Prianka Liz Kariat
c7e36f8720 Re-ordered dependencies in build file 2023-01-11 20:31:46 +05:30
Prianka Liz Kariat
fe05a8d201 Reformatted code 2023-01-11 20:24:17 +05:30
Prianka Liz Kariat
b1ded2f700 Added iOS text classifier 2023-01-11 20:22:33 +05:30
Prianka Liz Kariat
a0220de233 Added iOS text classifier result helpers 2023-01-11 20:22:20 +05:30
Prianka Liz Kariat
54161cc1ab Added iOS text classifier options helpers 2023-01-11 20:22:02 +05:30
Prianka Liz Kariat
1161ebce9d Added iOS text classifier result 2023-01-11 16:22:09 +05:30
Prianka Liz Kariat
ed6abbbe43 Added iOS text classifier options 2023-01-11 16:21:28 +05:30
Copybara-Service
e869e57cb4 Merge pull request #3975 from priankakariatyml:ios-base-options-helpers
PiperOrigin-RevId: 501073613
2023-01-10 13:07:47 -08:00
Jiuqiang Tang
25abd122b3 Support AudioRecord in MediaPipe audio tasks in Java.
PiperOrigin-RevId: 501019327
2023-01-10 09:45:40 -08:00
Copybara-Service
b747fc481b Merge pull request #3973 from priankakariatyml:ios-task-classifier-result
PiperOrigin-RevId: 501005242
2023-01-10 08:47:45 -08:00
Jiuqiang Tang
6032604f94 Hide base task api classes for MediaPipe Tasks Python from API docs
PiperOrigin-RevId: 501004802
2023-01-10 08:43:51 -08:00
Sebastian Schmidt
d7ee875356 Fix spacing issue in test name
PiperOrigin-RevId: 500833769
2023-01-09 16:20:08 -08:00
Sebastian Schmidt
0831023114 Use uppercase enum constants for RunningMode
PiperOrigin-RevId: 500760402
2023-01-09 11:11:21 -08:00
Sebastian Schmidt
73f4636292 Create README.md files to NPM packages
PiperOrigin-RevId: 500750516
2023-01-09 10:36:49 -08:00
Sebastian Schmidt
2b9299959c Internal change
PiperOrigin-RevId: 500730237
2023-01-09 09:22:02 -08:00
Sebastian Schmidt
1bbe065647 Simplify default options for GestureRecognize
PiperOrigin-RevId: 500729643
2023-01-09 09:18:08 -08:00
Sebastian Schmidt
c9ebc6fa60 Use synthetic timestamps in Web when none provided
PiperOrigin-RevId: 500327275
2023-01-06 21:41:30 -08:00
Sebastian Schmidt
ed0054836a Allow task to recover after a failed graph start
PiperOrigin-RevId: 500324587
2023-01-06 21:06:47 -08:00
Sebastian Schmidt
b4ede6db7b Fix typo in Category.java
PiperOrigin-RevId: 500324008
2023-01-06 21:02:16 -08:00
Sebastian Schmidt
9055effddd Add ImageProcessingOptions to all Vision Tasks
PiperOrigin-RevId: 500323261
2023-01-06 20:57:39 -08:00
Copybara-Service
e11ba95adf Merge pull request #3974 from priankakariatyml:ios-task-updates
PiperOrigin-RevId: 500323180
2023-01-06 20:53:33 -08:00
Sebastian Schmidt
9b34a105cf Do not depend on Image methods in TaskRunner
PiperOrigin-RevId: 500299571
2023-01-06 18:20:36 -08:00
Prianka Liz Kariat
14e3de49ad Added MPPTextTaskRunner 2023-01-06 16:37:31 +05:30
Prianka Liz Kariat
b91b485035 Added MPPBaseOptions Helpers 2023-01-06 16:36:28 +05:30
Prianka Liz Kariat
b6bcc35ade Added provision for packets callback in iOS task runner 2023-01-06 16:36:15 +05:30
Prianka Liz Kariat
c6bae99a2f Updated formatting in MPPTextPacketCreator.mm 2023-01-06 16:25:56 +05:30
Prianka Liz Kariat
bc1b069edf Updated property name in MPPTaskResult 2023-01-06 16:24:41 +05:30
Prianka Liz Kariat
16f9831c3f Updated formatting in MPPTaskOptions.m 2023-01-06 16:23:37 +05:30
Prianka Liz Kariat
61d16b284b Updated comments in MPPTaskOptions.h 2023-01-06 16:23:22 +05:30
Prianka Liz Kariat
27ce2ec00f Updated C++ types to camel case in MPPTaskInfo 2023-01-06 16:22:11 +05:30
Prianka Liz Kariat
f37689fc33 Updated documentation for MPPCommonUtils.m 2023-01-06 16:15:53 +05:30
Prianka Liz Kariat
4e38c7e623 Updated documentation for MPPCommon.h 2023-01-06 16:15:32 +05:30
Prianka Liz Kariat
8f74a175d8 Removed MPPClassifierOptions and helpers 2023-01-06 16:08:06 +05:30
Prianka Liz Kariat
89aad67a87 Added iOS helpers for classification result containers 2023-01-06 16:07:50 +05:30
Prianka Liz Kariat
33df6c042f Added iOS result containers for classification tasks 2023-01-06 16:07:11 +05:30
Sebastian Schmidt
667fd81ddc Internal change
PiperOrigin-RevId: 499956657
2023-01-05 11:43:43 -08:00
Copybara-Service
a7bb0aba8f Merge pull request #3937 from priankakariatyml:ios-task-files
PiperOrigin-RevId: 499296662
2023-01-03 13:04:55 -08:00
Sebastian Schmidt
75b87e0e32 Internal change
PiperOrigin-RevId: 499283559
2023-01-03 12:12:24 -08:00
Sebastian Schmidt
68f247a5c7 Internal change
PiperOrigin-RevId: 499282085
2023-01-03 12:05:43 -08:00
Sebastian Schmidt
987f4dc1ed Make addJsamineCustomFloatEqualityTest configurable
PiperOrigin-RevId: 499263931
2023-01-03 10:55:58 -08:00
Sebastian Schmidt
9252a025e5 Use custom gesture options in GestureRecognizer
PiperOrigin-RevId: 498567432
2022-12-30 05:01:02 -08:00
Sebastian Schmidt
9580f04571 Apply most graph options synchronously
PiperOrigin-RevId: 498244085
2022-12-28 13:58:46 -08:00
Prianka Liz Kariat
48eeae4d9d Formatted code 2022-12-22 12:16:43 +05:30
Prianka Liz Kariat
613ed58890 Inverted condition check in MPPTaskInfo 2022-12-22 12:16:33 +05:30
Prianka Liz Kariat
e47256ae55 Clearing proto before assigining new values in MPPClassifierOptions Helpers 2022-12-22 12:10:23 +05:30
Prianka Liz Kariat
e559613b9d Updated comments in MPPClassifierOptions.h 2022-12-22 02:02:48 +05:30
Prianka Liz Kariat
b4a7644428 Updated comments 2022-12-22 02:01:04 +05:30
Prianka Liz Kariat
20c3388ab6 Updated category allowlist and denylist names 2022-12-22 01:59:38 +05:30
Prianka Liz Kariat
c185dc9ad7 Renamed label to category in classifier options 2022-12-22 01:19:01 +05:30
Prianka Liz Kariat
e1dfcf03cf Updated comments in MPPClassifierOptions.h 2022-12-22 01:12:34 +05:30
Prianka Liz Kariat
66ee8d47c0 Resorted options 2022-12-22 01:10:07 +05:30
Prianka Liz Kariat
673b38dfe8 Updated comments 2022-12-22 01:08:13 +05:30