Commit Graph

213 Commits

Author SHA1 Message Date
Yuqi Li
46b5c4012d add custom metadata in metadata_schema.
PiperOrigin-RevId: 514768756
2023-03-07 10:15:09 -08:00
Jiuqiang Tang
dbd6d72696 Add GetInputImageTensorSpecs into BaseVisionTaskApi for tasks api users to get input image tensor specifications.
PiperOrigin-RevId: 514650593
2023-03-07 00:44:07 -08:00
MediaPipe Team
e4ac1a10c2 TensorsToSegmentation web postprocessing on GPU: softmax activation
PiperOrigin-RevId: 514589911
2023-03-06 19:08:53 -08:00
MediaPipe Team
bd9a2ee1fc Internal change
PiperOrigin-RevId: 514580892
2023-03-06 18:13:50 -08:00
MediaPipe Team
f15244997f Internal change
PiperOrigin-RevId: 514498364
2023-03-06 12:58:01 -08:00
MediaPipe Team
763842289a Add FaceLandmarkerResult for FaceLandmarker API
PiperOrigin-RevId: 514137566
2023-03-06 07:31:30 -08:00
MediaPipe Team
cd14d2e688 Internal MediaPipe Tasks change.
PiperOrigin-RevId: 514002859
2023-03-06 07:29:55 -08:00
Yuqi Li
dbe4175a08 Internal change
PiperOrigin-RevId: 514001732
2023-03-06 07:28:20 -08:00
MediaPipe Team
3d41eabc2e Face Detector C++ API
PiperOrigin-RevId: 513959349
2023-03-06 07:17:46 -08:00
MediaPipe Team
2963739086 Internal MediaPipe Tasks change.
PiperOrigin-RevId: 513897822
2023-03-06 07:12:37 -08:00
Sebastian Schmidt
13db1c55d3 Make Bert/RegexTokenizerTest pass on Windows
PiperOrigin-RevId: 513887535
2023-03-06 07:04:30 -08:00
MediaPipe Team
b7ec83efb5 Add optional face blendshapes to face landmarks detector graph.
PiperOrigin-RevId: 513867488
2023-03-03 10:48:55 -08:00
MediaPipe Team
91d53cd181 Make image preprocessing support RGBA image.
PiperOrigin-RevId: 513680594
2023-03-02 17:13:19 -08:00
Sebastian Schmidt
7664e0ef64 Make SentencePieceTokenizerTest work on Windows
PiperOrigin-RevId: 513638600
2023-03-02 14:23:22 -08:00
MediaPipe Team
dd4301802a migrate env_generator_calculator
PiperOrigin-RevId: 513585830
2023-03-02 11:05:02 -08:00
MediaPipe Team
6796977a04 migrate geometry_pipeline_calculator
PiperOrigin-RevId: 513368520
2023-03-01 16:09:48 -08:00
Sebastian Schmidt
f15637b62c Make Metadata tests pass on Windows
PiperOrigin-RevId: 513365428
2023-03-01 15:59:43 -08:00
Sebastian Schmidt
abfcd8ec1d Make LoadBinaryContent work on Windows
PiperOrigin-RevId: 513330348
2023-03-01 13:49:02 -08:00
MediaPipe Team
22fce9e136 migrate mediapipe/modules/face_geometry to mediapipe/tasks
PiperOrigin-RevId: 513284254
2023-03-01 10:59:56 -08:00
Sebastian Schmidt
4a1ba11e3f Do not use designated initializers
PiperOrigin-RevId: 513028900
2023-02-28 13:52:36 -08:00
Jiuqiang Tang
646ab8505a Small fixes to TensorsToImageCalculator.
PiperOrigin-RevId: 512967357
2023-02-28 10:11:42 -08:00
Sebastian Schmidt
1dca871d09 Remove designated initializer use from CombinedPredictionCalculatorTestCase
PiperOrigin-RevId: 512747781
2023-02-27 15:28:34 -08:00
Sebastian Schmidt
1d927c5971 Internal change
PiperOrigin-RevId: 512709627
2023-02-27 13:08:04 -08:00
Jiuqiang Tang
aa61abe386 Implement TensorsToImageCalculator.
PiperOrigin-RevId: 512687103
2023-02-27 11:46:07 -08:00
Sebastian Schmidt
9f59d4d01b Remove cosineSimilarity() from AudioEmbedder
PiperOrigin-RevId: 512671255
2023-02-27 11:13:20 -08:00
MediaPipe Team
17466fb7f1 Internal change
PiperOrigin-RevId: 512111461
2023-02-27 11:10:19 -08:00
MediaPipe Team
75d799d2b9 Add Copyright head
PiperOrigin-RevId: 511694458
2023-02-22 22:47:02 -08:00
MediaPipe Team
ff10f3c814 Move NormalizedKeypoint to a separate header
PiperOrigin-RevId: 511642586
2023-02-22 17:42:06 -08:00
MediaPipe Team
2c3c1e664a add TensorsToFaceLandmarksGraph to support two types of face mesh models.
PiperOrigin-RevId: 511626032
2023-02-22 16:22:13 -08:00
MediaPipe Team
000aeeb036 Update face detector graph for downstream face landmarks graph.
PiperOrigin-RevId: 511566984
2023-02-22 12:31:57 -08:00
MediaPipe Team
fbbc13d756 update detection result to include optional keypoints.
PiperOrigin-RevId: 511538880
2023-02-22 10:50:58 -08:00
MediaPipe Team
e2ac704428 internal change
PiperOrigin-RevId: 511338483
2023-02-21 16:40:37 -08:00
MediaPipe Team
ba10ae8410 Add mediapipe tasks face blendshapes graph
PiperOrigin-RevId: 509995915
2023-02-15 19:26:56 -08:00
MediaPipe Team
5f2261ff59 face landmarks detector graph
PiperOrigin-RevId: 509630430
2023-02-14 14:00:37 -08:00
MediaPipe Team
626f92caea Move BuildInputImageTensorSpecs to utils
PiperOrigin-RevId: 508829724
2023-02-10 21:57:13 -08:00
MediaPipe Team
915d2c7417 Internal text task change.
PiperOrigin-RevId: 508568811
2023-02-09 22:31:14 -08:00
MediaPipe Team
1eb54bdaa6 Internal change
PiperOrigin-RevId: 508533812
2023-02-09 18:49:01 -08:00
MediaPipe Team
6ea2d579e1 Internal change
PiperOrigin-RevId: 508173086
2023-02-08 13:51:14 -08:00
Sebastian Schmidt
712a22101f Do not use designated initializer
PiperOrigin-RevId: 507805920
2023-02-07 09:37:46 -08:00
Sebastian Schmidt
daf0a76c87 Update TensorFlow to latest
PiperOrigin-RevId: 507505016
2023-02-06 09:44:19 -08:00
MediaPipe Team
632a3602dd Internal text tasks change.
PiperOrigin-RevId: 506957718
2023-02-03 11:52:09 -08:00
MediaPipe Team
e485961c2d fixes spelling mistake
PiperOrigin-RevId: 506697863
2023-02-02 12:49:30 -08:00
Sebastian Schmidt
286dde97ad Make TextEmbedder and TextClassifier tests pass on Windows
PiperOrigin-RevId: 506421383
2023-02-01 14:22:04 -08:00
Sebastian Schmidt
83e33b4dbe Internal change
PiperOrigin-RevId: 506345436
2023-02-01 09:55:19 -08:00
MediaPipe Team
5730dec260 Internal change
PiperOrigin-RevId: 506053206
2023-01-31 11:03:41 -08:00
Sebastian Schmidt
be3bddc620 Add Text Embedder tests for text with different themes
PiperOrigin-RevId: 506023265
2023-01-31 09:23:30 -08:00
MediaPipe Team
f9f6acffed Make NORM_RECT optional for GestureRecognizerGraph and add PALM_DETECTION output PORT
PiperOrigin-RevId: 505712542
2023-01-30 09:17:38 -08:00
MediaPipe Team
29001234d5 Replace SourceOrNodeOutput with Source.
PiperOrigin-RevId: 504883990
2023-01-26 10:46:12 -08:00
Sebastian Schmidt
5dc81c4c27 Remove unused import on strings.h
PiperOrigin-RevId: 504397437
2023-01-24 15:56:15 -08:00
MediaPipe Team
873d7181bf Add mediapipe tasks face detector graph
PiperOrigin-RevId: 504078951
2023-01-23 14:15:21 -08:00
Sebastian Schmidt
ccd1461add Don't error in ExternalFile handler on Windows if FileContent is provided
PiperOrigin-RevId: 504069137
2023-01-23 13:38:41 -08:00
MediaPipe Team
69d354fc89 Use c++ struct as hand landmark detection results.
PiperOrigin-RevId: 504048095
2023-01-23 12:12:09 -08:00
Nikolay Chirkov
1124569c29 Tensor: Make tensor not requiring "-x objective-c++" option.
In this case tensor.h is compiled differently for C++ and Objective-C++ that violates ODR (once definition rule). Tensor has no virtual methods conditionally compiled but some Metal-related data members. Instead, unique_ptr to MtlResources that is declared as forward structure is unconditionally defined in the tensor class. MtlResources is defined differently in cc-file only that compiled just once per project so no ODR violation is here.

PiperOrigin-RevId: 504029286
2023-01-23 11:00:35 -08:00
Jiuqiang Tang
7a4b450c50 Resolve the error "call to 'abs' is ambiguous".
PiperOrigin-RevId: 502630518
2023-01-17 10:53:14 -08:00
Copybara-Service
4e19a5a0dc Merge pull request #3988 from priankakariatyml:ios-text-classifier-impl
PiperOrigin-RevId: 501739316
2023-01-12 20:25:02 -08:00
Jiuqiang Tang
8156da3418 ClassificationAggregationCalculator should fill in the timestamp_ms field of the classification results in the stream mode.
Per user feedback, the consistency between the packet timestamp and the timestamp field of the classification result helps reducing the confusion.

PiperOrigin-RevId: 501657922
2023-01-12 13:54:55 -08:00
Jiuqiang Tang
5c74ed2ae5 EmbeddingAggregationCalculator should fill in the timestamp_ms field of the embedding results in the stream mode.
Per user feedback, the consistency between the packet timestamp and the timestamp field of the embedding result helps reducing the confusion.

PiperOrigin-RevId: 501572379
2023-01-12 08:30:07 -08:00
Sebastian Schmidt
9055effddd Add ImageProcessingOptions to all Vision Tasks
PiperOrigin-RevId: 500323261
2023-01-06 20:57:39 -08:00
Sebastian Schmidt
9252a025e5 Use custom gesture options in GestureRecognizer
PiperOrigin-RevId: 498567432
2022-12-30 05:01:02 -08:00
Sebastian Schmidt
fb21797611 Internal change
PiperOrigin-RevId: 494914168
2022-12-12 21:30:31 -08:00
Sebastian Schmidt
9ae2e43b70 Open Source the remaining MediaPipe Tasks tests for Web
PiperOrigin-RevId: 493769657
2022-12-07 19:19:27 -08:00
MediaPipe Team
700c7b4b22 Internal refactoring for TextEmbedder.
PiperOrigin-RevId: 493766612
2022-12-07 18:56:27 -08:00
MediaPipe Team
a0efcb47f2 internal change
PiperOrigin-RevId: 493742399
2022-12-07 16:38:42 -08:00
MediaPipe Team
a59f0a9924 Make java/C++/python tasks API public visible.
PiperOrigin-RevId: 493730506
2022-12-07 15:51:04 -08:00
MediaPipe Team
91664eb254 Object Detector deduplication
PiperOrigin-RevId: 493716159
2022-12-07 14:54:30 -08:00
Jiuqiang Tang
ef1507ed5d Retire the visibility group "//mediapipe/framework:mediapipe_internal".
PiperOrigin-RevId: 493713823
2022-12-07 14:45:49 -08:00
Jiuqiang Tang
3c0ddf16b4 Fix an incorrect model sanity check in the object detector graph.
PiperOrigin-RevId: 493663592
2022-12-07 11:38:54 -08:00
Jiuqiang Tang
6deef1a5f1 Allow specifying tag_suffix in the templated CreateModelResources method.
PiperOrigin-RevId: 493375701
2022-12-06 12:10:06 -08:00
MediaPipe Team
af43687f2e Open-sources a unit test.
PiperOrigin-RevId: 493184055
2022-12-05 20:11:07 -08:00
MediaPipe Team
3174b20fbe Move segmentation calculator and options out of 'components' folder.
PiperOrigin-RevId: 493157929
2022-12-05 17:37:49 -08:00
Jiuqiang Tang
1e76d47a71 Checks if a custom global resource provider is used as the first step of loading the model resources on all platforms.
PiperOrigin-RevId: 493141519
2022-12-05 16:20:20 -08:00
Jiuqiang Tang
ead41132a8 Load model file content from model file path with the help of GetResourceContents in browsers.
This can handle the model files that are provided via a custom ResourceProviderFn.

PiperOrigin-RevId: 492308453
2022-12-01 15:03:57 -08:00
Jiuqiang Tang
3ee37800e2 Depending on "inference_calculator_cpu" when the mediapipe tasks can only support cpu inference.
PiperOrigin-RevId: 492205954
2022-12-01 08:43:30 -08:00
Sebastian Schmidt
342f95fa20 Typo fix
PiperOrigin-RevId: 491434987
2022-11-28 13:54:09 -08:00
MediaPipe Team
c48ca1f674 internal change
PiperOrigin-RevId: 491429214
2022-11-28 13:33:57 -08:00
MediaPipe Team
bfa57310c4 Move TextPreprocessing to "processors" folder.
PiperOrigin-RevId: 490532670
2022-11-23 10:19:45 -08:00
MediaPipe Team
b5189758f7 Move ImagePreprocessing to "processors" folder.
PiperOrigin-RevId: 490444821
2022-11-23 02:08:37 -08:00
MediaPipe Team
7acbf557a1 Cleanup after migration to new classification output format.
PiperOrigin-RevId: 489921603
2022-11-21 01:57:05 -08:00
MediaPipe Team
6cf464636b Internal change
PiperOrigin-RevId: 489842199
2022-11-20 14:26:22 -08:00
Sebastian Schmidt
71ae496a20 Add AudioEmbedder documentation
PiperOrigin-RevId: 489532283
2022-11-18 12:12:41 -08:00
MediaPipe Team
e2052a6a51 Rename embedding postprocessor "configure" method for consistency with classification postprocessor.
PiperOrigin-RevId: 489518257
2022-11-18 11:13:10 -08:00
MediaPipe Team
03d388fecf Add hand landmark named index constants
PiperOrigin-RevId: 489498248
2022-11-18 09:52:44 -08:00
MediaPipe Team
dc9578d226 Internal change
PiperOrigin-RevId: 488946809
2022-11-16 08:30:20 -08:00
MediaPipe Team
ebba119f15 Add Java ImageEmbedder API.
PiperOrigin-RevId: 488588010
2022-11-15 01:26:00 -08:00
Jiuqiang Tang
b4fba6fe61 MediaPipe Tasks AudioEmbedder Java API
PiperOrigin-RevId: 488456442
2022-11-14 13:42:55 -08:00
MediaPipe Team
34daba4747 Add Java TextEmbedder API.
PiperOrigin-RevId: 488427327
2022-11-14 11:49:56 -08:00
Jiuqiang Tang
6c0ca947de MediaPipe Tasks Audio embedder C++ API.
PiperOrigin-RevId: 488273381
2022-11-13 23:10:23 -08:00
Jiuqiang Tang
f329e38dc1 Map the "com_github_glog_glog" dependency of "com_google_sentencepiece" to mediapipe's "com_github_glog_glog_no_gflags".
PiperOrigin-RevId: 487727239
2022-11-10 22:12:42 -08:00
MediaPipe Team
b4972ed4ae Update GestureRecognitionResult to GestureRecognizerResult.
PiperOrigin-RevId: 487712873
2022-11-10 20:25:31 -08:00
MediaPipe Team
2ea5184c51 Internal change
PiperOrigin-RevId: 487663454
2022-11-10 16:04:22 -08:00
Jiuqiang Tang
da4d455d0c Implement MediaPipe Tasks AudioClassifier Java API.
PiperOrigin-RevId: 487570148
2022-11-10 10:10:03 -08:00
MediaPipe Team
0ac604d507 Add timestamp aggregation to EmbeddingPostprocessingGraph.
PiperOrigin-RevId: 487463848
2022-11-10 01:20:45 -08:00
MediaPipe Team
f11c757629 Update C++ HandLandmarksDetectionResult to HandLandmarkerResult.
PiperOrigin-RevId: 487443827
2022-11-09 23:20:15 -08:00
MediaPipe Team
0363d60511 Open-sources TextEmbedder.
PiperOrigin-RevId: 487041832
2022-11-08 13:48:49 -08:00
MediaPipe Team
1049ef781d Add image_segmenter namespace and update image segmenter proto for java package.
PiperOrigin-RevId: 486792164
2022-11-07 16:24:16 -08:00
MediaPipe Team
6f38a7a21f Add hand landmarker C++ api.
PiperOrigin-RevId: 486791711
2022-11-07 16:17:42 -08:00
Jiuqiang Tang
63a759accc Implement MediaPipe AudioClassifier Tasks Python API. Adjust the AudioClassifier Tasks C++ API to remove "sample_rate" from its options.
PiperOrigin-RevId: 486763992
2022-11-07 14:28:14 -08:00
Jiuqiang Tang
9f4496db77 Fix typos
PiperOrigin-RevId: 486698923
2022-11-07 10:24:17 -08:00
Jiuqiang Tang
416f91180b Remove the use of designated initializers.
PiperOrigin-RevId: 486261384
2022-11-04 16:57:21 -07:00
Jiuqiang Tang
c10ebe8476 Remove the use of designated initializers.
PiperOrigin-RevId: 486215798
2022-11-04 13:24:48 -07:00