Commit Graph

2634 Commits

Author SHA1 Message Date
Kinar
1c860cace6 Added files for the Object Detector C Tasks API 2023-11-13 09:53:37 -08:00
Sebastian Schmidt
d504d3bf22 Create shared utilities to construct landmark lists
PiperOrigin-RevId: 581970043
2023-11-13 08:24:19 -08:00
Kinar
38737849e6 Updated copyright 2023-11-11 03:34:57 -08:00
Kinar
99c8b9ee3c Updated copyright 2023-11-11 03:34:26 -08:00
Kinar
021c7edde7 Updated README and script 2023-11-11 03:32:45 -08:00
Kinar
35f2f36733 Added image classifier benchmark 2023-11-11 03:25:36 -08:00
MediaPipe Team
939a9c2a37 No public description
PiperOrigin-RevId: 581469194
2023-11-10 23:59:21 -08:00
MediaPipe Team
ad4da8c9cc No public description
PiperOrigin-RevId: 581468467
2023-11-10 23:53:57 -08:00
MediaPipe Team
418680936d No public description
PiperOrigin-RevId: 581450685
2023-11-10 21:55:41 -08:00
MediaPipe Team
4ad67abd70 ...internal change...
PiperOrigin-RevId: 581375224
2023-11-10 14:46:01 -08:00
MediaPipe Team
5dec91226d No public description
PiperOrigin-RevId: 581322099
2023-11-10 11:39:24 -08:00
MediaPipe Team
64b21d758e Remove batch dimension from the output of tflite_with_tokenizer in text classifier.
PiperOrigin-RevId: 581292824
2023-11-10 10:05:40 -08:00
MediaPipe Team
d772bf8134 Add BinaryAUC metric and Best Checkpoint callback to Text Classifier
PiperOrigin-RevId: 581276382
2023-11-10 09:04:26 -08:00
MediaPipe Team
fd4859c178 Refactor OpenCV path out of TensorsToSegmentationCalculator main file.
ProcessCpu() is changed into an OpenCV converter that is owned by the calculator. The calculator should call converter.Convert() to get the conversion result.

PiperOrigin-RevId: 581103226
2023-11-09 20:06:47 -08:00
Youchuan Hu
1038f8176d Refactor OpenCV path out of TensorsToSegmentationCalculator main file.
ProcessCpu() is changed into an OpenCV converter that is owned by the calculator. The calculator should call converter.Convert() to get the conversion result.

PiperOrigin-RevId: 581073731
2023-11-09 17:28:24 -08:00
MediaPipe Team
333125ac20 Add some convenience getters to EglManager.
PiperOrigin-RevId: 581049412
2023-11-09 15:58:06 -08:00
Sebastian Schmidt
edca85c5d3 Create shared utilities to construct category lists
PiperOrigin-RevId: 581009898
2023-11-09 13:38:21 -08:00
MediaPipe Team
6532ce5c59 Refactor OpenCV path out of TensorsToSegmentationCalculator main file.
ProcessCpu() is changed into an OpenCV converter that is owned by the calculator. The calculator should call converter.Convert() to get the conversion result.

PiperOrigin-RevId: 580937591
2023-11-09 09:45:10 -08:00
MediaPipe Team
a9a169372a Fixes multiple typos in the calculator's internal files.
PiperOrigin-RevId: 580907788
2023-11-09 08:02:54 -08:00
MediaPipe Team
7c5c216652 Exposes a handle to AHardwareBuffers through a new GpuBuffer view
PiperOrigin-RevId: 580754933
2023-11-08 20:06:35 -08:00
MediaPipe Team
252c7eef25 Add option to omit the checkpoint callback in text classifier.
PiperOrigin-RevId: 580658724
2023-11-08 14:30:00 -08:00
Youchuan Hu
ae606c1550 Refactor OpenCV path out of TensorsToSegmentationCalculator main file.
ProcessCpu() is changed into an OpenCV converter that is owned by the calculator. The calculator should call converter.Convert() to get the conversion result.

PiperOrigin-RevId: 580625461
2023-11-08 12:53:52 -08:00
Copybara-Service
d4d30768be Merge pull request #4943 from kinaryml:c-image-embedder-api
PiperOrigin-RevId: 580618718
2023-11-08 12:35:05 -08:00
MediaPipe Team
000314a545 No public description
PiperOrigin-RevId: 580614241
2023-11-08 12:17:12 -08:00
Copybara-Service
65e74dde0f Merge pull request #4940 from priankakariatyml:ios-pose-landmarker-implementation
PiperOrigin-RevId: 580578919
2023-11-08 10:39:24 -08:00
Copybara-Service
8d4407b04e Merge pull request #4941 from priankakariatyml:ios-language-detector-tests
PiperOrigin-RevId: 580577290
2023-11-08 10:34:06 -08:00
MediaPipe Team
81a07e2e32 No public description
PiperOrigin-RevId: 580504831
2023-11-08 05:53:54 -08:00
MediaPipe Team
6ea6f28250 Creates GpuBuffers around pre-allocated AHardware_Buffer objects.
PiperOrigin-RevId: 580358465
2023-11-07 18:01:37 -08:00
Kinar
c442d6117e Resolved issues and added a common header to hold all the necessary structures for the vision tasks 2023-11-07 14:23:15 -08:00
MediaPipe Team
c375761480 No public description
PiperOrigin-RevId: 580292393
2023-11-07 14:02:30 -08:00
Sebastian Schmidt
8d370f4f5b Remove const from input types of C API
PiperOrigin-RevId: 580217902
2023-11-07 10:08:51 -08:00
Kinar
197358dfee Drop default arguments in Image Embedder C API 2023-11-07 07:34:08 -08:00
Kinar
60fcfa74cc Fixed some typos in the error message 2023-11-07 07:26:57 -08:00
Kinar
b0725b46fb Fixed merge conflicts 2023-11-07 07:12:58 -08:00
Kinar R
42a916ad4f
Merge branch 'master' into c-image-embedder-api 2023-11-07 20:37:09 +05:30
Kinar
d9080c0d38 Updated the Image Embedder C API and added tests for cosine similarity 2023-11-07 07:02:08 -08:00
Prianka Liz Kariat
9d9a5dc5e7 Added iOS language detector tests 2023-11-07 11:15:01 +05:30
Prianka Liz Kariat
b5b0d6eee7 Fixed graph name in iOS language detector 2023-11-07 11:13:25 +05:30
Prianka Liz Kariat
32571a37d2 Added pose landmarker protobuf utils 2023-11-07 09:49:53 +05:30
Prianka Liz Kariat
91095c2d6a Added null check for segmentation masks in pose landmarker helper initializer 2023-11-07 09:49:42 +05:30
Prianka Liz Kariat
1d0f3734b4 Added iOS MPPPoseLandmarker.mm 2023-11-07 09:46:39 +05:30
Sebastian Schmidt
2abaabce0e Drop default arguments in C API
PiperOrigin-RevId: 579965820
2023-11-06 14:55:41 -08:00
MediaPipe Team
a8d88bf7cf Creates GpuBuffers around pre-allocated AHardware_Buffer objects.
PiperOrigin-RevId: 579961642
2023-11-06 14:42:13 -08:00
Sebastian Schmidt
077b52250d Pass Model Asset Buffer as byte array + length
PiperOrigin-RevId: 579944283
2023-11-06 13:42:40 -08:00
Kinar R
3b122a1e61
Merge branch 'google:master' into c-image-embedder-api 2023-11-07 02:00:23 +05:30
MediaPipe Team
5f0d24d741 Fixes typo in GlCalculatorHelper::UpdateContract argument name
PiperOrigin-RevId: 579832146
2023-11-06 07:08:33 -08:00
MediaPipe Team
0b53c9752f Fixes multiple typos in the calculator's internal files.
PiperOrigin-RevId: 579718764
2023-11-05 20:49:16 -08:00
MediaPipe Team
e22b7d5dd4 Example updated for mp.Image in documentation
PiperOrigin-RevId: 579277510
2023-11-03 12:58:47 -07:00
Sebastian Schmidt
8f564c4b7b Allow OffscreenCanvas to be used by DrawingUtils
PiperOrigin-RevId: 579021013
2023-11-02 17:03:07 -07:00
Copybara-Service
1cc79001f4 Merge pull request #4904 from priankakariatyml:ios-image-segmenter-cocoapods-build
PiperOrigin-RevId: 578993411
2023-11-02 15:24:59 -07:00
Copybara-Service
1b8a0ee6af Merge pull request #4900 from priankakariatyml:ios-pose-landmarker-impl
PiperOrigin-RevId: 578991151
2023-11-02 15:23:04 -07:00
Copybara-Service
35b9453da4 Merge pull request #4924 from google:mrschmidt/gpu
PiperOrigin-RevId: 578991016
2023-11-02 15:18:10 -07:00
Copybara-Service
b4ce39cbf7 Merge pull request #4905 from priankakariatyml:ios-image-utils-fix
PiperOrigin-RevId: 578990990
2023-11-02 15:15:58 -07:00
Copybara-Service
35010894c1 Merge pull request #4901 from priankakariatyml:ios-language-detector
PiperOrigin-RevId: 578990815
2023-11-02 15:10:37 -07:00
MediaPipe Team
9018ca699b Creates GpuBuffers around pre-allocated AHardware_Buffer objects.
PiperOrigin-RevId: 578850184
2023-11-02 07:46:51 -07:00
MediaPipe Team
f8197651e8 Add AT_FIRST_TICK processing to SidePacketToStreamCalculator.
PiperOrigin-RevId: 578824863
2023-11-02 05:58:35 -07:00
Sebastian Schmidt
e81fc5d0aa Access document via self.document
PiperOrigin-RevId: 578635298
2023-11-01 14:08:09 -07:00
Sebastian Schmidt
9474394768 Add drawCategoryMask() to our public API
PiperOrigin-RevId: 578526413
2023-11-01 08:33:18 -07:00
MediaPipe Team
3a55f1156a No public description
PiperOrigin-RevId: 578496866
2023-11-01 06:21:05 -07:00
MediaPipe Team
c6aa9cbaef No public description
PiperOrigin-RevId: 578303180
2023-10-31 14:29:38 -07:00
MediaPipe Team
35f2f98a1c No public description
PiperOrigin-RevId: 578266141
2023-10-31 12:30:04 -07:00
MediaPipe Team
b9ff9708e3 Upgrade to use Gradle 8.4
PiperOrigin-RevId: 578259506
2023-10-31 12:07:37 -07:00
MediaPipe Team
a4048eee11 Add video and live stream processing and tests for Image Classifier C API
PiperOrigin-RevId: 578242391
2023-10-31 11:14:28 -07:00
MediaPipe Team
7da2810b83 Move filtering logic of score to ConvertToDetection.
PiperOrigin-RevId: 578189518
2023-10-31 08:20:03 -07:00
Sebastian Schmidt
95692c64a9 Add GPU support 2023-10-30 16:05:12 -06:00
Sebastian Schmidt
ec032fb018 Use SRGBA for Mac on Python for image test
PiperOrigin-RevId: 577931014
2023-10-30 13:07:10 -07:00
Sebastian Schmidt
7256bd2638 No public description
PiperOrigin-RevId: 577873616
2023-10-30 09:46:16 -07:00
MediaPipe Team
2f4d7b4079 No public description
PiperOrigin-RevId: 577410310
2023-10-28 01:10:02 -07:00
MediaPipe Team
a96581e3b7 TensorsToDetectionsCalculator supports multi clasees for a bbox.
PiperOrigin-RevId: 577300797
2023-10-27 14:13:02 -07:00
Sebastian Schmidt
d73ef24406 Support 3-channel RGB images for Mac Python
PiperOrigin-RevId: 577240413
2023-10-27 10:34:08 -07:00
MediaPipe Team
eaf0807849 Fixes multiple typos in the calculator's internal files.
PiperOrigin-RevId: 577202836
2023-10-27 08:08:52 -07:00
MediaPipe Team
46cca0d486 Rolling back.
PiperOrigin-RevId: 577128565
2023-10-27 02:25:42 -07:00
Sebastian Schmidt
2cb0100fe6 Use mp.ImageFormat instead of just ImageFormat
Fixes https://github.com/google/mediapipe/issues/4911

PiperOrigin-RevId: 577003083
2023-10-26 15:32:28 -07:00
MediaPipe Team
5459705038 Adding two new immutable texture GpuBufferFormat types
PiperOrigin-RevId: 577002534
2023-10-26 15:27:43 -07:00
Youchuan Hu
e7121e4feb Use designated initializers for TensorsToSegmentationCalculator tests.
PiperOrigin-RevId: 576671943
2023-10-25 16:02:28 -07:00
Sebastian Schmidt
a277d853ea Don't drop status message in ConvertFromImageFrame
PiperOrigin-RevId: 576667666
2023-10-25 15:46:41 -07:00
MediaPipe Team
3017c02d3d No public description
PiperOrigin-RevId: 576663264
2023-10-25 15:30:54 -07:00
Copybara-Service
06dab1e526 Merge pull request #4818 from markmcd:ios-docgen
PiperOrigin-RevId: 576628799
2023-10-25 14:00:39 -07:00
MediaPipe Team
496a6ed809 No public description
PiperOrigin-RevId: 576314429
2023-10-24 16:08:19 -07:00
Sebastian Schmidt
c698414c71 Use cc_library for DrishtiMetalHelper
PiperOrigin-RevId: 576230898
2023-10-24 12:40:15 -07:00
Youchuan Hu
905a18c88c Add CPU tests for TensorsToSegmentationCalculator
PiperOrigin-RevId: 576208735
2023-10-24 11:35:58 -07:00
Sebastian Schmidt
5b0f1f9ac4 No public description
PiperOrigin-RevId: 576166645
2023-10-24 09:34:24 -07:00
MediaPipe Team
543b595971 Fix internal incensistency in parsing code
PiperOrigin-RevId: 576094494
2023-10-24 04:27:18 -07:00
Sebastian Schmidt
05564cbe9a No public description
PiperOrigin-RevId: 575930740
2023-10-23 14:36:03 -07:00
Sebastian Schmidt
aedafd63f9 Remove objc_library from Python build path for Mac GPU build
Addresses https://github.com/bazelbuild/bazel/issues/19912

PiperOrigin-RevId: 575896231
2023-10-23 12:36:14 -07:00
Copybara-Service
a39df33664 Merge pull request #4814 from kinaryml:face-stylizer-adding-unit-tests-to-api
PiperOrigin-RevId: 575895855
2023-10-23 12:31:33 -07:00
Sebastian Schmidt
b904ade0cf Allow Mac to use GPU Delegate
PiperOrigin-RevId: 575882254
2023-10-23 11:44:02 -07:00
Sebastian Schmidt
6aa27d9aeb Initialize GPU support for Python Task API
PiperOrigin-RevId: 575842513
2023-10-23 09:39:16 -07:00
Prianka Liz Kariat
d5a1bc03af Fixed deletion of iOS output MPImage buffer in MPImage Utils 2023-10-23 20:28:43 +05:30
Prianka Liz Kariat
7c45bc802f Added iOS Image Segmenter to CocoaPods build 2023-10-23 20:02:57 +05:30
Prianka Liz Kariat
305f076c7f Fixed extra condition check in iOS Image Segmenter Result Helper 2023-10-23 20:02:39 +05:30
Kinar
4b3cb5b758 Added files for the Image Embedder C API and tests 2023-10-23 00:30:51 -07:00
MediaPipe Team
0dee33ccba No public description
PiperOrigin-RevId: 575477678
2023-10-21 10:26:09 -07:00
Prianka Liz Kariat
3a43aff13c Added iOS language detector implementation 2023-10-21 10:42:48 +05:30
Prianka Liz Kariat
f185bc6635 Added language detector result helpers 2023-10-21 10:42:32 +05:30
Prianka Liz Kariat
c48a5668b8 Updated documentation 2023-10-21 03:57:55 +05:30
Prianka Liz Kariat
96ed3a7422 Added iOS pose landmarker header 2023-10-21 03:55:00 +05:30
Prianka Liz Kariat
3622ff9bff Added iOS pose landmarks connections 2023-10-21 03:53:54 +05:30
Prianka Liz Kariat
c4315c500d Added pose landmarker result helpers 2023-10-21 03:52:46 +05:30
MediaPipe Team
8fc3a0473f Add scaling support to surface view renderer.
PiperOrigin-RevId: 575134648
2023-10-20 01:08:17 -07:00
Sebastian Schmidt
305d7abec4 Add a field to GPUBuffer C struct so FFIGen can handle it
PiperOrigin-RevId: 575020084
2023-10-19 15:29:44 -07:00
Copybara-Service
1601073cf0 Merge pull request #4863 from priankakariatyml:ios-image-segmenter-populate-labels
PiperOrigin-RevId: 574977633
2023-10-19 13:07:53 -07:00
Copybara-Service
1c7ea02b0e Merge pull request #4864 from priankakariatyml:ios-image-segmenter-documentation-updates
PiperOrigin-RevId: 574966608
2023-10-19 12:32:23 -07:00
Sebastian Schmidt
5779f5e9da Allow GPU Origin Proto to be build by Maven
PiperOrigin-RevId: 574966597
2023-10-19 12:30:38 -07:00
Copybara-Service
02e0ce3f87 Merge pull request #4851 from priankakariatyml:ios-language-detector-containers
PiperOrigin-RevId: 574954531
2023-10-19 11:58:54 -07:00
Copybara-Service
ddf46a2a61 Merge pull request #4850 from priankakariatyml:ios-pose-landmarker-containers
PiperOrigin-RevId: 574954344
2023-10-19 11:54:25 -07:00
Fergus Henderson
f9fa7cfbeb No public description
PiperOrigin-RevId: 574913082
2023-10-19 10:10:26 -07:00
Prianka Liz Kariat
06d893a9f9 Revert "Updated deletion in FreeDataProviderReleaseCallback"
This reverts commit 69b7a21368.
2023-10-19 20:45:32 +05:30
Prianka Liz Kariat
69b7a21368 Updated deletion in FreeDataProviderReleaseCallback 2023-10-19 20:42:06 +05:30
Prianka Liz Kariat
af9a7e7e40 Added documentation 2023-10-19 20:27:51 +05:30
Prianka Liz Kariat
b9c869494d Fixed formatting of MPPImage+Utils.mm 2023-10-19 19:59:59 +05:30
Prianka Liz Kariat
4668d683d5 Updated implementation of MPPImage Utils to reduce lines of code 2023-10-19 19:59:09 +05:30
Prianka Liz Kariat
ad68122069 Added support for creating CVPixelBuffer from C++ Images to iOS MPPImage Utils 2023-10-19 19:58:40 +05:30
Prianka Liz Kariat
032d7a5d22 Removed support for CVPixelBuffer of type 32RGBA 2023-10-19 19:56:44 +05:30
Prianka Liz Kariat
0fe677b78f Updated supported pixel formats in iOS image classifier Documentation 2023-10-19 19:24:40 +05:30
MediaPipe Team
7dca7ad24e Internal change.
PiperOrigin-RevId: 574777627
2023-10-19 01:50:24 -07:00
MediaPipe Team
259fa86c62 Add implementation and tests for Image Classifier C API
PiperOrigin-RevId: 574679661
2023-10-18 18:57:19 -07:00
Sebastian Schmidt
364048daca Allow Python to be build on Mac with GPU support
PiperOrigin-RevId: 574625520
2023-10-18 15:45:17 -07:00
Sebastian Schmidt
4f29ffcc3e Add GPU Origin proto to Java Tasks Library
PiperOrigin-RevId: 574535005
2023-10-18 11:18:46 -07:00
MediaPipe Team
06cc6d1546 No public description
PiperOrigin-RevId: 574528013
2023-10-18 10:58:53 -07:00
MediaPipe Team
2bd6726c89 Plumb an optional default Executor and set of input side packets
through TaskApiFactory::Create so that consumers of that API
can provide these inputs to their underlying graph.

PiperOrigin-RevId: 574503266
2023-10-18 09:51:43 -07:00
MediaPipe Team
e27bbf15dc No public description
PiperOrigin-RevId: 574497996
2023-10-18 09:46:36 -07:00
MediaPipe Team
d006304f6a Migrate ParseTagAndName to use absl::string_view
PiperOrigin-RevId: 574492000
2023-10-18 09:44:39 -07:00
Youchuan Hu
de1b1b6b97 Initial test for TensorsToSegmentationCalculator
This test is a pass-through with no modification of the input tensor. CPU test.

PiperOrigin-RevId: 574210865
2023-10-17 11:22:03 -07:00
MediaPipe Team
dd215e00f5 No public description
PiperOrigin-RevId: 574045894
2023-10-17 00:11:39 -07:00
MediaPipe Team
2e11444f5c Introduce FixGraphBackEdges utils function.
PiperOrigin-RevId: 573925628
2023-10-16 14:13:18 -07:00
MediaPipe Team
a1e1b5d34c Internal change.
PiperOrigin-RevId: 573318330
2023-10-13 14:25:27 -07:00
MediaPipe Team
8993073f35 Internal change
PiperOrigin-RevId: 573254750
2023-10-13 10:25:00 -07:00
MediaPipe Team
1bd800697e GPU_ORIGIN configurable through base options proto.
PiperOrigin-RevId: 573251085
2023-10-13 10:10:52 -07:00
MediaPipe Team
8823046e4b Add check to avoid doing illegal memory access from an invalid iterator from std::prev()
PiperOrigin-RevId: 573248334
2023-10-13 10:02:09 -07:00
MediaPipe Team
652792ebaa Internal change
PiperOrigin-RevId: 573228351
2023-10-13 08:31:17 -07:00
MediaPipe Team
61dc7281e2 No public description
PiperOrigin-RevId: 573107636
2023-10-12 22:39:54 -07:00
MediaPipe Team
2a286cc790 Introduce AlignHandToPoseInWorldCalculator
PiperOrigin-RevId: 572959145
2023-10-12 11:14:03 -07:00
MediaPipe Team
ac2d5cedbd No public description
PiperOrigin-RevId: 572742286
2023-10-11 18:12:09 -07:00
Sebastian Schmidt
a97eaad10f No public description
PiperOrigin-RevId: 572722787
2023-10-11 16:41:08 -07:00
MediaPipe Team
dd29666296 Adding vector versions of input calls to TS GraphRunner API
PiperOrigin-RevId: 572711430
2023-10-11 15:55:08 -07:00
Sebastian Schmidt
4b8fd3b2d0 No public description
PiperOrigin-RevId: 572628807
2023-10-11 11:14:07 -07:00
Copybara-Service
84f6959f9d Merge pull request #4860 from kinaryml:c-language-detector-api
PiperOrigin-RevId: 572385111
2023-10-10 15:37:06 -07:00
MediaPipe Team
d6d92354ea Detection postprocessing support quantized tensor.
PiperOrigin-RevId: 572310272
2023-10-10 11:13:54 -07:00
Sebastian Schmidt
df13788883 No public description
PiperOrigin-RevId: 572309070
2023-10-10 11:08:47 -07:00
Sebastian Schmidt
0d5f35d351 No public description
PiperOrigin-RevId: 572292160
2023-10-10 10:23:35 -07:00
Sebastian Schmidt
dc63a5401c No public description
PiperOrigin-RevId: 572266397
2023-10-10 09:02:48 -07:00
Kinar R
91c5f84f9c Removed language_detection_result and moved the necessary containers to language_detector.h 2023-10-10 13:23:25 +05:30
MediaPipe Team
ef6e712a88 Internal change
PiperOrigin-RevId: 572125477
2023-10-09 21:28:52 -07:00
MediaPipe Team
f72542ae5d Internal change
PiperOrigin-RevId: 572122579
2023-10-09 21:11:24 -07:00
MediaPipe Team
ac954215cf Internal change
PiperOrigin-RevId: 572121726
2023-10-09 21:06:32 -07:00
MediaPipe Team
3adc068e97 Add OnCameraBoundListener and support for landscape orientation to CameraXPreviewHelper
PiperOrigin-RevId: 572054649
2023-10-09 15:21:46 -07:00
MediaPipe Team
3dd6480705 No public description
PiperOrigin-RevId: 572032324
2023-10-09 13:59:35 -07:00
Prianka Liz Kariat
3a97762569 Fixed typo in iOS image segmenter Swift delegate name 2023-10-09 17:48:57 +05:30
Prianka Liz Kariat
6c4b4469ae Updated iOS Image Segmenter documentation to use Swift names 2023-10-09 17:48:39 +05:30