cassdlcm/mediapipe
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
626 Commits 10 Branches 56 Tags 829 MiB
a33cb1e05e
Commit Graph

626 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Camillo Lugaresi
a33cb1e05e Check that Java buffer supports direct access before using it 
If the buffer is not created with allocateDirect, JNI APIs will return a data pointer of nullptr and a capacity of -1. This can cause a crash when we access it.

Also clean up the code to raise exceptions instead of just logging errors and returning nullptr.

PiperOrigin-RevId: 489751312
 2022-11-19 21:04:48 -08:00
MediaPipe Team
977ee4272e Add public visibility to the model maker public API. 
PiperOrigin-RevId: 489701768
 2022-11-19 10:53:21 -08:00
Sebastian Schmidt
bbcbd5fc6c Audio Embedder for Web 
PiperOrigin-RevId: 489669966
 2022-11-19 04:49:24 -08:00
Sebastian Schmidt
e853f04b79 Create AudioTaskRunner 
PiperOrigin-RevId: 489613573
 2022-11-18 19:55:08 -08:00
Camillo Lugaresi
eb8ef1ace0 Use shared_from_this in GlTextureBuffer::GetReadView, GetWriteView 
This ensures that the callbacks in GlTextureView won't call an expired object, even if user code holds a GlTextureView after releasing the buffer.

Note that GlTextureBuffer is not always held by a shared_ptr, but it always is when GpuBuffer calls GetRead/WriteView on it. An alternative solution would have been to have GpuBuffer pass its shared_ptr<GlTextureBuffer> to the view method, which could have been implemented with some compile-time logic to detect whether the method expects such an argument. However, that doesn't seem necessary.

PiperOrigin-RevId: 489611843
 2022-11-18 19:42:34 -08:00
MediaPipe Team
bbd5da7971 Added the gray scale image support for the ImageToTensorCalculator on CPU. 
PiperOrigin-RevId: 489593917
 2022-11-18 17:12:57 -08:00
MediaPipe Team
524ac3ca61 Internal change for Model Maker 
PiperOrigin-RevId: 489540387
 2022-11-18 12:48:30 -08:00
Jiuqiang Tang
1b594a0310 Return error status when any tflite input and output tensor doesn't have valid dimensionality information that is needed to allocate Gl/Metal buffer before calling ModifyGraphWithDelegate. 
PiperOrigin-RevId: 489539740
 2022-11-18 12:44:55 -08:00
Sebastian Schmidt
71ae496a20 Add AudioEmbedder documentation 
PiperOrigin-RevId: 489532283
 2022-11-18 12:12:41 -08:00
MediaPipe Team
e2052a6a51 Rename embedding postprocessor "configure" method for consistency with classification postprocessor. 
PiperOrigin-RevId: 489518257
 2022-11-18 11:13:10 -08:00
Adam Cozzette
ac212c1507 Internal change 
PiperOrigin-RevId: 489502255
 2022-11-18 10:08:26 -08:00
MediaPipe Team
03d388fecf Add hand landmark named index constants 
PiperOrigin-RevId: 489498248
 2022-11-18 09:52:44 -08:00
MediaPipe Team
2f361e2f47 Internal change 
PiperOrigin-RevId: 489486417
 2022-11-18 08:53:43 -08:00
Jiuqiang Tang
e046982a3c Internal change 
PiperOrigin-RevId: 489484898
 2022-11-18 08:47:09 -08:00
Hadon Nash
ae44012c0c Allowing BypassCalculator to accept InputSidePackets. 
PiperOrigin-RevId: 489483992
 2022-11-18 08:43:02 -08:00
Camillo Lugaresi
efcdedbd59 Remove redundant _ios targets 
PiperOrigin-RevId: 489355333
 2022-11-17 18:16:58 -08:00
Copybara-Service
cd056e114a Merge pull request #3866 from kinaryml:fix-tasks-api-python-311-errors 
PiperOrigin-RevId: 489346167
 2022-11-17 17:20:23 -08:00
MediaPipe Team
6f3cb340e1 Internal change 
PiperOrigin-RevId: 489345940
 2022-11-17 17:16:25 -08:00
MediaPipe Team
ab3a5f0fbf Make MuxCalculator with DefaultInputStreamHandler to handle graph closure gracefully 
PiperOrigin-RevId: 489336722
 2022-11-17 16:30:35 -08:00
MediaPipe Team
a7bd725e65 Internal change 
PiperOrigin-RevId: 489331826
 2022-11-17 16:09:15 -08:00
MediaPipe Team
1fb0902aa0 Update gesture_recognizer test 
PiperOrigin-RevId: 489301508
 2022-11-17 14:04:30 -08:00
Sebastian Schmidt
3ccf7308e0 Add shared options for Text and Audio Tasks 
PiperOrigin-RevId: 489186644
 2022-11-17 05:28:27 -08:00
Hadon Nash
ea4989b6f1 Internal change 
PiperOrigin-RevId: 489135553
 2022-11-17 00:07:59 -08:00
kinaryml
5a6837d034 Fix errors that will occur in python 3.11 2022-11-16 22:08:52 -08:00
Sebastian Schmidt
899c87466e Add MP Tasks entrypoints 
PiperOrigin-RevId: 489110875
 2022-11-16 20:57:33 -08:00
Camillo Lugaresi
6fc277ee1c Internal change 
PiperOrigin-RevId: 489091534
 2022-11-16 18:38:03 -08:00
Sebastian Schmidt
e66e88802c Change NPM Bundle to ESM 
PiperOrigin-RevId: 489091370
 2022-11-16 18:34:53 -08:00
MediaPipe Team
90eb4a19d8 Internal change 
PiperOrigin-RevId: 489088227
 2022-11-16 18:16:32 -08:00
MediaPipe Team
b6b72d5e4e Add MuxCalculator test case where graph is being closed while SELECT has not been received. 
PiperOrigin-RevId: 489061902
 2022-11-16 15:56:43 -08:00
Sebastian Schmidt
3cdf0f6536 Fix a crash that occurred when a model returns fewer vector elements than before 
PiperOrigin-RevId: 489041814
 2022-11-16 14:38:37 -08:00
MediaPipe Team
74474d859e Update image_classifier demo with new ImageClassifierOption changes 
PiperOrigin-RevId: 489031381
 2022-11-16 14:00:39 -08:00
MediaPipe Team
512a531b9e Internal change 
PiperOrigin-RevId: 488977390
 2022-11-16 10:31:50 -08:00
MediaPipe Team
cdd44e77b7 Internal change 
PiperOrigin-RevId: 488969539
 2022-11-16 10:07:40 -08:00
MediaPipe Team
dc9578d226 Internal change 
PiperOrigin-RevId: 488946809
 2022-11-16 08:30:20 -08:00
Sebastian Schmidt
f7aef677fc Add running mode to all vision tasks 
PiperOrigin-RevId: 488816785
 2022-11-15 19:02:21 -08:00
Camillo Lugaresi
febfc2029b Annotate plane argument 
PiperOrigin-RevId: 488813363
 2022-11-15 18:53:09 -08:00
Camillo Lugaresi
63e2089639 Deprecate a bunch of old stuff in GlCalculatorHelper 
PiperOrigin-RevId: 488813296
 2022-11-15 18:51:56 -08:00
Camillo Lugaresi
1979801a92 Remove GlCalculatorHelperImpl; merge with GlCalculatorHelper 
Originally, there were multiple implementations of GlCalculatorHelperImpl, depending on the platform and underlying GL APIs. These have all been refactored into other components, and the remaining code in this class is unified and much reduced in size. We can get rid of this implementation detail now.

PiperOrigin-RevId: 488813220
 2022-11-15 18:50:45 -08:00
Camillo Lugaresi
8b319e963a Add comment explaining ViewProvider 
This was only documented via examples (e.g. ViewProvider<GlTextureView>), but it's better to explain it properly in the header where the base case is defined.

PiperOrigin-RevId: 488813144
 2022-11-15 18:48:54 -08:00
Camillo Lugaresi
a28ccb0964 Remove unnecessary forward declarations 
PiperOrigin-RevId: 488813066
 2022-11-15 18:43:36 -08:00
Camillo Lugaresi
13b4b825d7 Remove std::shared_ptr<GpuBuffer> argument from GetRead/WriteView 
PiperOrigin-RevId: 488813004
 2022-11-15 18:41:53 -08:00
Camillo Lugaresi
1c0a1d0aab Remove shared_ptr<GpuBuffer> member from GlTextureView 
This only exists to support GlTexture's GetFrame API. It can be moved into GlTexture.

PiperOrigin-RevId: 488812896
 2022-11-15 18:40:15 -08:00
Camillo Lugaresi
767cc2ee3c More comments on gpu_buffer_storage 
This gives a basic explanation of the role of storages and views, and provides some details on how to implement a new storage type.

PiperOrigin-RevId: 488812807
 2022-11-15 18:38:29 -08:00
Camillo Lugaresi
4c874fe4cd Allow conversion of GlTextureBuffer to CVPixelBufferRef 
This means that, if an iOS application sends in a GlTextureBuffer but expects a CVPixelBufferRef as output, everything will work even if the graph just forwards the same input. Also, access by Metal calculators will also work transparently.

PiperOrigin-RevId: 488812748
 2022-11-15 18:36:45 -08:00
Camillo Lugaresi
fe66de3714 Internal change 
PiperOrigin-RevId: 488812677
 2022-11-15 18:32:54 -08:00
MediaPipe Team
2f77bf44e3 Use train_data to evaluate accuracy of unit test for gesture_recognizer due to limited dataset size. 
PiperOrigin-RevId: 488808942
 2022-11-15 18:10:28 -08:00
Camillo Lugaresi
b308c0dd5e Implement CVPixelBufferRef access as a view. 
PiperOrigin-RevId: 488798216
 2022-11-15 17:18:07 -08:00
Camillo Lugaresi
4bda012bba Factor out gl_texture_util 
PiperOrigin-RevId: 488797985
 2022-11-15 17:13:22 -08:00
Camillo Lugaresi
77b3edbb67 Internal change 
PiperOrigin-RevId: 488797407
 2022-11-15 17:09:43 -08:00
Mark McDonald
6702ef3d57 Internal change 
PiperOrigin-RevId: 488796090
 2022-11-15 17:04:31 -08:00