Commit Graph

306 Commits

Author SHA1 Message Date
MediaPipe Team
124a4de08d Clean up TensorConverterCalculator flipping behavior
Returns an error if
- gpu_origin is specified for a CPU image, and
- gpu_origin and flip_vertically are both specified.
Adds a test for an IMAGE_GPU input to validate flipping.

PiperOrigin-RevId: 565311456
2023-09-14 02:56:02 -07:00
MediaPipe Team
e1d1877e07 Modifying tensor_to_vector_float_calculator to take in D_BFLOAT16 values
PiperOrigin-RevId: 565189254
2023-09-13 16:10:35 -07:00
MediaPipe Team
90e18eab91 Internal change.
PiperOrigin-RevId: 565062314
2023-09-13 08:49:16 -07:00
MediaPipe Team
1d8dda3337 Remove uncoditional texture params reset to make float textures handled correctly.
PiperOrigin-RevId: 564869245
2023-09-12 16:40:13 -07:00
MediaPipe Team
4ba1dadf92 Add option for nearest neighbor interpolation.
PiperOrigin-RevId: 564786213
2023-09-12 11:41:58 -07:00
MediaPipe Team
26a67f4424 No public description
PiperOrigin-RevId: 564651554
2023-09-12 02:15:53 -07:00
Chris McClanahan
e51b923bda internal fix
PiperOrigin-RevId: 564404269
2023-09-11 09:11:49 -07:00
MediaPipe Team
e39119ae53 Add missing cache writing implementation in InferenceCalculatorAdvancedGL
Add missing implementation for absl::Status SaveGpuCachesBasedOnBehavior(tflite::gpu::TFLiteGPURunner* gpu_runner) const for non android/chromeos.

PiperOrigin-RevId: 562973338
2023-09-05 20:51:36 -07:00
MediaPipe Team
bf32d1acb2 No public description
PiperOrigin-RevId: 562915674
2023-09-05 15:52:21 -07:00
MediaPipe Team
d6119957a4 No public description
PiperOrigin-RevId: 562075110
2023-09-01 16:31:33 -07:00
MediaPipe Team
ab70d92752 No public description
PiperOrigin-RevId: 562071599
2023-09-01 16:14:06 -07:00
MediaPipe Team
23057ac146 Update PackMediaSequenceCalculator to support setting clip/media/string, clip/media/confidence and clip/label/index.
The input stream is provided as drishti::Detection.

PiperOrigin-RevId: 562070790
2023-09-01 16:08:52 -07:00
MediaPipe Team
de0c7f2a30 Make cache writes optional in InferenceCalculatorAdvancedGL
Previously, caches were always written, and an error would cause the graph to close abruptly. This prevented services with read-only access to the cache from using the calculator.

The new behavior allows services to choose whether or not to write caches.

PiperOrigin-RevId: 561866791
2023-08-31 23:31:27 -07:00
MediaPipe Team
7c2d654d67 Convert CHECK macro to ABSL_CHECK.
Chrome can't use Absl's CHECK because of collisions with its own version.

PiperOrigin-RevId: 561740965
2023-08-31 13:20:29 -07:00
MediaPipe Team
c92570f844 Use ABSL_LOG in MediaPipe.
This is needed in Chrome builds to avoid collisions with its own LOG.

PiperOrigin-RevId: 561436864
2023-08-30 13:43:49 -07:00
MediaPipe Team
6c2638592e Internal update.
PiperOrigin-RevId: 561184322
2023-08-29 17:34:35 -07:00
Zu Kim
c56f45bce5 Change the image label input from Classification to Detection.
PiperOrigin-RevId: 559828139
2023-08-24 12:08:25 -07:00
Richard Levasseur
f2e9a553d6 No public description
PiperOrigin-RevId: 559787614
2023-08-24 10:06:00 -07:00
MediaPipe Team
a44c810921 Update PackMediaSequenceCalculator to support adding clip/media/id to the MediaSequence.
As the media ID is usually a video ID which is provided to the graph as a side packet, in this graph it expects it to be provided as as a input side packet instead of an input stream.

PiperOrigin-RevId: 558266967
2023-08-18 15:48:40 -07:00
Chris McClanahan
a04a3a1c81 internal fix
PiperOrigin-RevId: 557934477
2023-08-17 14:20:58 -07:00
MediaPipe Team
a392561b31 Internal change
PiperOrigin-RevId: 557015628
2023-08-14 22:16:20 -07:00
MediaPipe Team
b6f5414b3d Support more GPU formats in tensor converter calculator.
PiperOrigin-RevId: 556987807
2023-08-14 19:57:05 -07:00
MediaPipe Team
a183212a13 Header for callback_packet_calculator to allow dynamic registration for superusers
PiperOrigin-RevId: 556977122
2023-08-14 18:50:11 -07:00
MediaPipe Team
6605fdb16f add end loop calculator for image size
PiperOrigin-RevId: 556955370
2023-08-14 17:09:02 -07:00
Zu Kim
22054cd468 Set confidence score of the bounding box label.
PiperOrigin-RevId: 554508925
2023-08-07 10:01:59 -07:00
Zu Kim
460346ed13 Add a support for label annotations (image/label/string and image/label/confidence). Also fixed some clang tidy issues.
PiperOrigin-RevId: 553900667
2023-08-04 13:43:44 -07:00
MediaPipe Team
360959e325 Replace some size EXPECTs by ASSERTs
PiperOrigin-RevId: 553555650
2023-08-03 12:27:52 -07:00
MediaPipe Team
a0b91e4062 Add a GpuOrigin parameter to TensorConverterCalculator
The parameter superseeds flip_vertically. GpuOrigin works more generally than flip_vertically because CONVENTIONAL works on both iOS (no flip) and Android (yes flip). If not set, the calculator falls back to flip_vertically for backwards compatibility.

Note that web demos actually use TOP_LEFT image orientation, so they shouldn't be flipped, but they still are by CONVENTIONAL. That's being discussed right now.

PiperOrigin-RevId: 553400525
2023-08-03 01:40:13 -07:00
MediaPipe Team
113c9b30c2 No public description
PiperOrigin-RevId: 550616150
2023-07-24 11:09:31 -07:00
MediaPipe Team
4e72fcf0cb Replace CHECK with RET_CHECK in GetContract() implementation from six calculators.
PiperOrigin-RevId: 549158984
2023-07-18 17:38:44 -07:00
MediaPipe Team
17bc1a5ab5 Internal change
PiperOrigin-RevId: 548196034
2023-07-14 12:39:45 -07:00
MediaPipe Team
cc2aa4f4cc InferenceCalculatorAdvancedGL save cache in Open().
PiperOrigin-RevId: 547652481
2023-07-12 18:09:51 -07:00
MediaPipe Team
e4ec4d2526 Internal change
PiperOrigin-RevId: 547258228
2023-07-11 12:05:58 -07:00
MediaPipe Team
0bde987a38 Removed internal dependency on OpenCV 3.x, migrating it to OpenCV 4.x
PiperOrigin-RevId: 546945166
2023-07-10 12:17:54 -07:00
MediaPipe Team
15ee1210e5 Internal change
PiperOrigin-RevId: 546035969
2023-07-06 10:58:20 -07:00
Sebastian Schmidt
9861b3c8a8 Fix bounds calculation in RefineLandmarksFromHeatMapCalculator
Fixes https://github.com/google/mediapipe/issues/4414

PiperOrigin-RevId: 545794151
2023-07-05 14:58:36 -07:00
MediaPipe Team
74f484d96d Internal change
PiperOrigin-RevId: 545658434
2023-07-05 07:09:40 -07:00
MediaPipe Team
dbe8e40124 Internal change
PiperOrigin-RevId: 545045282
2023-07-03 10:04:19 -07:00
MediaPipe Team
422556c4a3 Internal change
PiperOrigin-RevId: 544663494
2023-06-30 08:34:32 -07:00
Jiuqiang Tang
6c7aa8a0d6 Internal change
PiperOrigin-RevId: 544563029
2023-06-29 23:05:37 -07:00
MediaPipe Team
687075e5b8 Add gpu to cpu fallback for tensors_to_detections_calculator.
PiperOrigin-RevId: 544480883
2023-06-29 15:36:33 -07:00
MediaPipe Team
e15d5a797b Do not send PreviousLoopback output packets to closed streams
PiperOrigin-RevId: 544449979
2023-06-29 13:44:56 -07:00
MediaPipe Team
2f5fc16a38 Fix timestamp computation when copying within first block.
When computing the last copied sample's timestamp, first_block_offset_ needs to be taken into account.

PiperOrigin-RevId: 542643291
2023-06-22 13:03:36 -07:00
Jiuqiang Tang
98d493f37a Add MatrixData as a packet option for ConstantSidePacketCalculatorOptions.
PiperOrigin-RevId: 542616847
2023-06-22 11:28:07 -07:00
MediaPipe Team
825e3a8af0 Speed up TimeSeriesFramerCalculator.
Currently, TimeSeriesFramerCalculator constructs a distinct Matrix object for every input sample, which is inefficient. This CL revises buffering to keep each input packet's worth of samples as one grouped Matrix. A benchmark is added, showing a speed up of about 20x.

```
name                               old      new
BM_TimeSeriesFramerCalculator  48.45ms   2.26ms
```

PiperOrigin-RevId: 542462618
2023-06-21 23:03:54 -07:00
MediaPipe Team
7edb6b8fcb add concatenate image vector calculator
PiperOrigin-RevId: 542084345
2023-06-20 16:40:11 -07:00
MediaPipe Team
02d55dfb0a Modify the TensorToImageFrameCalculator to support normalized outputs.
PiperOrigin-RevId: 540104988
2023-06-13 16:20:42 -07:00
MediaPipe Team
b97d11fa76 Internal MediaPipe Tasks change
PiperOrigin-RevId: 540083633
2023-06-13 15:05:04 -07:00
MediaPipe Team
b19b80e10f Add support for int64 constant side package value.
PiperOrigin-RevId: 539893314
2023-06-13 01:53:13 -07:00
MediaPipe Team
37290f0224 Port StreamToSidePacketCalculator to api2
PiperOrigin-RevId: 538109898
2023-06-06 01:34:43 -07:00