diff options
| author | Naushir Patuck <naush@raspberrypi.com> | 2021-11-02 12:46:57 +0000 |
|---|---|---|
| committer | Kieran Bingham <kieran.bingham@ideasonboard.com> | 2021-11-02 13:03:50 +0000 |
| commit | 06008c6e81e8d62c3ebf45025448a3137b76d394 (patch) | |
| tree | 686a6bd9eca03d3757257151265a391922ff3c59 /subprojects/libyuv.wrap | |
| parent | 5004d8a969330c52449e6840bbef6552cfa8ee1a (diff) | |
pipeline: raspberrypi: Fix rounding issue in findBestFormat()
The aspect ratio calculation divides two integer values then casts to a double.
This might reduce precision when scoring for aspect rato differences.
Fix this by casting the integer to a double before the division.
Reported-by: Coverity CID=361652
Signed-off-by: Naushir Patuck <naush@raspberrypi.com>
Reviewed-by: David Plowman <david.plowman@raspberrypi.com>
Reviewed-by: Kieran Bingham <kieran.bingham@ideasonboard.com>
Signed-off-by: Kieran Bingham <kieran.bingham@ideasonboard.com>
Diffstat (limited to 'subprojects/libyuv.wrap')
0 files changed, 0 insertions, 0 deletions