History

avcodec/vp9dsp_template: Fix integer overflows in itxfm_wrapper

Fixes: signed integer overflow: 2147483641 + 32 cannot be represented in type 'int' Fixes: 27452/clusterfuzz-testcase-minimized-ffmpeg_AV_CODEC_ID_VP9_fuzzer-5078752576667648

Michael Niedermayer committed 5 years ago

Commit 4dfb7ff1 parent 3d7ee5c1 file · +2 −2Browse files

Unified · Split

libavcodec/vp9dsp_template.c+2−2
@@ -1138,7 +1138,7 @@ static void type_a##_##type_b##_##sz##x##sz##_add_c(uint8_t *_dst, \ · 1137 unmodified lines
11381138 for (j = 0; j < sz; j++) \
11391139 dst[j * stride] = av_clip_pixel(dst[j * stride] + \
11401140 (bits ? \
1141− (t + (1 << (bits - 1))) >> bits : \
1141+ (int)(t + (1U << (bits - 1))) >> bits : \
11421142 t)); \
11431143 dst++; \
11441144 } \
@@ -1153,7 +1153,7 @@ static void type_a##_##type_b##_##sz##x##sz##_add_c(uint8_t *_dst, \ · 8 unmodified lines
11531153 for (j = 0; j < sz; j++) \
11541154 dst[j * stride] = av_clip_pixel(dst[j * stride] + \
11551155 (bits ? \
1156− (out[j] + (1 << (bits - 1))) >> bits : \
1156+ (int)(out[j] + (1U << (bits - 1))) >> bits : \
11571157 out[j])); \
11581158 dst++; \
11591159 } \

Keyboard shortcuts

General

Show keyboard shortcuts
?
Focus the current search
/

Issues and pull requests

Open filters
f

Issues, pull requests and Inbox

Select next item
j↓
Select previous item
k↑
Open selected item
Enter
Dismiss filters or clear selection
Esc

Repository code

Go to file
t