History

avcodec/rv60dec: inter also fails with qp >= 32

Fixes: out of array read in decode_cu_16x16() Fixes: 398049430/clusterfuzz-testcase-minimized-ffmpeg_AV_CODEC_ID_RV60_fuzzer-5525836849807360

Michael Niedermayer committed 1 year ago

Commit 9230c931 parent ce1fd731 file · +1 −1Browse files

Unified · Split

libavcodec/rv60dec.c+1−1
@@ -1791,7 +1791,7 @@ static int decode_cu_r(RV60Context * s, AVFrame * frame, ThreadContext * thread, · 1790 unmodified lines
1791 ttype = cu.pu_type == PU_FULL ? TRANSFORM_8X8 : TRANSFORM_4X4;1791 ttype = cu.pu_type == PU_FULL ? TRANSFORM_8X8 : TRANSFORM_4X4;
1792 1792
1793 is_intra = cu.cu_type == CU_INTRA;1793 is_intra = cu.cu_type == CU_INTRA;
1794 if (is_intra && qp >= 32)1794 if (qp >= 32)
1795 return AVERROR_INVALIDDATA;1795 return AVERROR_INVALIDDATA;
1796 cu_pos = ((xpos & 63) >> 3) + ((ypos & 63) >> 3) * 8;1796 cu_pos = ((xpos & 63) >> 3) + ((ypos & 63) >> 3) * 8;
1797 1797

Keyboard shortcuts

General

Show keyboard shortcuts
?
Focus the current search
/

Issues and pull requests

Open filters
f

Issues, pull requests and Inbox

Select next item
j↓
Select previous item
k↑
Open selected item
Enter
Dismiss filters or clear selection
Esc

Repository code

Go to file
t