History

vpx_dsp/x86/avg_intrin_sse2: fix int sanitizer warnings

Unit Test: VP9/AqSegmentTest. VP9/CpuSpeedTest, AVX2/Loop8Test6Param implicit conversion from type 'int' of value 59741 (32-bit, signed) to type 'int16_t' (aka 'short') changed the value to -5795 (16-bit, signed) BUG=webm:1615

Hien Ho committed 7 years ago

Commit 10b475e1 parent 08da66d1 file · +1 −1Browse files

Unified · Split

vpx_dsp/x86/avg_intrin_sse2.c+1−1
@@ -571,7 +571,7 @@ int vpx_vector_var_sse2(const int16_t *ref, const int16_t *src, const int bwl) { · 570 unmodified lines
571 v1 = _mm_srli_epi64(sse, 32);571 v1 = _mm_srli_epi64(sse, 32);
572 sse = _mm_add_epi32(sse, v1);572 sse = _mm_add_epi32(sse, v1);
573 573
574 mean = _mm_extract_epi16(sum, 0);574 mean = (int16_t)_mm_extract_epi16(sum, 0);
575 575
576 return _mm_cvtsi128_si32(sse) - ((mean * mean) >> (bwl + 2));576 return _mm_cvtsi128_si32(sse) - ((mean * mean) >> (bwl + 2));
577}577}

Keyboard shortcuts

General

Show keyboard shortcuts
?
Focus the current search
/

Issues and pull requests

Open filters
f

Issues, pull requests and Inbox

Select next item
j↓
Select previous item
k↑
Open selected item
Enter
Dismiss filters or clear selection
Esc

Repository code

Go to file
t