avfilter/vf_bm3d: Dont round MSE2SSE to an integer

Fixes: CID1439581 Result is not floating-point

Michael Niedermayer committed 2 years ago

Commit ec18ec91 parent ffba5281 file · +1 −1Browse files

Showing the changes to libavfilter (1 of 1 file). Show all

Unified · Split

@@ -274,7 +274,7 @@ static void do_block_matching_multi(BM3DContext s, const uint8_t src, int src_ · 273 unmodified lines
274	274	int r_y, int r_x, int plane, int jobnr)
275	275	{
276	276	SliceContext *sc = &s->slices[jobnr];
277		− double MSE2SSE = s->group_size * s->block_size * s->block_size * src_range * src_range / (s->max * s->max);
	277	+ double MSE2SSE = s->group_size * s->block_size * s->block_size * src_range * src_range / (double)(s->max * s->max);
278	278	double distMul = 1. / MSE2SSE;
279	279	double th_sse = th_mse * MSE2SSE;
280	280	int index = sc->nb_match_blocks;

Keyboard shortcuts