You're not the only one. Many of us have been trying to argue that point for ages. It's just that people who think it's a voodoo doll are more familiar with the concept of voodoo than with the asian concept of sacred-statue disrespect and retribution (or... with the janinism concept of Karma that doesn't require ill intent to punish someone).
Hey! I think this might be the manga you were thinking about?
http://www.mangago.me/read-manga/fukouchuu_no_shiawase/
I just need to know, am i the only one that thinks this is happening because of How jinwoo acted towards that holy monk statue or what it was? Like I feel like I’ve read another manga with someone not treating it with respect and therefore ended up with bad luck