“For it is God’s will that by doing good you should silence the ignorant talk of foolish men.” 1 Peter 2:15
People love to make jest of Christians, especially those who don’t believe in any religion. They talk and talk and talk without any basic reason(s). To them, they don’t just like Christians.
When you do well, then you are showing to them the power of God. They will seize to be bad and most of them will turn to Christ because of your deeds.
This is why in order for you to shut down their mouth and destroy their ignorance; you must live your life in doing well all the time even if you find this discomfort. By your positive acts, you are promoting the kingdom of God and you are showing to them that Christianity is not evil but Good.