There is a caulk that is made specifically to look and feel like mortar. It's called "Mor-Flexx". On the tube it says, "Looks like mortar - Stretches like rubber. It has a sandy texture to it and it's gray. It can be painted if another color is desired.