Can we still eat probiotic yoghurt that's past its use by date?

Or will we get a stomach ache? Seeing as there is bacteria already in the yoghurt, is it fair to ume that this harmless bacteria would merely multiply and have an innocuous effect on the body, or otherwise?