Jesus, Mary and Joseph were a holy and good family but their lives were far from idyllic.