Priest takes leave of absence after being accused of 'inappropriate contact' with woman