Actually, it's A Time to Harvest, where Janeway says they had one date..Though there is a reference to their Academy days in Hate too. Looks like in Mosaic Janeway was more interested in keeping her distance from him... This is all from searching Google Books.