Not a lost cause at all but...
You were mistaken to assume that you had plans. The "that sounds good" comment, while encouraging, is not the same as "see you there".
You were halfway there though; you had a time, but not a place. Finalizing plans three hours before the date is insufficient...