Hi gwilliston,
When you say "city center" do you mean Fussen or Hohenschwangau?
Here are a
few hotels in Hohenschwangau, one of which you might recognize.
There's also
this hotel.
If it was Fussen there are a number of hotels from which you may have eaten.
Here's a nice one.
Finally,
here is a sampling of some hotels in Fussen with reviews that you might find useful.
Sorry I can't be more help, but there are quite a few possibilities floating out there. If any of the above links help you find it let us know!