水美温泉会館

The hotel is quite close to the Xin-Beitou station (on the right hand side).
The hot spring water is also available in your room (which I found nice). You do not the swimsuit in the public bath. The breakfast is just OK.