I would leave a hand written thank you card at their place. If you think that’s not enough you can buy a small gift for their property. A Photo frame, or a mug for example.
I have done this in many parts of the world and it was always appreciated. I am sure this will work in Japan too.