I will be going today, the 23rd and, my visa expires on the 24th. I'm at the airport right now and they put me on hold!
Yes, you can. A Japanese visa is valid for entry up to and including the day of expiry:
Visa holders must enter Japan on or before the visa expires, or date of expiry.