Hi Ashton! Yes, there were people swimming at Hiji Falls, but the US military discourages swimming due to underwater hazards and the possibility of waterborne bacteria. Great place to get a tan on the rocks and dip the feet after the hike!
Be sure to visit Okinawa, the Hawaii of Japan, while you are living in Kobe! Great money to be made teaching English! :-)
~Jeff (and Jenny)