Once below the upper gully (now featuring rappel stations up to 85 feet apart), do not do the rappel off the oak tree that used to be listed on Mountain Project (this rappel is stupid - it takes two ropes on a route that otherwise can be done with one; it is also slowly killing the tree). Instead make a class four traverse to the top of a lower gully.
That lower gully requires moving down among trees and boulders. Continuing all the way down the gully puts one on top of the caves. But the gully broadens down low and almost disappears. Veer right as it broadens and a grass and tree covered hillside allows easy walking to Balconies Cave Trail, east of the cave and east of the closure. Walk east to a junction with the Old Pinnacles and Balconies Cliff Trail and walk the Cliff Trail up and around, back to a point west of the caves.