Vicki and I went to Hawaii for our tenth wedding anniversary. We spent half the time in Honolulu.
The other half we spent at a friend's condo on Molokai. You're right: compared to the "touristy" islands, there's nothing there. It's an amazing contrast. But, with the whole family along, "nothing there" is probably a lot of fun.