Bonaire is located just north of Venezuela in the ABC Islands. You can dive from shore from almost anyhwere on the Island or rent a kayak and paddle to Klein Bonaire to dive. Here's the kayak rental:
http://www.bonairediveandadventure.com/index-db.html
My wife and I rented an OK Malibu II XL and spent 1/2 day on Klein diving and kayaking around. It's about 1 mile across to the island, expect windy conditions, the wind rarely stops. I was going to do some offshore kayak fishing but my rods ended up in Puerto Rico instead...
Here's where we always stay, very quiet:
http://www.bellafontebonaire.com/