The lifeguards won't let you launch at the beach and surf near swimmers.

If you have a military ID you can launch at Ft. Story and paddle around to the
surf or just play in the mouth of the bay.

Keep an eye out though, once the USN Seals asked me to paddle somewhere else
because they were going to drop a boat out of a helicopter where I was
paddling.

Brian