It's one of the last weekends swimmers can enjoy the popular spot, Cromwell's, near Black Point as it's been for decades.
Click here for Nana Ohkawa's report.
A fence will be installed there soon, swimmers are warning that it will make the area even more dangerous.
People said jumping is the thing to do at Cromwell's.
"This is a very popular spot. For the longest time a lot of the kids come here and meet up with friends, they run into old friends. It's a gathering place," said Deshannon Chun.
The Doris Duke Foundation for Islamic Art and Culture that owns this property wants people to stop jumping off the walls. There are plenty of warning signs that say no diving, no jumping and no climbing. They are often ignored, so the foundation is going to install a safety measure, a 6 foot-tall aluminum fence.
The foundation said the fence will be constructed along the stone walkway and will not prevent ocean use such as swimming, snorkeling or fishing.
"I'm sad to hear that they are going to put up the fence. I've been coming here since I was a kid, brought here by my father and grandfather, and I also taught my son about this place," said Kenny Rowe.
There have been numerous injuries at Cromwell's, and two tragic ones that ended in paralysis. The foundation settled the two lawsuits from the incidents.
Many swimmers said the fence will make things worse, only tempting people to climb up and jump over.
"People are doing it now with no fence. Imagine a ladder, a fence, I think it's going to make matters worse," said Alex Caswell.
"I think its going to attract more people. They will see that it's restricted and sometimes when you restrict things more people tend to want to do it more and rebel," said Marcie Reihanifam.
Construction of the fence will begin the week of the 21st. It will take four weeks or less to complete.