You need to get rid of the algae first.
See "How do I get rid of the algae" for details.
When the algae's gone, it will reveal a hole.
The hole seems to be a mechanism of some sort.
The mechanism opens the gate.
You need to put something in the hole.
Try the roasting spit from the manor house.
Good idea, but now it seems to be rusted.