This was once the site of the original Fort Victoria which was founded in 1843. Though this is now long gone.  Bastion Square which was developed in 1963 is now a place for shops, stalls, restaurants and street entertainers, and is also surrounded by some historic building.

The square is said to be very haunted especially one of its alley ways, where there used be a prison, which was demolished in 1884. People think that it is some of these prisoners and guards that have returned to haunt the area, with reports such as the sounds of chains dragging and an apparition of a man in an old prison uniform is often seen. Also music can sometimes be heard and many orbs have been seen.