This property was originally purchased by Judge Edwin B. Crocker in 1868. After working with architect Seth Babson, the original building was transformed into a mansion. The Crockers moved into their home in 1872. There was a gallery building that was also constructed and it was opened in 1873. The gallery included a bowling alley, skating rink and billiards room; all of which were located on the "ground floor." The natural history museum (which is now the ballroom) was located on the first floor along with the Library. The actual art gallery space was located on the second floor.

The family had planned to create a major art museum there opened to the public when tragedy struck. The eldest daughter, Kate, died just a few months after being married in the house. Judge Crocker died a year later. Mrs. Crocker was known to be a spiritualist and was deeply interested in paranormal or spiritual phenomena. In 1885 she gave the building and it’s contents to the City of Sacramento. As a result, a lecture program was started and the Sacramento School of Design was also opened there.

In the early 1900’s the building was transformed into the Peniel Rescue Mission which was a place for unwed mothers and their children. Mrs. Crocker died in 1901; and her ashes are now buried in the Old City Cemetery. Her daughter, Jennie Fassett, gave the family home itself to the city; which became an additional museum piece.

People have reported feeling the presence of both Judge and Mrs. Crocker’s spirits in the museum. The spirits appear to be of a calming nature; no one has reported feelings of fear of apprehension there. Most of the sensations come from the East Wing and the Library. People have heard alleged sounds that come from the Library; such as someone running in the area. There was an incident where a piece of sculpture was toppled over with no explanation and that the sculpture was damaged. A sculpture of a monkey on a hat was also broken . Security Alarms were tripped and no one could explain why.

There have been extensive investigations of the Crocker Art Museum where it was determined that there is an excess amount of energy in the Library, the West Wing and the Ballroom.