Is Bristol safe at like 3 AM?

I'm a female in her early 20s. I got an early morning shift to travel towards Totterdown. I stay around the Centre and busses for this route are from the Wine Street. I heard that the area around Wine Street bus stop (Castle Park) is not really safe.

I'm confused about what to be done :/