At one point we see her on a stretch of the Des Voeux Road which is almost as recognisable today even though all the buildings along it have changed - Hong Kong can be a bit weird like that. One feature that helps us place this shot is the building in the far background which is the old Wing On building. Wing On still occupies the same site today, albeit with a slightly more modern building.
The second recognisable part is the intersection of Des Voeux Road and Wing Lok Street which joins at a tangent to the left of the curved building in the background. The Streetview grab below shows pretty much the same angle as the film - the gold-windowed building (above the jaywalking pedestrian) being the modern day replacement of the curved one in the 1955 picture.
The bottom screen grab shows a closer view of the aforementioned Wing On building that can be seen in the background of the top picture. It is a good example of how film makers mess with geography because this second shot occurs almost immediately after the top shot even though Hayward's character can be seen moving away from it in the top shot.