Golf club head or other ball striking device with removable and/or movable sole member

A ball striking device, such as a golf club, includes a head with a face having a striking surface configured for striking a ball and being defined by a plurality of peripheral edges, a body connected to the face and extending rearwardly from the peripheral edges of the face, and a sole member connected to the sole of the body. The sole member may be removably connected to the sole, which can permit removal and replacement with another sole member having a different property. The sole member may additionally or alternately be movably connected to the sole, which can permit adjustment of the sole member, such as to change the lie angle of the head. The sole member may be at least partially received in a receiver in the sole and may form at least a portion of the lowermost surface of the head.