Right
下 supplies the sound for the xià reading. The down-arrow shape also adds a faint semantic hook: a startled person ducks down or sinks. Same phonetic in
虾. For the hè reading (
恐吓,
威吓), the sound link has drifted - the traditional form
嚇 took its phonetic from
赫 instead.