This question is a little vague, because the answer could vary depending on specific exercises.
For overhead pressing, the advice I've read most often is to pull the head back and tuck the chin – as if you were making a double chin. On a military press, this is partially a matter of logistics, allowing for a safer bar path. But I've also found it to be better for DB presses too.
If I try to keep a neutral neck or even worse, head tilted up, I'm much more likely to over-engage the small muscles in the neck and have a painful strain, specifically the levator scapulae. I tweaked my neck doing DB OHP probably 20 times before I figured this out, and I think only once since (sloppily pushing for a PR). You'll see advice to "look up" when pressing overhead, but that generally refers to your eye position, not your neck or chin.
My experience is anecdotal; I don't have science creds to back it up. Do your own tests. See what works for you. But it has also helped some friends, and you see the instruction to tuck your chin in plenty of legitimate sources: