Its perfectly normal because the gears for the 5th are already in place and running smoothly. If you keep on pushing it, it just saying you pushing 2 gears ( the sound are acturally 2 gears are brushing each other )
But it will hurt the gears inside the gearbox.
Cheers!