You can, but its a pretty bad look to be very publicly demoted and then just stick around. Better to go out on a high note as “a house speaker” instead of “a Congressman.”