Penis sizes do vary, but not by as much as you might think. The soft penis usually shrinks when it is cold or when the man is anxious.
As a rough rule, the longer a penis is when soft, the less it grows when hard. It increases in size when it is erect. If it is small when soft, it may increase relatively more in size when it becomes erect.