I'd hunt as late as possible, such as 3rd season.
Quite often you will have snow that will start to push the animals down to the lower elevations where in the early seasons there are no animals.
A great example of this is in unit 21 in Colorado. You might see one or two deer in the earlier seasons but it is the later seasons where they actually start to move into the unit. Same with elk in some other units. They spend their summers up high but start to migrate down when the snow starts to cover their food source.