From BR Bullpen

A division is a grouping of teams within the league:

Before there were divisions of this kind, a team in the "Second Division" of the league was one who finished in the lower half of the league's standings. (The opposite term is "First Division", although it was used less frequently.)