Magnetic recording using circularly polarized femto-second laser pulses is an emerging technology that would allow write speeds much faster than existing field driven methods. However, the mechanism that drives the magnetization switching in ferromagnets is unclear. Recent theories suggest that the interaction of the light with the magnetized media induces an opto-magnetic field within the media, known as the inverse Faraday effect. Here we show that an alternative mechanism, driven by thermal excitation over the anisotropy energy barrier and a difference in the energy absorption depending on polarization, can create a net magnetization over a series of laser pulses in an ensemble of single domain grains. Only a small difference in the absorption is required to reach magnetization levels observed experimentally and the model does not preclude the role of the inverse Faraday effect but removes the necessity that the opto-magnetic field is 10s of Tesla in strength.