We study the Hubble era cosmology in the five-dimensional compactification of Horava-Witten M-Theory. We will examine whether one can recover the usual four dimensional FRW cosmology in this framework. Upon compactification on a Calabi-Yau threefold one has the five dimensional bulk space R^4 \times S^1/Z_2. The five dimensional bulk space contains N=1 supergravity and is bounded by a pair of three banes which reside at the orbifold fixed points. We add matter perturbatively on the branes (one of which is our universe while hidden matter resides on the distant brane) and then examine the consistency of the system which includes five dimensional gravity coupled to scalar moduli that arise from the compactification. We will first discuss the case where only universal moduli (the Calabi-Yau volume modulus) are included and find an inconsistency when matter is treated as a perfect fluid. We will find this result holds when the moduli sector is extended to include non-universal shape moduli. However we will then show that if one relaxes the perfect fluid assumption a consistent cosmology may be obtained. We will also discuss the inclusion of moduli that arise from the four-form flux.