E-learning has broadly become an important enabler to promote distance education (DE) and lifelong learning in most of the developed countries, but in Bangladesh it is still a new successful progressive system for the learning communities. Distance education is thought to be introduced as an effective way of educating people of all sections in Bangladesh. Bangladesh Open University (BOU), the only distance education provider in Bangladesh, has been trying to adopt the use of various e-learning materials for its distance delivery. This paper has tried to describe the current progress of quality elearning for expanding distance education, identifying the major problems of e-learning in distance education at tertiary level in Bangladesh, with special reference to BOU, and finally to put forward some valuable recommendations for solving the problems. The study is based on both primary and secondary sources. It is observed from the research that elearning is going to ensure its bright prospect as an alternative mode of education at the tertiary level in Bangladesh. There are several problems that are identified and can be mitigated and solved through Information and Communication Technology (ICT) development, greater acceptance by learners, and much research in this sector in Bangladesh to face globalization.