HIV prevalence is rising and has been consistently higher among women in Rwanda whereas a decreasing national HIV prevalence rate in the adult population has stabilised since 2005. Factors explaining the increased vulnerability of women to HIV infection are not currently well understood. A statistical mapping at smaller geographic units and the identification of key HIV risk factors are crucial for pragmatic and more efficient interventions. The data used in this study were extracted from the 2010 Rwanda Demographic and Health Survey data for 6952 women. A full Bayesian geo-additive logistic regression model was fitted to data in order to assess the effect of key risk factors and map district-level spatial effects on the risk of HIV infection. The results showed that women who had STIs, concurrent sexual partners in the 12 months prior to the survey, a sex debut at earlier age than 19 years, were living in a woman-headed or high-economic status household were significantly associated with a higher risk of HIV infection. There was a protective effect of high HIV knowledge and perception. Women occupied in agriculture, and those residing in rural areas were also associated with lower risk of being infected. This study provides district-level maps of the variation of HIV infection among women of child-bearing age in Rwanda. The maps highlight areas where women are at a higher risk of infection; the aspect that proximate and distal factors alone could not uncover. There are distinctive geographic patterns, although statistically insignificant, of the risk of HIV infection suggesting potential effectiveness of district specific interventions. The results also suggest that changes in sexual behaviour can yield significant results in controlling HIV infection in Rwanda.