West Africa is highly vulnerable to climate hazards and better quantification and understanding of the impact of climate change on crop yields are urgently needed. Here we provide an assessment of near-term climate change impacts on sorghum yields in West Africa and account for uncertainties both in future climate scenarios and in crop models. Towards this goal, we use simulations of nine bias-corrected CMIP5 climate models and two crop models (SARRA-H and APSIM) to evaluate the robustness of projected crop yield impacts in this area. In broad agreement with the full CMIP5 ensemble, our subset of bias-corrected climate models projects a mean warming of +2.8 °C in the decades of 2031–2060 compared to a baseline of 1961–1990 and a robust change in rainfall in West Africa with less rain in the Western part of the Sahel (Senegal, South-West Mali) and more rain in Central Sahel (Burkina Faso, South-West Niger). Projected rainfall deficits are concentrated in early monsoon season in the Western part of the Sahel while positive rainfall changes are found in late monsoon season all over the Sahel, suggesting a shift in the seasonality of the monsoon. In response to such climate change, but without accounting for direct crop responses to CO2, mean crop yield decreases by about 16–20% and year-to-year variability increases in the Western part of the Sahel, while the eastern domain sees much milder impacts. Such differences in climate and impacts projections between the Western and Eastern parts of the Sahel are highly consistent across the climate and crop models used in this study. We investigate the robustness of impacts for different choices of cultivars, nutrient treatments, and crop responses to CO2. Adverse impacts on mean yield and yield variability are lowest for modern cultivars, as their short and nearly fixed growth cycle appears to be more resilient to the seasonality shift of the monsoon, thus suggesting shorter season varieties could be considered a potential adaptation to ongoing climate changes. Easing nitrogen stress via increasing fertilizer inputs would increase absolute yields, but also make the crops more responsive to climate stresses, thus enhancing the negative impacts of climate change in a relative sense. Finally, CO2 fertilization would significantly offset the negative climate impacts on sorghum yields by about 10%, with drier regions experiencing the largest benefits, though the net impacts of climate change remain negative even after accounting for CO2.