"I cannot imagine that he (Ballack) would go to Manchester United," Rummenigge told television channel Premiere.
"What do Manchester United have that Bayern Munich don't? If you take a quick look at the English table then it seems it is nothing. If I was a player I would not go to Manchester United under any circumstances."
Nine-time European champions Real Madrid are another club linked with Ballack's signature but Rummenigge pointed out that the Spanish titans were going through a lean spell.
"Real Madrid is another club with this amazing image but if you look at it they have failed to win anything for the past two years," he added.