For reference, Gregor Richards explains the issue well in this news post.
The current rakefile hands all the files to dmd at once. This means fast builds, but results in lib files that makes your executable larger when you link with them. How much larger varies from one project to another.
Would it be possible to have an option to build one file at a time, like DSSS can do? This could even be the default, and you would have to use a QUICK=1 option or something like that if you want the all-at-once build. I'm not sure which way is the best default, though.
I would attach a patch, but I don't know rake or ruby. :)