As long as the weight added on to the body is muscle, not fat, in theory you shouldn't be noticeably slower. Any muscle added to the legs certainly shouldn't make you slower.
Case in point, the top three finishers of the 100m dash in the last Olympics:
Note: these are sprinters. They're...