You must distribute the source code you have used to compile the [GPL V2 licensed] binary that you distribute, So anyone that fetch the binary can modify and recompile the source code.
The source code and binary don't have to be exactly side-by side. The source code should be easy to fetch, uncompress..., otherwise you should document how to get it, where to get it, how to uncompress and build it...
This only applies to each and every version of the binary that you distribute (even experimental). If your experimental binary is published and overwritten, it's probably fine to publish the source repository (like git).