I hosted a HL2DM server last night on a whim, and even though there were no more than 4 players on it at a time, the memory usage gradually climbed until the system crashed. This was on a 6mb connection and it was the only server running on the box.
So yeah. Memory leaks. Valve should probably do something about that, I think.