If the milk tooth is intact (i.e. no carious exposure of pulp), it is a natural barrier against infection. So the tooth's root can be resorbed all the way up to exfoliation and it would not be infected.
On the other hand, if the milk tooth is bombed out (gross carious exposure and pulp necrosis), you can indeed get a draining sinus tract in the gums (abscessed tooth).