Down is not inherited, it's a chromosomal nondisjunction. On the other hand, Fragile X is x-linked inherited disease (CGG; anticipation; hypermethylation).
The way I see it, Down is the most common cause of intellectual disability, period. Fragile X is the most common inherited intellectual disability.