Are experienced units cost-effective?
That depends on what you mean. If you look at individual units and look for the most “bang-for-the-buck”, the answer is no. Still, having some experienced units is probably a good idea since quality often beats quantity, at least in the long run (inexperienced troops tend to lose cohesion during long campaigns, even when not fighting).