Every Four From One to Five Thousand

Write out every integer from $1$ to $5000$ in a long list. How many times does the digit $4$ appear in total? (Note that a number like $444$ contributes three occurrences.)

Follow-up: how many of those $5000$ numbers contain at least one $4$?