Not necessarily. Most health departments, for example, state clearly that services must be provided for all inhabitants of that State. The reason for this is to prevent the spread of disease.

Edit: here's California's Health Directive:

CDPH's key activities and services include protecting people in California from the threat of preventable infectious diseases like Zika virus, HIV/AIDS, tuberculosis and viral hepatitis, and providing reliable and accurate public health laboratory services and information about health threats.

Other critical services include providing nutritional support to low-income women, infants and children, and screening newborns and pregnant women for genetic diseases.

...and so on.

Of course, whenever an illegal commits a crime, well, there's the whole police thing.

These examples are only just for starters.