There's a difference between a refugee and an immigrant. I'm generally in favor of both within reason. The issues mainly have to do with the enormous government burden in ensuring that refugees are educated and acclimated to the new country.

It's vitally important for instance for public education to be considered here. When families come as refugees the parents usually work full time and can't spend as much time teaching the kids as well as their cultural attitudes potentially not being in line with what is necessary for success in the new country. You see this with many refugees where their kids end up being delinquents as they get older due to disruptive effects from the move over the long term. And the piss poor public education system in the US doing little to prepare them for success when the parents aren't pushing it either for to cultural attitudes or lack of ability and time to deal with the school system especially once language barriers are taken into consideration.