sure.
In these sweat shops the product doesn't end up in a local market, and usually there is no or limited growth of any supporting "cottage industries". so the sweat shop is not providing new/better goods to the local community. while taking workers away from the past mom/pop places or the fields.
so whatever limited options were there to spend money on, have been further decreased. demand has either stayed the same, or increased with increased wages; while the supply has decreased. which means either prices rise, or they have to import from elsewhere, which doesn't much help the local community. but the inflation will hit the entire community, not just the workers.
so the worker may not see an increase in the actual standard of living, because the cost of living the same life has gone up.
definitely doesn't apply to every sweat shop, but it happens enough to really call into question how much of net gain is it for the local workers.