The committee's report found that the system creates conditions that can lead to exploitation and abuse.
NDP MPs Jenny Kwan and Matthew Green say the government needs to take this a step further by allowing all temporary workers access to open work permits in an effort to prevent abuse.
"The reality is, if you're tied to one specific employer, you are really at their behest to do what they demand of you," Kwan said.
"No matter what the abuse is, no matter if you're faced with wage theft, with harassment, with violence, for women, with sexual harassment — you just have to live with it."
She said the least the federal government can do to curb abuse in the temporary worker system is to end the closed work permit system.
The committee also recommended increasing the number of unexpected, on-site workplace inspections and developing a plan to provide more permanent residency pathways to low-wage and agricultural workers.
More than half of workplace inspections take place virtually, according to the report.
