A new report warns many of the farms filling market stalls are struggling to keep up with rising costs.