A food collective spokesman said the U.S. Department of Agriculture's decision will hurt food pantries and families in need.