A federal judge in Georgia says a former restaurant manager can’t sue celebrity chef Paula Deen for racial discrimination. But the ruling today by U.S. District Judge William T. Moore Jr. leaves sexual harassment claims against Deen intact, the AP reports. In his decision, Moore said Lisa Jackson had no standing to sue Deen on basis of racial discrimination. Jackson’s lawsuit against Deen and her brother Bubba Hiers started an avalanche of bad press for Deen leading to the collapse of her cooking empire. Food Network dropped her and other business partners followed after it was revealed that she confessed to using the N-word in a deposition for Jackson’s suit.

Related: Paula Deen Lawsuit “Never Been About N-Word” Says Plaintiff