The Swans boss was far from pleased with the refree's decision in sending-off Albert Serran 17 minutes into the game at The Liberty Stadium on Monday afternoon.
"It's not easy but we need to be strong to get above such things as has happened to us today. Perhaps the officials do not want to see us high up in the table," Sousa said after the match.
"The sending-off was ridiculous and if standards of refereeing are not improved it will kill the game.
"We train hard and try to play good football and so I want to see good referees.
"I will not show him respect by speaking to him as he has not shown any respect to us by his actions today.
"I don't know if we would have won with a full side but we did make a number of chances."