Despite the widespread adoption, there is a lack of research into how various critical aspects of LLMs affect their performance in hate speech detection. Through five research questions, our findings and recommendations ...