Would it sound out of place if the riffs of a song didn't follow the similiar scale or would it be ok if only the backing rhythm did?

EDIT: Holy Shit! you guys know alot about theory, I need to start learning some of this

__________________