He's not entirely to blame, but he's not guiltless [=innocent], either.他不该对此负全责，但他也不是无辜的。

a guiltless pleasure [=a pleasure that does not make you feel guilty]心安理得的享乐