Actually, justice is also a large theme in the Bible. The reason God had to sacrifice Jesus Christ rather than just forgiving and forgetting man's trespasses right away was because despite His infinite love, God also had to be infinitely just. The price for sin had to be paid, so He took it wholeheartedly for us, so that love and justice could prevail.