Chinese doesn't have a phonetic alphabet, so basically all the writing is in hanzi. Japanese kanji were basically just taken from hanzi, but they also have a phonetic alphabet, so they don't need all the words to have a kanji equivalent.

Also, there's much less overlap in pronunciation of Japanese words than in Chinese. It makes sense that you would have more characters to represent more words when their pronunciation is identical.