What if the addresses of passport and ID card are different?

It doesn't matter, it doesn't affect your visa and other procedures.

A visa is a document issued by a country's entry-exit administration department (such as immigration bureau or its embassy or consulate abroad) to express approval to foreign citizens.

Passport is a legal document issued by a country to prove the nationality and identity of its citizens when they enter and leave the country and travel or stay abroad.

In other words, passports are issued by local authorities, while visas are issued by foreign authorities. Since the local authorities have issued passports, foreign authorities will not verify the location and issuing place of your account when applying for a visa. You can rest assured.