Former Japanese leader Yasuo Fukuda urges action as public sentiment between the countries drops to 20-year low.