Congress called Modi’s visit irresponsible and said that nothing had happened to warrant warming of ties