If you've got more than 1 Apple device synced to your phone such as an Apple Watch, the prompt of 'Add to Apple Wallet' will remain until you've added your card to all devices.

The device will need to be switched on and not in airplane mode.