If there had been some gain near at hand and an average journey, they would have certainly followed you, but the difficult destination was too far for them. And they will swear by Allah: "If we could, we would have set out with you." They are ruining themselves. And Allah knows that they are liars.