I answered a similar question recently, although it was sort of asking the opposite - the OP was curious about whether crusades to Egypt actually happened.

But hopefully that helps answer your question as well. Very briefly, the crusaders in the Holy Land, and crusade organizers back in Europe, recognized pretty much immediately that they would never be able to hold on to Jerusalem without controlling Egypt as well.