Well, I'm recovering from major surgery, so yes I have fatigue.
And I would imagine that I will have some fatigue here and there as my recovery continues during the period that I'm still very limited in the amount of food I can consume.
And no, I'm not concerned about it in the least, because while--like you--I don't have time for fatigue, I can say that I DEFINITELY don't have the time or energy to drag around 200 pounds of extra weight for the rest of my life. So, fatigue? Bring it on. It'll just be something I'll deal with temporarily on my way to a healthier and more energetic life.