Balancing different groups of friends ?

How do i even balance myself with different groups of friends? I can't just meet up with one group and neglect the other right ? Trying my best to meet both sides as much as i can. If i kept on meeting one side, i'll be neglecting the other. I don't want to be drifted from any. Yes i'm selfish but i just don't want to be drifted away from people i'm close with. I've already drifted away from my own batch of people, the people who i've known through out this secondary life. I don't want to drift away from those who are close to me now. We came all the way from the not in good terms to now where we are close. Please don't let this be temporary .  But how long can this go on ? Honestly, i'm tired of it . I can't seem to balance myself with different groups of people.