How will this change in family structure affect a toddler?

The needs of the child are important, but so are yours, and staying around just for the child would be wrong regardless - wrong reason to stay around as your resentment will grow. Plus, your statement seems to indicate the dad is comfortable with your leaving. If your presence is not important for him, or in his own view for his child, then its time to pack and go.