I want another kid, but not another baby

My husband and I have mostly decided that we want another baby. If we started trying soonish our first (and currently only) would be 4 when the baby was born. I love the idea of having a second, and I feel like we’re pretty well prepared, but I hated the baby stage so much the first time that I’m starting to doubt my decision. My first was a super tough baby. He cried constantly and was fussy when he wasn’t crying. I also had really bad seasonal depression when he was born because it was at the start of winter and I could barely ever leave the house. Because of this we would try to time it so baby was born in spring or summer. Seasonal depression may also be the reason that I’m currently feeling terrible and like I’m not cut out for a second. I guess I’m just trying to convince myself that I’ll be able to get through another difficult first year.