How do you guys coordinate your lives?

We both in our 20s. We got married as we were both coming out of graduate school. We lived very close and slept at each other's places, which worked really well since we were students. Now we live together. I have had a rough year, working a bit in between as I have been applying to jobs more relevant to my field. My husband works from home, and loves being at home, reading, napping, playing board games etc. In contrast, I am a very social and active person. My husband is getting increasingly frustrated with me, because sometimes in the morning I will have gone out for a run without telling him (he gets up before me), or I will want to run in the evening even if he was assuming I would just be home. Sometimes I like to go to yoga, and then I will only be home at 7 (we usually eat dinner at 5). He will want to go for a walk with me on a Saturday morning, but I have already planned to go to brunch. I just feel like it's impossible to keep him updated constantly on where I am and what I am up to. If we have made a plan, like having breakfast on Saturday morning, or to watch a movie, I will of course do that. But it's like he thinks that he always has the right to my time, and is upset with me when I do something that he was unaware of (i.e spontaneous run, or an old friend is in town so I will go for a drink with them etc).

I am writing to you guys because I am exhausted by the stress... of coordinating our lives? How do you do it? It feels like anytime I leave I have to tell him where I am going, who I am going to be with and how long I will be gone. Sometimes I don't know, like when I'm brunching with my friends. Maybe we only have brunch. Maybe we also go a walk. Maybe we go to thrift shopping. So it's really hard to set a time??? And then if I come home later than the time I said, he will be upset with me. We spend a lot of time together, so it's not that we don't see each other.

I love my husband, but it drives me absolutely crazy feeling like I am a child asking for permission to leave home, which I never even had at home. My parents both worked shifts and I grew up somewhere remote, so work/school led us to have different schedules, but we would always have dinner together. Apart from that, everyone did what they wanted, whether it's to go for a run or seeing a friend, unless there are fixed plans. Is that too much to expect?