Congratulations on your new arrival!
Not sure if it would work for you but what about some compromising? In the early days hubby slept in the guest room from Sunday to Friday to have proper nights sleep (he has a very demanding, stressful job) while I slept with the baby in our room. On Friday and Saturday nights he slept with the baby while I went to the guest room on my own, door closed and wasn't allowed to be disturbed - total bliss
I had a very complicated labour (emergency c-section) and tough recovery too (spent nearly 2 weeks in hospital afterwards during which hubby had to look after the baby on his own every day and night!) but those 2 full nights sleep per week that I had was all I needed to cope with the rest of the week on my own.
Good luck! As you already know, it will get easier eventually xx