Most liveries can be total and utter tools, and are a nightmare to deal with (experience from my parents’ farm). Budget on replacing the fencing with electric tape or post and rail if it’s barbed wire or similar, and you’ll need insurance as well.
Do you have somewhere to store hay? Square bales take up room; round bales of haylage tend to distribute the contents across the whole field after a bit. Add a ring feeder to the previous list of expenses if you don’t have room inside.
Guess who has to go out when you see the horses trotting towards the main road after the owner hasn’t shut the gate properly and pissed off home?
Might not be worth it for only 2 horses.