Sadly due to the global economic recession,lots of people are loosing their jobs as well as going on short time, you really should sit back and think how youd feel if you where in the same position,a child on the way, etc, im sure a wooden fence would not be your biggest thought, especially as the neighbour wanted you to spend your money.
Id personally pay for the fence,invite the neighbours round for a barbeque,to get to know them better,offer a hand of freindship, instead of a sword of demand.
Perhaps you could invite your neighbour out for a bike ride, or a drink.
Be kind , considerate to all around you, help people in need, dont get angry and bitter, learn to love everyone in a worse situation than yourself.
Then watch and wait as they all abuse your trust,take what they can, laugh at you, and finally vote bloody labour, youve been warned.