I have no start-up costs as I already have everything I need. I basically just need to do the work and then I'd invoice for hours & expenses.
There are always start up costs. Even the working capital to tide you over until your first invoices get paid up and basic marketing (ie, taking potential customers for a cup of tea and a bun).
If redundancy is looking likely, hang on until it happens. Gardening leave will pay you to sit at home for a month whilst you sort out your business plan (do one even if you aren't borrowing money, do a proper financial plan and work out what impact pricing changes etc. have on the bottom line). If you get a redundancy package, you've got some seed capital / something to fall back on.
If it's consultancy, I believe it's professional indemnity insurance you'll be wanting.