Heyooo
When I first kept my two boars i kept them in a hutch in the shed, if you do have a spare hour or two on the evening go into the shed and sit with them....this isnt too everyones taste i understand and I'm sure not everyone is as dotty as i was with my boys (think wrapping up in a jumper, coat and scarf and sitting with them in the shed with the shed light on and a book!
However if you can spare 15-20 a evening just to sit and chat to them you can build up their confidence over time. You could try reading a book to them so they get used to your voice and associate it with something that isn't dangerous. Another option is leaving the radio on for a couple of hours whilst you are out so they can become used to voices
For handling not all piggies like to be touched and 'cuddled' however you can make this cuddling time fun for both you and the piggies. If you have a cosy cup or pet bed (or even a small dog bed with hay) you can entice them in with veggies and place this on your lap and slowly get them used to stroking and cuddling.
Another tip might be leaving something that smells of you in their cage (if you dont mind it being nibbled/peed on) ie a scarf, hankicheif, cuddley toy.
I know it can be a chore in the winter months when its pouring down, and the piggies need their hay and veggies but you can make it easier by having a check list, and a good winter coat and wellys!
I have a check list, and keep an eye on hay.

Hay is very cheap to buy esp in bulk a bale of hay is around £12-15 for meadow, and you can store it in the shed ontop of the hutch. For veggies try looking in the reduce section in supermarkets on a daily basis, my piggies get curly kale, parsley, little gem lettuce, spinich, carrots, apples all from the reduce section costing me from 10p-£2.10 depending on how much.
You could also have a wonder down to your local greengrocers (an independent shop not supermarket) and see if they'll come up with a discounted fee if you stick with them for x amount of time or you buy a certain amount weekly. They might also be able to deliver to your door which will be handy if you do find you forget easily.
It can get frustrating when you’re tired, got a lot on your hands and the piggies aren’t being friendly but it is so sooooo rewarding when they finally trust you (take my Artie for example, i did everything i have said above it took me a year and a half for him to finally come to me and allow me to touch his back. Amazing, you will get there it just takes time, trail and error and a bit of self motivation! Good luck x