I decided early on in life that I would participate in all the church activities I could - without sacrificing something more important. That works wonderfully for me - and I am confident that God understands and loves me for the desire of my heart.
For example, before our latest move I lived just over 30 minutes from church - but, more importantly, I was on a strict budget. I started a new career a few years ago, and I had to do so at the bottom end of the ladder. Therefore, I still am not making much money - with three children in college and three daughters still at home.
This means that my family simply couldn't afford to go to most of the church activities that are held on days other than Sunday and Wednesday - and that we couldn't make it to the ones that occur on Sunday evenings.
Furthermore, since I was serving as a High Councilor and needed to drive pretty significant distances for my speaking assignments and stake meetings, some of the things we might have attended previously were not possible at that point.
Fine. We didn't attend them.
We do what we can, and I don't stress about not doing what we can't. My family comes first, and I use my own situation regularly to teach others that we can't judge others at all, in any way, by how active they are in non-essential activities. For example, I've mentioned in Stake Leadership Meetings that I don't attend the temple as regularly as I would like because my and my wife's work schedules don't match, and it's hard to afford extra trips to the temple right now.
Summary: I am comfortable doing what I can, when I can, to the extent I can. Period. If that's good enough for others, fine; if it's not, fine. Period. It's what they are going to get, and once they realize that they are fine with it. (with a few exceptions, but there are people like that everywhere in life)
God loves me, and that really is enough in the end - although I've found that people generally love and accept me when they know I genuinely love and accept them and am willing to worship with them as much as I possibly can.