merc 350 mpi starting issue

New to the site, enjoy reading the topics. first time posting. I got an 04 v220 with merc 350 mpi, a couple times this year when I turn it off, it won't turn back on, sits for a little while then starts up fine. When it decides not to start nothing happens, I can hear the fuel pump prime when I turn the key but nothing else, not getting any alarms either. The temp is midrange 175 or lower. Has this happened to anyone else? I'm leaning toward it being the starter, the solenoid is attached to the starter. Any help is greatly appreciated.