If you are familiar with Victoria from the ocean side of things you will feel right at home on one of their wake models. The main difference between the wake and ocean skimmers has to do with rocker and surface area. They are fairly similar but do have some changes. Victoria can make custom skims in 2 weeks time but some shops do carry them in stock and have them ready to ship.
They can ride looser than surf style boards but if you have the rail locked into the wave they will hold their edge and allow you to get airs for big grabs and shuv tricks as well.
The Factor is a great board at a great price and as I said, if you have that ocean skim background you will feel right at home on it.
Depending on your height/weight California Marine Sports has a Small, Medium and Large in stock and ready to ship if you dont want to wait two weeks for a custom.
You can defiantly mess around with your current skim and the fin but the rockers will seem off and not give you the same ride as a board designed for boat waves.