Moving the ball in any way cannot provide any acceleration. All it can do is change the center of mass of the system. Consider sitting in a box on top of a super-slippery surface. Tie a heavy ball to the end of a rope. Swing the ball around. If you swing it in a steady circle, you would not move. Vary the speed (by pulling harder or changing the length of the rope) while you swing the ball and you might move around, but you would just wiggle back and forth around the place where you started.
Moving mass around inside a closed system just changes the center of mass of the system. It cannot cause the system to move. Get back in the box and toss the ball out of the box. The box will move in the opposite direction. This is how rocket motors work. The system isn't closed, because the ball leaves it. Now, toss the ball at the wall of the box. The box will move as before until the ball hits the wall which will cause it to move back. The net effect is no movement of the box. That's what happens in a closed system like the device described in the original post.
The only acceleration you might get from this device would be due to the slightly asymmetrical release of heat. Some of the heat from the "friction" side would reflect off the "smooth" side causing acceleration. But, that wouldn't provide much acceleration (especially in relation to the energy you would put into the system to keep the ball moving.)
An LED or light bulb powered by a battery would work in a similar way and would be much more efficient.
-- Roger