It's not just the piston speed, but also the side load on the major thrust face. It's why cylinders wear into ovals. You don't think this will occur at a higher rate when the oil is 150 degrees below its operating temp and you have a load sufficient to accelerate the car's weight? Vs. nearly zero load?
This is a valid concern. It is also why many engines have the crank pin offset slightly from the cylinder centerline, such that the power DOWN stroke (which is when the piston side thrust is at the greatest) sees less crankpin offset than the compression UP stroke.
Now then, just because there exists piston side thrust doesn't mean there will be wear on the opposing cylinder wall. If that is the case, then the engine will be destroyed in no time at all. We all know that is not the case. Why?? Because thin film lubrication by circulating engine oil provides a cushion between the piston skirt and the cylinder wall. Same as at any bearing surfaces. The two opposing metal surfaces actually glide on a thin film of oil, such that no metal-to-metal contact actually occurs.
What produces frictional heat is actually work done in shearing this thin film of oil -
not dry contact friction. More side thrust adds more stresses, which produces more frictional heat,
not necessarily more wear... so long as the thin film lubrication is maintained.
So... what provides this thin film of oil, you ask? Why, the engine oil pump, or course. This gets at the crux of why driving gently is preferrable to idling. With the car driven gently and the engine operating at moderate RPMs (say between 1500 and 2000 RPM), the direct gear-driven oil pump will be pumping more rigorously to produce a healthy oil pressure - and flow - compared to when idling. This is absolutely critical, especially when oil at low temp is more viscous and thus harder to flow effectively through tiny oil passages. Again, as long as thin film lubrication is maintained - and the driver doesn't go nuts with the loud pedal - the engine
will warm up faster and get out of the danger zone sooner, all the while protected by a robust oil circulation.
Now, if instead you choose to idle. RPM will be low and the oil pump will be driven at the absolute slowest RPM. Now, if you check the oil pressure reading, it might actually read reasonably high, depending on where that oil pressure sensor is located. This might mislead you into believing you have adequate oil pressure
and flow. Well, because the oil at low temp has higher viscosity, it tends to resist pumping, so the oil pump needs to push that thicker fluid harder. This might register an adequate pressure reading at the oil pump outlet, but that pressure will quickly drop when the oil has to flow through tiny orifices and small passages. So, by the time that oil reaches the bearing surfaces, there might not be much pressure left to produce a robust enough thin film strength.
Ironically, NO load doesn't necessarily guarantee NO wear. This is an easy misconception to theorize, by those without a solid understanding of tribology.