The Luddites weren't against technology, they were against the misuse of technology by factory owners. But factory owners got to tell their story louder and more persistently.
"If you make it easy enough children can do it, then owners will use children." And at the time, that mean children working cotton-mills, getting mauled by the equipment, and unable to protest because you got rid of the adults who could refuse unsafe work. Luddites would embrace technology IF it meant the people who have expertise could produce better work, they protested technology that empowered abuse of employees.
In the words of Reverend Mother Gaius Helen Mohiam,
Once, men turned their thinking over to machines in the hope that this would set them free; but that only permitted other men with machines to enslave them.
The Butlerian Jihad started not because a auto-hospital spontaneously misbehaved, but because the auto-hospital's manufacturer was found out to be an enemy foreign government who, to further their own ends, abused the trust of people like Jeanne Butler.