If your brigadeiros are too delicate, you most likely did not cook them enough. Place them in the fridge, and they should harden enough so that you can roll them.