The vision system was tested to control a manipulator. First, the environment was modeled. After the environment modeling phase, the objects in the scene were picked up with an electromagnetic gripper of the robot arm based on the visual feedback. The accepted maximum error in depth estimates in gripping was ± 1 cm due the compliance of the gripper. The system managed to collect up all the objects into a box.