Efficient Sequential Decision Making In Design, Manufacturing And Robotics