The system automatically learns internal representations ofthe necessary processing steps such as detecting usefulroad features with only the human steering angle as thetraining signal. We never explicitly trained it to detect, for example, theoutline of roads. Compared to explicit decomposition of the problem, such aslane marking detection, path planning, and control, our endto-end system optimizes all processing steps simultaneously. We argue that this will eventually lead to better performanceand smaller systems.