In this paper, DeepLayout, a new approach to page layout analysis is presented. Previous work divides the problem into unsupervised segmentation and classification. Instead of a step-wise method, we adopt semantic segmentation which is an end-to-end trainable deep neural network. Our proposed segmenta- tion model takes only document image as input and predicts per pixel saliency maps.