The system adopts advanced laser triangulation technology, image mosaic technology and deep learning technology. And carries out image acquisition and image recognition of rail surface, rail waist and rail bottom through multiple 3D laser cameras, so as to realize non-contact measurement of rail type size, end straightness and distortion during rail static operation; And non-contact detection of rail surface quality during rail dynamic operation. It is applicable to the quality inspection of newly made rails in rail welding base.