When the synthetic aperture focusing technology (SAFT) is used for the detection of the concrete, the signal-to-noise ratio (SNR) and detection depth are not satisfactory. Therefore, the application of SAFT is usually limited. In this paper, we propose an improved SAFT technique for the detection of concrete based on the pulse compression technique used in the Radar domain. The proposed method first transmits a linear frequency modulation (LFM) signal, and then compresses the echo signal using the matched filtering method, after which a compressed signal with a narrower main lobe and higher SNR is obtained. With our improved SAFT, the compressed signals are manipulated in the imaging process and the image contrast is improved. Results show that the SNR is improved and the imaging resolution is guaranteed compared with the conventional short-pulse method. From theoretical and experimental results, we show that the proposed method can suppress noise and improve imaging contrast, and can also be used to detect multiple defects in concrete.