Food safety has recently become a widespread concern among consumers. Surface-enhanced Raman scattering (SERS) is a rapidly developing novel spectroscopic analysis technique with high sensitivity, an ability to provide molecular fingerprint spectra, and resistance to photobleaching, offering broad application prospects in rapid trace detection. With the interdisciplinary development of nanomaterials and biotechnology, the detection performance of SERS biosensors has improved significantly. This review describes the advantages of nanomaterial-based SERS detection technology and SERS’s latest applications in the detection of biological and chemical contaminants, the identification of foodborne pathogens, the authentication and quality control of food, and the safety assessment of food packaging materials. Finally, the challenges and prospects of constructing and applying nanomaterial-based SERS sensing platforms in the field of food safety detection are discussed with the aim of early detection and ultimate control of foodborne diseases.