It's only ~100 years since seafood was the primary protein source of most coastal regions. The rampant mismanagement of fish/shellfish stocks that put an end to that has had knock-on effects across our entire food supply, that continue to influence agricultural policy to this day
I think a lack of seafood would have less of an impact to the general population than say, lack of satellite navigation or communication technology.