Energy is the only resource that matters. With enough energy and technology we can recycle and transform whatever current raw physical materials we have available, no matter how inefficient it is.

With the population leveling off, I think the amount of physical materials needed at any one time will stop growing exponentially. Consumption will rates will still be increasing, but we can recycle the raw materials to keep the absolute amount needed within physical limits.