It's not infeasible, obviously you could ray trace a fairly simple scene in real time with modest hardware. The question is, can ray tracing ever produce a better result than rasterization in the same amount of time? The answer at the moment is no, and probably will be for the foreseeable future. Even in high end film work, ray tracing is used sparingly where needed.