Reducing Infrastructure Constraints to Enable AI Scale