TY - RPRT TI - Depth Dependence of $μ$P Learning Rates in ReLU MLPs AU - Samy Jelassi AU - Boris Hanin AU - Ziwei Ji AU - Sashank J. Reddi AU - Srinadh Bhojanapalli AU - Sanjiv Kumar PY - 2023 UR - https://arxiv.org/abs/2305.07810 ID - 2305.07810 ER -