The duration of the study for each participant will be up to 9 years and 4 months that will consist of a 14-day screening period, that may be extended to up to 4 weeks in pre-specified situations. This is followed by a 25-week treatment period and an up to a 462-week treatment extension period and a 4-week post-treatment observation period. Cohort 1 and 2 (Cohort 1: avalglucosidase alfa 20 milligrams per kilogram \[mg/kg\], Cohort 2: avalglucosidase alfa 40 mg/kg) will be non-randomized and Cohort 3 (Cohort 3a: avalglucosidase alfa 40 mg/kg \[maximum tolerated dose\] and Cohort 3b: alglucosidase alfa) will be randomized.