The COVID-19 pandemic’s disruptions to daily routines and services have proven especially challenging for children with autism spectrum disorder (ASD) and their families. The current retrospective study aimed to determine the impact of the COVID-19 pandemic’s social environmental changes on parental ratings of personal and child concerns about family conflict, opportunities for social interaction, and loss of institutional support (school and therapy services). Analyses of responses from families with ASD in the US determined differences in concerns across three time points which were measured simultaneously: prior to COVID-19, at the start of COVID-19, and at the time of survey completion. From our sample of 246 school-aged children, parents retrospectively reported significantly increasing levels of concern for both themselves and their children over time, with parents’ personal concern levels rated consistently higher than their ratings of their child’s level of concern. Concerns about loss of institutional support were higher for parents of children reported as having co-occurring intellectual disability. Further, parents of younger children also reported more concerns about loss of services, as well as more social concerns. For parent ratings of child concerns, children who were reportedly aware of COVID-19 were determined to have higher levels of social concerns and concerns about loss of institutional support. Meanwhile, the child’s age and gender did not impact their parent ratings of child concerns. The increased level of parental and child-perceived concerns over the course of the pandemic suggests a need for improved service delivery and support for these families. The high levels of concerns observed in the current study provide support for the need to assess families’ priorities and tailor services to best meet families’ needs. This will potentially increase the quality of life of family members, and improve ASD services across the lifespan, and improve outcomes.