Sounds good in theory, but if that were a rule, the committee would not have been able to find enough teams to fill out a bracket in 2018-19.
The 2020-21 season was stupid because of the remnants of COVID.
In 2021-22, the policy you propose would have removed 10 teams. Their final NET rankings were 16, 31, 34, 37, 38, 42, 44, 49, 53 and 77. They played from 13 to 21 games vs. Q1-22 opponents. Collectively 84-109 vs. Q1-2 for an average of ~ 8-11 record.
In their place would have gone 45, 47, 48, 58, 72, 105, 165, 171, 186, 218. Collectively, those teams went 33-28 vs. Q1-2 for an average record of six games played.
Story is comparable in 2023 and 2024.
Nice idea but practically unworkable.