To play devils advocate, do the technical requirements even matter in that case if nobody can tell they aren’t being met?

It’s short term thinking IMO, but it’s my interpretation of the argument AI proponents are making.