They used to have very comprehensive automated testing processes to exercise all sorts of things. Unfortunately, like many tech companies these days like Apple, Google, etc., they’re all punting QA as a concept because they just don’t care - what are you going to do, go use another oligopoly platform?
You will never have resources to “test absolutely everything”. It is ALWAYS about building out personas and deriving tests from those.
What this tells us is that one of two things happened:
This was not tested at all
The testing harness resets the environment after every check (e.g. “does process close when killed”) rather than involving a manual reset (i.e. “close and re-open task manager”)
The latter is a lot more common than you would think since it makes it much easier to automate these harnesses rather than having a human at a VM. But… this is what happens when you don’t step through the entire workflow.
For people to test, you need management that is willing to invest in QA. But that incentive disappears for a corporation when there’s no free market of competitors who can poach your customers by making a better quality product or service.
Well, who’d ever think of testing that closing the app works. Some things you have to take for granted or you’ll never test anything meaningful.
The person who fiddles with the always on top option in this monstrosity of a compositor maybe?
If you are a company the size of Microsoft, you have more than enough resources to test absolutely everything.
Latest news is that Xbox Games Division had been required to aim for a 30% profit margin for the last several years.
Thats why everything sucks and blew up.
Thats a fucking insane baseline target.
Line for next quarter profit must go up, therefore, cut costs.
This is obvious self destructive in the long run, but that doesn’t matter, what matters is C Suite’s golden parachutes.
They used to have very comprehensive automated testing processes to exercise all sorts of things. Unfortunately, like many tech companies these days like Apple, Google, etc., they’re all punting QA as a concept because they just don’t care - what are you going to do, go use another oligopoly platform?
You will never have resources to “test absolutely everything”. It is ALWAYS about building out personas and deriving tests from those.
What this tells us is that one of two things happened:
The latter is a lot more common than you would think since it makes it much easier to automate these harnesses rather than having a human at a VM. But… this is what happens when you don’t step through the entire workflow.
Didn’t Microsoft fire their dedicated human testing team in about 2014?
Probably?
This is the kind of thing that a LOT of companies outsource. Mostly for ill.
Isn’t that the final step in the testing plan for every app though? The first step is always opening it.
A bug like this means literally nobody tested it at all on this build, or was so apathetic they didn’t file an obvious issue.
For people to test, you need management that is willing to invest in QA. But that incentive disappears for a corporation when there’s no free market of competitors who can poach your customers by making a better quality product or service.