From: Saku Ytti <saku@ytti.fi> Sent: Thursday, January 24, 2019 4:28 PM
On Thu, 24 Jan 2019 at 17:52, <adamv0025@netconsultings.com> wrote:
This actually makes me thing that it might be worthwhile including these types of test to the regression testing suite.
I seem to recall one newish entrant to SP market explaining that they are limited by wall-time in blackbox testing. They would have no particularly challenge testing everything, but the amount of permutations and wall-time to execute single test simply makes it impossible to test comprehensively. So if you can't test everything, what do you test? How do you predict what is more likely to be broken?
We fight with that all the time, I'd say that from the whole Design->Certify->Deploy->Verify->Monitor service lifecycle time budget, the service certification testing is almost half of it. That's why I'm so interested in a model driven design and testing approach. I really need to have this ever growing library of test cases that the automat will churn through with very little human intervention, in order to reduce the testing from months to days or weeks at least.
There are some commercial BGP fuzzers, I've only tested one of them: https://www.synopsys.com/software-integrity/security-testing/fuzz- testing/defensics/protocols/bgp4-server.html
Thank you very much for the link. adam