netsocket: networkinterface status failures

[0xc0170]

Description

Tracking issue for latest test failures we noticed in recent PR.

Targets: K64F, NUCLEO_F429ZI, ARCH_PRO, NUCLEO_F207ZG
Compilers: all

First CI test job that had this failures is 3370. One of the latests test logs can be seen here #8335 (comment)

@mikisch81 was able to reproduce this on master. I suspected initially networking issue in our CI setup (@studavekar just in case).

@ARMmbed/mbed-os-ipcore Please review

Issue request type

[ ] Question
[ ] Enhancement
[X] Bug

[0xc0170]

cc @ARMmbed/mbed-os-maintainers

[mikisch81]

Reproduced it with latest master branch:

> git clone git@github.com:ARMmbed/mbed-os.git
> mbed test -m K64F -t GCC_ARM -n tests-network-interface
...
...
mbedgt: mbed-host-test-runner: started
mbedgt: checking for GCOV data...
mbedgt: test on hardware with target id: 0240000030514e45003520067d7e00351f91000097969900
mbedgt: test suite 'mbed-os-tests-network-interface' ................................................. FAIL in 30.68 sec
        test case: 'NETWORKINTERFACE_CONN_DISC_REPEAT' ............................................... SKIPPED in 0.00 sec
        test case: 'NETWORKINTERFACE_STATUS' ......................................................... FAIL in 15.09 sec
        test case: 'NETWORKINTERFACE_STATUS_GET' ..................................................... SKIPPED in 0.00 sec
        test case: 'NETWORKINTERFACE_STATUS_NONBLOCK' ................................................ SKIPPED in 0.00 sec
mbedgt: test case summary: 0 passes, 1 failure
mbedgt: utest test case summary mismatch: utest reported passes and failures miscount!
        reported by utest: passes = 0, failures 1)
        test case result count: passes = 0, failures 4)
mbedgt: all tests finished!
mbedgt: shuffle seed: 0.3196952986
mbedgt: test suite report:
+--------------+---------------+---------------------------------+--------+--------------------+-------------+
| target       | platform_name | test suite                      | result | elapsed_time (sec) | copy_method |
+--------------+---------------+---------------------------------+--------+--------------------+-------------+
| K64F-GCC_ARM | K64F          | mbed-os-tests-network-interface | FAIL   | 30.68              | default     |
+--------------+---------------+---------------------------------+--------+--------------------+-------------+
mbedgt: test suite results: 1 FAIL
mbedgt: test case report:
+--------------+---------------+---------------------------------+-----------------------------------+--------+--------+---------+--------------------+
| target       | platform_name | test suite                      | test case                         | passed | failed | result  | elapsed_time (sec) |
+--------------+---------------+---------------------------------+-----------------------------------+--------+--------+---------+--------------------+
| K64F-GCC_ARM | K64F          | mbed-os-tests-network-interface | NETWORKINTERFACE_CONN_DISC_REPEAT | 0      | 0      | SKIPPED | 0.0                |
| K64F-GCC_ARM | K64F          | mbed-os-tests-network-interface | NETWORKINTERFACE_STATUS           | 0      | 1      | FAIL    | 15.09              |
| K64F-GCC_ARM | K64F          | mbed-os-tests-network-interface | NETWORKINTERFACE_STATUS_GET       | 0      | 0      | SKIPPED | 0.0                |
| K64F-GCC_ARM | K64F          | mbed-os-tests-network-interface | NETWORKINTERFACE_STATUS_NONBLOCK  | 0      | 0      | SKIPPED | 0.0                |
+--------------+---------------+---------------------------------+-----------------------------------+--------+--------+---------+--------------------+
mbedgt: test case results: 1 FAIL / 3 SKIPPED
mbedgt: completed in 30.87 sec
mbedgt: exited with code 1
[mbed] ERROR: "mbedgt" returned error code 1.
[mbed] ERROR: Command "mbedgt --test-spec /home/micsch01/dev/spm/BUILD/tests/K64F/GCC_ARM/test_spec.json -n mbed-os-tests-network-interface" in "/home/micsch01/dev/spm"

[0xc0170]

@mtomczykmobica Noticed you were not part of ipcore, mention separately

[0xc0170]

Latest test results (completed few mins ago): #7755 (comment)

[cmonr]

Update.

Going back to the merge commit generated when it was first merged into Mbed OS still fails.

git checkout fef02181
mbed test -m AUTO -t ARM -n tests-network-interface -c -vv

Good news: Master is fine.
Bad news: Austin CI networking is not.

[studavekar]

@cmonr it's just CI or Austin network ?

[cmonr]

Fyi, the first failure was seen here, but it looks like it was also aborted.
http://mbed-ci-master-2.austin.arm.com:8081/job/test_matrix_raas/3369/

[cmonr]

@cmonr it's just CI or Austin network ?
Thinking about it, I don't know. I'd wager it's not just CI, since I was able to easily reproduce it locally.

[cmonr]

Don't think it's either, since @0xc0170 was also able to reproduce the problem, but he's just a tad bit not in Austin.

[cmonr]

Another update.
Re-ran tests while of the internal network, and the issue is still present. I suspect that ssomething external the the test depends on recently changed.

[ciarmcom]

Internal Jira reference: https://jira.arm.com/browse/MBOCUSTRIA-160