Timed out.

Traceback

/usr/local/lib/python3.7/unittest/case.py in testPartExecutor (arguments ▶)
self : _Outcome
<unittest.case._Outcome object at 0x7fe3ef4312d0>
test_case : OneAzConnectivity
test_ping_from_custom_ip_to_custom_ip_via_rtb_one_subnet (c2tests.vpc.oneaz_connectivity.OneAzConnectivity)
isTest : bool
True
```
    @contextlib.contextmanager
    def testPartExecutor(self, test_case, isTest=False):
        old_success = self.success
        self.success = True
        try:
            yield
        except KeyboardInterrupt:
            raise
        except SkipTest as e:
            self.success = False
```
Locals ▶
exc_info : NoneType
None
old_success : bool
True
Globals ▶
__unittest : bool
True
_subtest_msg_sentinel : object
<object object at 0x7fe415310fc0>
DIFF_OMITTED : str
Diff is %s characters long. Set self.maxDiff to None to see it.
/usr/local/lib/python3.7/unittest/case.py in run (arguments ▶)
self : OneAzConnectivity
test_ping_from_custom_ip_to_custom_ip_via_rtb_one_subnet (c2tests.vpc.oneaz_connectivity.OneAzConnectivity)
result : DiagnosticsTestResult
<xmlrunner.extra.diagnosticstestrunner.DiagnosticsTestResult run=1 errors=0 failures=0>
```
            with outcome.testPartExecutor(self):
                self.setUp()
            if outcome.success:
                outcome.expecting_failure = expecting_failure
                with outcome.testPartExecutor(self, isTest=True):
                    testMethod()
                outcome.expecting_failure = False
                with outcome.testPartExecutor(self):
                    self.tearDown()
```
Locals ▶
expecting_failure : bool
False
expecting_failure_class : bool
False
expecting_failure_method : bool
False
orig_result : DiagnosticsTestResult
<xmlrunner.extra.diagnosticstestrunner.DiagnosticsTestResult run=1 errors=0 failures=0>
outcome : _Outcome
<unittest.case._Outcome object at 0x7fe3ef4312d0>
testMethod : method
<bound method OneAzConnectivity.test_ping_from_custom_ip_to_custom_ip_via_rtb_one_subnet of <c2tests.vpc.oneaz_connectivity.OneAzConnectivity testMethod=test_ping_from_custom_ip_to_custom_ip_via_rtb_one_subnet>>
Globals ▶
__unittest : bool
True
_subtest_msg_sentinel : object
<object object at 0x7fe415310fc0>
DIFF_OMITTED : str
Diff is %s characters long. Set self.maxDiff to None to see it.

/root/c2tests/.venv/lib/python3.7/site-packages/c2tests/vpc/oneaz_connectivity.py in test_ping_from_custom_ip_to_custom_ip_via_rtb_one_subnet (arguments ▶)

self : OneAzConnectivity: test_ping_from_custom_ip_to_custom_ip_via_rtb_one_subnet (c2tests.vpc.oneaz_connectivity.OneAzConnectivity)

              ping from inst2 (-I 10.0.1.1) to 10.0.0.1
        """
        behind_inst1 = "10.0.0.1"
        behind_inst2 = "10.0.1.1"
        key, instances = self.infrastructure_provisioning(self.vpc, 1, 2)
        instance1, instance2 = instances
        self.add_icmp_rules([behind_inst1, behind_inst2])

Locals ▶

behind_inst1 : str: 10.0.0.1
behind_inst2 : str: 10.0.1.1

Globals ▶

/root/c2tests/.venv/lib/python3.7/site-packages/c2tests/__init__.py in infrastructure_provisioning (arguments ▶)
self : OneAzConnectivity
test_ping_from_custom_ip_to_custom_ip_via_rtb_one_subnet (c2tests.vpc.oneaz_connectivity.OneAzConnectivity)
vpc : VPC
VPC:vpc-545FA5EA
subnets_count : int
1
instances_per_subnet : int
2
azs : list
['az-1']
subnet_prefix : NoneType
None
subnet_cidrs : NoneType
None
associate_eip : bool
True
register_template : bool
True
**kwargs : dict
{}
```
            if associate_eip:
                common.parallelize(
                    utils.check_ssh,
                    instances,
                    threads=len(instances),
                    check_errors=True,
                )
            ssh_key = instances[0][0]
            instances = [i[1] for i in instances]
```
Locals ▶
cidrs : generator
<generator object VPCTestCase.infrastructure_provisioning.<locals>.<genexpr> at 0x7fe3fd9f8f50>
current_azs : ResultSet
[Zone:az-1]
instances : list
[('/tmp/tmpacb9jb9g.pub', Instance:i-2208D900), ('/tmp/tmpswlxdkmt.pub', Instance:i-E0348940)]
snapshot : Snapshot
Snapshot:snap-EA91722E
ssh_key : NoneType
None
subnets : list
[Subnet:subnet-CFFF46E0]
subnets_prefix : int
24
template_id : str
cmi-6168072A
vpc_network : IPv4Network
192.168.0.0/24
vpc_prefix : int
24
Globals ▶
gethostbyname : builtin_function_or_method
<built-in function gethostbyname>
UNSIGNED : UNSIGNED
<botocore.UNSIGNED object at 0x7fe407aa0ed0>
/root/c2tests/.venv/lib/python3.7/site-packages/c2tests/common.py in parallelize (arguments ▶)
func : function
<function check_ssh at 0x7fe4061c6560>
data : list
[('/tmp/tmpacb9jb9g.pub', Instance:i-2208D900), ('/tmp/tmpswlxdkmt.pub', Instance:i-E0348940)]
threads : int
2
log_errors : bool
False
check_errors : bool
True
```
            for thread in thread_pool:
                join_thread(thread)
        if check_errors:
            for result in results:
                if isinstance(result[1], Exception):
                    raise result[1]
        results.sort(key=lambda result: result[0])
        return [result[1] for result in results]
```
Locals ▶
i : int
1
q : Queue
<queue.Queue object at 0x7fe3ff5a68d0>
result : tuple
(1, TimeoutException('Timed out.'))
results : list
[(1, TimeoutException('Timed out.')), (0, TimeoutException('Timed out.'))]
task : tuple
(1, ('/tmp/tmpswlxdkmt.pub', Instance:i-E0348940))
thread : Thread
<Thread(Thread-127, stopped 140616935655168)>
thread_pool : list
[<Thread(Thread-126, stopped 140617180444416)>, <Thread(Thread-127, stopped 140616935655168)>]
Globals ▶
AVAILABLE_MARKERS : list
['exclude']
BASE_OBJECT_TYPES : tuple
(<class 'str'>, <class 'int'>, <class 'bool'>)
EXCLUDE_ATTRIBUTE : str
__c2tests_exclude__
EXCLUDE_MARKER : str
exclude
IMAGES : dict
{'cirros-0.3.4-x86_64-disk.raw': '/root/c2tests/.venv/var/lib/c2tests/images/cirros-0.3.4-x86_64-disk.raw.bz2', 'openwrt.img': '/root/c2tests/.venv/var/lib/c2tests/images/openwrt.img.bz2', 'tiny_core.vmdk': '/root/c2tests/.venv/var/lib/c2tests/images/tiny_core.vmdk', 'empty.ova': '/root/c2tests/.venv/var/lib/c2tests/images/empty.ova', 'tiny_core.ova': '/root/c2tests/.venv/var/lib/c2tests/images/tiny_core.ova'}
IMAGES_BUCKET_PREFIX : str
c2tests-images
logger : RootLogger
<RootLogger root (DEBUG)>
mark : _Mark
<c2tests.common._Mark object at 0x7fe406d930d0>
MARKER_ATTRIBUTE : str
__c2tests_marks__
md5 : builtin_function_or_method
<built-in function openssl_md5>
/root/c2tests/.venv/lib/python3.7/site-packages/c2tests/common.py in worker (arguments ▶)
q : Queue
<queue.Queue object at 0x7fe3ff5a68d0>
```
                    task_id, element = q.get(False)
                except queue.Empty:
                    break
                try:
                    result = func(element)
                except Exception as e:
                    if log_errors:
                        logger.exception("Parallelize of %s for %s failed.", func, element)
                    result = e
```
Locals ▶
element : tuple
('/tmp/tmpswlxdkmt.pub', Instance:i-E0348940)
log_errors : bool
False
result : TimeoutException
Timed out.
results : list
[(1, TimeoutException('Timed out.')), (0, TimeoutException('Timed out.'))]
task_id : int
1
Globals ▶
AVAILABLE_MARKERS : list
['exclude']
BASE_OBJECT_TYPES : tuple
(<class 'str'>, <class 'int'>, <class 'bool'>)
EXCLUDE_ATTRIBUTE : str
__c2tests_exclude__
EXCLUDE_MARKER : str
exclude
IMAGES : dict
{'cirros-0.3.4-x86_64-disk.raw': '/root/c2tests/.venv/var/lib/c2tests/images/cirros-0.3.4-x86_64-disk.raw.bz2', 'openwrt.img': '/root/c2tests/.venv/var/lib/c2tests/images/openwrt.img.bz2', 'tiny_core.vmdk': '/root/c2tests/.venv/var/lib/c2tests/images/tiny_core.vmdk', 'empty.ova': '/root/c2tests/.venv/var/lib/c2tests/images/empty.ova', 'tiny_core.ova': '/root/c2tests/.venv/var/lib/c2tests/images/tiny_core.ova'}
IMAGES_BUCKET_PREFIX : str
c2tests-images
logger : RootLogger
<RootLogger root (DEBUG)>
mark : _Mark
<c2tests.common._Mark object at 0x7fe406d930d0>
MARKER_ATTRIBUTE : str
__c2tests_marks__
md5 : builtin_function_or_method
<built-in function openssl_md5>
/root/c2tests/.venv/lib/python3.7/site-packages/c2tests/utils.py in check_ssh (arguments ▶)
instance : tuple
('/tmp/tmpswlxdkmt.pub', Instance:i-E0348940)
```
def check_ssh(instance):
    """Helper for parallel using of 'long_ssh_test'."""
    return long_ssh_test(*instance)
RULES = [
    {
```
Locals ▶
Globals ▶
_DD : str
/bin/dd
_QEMU_IMG : str
/usr/bin/qemu-img
LOG : RootLogger
<RootLogger root (DEBUG)>
md5 : builtin_function_or_method
<built-in function openssl_md5>
RULES : list
[{'cidr_ip': '0.0.0.0/0', 'ip_protocol': 'tcp', 'from_port': '22', 'to_port': '22'}, {'cidr_ip': '0.0.0.0/0', 'ip_protocol': 'icmp', 'from_port': '-1', 'to_port': '-1'}]
/root/c2tests/.venv/lib/python3.7/site-packages/c2tests/utils.py in long_ssh_test (arguments ▶)
keypath : str
/tmp/tmpswlxdkmt.pub
instance : Instance
Instance:i-E0348940
```
def long_ssh_test(keypath, instance):
    """Getting instance id frome metadata server w/retries"""
    wait_long(lambda: ssh_test(instance.ip_address, keypath) == instance.id)
def check_ssh(instance):
    """Helper for parallel using of 'long_ssh_test'."""
```
Locals ▶
Globals ▶
_DD : str
/bin/dd
_QEMU_IMG : str
/usr/bin/qemu-img
LOG : RootLogger
<RootLogger root (DEBUG)>
md5 : builtin_function_or_method
<built-in function openssl_md5>
RULES : list
[{'cidr_ip': '0.0.0.0/0', 'ip_protocol': 'tcp', 'from_port': '22', 'to_port': '22'}, {'cidr_ip': '0.0.0.0/0', 'ip_protocol': 'icmp', 'from_port': '-1', 'to_port': '-1'}]
/root/c2tests/.venv/lib/python3.7/site-packages/c2tests/utils.py in wait_long (arguments ▶)
func : function
<function long_ssh_test.<locals>.<lambda> at 0x7fe3ef606c20>
*args : tuple
()
**kwargs : dict
{}
```
def wait_long(func, *args, **kwargs):
    """Fail unless func return success within the long timeout"""
    return wait(5 * constants.MINUTE_SECONDS, func, *args, **kwargs)
def wait_long_enough(func, *args, **kwargs):
    """Fail unless func return success within the enough long timeout."""
```
Locals ▶
Globals ▶
_DD : str
/bin/dd
_QEMU_IMG : str
/usr/bin/qemu-img
LOG : RootLogger
<RootLogger root (DEBUG)>
md5 : builtin_function_or_method
<built-in function openssl_md5>
RULES : list
[{'cidr_ip': '0.0.0.0/0', 'ip_protocol': 'tcp', 'from_port': '22', 'to_port': '22'}, {'cidr_ip': '0.0.0.0/0', 'ip_protocol': 'icmp', 'from_port': '-1', 'to_port': '-1'}]
/root/c2tests/.venv/lib/python3.7/site-packages/c2tests/utils.py in wait (arguments ▶)
timeout : int
300
func : function
<function long_ssh_test.<locals>.<lambda> at 0x7fe3ef606c20>
*args : tuple
()
**kwargs : dict
{}
```
        result = func(*args, **kwargs)
        if result:
            return result
        time.sleep(min(timeout, 0.1))
    raise exceptions.TimeoutException()
def wait_short(func, *args, **kwargs):
    """Fail unless func return success within the timeout"""
```
Locals ▶
endtime : float
1708645789.643473
result : bool
False
Globals ▶
_DD : str
/bin/dd
_QEMU_IMG : str
/usr/bin/qemu-img
LOG : RootLogger
<RootLogger root (DEBUG)>
md5 : builtin_function_or_method
<built-in function openssl_md5>
RULES : list
[{'cidr_ip': '0.0.0.0/0', 'ip_protocol': 'tcp', 'from_port': '22', 'to_port': '22'}, {'cidr_ip': '0.0.0.0/0', 'ip_protocol': 'icmp', 'from_port': '-1', 'to_port': '-1'}]

Traceback

Environment