Page History
| Table of Contents |
|---|
This is an exercise to extract unsupported tests on simulator from the existing smoke and regression integration test suites.
Here is the list of automated smoke/BVT/sanity tests which needs to be reviewed. There is a column 'type' added with the following values
- self service
- provisioning
- unsupported
- test issue
- Not Run -skipped test
- skipped tests need to be run manually.
- test issues need to be fixed an re run.
BVT Report - advanced zone:
| Sl. No. | test case | status | Error Description | Type | Comment |
| 1 | test_DeployVmAntiAffinityGroup | PASSED | None | self service |
|
| 2 | test_deploy_vm | PASSED | None | self service | |
| 3 | test_deployvm_userdata | PASSED | None | provisioning | [ Koushik ] This looks same as #2 unless user data is verified. For verification you need actual setup. So this should belong to provisioning. Talluri/Koushik Fix the test to verify userdata |
| 4 | test_deployvm_userdata_post | PASSED | None | provisioning | [ Koushik ] This looks same as #2 unless user data is verified. For verification you need actual setup. So this should belong to provisioning. Talluri/Koushik Fix the test to verify userdata |
| 5 | test_deployvm_firstfit | PASSED | None | self service | |
| 6 | test_deployvm_userconcentrated | PASSED | None | self service | |
| 7 | test_deployvm_userdispersing | PASSED | None | self service | |
| 8 | test_01_create_disk_offering | PASSED | None | self service | |
| 9 | test_02_edit_disk_offering | PASSED | None | self service | |
| 10 | test_03_delete_disk_offering | PASSED | None | self service | |
| 11 | test_UpdateConfigParamWithScope | PASSED | None | self service | |
| 12 | test_dedicateGuestVlanRange | PASSED | None | self service | |
| 13 | test_internallb | PASSED | None | provisioning | Enhancement: modify this test to verify lb rules by sending request from another tier |
| 14 | test_01_create_iso | PASSED | None | self service | Enhancement: check the existence of registered of ISO in secondary deploy a VM with registered ISO. can be added as another test (provisioning) |
| 15 | test_02_edit_iso | PASSED | None | self service | |
| 16 | test_03_delete_iso | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete ISO'} | self service | Rajani: this can be fixed by implementing deleteAsync in SimulatorImageStoreDriverImpl.java (Fixed this locally. will push after more testing) |
| 17 | test_04_extract_Iso | FAILED | Extract ISO Failed with invalid URL http://192.168.2.3/userdata/9a95de36-9645-40c1-b473-f6665bb9a4f0.iso (ISO id: 297135cd-020a-47cb-ae0d-efb970876eee) | provisioning | This test can be modified for simulator not to download using URL |
| 18 | test_05_iso_permissions | PASSED | None | self service | |
| 19 | test_06_copy_iso | SKIPPED | None | provisioning | destination zone needs to extract the template URL |
| 20 | test_01_create_lb_rule_src_nat | FAILED | Connection Failed: SSH failed for VM with IP Address: 192.168.2.8 | provisioning | avoid ssh connection |
| 21 | test_02_create_lb_rule_non_nat | FAILED | Connection Failed: SSH failed for VM with IP Address: 192.168.2.8: SSH failed for VM with IP Address: 192.168.2.8 | provisioning | avoid ssh connection |
| 22 | test_assign_and_removal_lb | FAILED | Connection Failed: SSH failed for VM with IP Address: 192.168.2.8 | provisioning | avoid ssh connection |
| 23 | test_nic_secondaryip_add_remove | PASSED | None | provisioning | Enhancement: add verification |
| 24 | test_delete_account | PASSED | None | self service | |
| 25 | test_01_port_fwd_on_src_nat | FAILED | SSH Access failed for 10.1.1.56: SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | avoid ssh connection |
| 26 | test_02_port_fwd_on_non_src_nat | FAILED | SSH Access failed for 10.1.1.56: SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | avoid ssh connection |
| 27 | test_public_ip_admin_account | PASSED | None | self service | |
| 28 | test_public_ip_user_account | PASSED | None | self service | |
| 29 | test_reboot_router | FAILED | SSH Access failed for 192.168.2.5: Connection Failed | provisioning | avoid ssh connection |
| 30 | test_releaseIP | PASSED | None | self service | |
| 31 | test_network_acl | PASSED | None | provisioning | [ Koushik ] Is it just testing creation of acl on the db? For verifying if the acl is working you need actual setup. In that case this will be provisioning. Enhancement: add actual verification Logic for rules. |
| 32 | test_01_nic | PASSED | None | provisioning | Enhancement: add validation |
| 33 | test_extendPhysicalNetworkVlan | PASSED | None | self service | |
| 34 | test_createPortablePublicIPAcquire | PASSED | None | self service | |
| 35 | test_createPortablePublicIPRange | PASSED | None | self service | |
| 36 | test_01_primary_storage_iscsi | PASSED | None | self service | in actual VM deployment scenarios storage will be tested. |
| 37 | test_01_primary_storage_nfs | PASSED | None | self service | in actual VM deployment scenarios storage will be tested. |
| 38 | test_privategw_acl | PASSED | None | self service | Enhancement: add a new test to verification of ACL rules |
| 39 | test_dedicatePublicIpRange | PASSED | None | self service | |
| 40 | test_create_pvlan_network | PASSED | None | self service | |
| 41 | test_createRegion | PASSED | None | self service | |
| 42 | test_01_reset_vm_on_reboot | PASSED | None | self service | Enhancement: add new test to check volume contents |
| 43 | test_01_updatevolumedetail | PASSED | None | self service | |
| 44 | test_01_router_internal_basic | SKIPPED | None | provisioning | [ Koushik ] This test ssh to the router |
| 45 | test_02_router_internal_adv | SKIPPED | None | provisioning | [ Koushik ] This test ssh to the router |
| 46 | test_03_restart_network_cleanup | PASSED | None | self service | |
| 47 | test_04_restart_network_wo_cleanup | SKIPPED | None | provisioning | need access to host |
| 48 | test_05_router_basic | PASSED | None | self service | |
| 49 | test_06_router_advanced | PASSED | None | self service | |
| 50 | test_07_stop_router | PASSED | None | self service | |
| 51 | test_08_start_router | PASSED | None | self service | |
| 52 | test_09_reboot_router | PASSED | None | self service | |
| 53 | test_01_scale_vm | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'This operation not permitted for this hypervisor of the vm'} | provisioning | [ Koushik ] There is HV specific check in CS code and so fails for HV type 'Simulator'. For now run as provisioning test. |
| 54 | test_01_sys_vm_start | PASSED | None | self service | |
| 55 | test_02_sys_template_ready | PASSED | None | self service | |
| 56 | test_01_create_service_offering | PASSED | None | self service | |
| 57 | test_02_edit_service_offering | PASSED | None | self service | |
| 58 | test_03_delete_service_offering | PASSED | None | self service | |
| 59 | test_04_change_offering_small | FAILED | SSH Access failed for 10.1.1.130: SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | avoid ssh connection |
| 60 | test_01_snapshot_root_disk | FAILED | 'simulator' | provisioning | Test script needs to be changed for simulator to avoid checking the existence of snapshot on secondary |
| 61 | test_01_list_sec_storage_vm | PASSED | None | self service | |
| 62 | test_02_list_cpvm_vm | PASSED | None | self service | |
| 63 | test_03_ssvm_internals | SKIPPED | None | provisioning | [ Koushik ] Based on similar test cases for router |
| 64 | test_04_cpvm_internals | SKIPPED | None | provisioning | [ Koushik ] Based on similar test cases for router |
| 65 | test_05_stop_ssvm | SKIPPED | None | provisioning | actually doing a stop and then a start. then calls test_ssvm_internals() |
| 66 | test_06_stop_cpvm | SKIPPED | None | provisioning | do |
| 67 | test_07_reboot_ssvm | SKIPPED | None | provisioning | do |
| 68 | test_08_reboot_cpvm | SKIPPED | None | provisioning | do |
| 69 | test_09_destroy_ssvm | SKIPPED | None | provisioning | do |
| 70 | test_10_destroy_cpvm | SKIPPED | None | provisioning | do |
| 71 | test_01_create_template | FAILED | Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'} | self service | Delete template/ISO is eventually removing the entry from DB but errors out while trying to delete it from backend. [ Koushik ] Rajani fixed the simulator for this |
| 72 | test_02_edit_template | PASSED | None | self service | |
| 73 | test_03_delete_template | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'} | self service | Delete template/ISO is eventually removing the entry from DB but errors out while trying to delete it from backend. [ Koushik ] Rajani fixed the simulator for this |
| 74 | test_04_extract_template | FAILED | Extract Template Failed with invalid URL http://192.168.2.3/userdata/d408cfd8-bf7f-47ef-9aa0-84c353d24221.raw (template id: 31ea9fe5-3a0b-4425-b4ca-7aa9e0695605) | provisioning
| This test can be modified for simulator not to download using URL |
| 75 | test_05_template_permissions | PASSED | None | self service | |
| 76 | test_06_copy_template | SKIPPED | None | provisioning | destination zone needs to extract the template URL |
| 77 | test_07_list_public_templates | PASSED | None | self service | |
| 78 | test_08_list_system_templates | PASSED | None | self service | |
| 79 | test_advZoneVirtualRouter | PASSED | None | NA | duplicate test, remove it |
| 80 | test_deploy_vm | PASSED | None | self service | {Koushik}Is this a duplicate of #2 Can be removed since it is covered in test_vm_life_cycle.py |
| 81 | test_01_stop_vm | PASSED | None | self service | |
| 82 | test_02_start_vm | PASSED | None | self service | |
| 83 | test_03_reboot_vm | PASSED | None | self service | |
| 84 | test_06_destroy_vm | PASSED | None | self service | |
| 85 | test_07_restore_vm | PASSED | None | self service | Enhancement: add another test the data on the restored VM. |
| 86 | test_08_migrate_vm | PASSED | None | self service | |
| 87 | test_09_expunge_vm | PASSED | None | self service | |
| 88 | test_10_attachAndDetach_iso | FAILED | SSH failed for virtual machine: 10.1.1.62 - SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | avoid ssh connection |
| 89 | test_01_create_vm_snapshots | FAILED | SSH failed for Virtual machine: 10.1.1.44 | provisioning | avoid ssh connection |
| 90 | test_02_revert_vm_snapshots | FAILED | SSH failed for Virtual machine: 10.1.1.44 | provisioning | avoid ssh connection |
| 91 | test_03_delete_vm_snapshots | FAILED | Check list response returns a valid list | provisioning | |
| 92 | test_01_create_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | provisioning | attach volume is failing {Koushik} Rajani fixed simulator for this test does SSH connection, Hence, marking it as provisioning |
| 93 | test_02_attach_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | provisioning | attach volume is failing test does SSH connection, Hence, marking it as provisioning |
| 94 | test_03_download_attached_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | self service | attach volume is failing test is checking that downloading an attached volume fails |
| 95 | test_04_delete_attached_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | self service | attach volume is failing |
| 96 | test_05_detach_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | self service | attach volume is failing |
| 97 | test_06_download_detached_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | provisioning | attach volume is failing |
| 98 | test_07_resize_fail | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | self service | attach volume is failing |
| 99 | test_08_resize_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | provisioning | attach volume is failing Enhancement: check the resized volume on the backend if it has actually been resized. |
| 100 | test_09_delete_detached_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | self service | attach volume is failing |
| 101 | test_vpc_remote_access_vpn | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 31 on domR: r-9-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'} | self service
| vpn user creation is failing {Koushik} Rajani fixed simulator for this |
| 102 | test_vpc_site2site_vpn | PASSED | None | self service |
Self Service tests: 63
Provisioning tests: 38
Total no. of existing automated tests for advanced zone: 118
Test Report Analysis:
29 out of 102 smoke tests failed.
Unsupported commands:
- create vpn users. [ com.cloud.agent.api.routing.VpnUsersCfgCommand ]
- delete ISO- Delete template/ISO is eventually removing the entry from DB but errors out while trying to delete it from backend.
- delete Template -Delete template/ISO is eventually removing the entry from DB but errors out while trying to delete it from backend.
AttachVolumeCmd
java.lang.NullPointerException
at com.cloud.hypervisor.dao.HypervisorCapabilitiesDaoImpl.getMaxDataVolumesLimit(HypervisorCapabilitiesDaoImpl.java:90)
- extract template.
- scale VM
Regression test report -Advanced Zone:
Here is the list of automated regression tests which needs to be reviewed. There is a column 'type' added with the following values
- self service
- provisioning
- unsupported
- test issue
- Not Run -skipped test
- skipped tests need to be run manually.
- test issues need to be fixed an re run.
Sl. No. | test case | status | Error Description | Type | Comment |
1 | test_01_create_account | PASSED | None | self service |
|
2 | test_01_add_vm_to_subdomain | PASSED | None | self service |
|
3 | test_DeleteDomain | PASSED | None | self service |
|
4 | test_forceDeleteDomain | PASSED | None | self service |
|
5 | test_01_non_root_admin_Privileges | PASSED | None | self service |
|
6 | test_01_user_remove_VM_running | PASSED | None | self service |
|
7 | test_01_service_offering_hierarchy | PASSED | None | self service |
|
8 | test_01_service_offering_siblings | PASSED | None | self service |
|
9 | ContextSuite context=TestTemplateHierarchy>:setup | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'} | provisioning | expand this test to all dependent tests |
10 | test_updateAdminDetails | PASSED | None | self service |
|
11 | test_updateDomainAdminDetails | PASSED | None | self service |
|
12 | test_updateUserDetails | PASSED | None | self service |
|
13 | test_LoginApiDomain | PASSED | None | self service |
|
14 | test_LoginApiUuidResponse | PASSED | None | self service |
|
15 | ContextSuite context=TestAddNetworkToVirtualMachine>:setup | SKIPPED | None | Not Run | add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor |
16 | ContextSuite context=TestFailureScenariosAddNetworkToVM>:setup | SKIPPED | None | Not Run | add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor |
17 | ContextSuite context=TestFailureScenariosRemoveNicFromVM>:setup | SKIPPED | None | Not Run | add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor |
18 | ContextSuite context=TestFailureScenariosUpdateVirtualMachineNIC>:setup | SKIPPED | None | Not Run | add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor |
19 | ContextSuite context=TestRemoveNetworkFromVirtualMachine>:setup | SKIPPED | None | Not Run | add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor |
20 | ContextSuite context=TestUpdateVirtualMachineNIC>:setup | SKIPPED | None | Not Run | add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor |
21 | test_01_deploy_vm_another_user | PASSED | None | self service |
|
22 | test_02_create_aff_grp_user | PASSED | None | self service |
|
23 | test_03_list_aff_grp_all_users | PASSED | None | self service |
|
24 | test_04_list_all_admin_aff_grp | PASSED | None | self service |
|
25 | test_05_list_all_users_aff_grp | PASSED | None | self service |
|
26 | test_06_list_all_users_aff_grp_by_id | PASSED | None | self service |
|
27 | test_07_delete_aff_grp_of_other_user | PASSED | None | self service |
|
28 | test_01_admin_create_aff_grp | PASSED | None | self service |
|
29 | test_02_doadmin_create_aff_grp | PASSED | None | self service |
|
30 | test_03_user_create_aff_grp | PASSED | None | self service |
|
31 | test_04_user_create_aff_grp_existing_name | PASSED | None | self service |
|
32 | test_05_create_aff_grp_same_name_diff_acc | PASSED | None | self service |
|
33 | test_06_create_aff_grp_nonexisting_type | PASSED | None | self service |
|
34 | test_01_delete_aff_grp_by_name | PASSED | None | self service |
|
35 | test_02_delete_aff_grp_for_acc | PASSED | None | self service |
|
36 | test_03_delete_aff_grp_with_vms | PASSED | None | self service |
|
37 | test_05_delete_aff_grp_id | PASSED | None | self service |
|
38 | test_06_delete_aff_grp_name | PASSED | None | self service |
|
39 | test_08_delete_aff_grp_by_id | PASSED | None | self service |
|
40 | test_09_delete_aff_grp_root_admin | PASSED | None | self service |
|
41 | test_01_deploy_vm_without_aff_grp | PASSED | None | self service |
|
42 | test_02_deploy_vm_by_aff_grp_name | PASSED | None | self service |
|
43 | test_03_deploy_vm_by_aff_grp_id | PASSED | None | self service |
|
44 | test_04_deploy_vm_anti_affinity_group | PASSED | None | self service |
|
45 | test_05_deploy_vm_by_id | PASSED | None | self service |
|
46 | test_06_deploy_vm_aff_grp_of_other_user_by_name | PASSED | None | self service |
|
47 | test_07_deploy_vm_aff_grp_of_other_user_by_id | PASSED | None | self service |
|
48 | test_08_deploy_vm_multiple_aff_grps | PASSED | None | self service |
|
49 | test_09_deploy_vm_multiple_aff_grps | PASSED | None | self service |
|
50 | test_10_deploy_vm_by_aff_grp_name_and_id | PASSED | None | self service |
|
51 | test_01_list_aff_grps_for_vm | PASSED | None | self service |
|
52 | test_02_list_multiple_aff_grps_for_vm | PASSED | None | self service |
|
53 | test_03_list_aff_grps_by_id | PASSED | None | self service |
|
54 | test_04_list_aff_grps_by_name | PASSED | None | self service |
|
55 | test_05_list_aff_grps_by_non_existing_id | PASSED | None | self service |
|
56 | test_06_list_aff_grps_by_non_existing_name | PASSED | None | self service |
|
57 | test_07_list_all_vms_in_aff_grp | PASSED | None | self service |
|
58 | test_01_update_aff_grp_by_ids | PASSED | None | self service |
|
59 | test_02_update_aff_grp_by_names | PASSED | None | self service |
|
60 | test_03_update_aff_grp_for_vm_with_no_aff_grp | PASSED | None | self service |
|
61 | test_04_update_aff_grp_remove_all | SKIPPED | None | Not Run |
|
62 | test_05_update_aff_grp_on_running_vm | PASSED | None | self service |
|
63 | test_01_zones | PASSED | None | self service |
|
64 | test_02_pods | PASSED | None | self service |
|
65 | test_03_clusters | PASSED | None | self service |
|
66 | test_04_hosts | PASSED | None | self service |
|
67 | test_05_storage_pools | PASSED | None | self service |
|
68 | test_06_secondary_storage | FAILED | Secondary storage should be in Up state | self service | We might need to fix simulator |
69 | test_01_move_across_different_domains | PASSED | None | self service |
|
70 | test_02_move_across_subdomains | PASSED | None | self service |
|
71 | test_03_move_from_domain_to_subdomain | PASSED | None | self service |
|
72 | test_04_move_from_domain_to_sub_of_subdomain | PASSED | None | self service |
|
73 | test_05_move_to_domain_from_sub_of_subdomain | PASSED | None | self service |
|
74 | test_06_move_to_domain_from_subdomain | PASSED | None | self service |
|
75 | test_07_move_across_subdomain | PASSED | None | self service |
|
76 | test_08_move_across_subdomain_network_create | PASSED | None | self service |
|
77 | test_09_move_across_subdomain | PASSED | None | self service |
|
78 | test_10_move_across_subdomain_vm_running | PASSED | None | self service |
|
79 | test_11_move_across_subdomain_vm_pfrule | PASSED | None | self service |
|
80 | test_12_move_across_subdomain_vm_volumes | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | self service | attachVolume {Koushik}Fixed by Rajani |
81 | test_13_move_across_subdomain_vm_snapshot | PASSED | None | self service |
|
82 | test_14_move_across_subdomain_vm_project | PASSED | None | self service |
|
83 | test_15_move_across_subdomain_account_limit | PASSED | None | self service |
|
84 | test_16_move_across_subdomain_volume_and_account_limit | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | self service | {Koushik}Fixed by Rajani |
85 | test_01_deploy_instance_with_is_volatile_offering | PASSED | None | self service |
|
86 | test_02_reboot_instance_with_is_volatile_offering | PASSED | None | self service |
|
87 | test_03_restore_vm_with_new_template | PASSED | None | self service |
|
88 | test_04_reoccuring_snapshot_rules | FAILED | Exception not raised | self service | Possible bug in CS.ReRun and validate |
89 | test_01_firewall_rules_port_fw | PASSED | None | self service | Add more tests to actually verify the rules on the router |
90 | test_01_restart_network_cleanup | PASSED | None | self service |
|
91 | test_01_list_routers_admin | PASSED | None | self service |
|
92 | test_01_create_template | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'} | provisioning |
|
93 | test_01_check_template_size | FAILED | Template instance has no attribute 'size' | provisioning |
|
94 | test_02_check_size_snapshotTemplate | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'} | provisioning | Rerun |
95 | test_03_reuse_template_name | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'} | provisioning | Rerun |
96 | test_01_multiple_core_vm_start_stop_instance | PASSED | None | self service |
|
97 | test_02_multiple_core_vm_migrate_instance | FAILED | Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only | provisioning | {Koushik}This is again HV specific check in code and so fails for 'Simulator' HV type |
98 | test_03_multiple_core_vm_delete_instance | PASSED | None | self service |
|
99 | test_04_deploy_multiple_vm_with_multiple_core | FAILED | Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only | self service | {Koushik}There looks some typo here. The test name and reason failure doesn't match. Modify the test not to unnecessary migration |
100 | test_01_multiple_child_domains | PASSED | None | self service |
|
101 | test_01_multiplecore_start_stop_instance | PASSED | None | self service |
|
102 | test_02_multiplecore_migrate_instance | FAILED | Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only | provisioning | {Koushik}This is again HV specific check in code and so fails for 'Simulator' HV type |
103 | test_03_multiplecore_delete_instance | PASSED | None | self service |
|
104 | test_04_deploy_multiple_vm_with_multiple_cpus | PASSED | None | self service | lets rename this test which is same as #108 |
105 | test_01_stop_start_instance | PASSED | None | self service |
|
106 | test_02_migrate_instance | FAILED | Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only | provisioning | {Koushik}This is again HV specific check in code and so fails for 'Simulator' HV type |
107 | test_03_delete_instance | PASSED | None | self service |
|
108 | test_04_deploy_multiple_vm_with_multiple_cpus | SKIPPED | None | provisioning | {Koushik}Atleast the test name suggest that this should be self service. marking it as provisioning test as it needs vm migration |
109 | test_01_deploy_vm_domain_limit_reached | PASSED | None | self service |
|
110 | test_02_deploy_vm_account_limit_reached | PASSED | None | self service |
|
111 | test_03_deploy_vm_project_limit_reached | PASSED | None | self service |
|
112 | test_04_deployVm__account_limit_reached | PASSED | None | self service |
|
113 | test_01_project_counts_start_stop_instance | PASSED | None | self service |
|
114 | test_02_project_counts_migrate_instance | FAILED | Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only | provisioning |
|
115 | test_03_project_counts_delete_instance | PASSED | None | self service |
|
116 | test_01_custom_hostname_instancename_false | PASSED | None | self service |
|
117 | test_01_user_provided_hostname | SKIPPED | None | self service | depends on vm.instancename.flag |
118 | test_02_instancename_from_default_configuration | SKIPPED | None | self service | {Koushik}Atleast the test name suggest that this should be self service. |
119 | test_03_duplicate_name | SKIPPED | None | self service | {Koushik}Atleast the test name suggest that this should be self service. |
120 | test_04_edit_display_name | PASSED | None | self service |
|
121 | test_05_unsupported_chars_in_display_name | PASSED | None | self service |
|
122 | test_deployvm_userdata_post | FAILED | No JSON object could be decoded | provisioning | we need to add some validation on router |
123 | test_01_1_egress_fr1 | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
124 | test_01_egress_fr1 | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
125 | test_02_1_egress_fr2 | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
126 | test_02_egress_fr2 | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
127 | test_03_1_egress_fr3 | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
128 | test_03_egress_fr3 | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
129 | test_04_1_egress_fr4 | PASSED | None | self service |
|
130 | test_04_egress_fr4 | PASSED | None | self service |
|
131 | test_05_1_egress_fr5 | SKIPPED | None | Not Run | WIP -Test is incomplete |
132 | test_05_egress_fr5 | SKIPPED | None | Not Run | WIP -Test is incomplete |
133 | test_06_1_egress_fr6 | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
134 | test_06_egress_fr6 | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
135 | test_07_1_egress_fr7 | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
136 | test_07_egress_fr7 | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
137 | test_08_1_egress_fr8 | SKIPPED | None | Not Run | WIP -Test is incomplete |
138 | test_08_egress_fr8 | SKIPPED | None | Not Run | WIP -Test is incomplete |
139 | test_09_1_egress_fr9 | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
140 | test_09_egress_fr9 | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
141 | test_10_1_egress_fr10 | PASSED | None | self service |
|
142 | test_10_egress_fr10 | PASSED | None | self service |
|
143 | test_11_1_egress_fr11 | PASSED | None | self service |
|
144 | test_11_egress_fr11 | PASSED | None | self service |
|
145 | test_12_1_egress_fr12 | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
146 | test_12_egress_fr12 | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
147 | test_13_1_egress_fr13 | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
148 | test_13_egress_fr13 | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
149 | test_01_deploy_vm_with_explicit_dedication | SKIPPED | None | self service | test can be modified to add a new host just before running this test- SIMULATOR only test if empty_host: |
150 | test_01_create_sticky_policy_default_values | FAILED | Connection Failed: SSH failed for VM with IP Address: 192.168.2.23 | provisioning |
|
151 | test_02_create_sticky_policy_custom_values | FAILED | Connection Failed: SSH failed for VM with IP Address: 192.168.2.23 | provisioning |
|
152 | test_03_supported_policies_by_network | PASSED | None | self service |
|
153 | test_04_delete_lb_rule | FAILED | Connection Failed: SSH failed for VM with IP Address: 192.168.2.23 | provisioning |
|
154 | test_05_error_alerts_after_create | FAILED | Connection Failed: SSH failed for VM with IP Address: 192.168.2.23 | provisioning |
|
155 | test_06_release_ip | FAILED | Connection Failed: SSH failed for VM with IP Address: 192.168.2.24 | provisioning |
|
156 | test_07_delete_account | FAILED | Connection Failed: SSH failed for VM with IP Address: 192.168.2.23 | provisioning | {Koushik}Not sure why delete account require ssh connection? |
157 | test_08_create_policy_router_stopped | FAILED | Connection Failed: SSH failed for VM with IP Address: 192.168.2.23 | provisioning |
|
158 | test_09_create_policy_router_destroy | FAILED | Connection Failed: SSH failed for VM with IP Address: 192.168.2.23 | provisioning |
|
159 | test_10_create_policy_enable_disable_vpn | FAILED | Connection Failed: SSH failed for VM with IP Address: 192.168.2.23 | provisioning |
|
160 | test_11_invalid_params | PASSED | None | self service |
|
161 | test_01_deploy_vm_with_implicit_planner | SKIPPED | None | self service | test can be modified to add a new host just before running this test- SIMULATOR only test if empty_host: |
162 | test_network_not_implemented | PASSED | None | self service |
|
163 | test_reservation_after_router_restart | PASSED | None | self service |
|
164 | test_vm_create_after_reservation | PASSED | None | self service |
|
165 | test_vm_create_outside_cidr_after_reservation | PASSED | None | self service |
|
166 | test_01_addLdapConfiguration | FAILED | addLdapConfiguration failed | self service | have proper LDAP settings configured in the test env. |
167 | test_01_stop_start_instance | PASSED | None | self service |
|
168 | test_02_migrate_instance | FAILED | Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only | provisioning |
|
169 | test_03_delete_instance | PASSED | None | self service |
|
170 | test_04_deploy_multiple_vm | SKIPPED | None | self service |
|
171 | test_01_stop_start_instance | PASSED | None | self service |
|
172 | test_02_migrate_instance | FAILED | Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only | provisioning |
|
173 | test_03_delete_instance | PASSED | None | self service |
|
174 | test_04_deploy_multiple_vm | FIXED | None | self service |
|
175 | test_01_change_service_offering | PASSED | None | self service |
|
176 | test_02_migrate_vm | FAILED | Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only | provisioning |
|
177 | test_03_delete_vm | PASSED | None | self service |
|
178 | test_04_deploy_multiple_vm | FIXED | None | self service |
|
179 | test_01_multiple_child_domains | PASSED | None | self service |
|
180 | test_01_deploy_vm_domain_limit_reached | PASSED | None | self service |
|
181 | test_02_deploy_vm_account_limit_reached | PASSED | None | self service |
|
182 | test_03_deploy_vm_project_limit_reached | PASSED | None | self service |
|
183 | test_04_deployVm__account_limit_reached | PASSED | None | self service |
|
184 | test_01_project_vmlifecycle_start_stop_instance | PASSED | None | self service |
|
185 | test_02_project_vmlifecycle_migrate_instance | FAILED | Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only | provisioning |
|
186 | test_03_project_vmlifecycle_delete_instance | PASSED | None | self service |
|
187 | test_add_netscaler_device | FAILED | Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user | provisioning |
|
188 | ContextSuite context=TestDeleteNetscaler>:setup | FAILED | Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user | provisioning |
|
189 | ContextSuite context=TestGuestNetworkShutDown>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
190 | ContextSuite context=TestGuestNetworkWithNetScaler>:setup | FAILED | Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user | provisioning |
|
191 | test_invalid_cred | FAILED | Network service providers list should not be empty | provisioning | netscaler |
192 | test_invalid_private_interface | FAILED | Network service providers list should not be empty | provisioning | netscaler |
193 | test_invalid_public_interface | FAILED | Network service providers list should not be empty | provisioning | netscaler |
194 | ContextSuite context=TestNetScalerCustomCapacity>:setup | FAILED | Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user | provisioning |
|
195 | ContextSuite context=TestNetScalerDedicated>:setup | FAILED | Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user | provisioning |
|
196 | ContextSuite context=TestNetScalerNoCapacity>:setup | FAILED | Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user | provisioning |
|
197 | ContextSuite context=TestNetScalerShared>:setup | FAILED | Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user | provisioning |
|
198 | ContextSuite context=TestServiceProvider>:setup | FAILED | Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user | provisioning | addNetscalerLoadBalancer |
199 | ContextSuite context=TestAddMultipleVmsLb>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
200 | ContextSuite context=TestDeleteCreateLBRule>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
201 | ContextSuite context=TestLbOnIpWithPf>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
202 | ContextSuite context=TestLbOnNonSourceNat>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
203 | ContextSuite context=TestLbSourceNat>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
204 | ContextSuite context=TestLoadBalancingRule>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
205 | ContextSuite context=TestMultipleLbRules>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
206 | ContextSuite context=TestMultipleLbRulesSameIp>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
207 | ContextSuite context=TestPfOnIpWithLb>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
208 | ContextSuite context=TestVmWithLb>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
209 | ContextSuite context=TestLbAlgoLcRr>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
210 | ContextSuite context=TestLbAlgoLcSb>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
211 | ContextSuite context=TestLbAlgoRrLc>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
212 | ContextSuite context=TestLbAlgoRrSb>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
213 | ContextSuite context=TestLbAlgoSbLc>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
214 | ContextSuite context=TestLbAlgoSbRr>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
215 | ContextSuite context=TestLbWithLeastConn>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
216 | ContextSuite context=TestLbWithRoundRobin>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
217 | ContextSuite context=TestLbWithSourceIp>:setup | FAILED | Warning: Exception during cleanup : type object 'TestLbWithSourceIp' has no attribute '_cleanup' | provisioning | {Koushik}Is this test not dependent on Netscaler? yes |
218 | ContextSuite context=TestLbStickyPolicy>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
219 | test_add_mul_netscaler_diff_zone | FAILED | Atleast 2 advanced mode zones should be present for this test | provisioning |
|
220 | test_add_netscaler_device | FAILED | Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user | provisioning |
|
221 | ContextSuite context=TestNOWithNetscaler>:setup | FAILED | Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
222 | ContextSuite context=TestNetScalerSharedMode>:setup | FAILED | Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user | provisioning |
|
223 | ContextSuite context=TestNwOffDToSUpgrade>:setup | FAILED | Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user | provisioning | addNetscalerLoadBalancer |
224 | ContextSuite context=TestNwOffDedicatedNetscaler>:setup | FAILED | Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user | provisioning |
|
225 | ContextSuite context=TestNwOffNetscaler>:setup | FAILED | Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user | provisioning |
|
226 | ContextSuite context=TestNwOffSToDUpgrade>:setup | FAILED | Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user | provisioning | addNetscalerLoadBalancer |
227 | test_01_network_off_without_conserve_mode | PASSED | None | self service |
|
228 | test_02_network_off_with_conserve_mode | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 460 on domR: r-794-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'} | self service | {Koushik}Fixed by Rajani |
229 | test_create_network_with_snat | PASSED | None | self service |
|
230 | test_01_nwupgrade_netscaler_conserve_on | FAILED | Execute cmd: createnetworkoffering failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
231 | test_02_nwupgrade_netscaler_conserve_off | FAILED | Execute cmd: createnetworkoffering failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler' | provisioning |
|
232 | ContextSuite context=TestNonContiguousVLANRanges>:setup | FAILED | Exception: Failed to find template of type BUILTIN with OSTypeID and which is in ready state: f6621e5e-9e1a-11e3-81d6-062a00000033 | self service | re run |
233 | test_network_state_after_destroying_vms | PASSED | None | self service |
|
234 | test_shared_network_offering_with_persistent | PASSED | None | self service |
|
235 | test_upgrade_network_offering_to_persistent | PASSED | None | self service |
|
236 | test_associate_ip_address | FAILED | 'NoneType' object has no attribute 'startip' | self service | cfg file doesn't have portable ip range rerun |
237 | test_associate_ip_address_invalid_zone | FAILED | 'NoneType' object has no attribute 'startip' | self service | cfg file doesn't have portable ip range rerun |
238 | test_associate_ip_address_no_free_ip | FAILED | 'NoneType' object has no attribute 'startip' | self service | cfg file doesn't have portable ip range rerun |
239 | test_associate_ip_address_services_enable_disable | SKIPPED | None | provisioning | need ssh access |
240 | test_create_portable_ip_range | FAILED | 'NoneType' object has no attribute 'startip' | self service | cfg file doesn't have portable ip range rerun |
241 | test_create_portable_ip_range_invalid_region | FAILED | 'NoneType' object has no attribute 'startip' | self service | cfg file doesn't have portable ip range |
242 | test_create_portable_ip_range_non_root_admin | FAILED | 'NoneType' object has no attribute 'startip' | self service | cfg file doesn't have portable ip range |
243 | test_delete_account_services_disabled | FAILED | 'NoneType' object has no attribute 'startip' | self service | cfg file doesn't have portable ip range |
244 | test_delete_account_services_enabled | FAILED | 'NoneType' object has no attribute 'startip' | self service | cfg file doesn't have portable ip range |
245 | test_delete_portable_ip_range | FAILED | 'NoneType' object has no attribute 'startip' | self service | cfg file doesn't have portable ip range |
246 | test_delete_portable_ip_range_in_use | FAILED | 'NoneType' object has no attribute 'startip' | self service | cfg file doesn't have portable ip range |
247 | test_delete_portable_ip_range_non_root_admin | FAILED | 'NoneType' object has no attribute 'startip' | self service | cfg file doesn't have portable ip range |
248 | test_disassociate_ip_address_no_services | FAILED | 'NoneType' object has no attribute 'startip' | self service | cfg file doesn't have portable ip range |
249 | test_disassociate_ip_address_other_account | FAILED | 'NoneType' object has no attribute 'startip' | self service | cfg file doesn't have portable ip range |
250 | test_disassociate_ip_address_services_enabled | FAILED | 'NoneType' object has no attribute 'startip' | self service | cfg file doesn't have portable ip range |
251 | test_list_portable_ip_range | FAILED | 'NoneType' object has no attribute 'startip' | self service | cfg file doesn't have portable ip range |
252 | test_list_portable_ip_range_non_root_admin | FAILED | 'NoneType' object has no attribute 'startip' | self service | cfg file doesn't have portable ip range |
253 | test_list_portable_ip_range_non_root_admin | FAILED | 'NoneType' object has no attribute 'startip' | self service | cfg file doesn't have portable ip range |
254 | ContextSuite context=TestProjectCreationNegative>:setup | SKIPPED | None | self service | depends on global config if not isinstance(configs, list): |
255 | test_add_user_to_project | PASSED | None | self service |
|
256 | ContextSuite context=TestProjectInviteRequiredTrue>:setup | SKIPPED | None | self service | depends on global config |
257 | ContextSuite context=TestProjectInviteTimeout>:setup | SKIPPED | None | self service | depends on global config |
258 | test_admin_project_creation | PASSED | None | self service |
|
259 | test_maxAccountNetworks | PASSED | None | self service |
|
260 | test_01_project_limits | PASSED | None | self service |
|
261 | test_02_project_limits_normal_user | PASSED | None | self service |
|
262 | test_03_vm_per_project | PASSED | None | self service |
|
263 | test_04_publicip_per_project | PASSED | None | self service |
|
264 | test_05_snapshots_per_project | PASSED | None | self service |
|
265 | test_06_volumes_per_project | PASSED | None | self service |
|
266 | test_07_templates_per_project | FAILED | Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'} | self service | re run |
267 | ContextSuite context=TestResourceLimitsProject>:teardown | FAILED | Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u"Can't delete the domain yet because it has 1 accounts to cleanup"} | self service | re run |
268 | test_03_network_create | PASSED | None | self service |
|
269 | test_01_service_offerings | PASSED | None | self service |
|
270 | test_02_project_disk_offerings | PASSED | None | self service |
|
271 | test_07_associate_public_ip | PASSED | None | self service |
|
272 | test_06_create_snapshots_in_project | PASSED | None | self service |
|
273 | test_04_public_template_use_in_project | FAILED | Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'} | self service | re run |
274 | test_05_use_private_template_in_project | FAILED | Execute cmd: deployvirtualmachine failed, due to: errorCode: 530, errorText:None | self service | {Koushik}Failure needs investigation re run |
275 | test_05_use_private_template_in_project | FAILED | Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'} | self service | re run |
276 | ContextSuite context=TestTemplates>:teardown | FAILED | Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u"Can't delete the domain yet because it has 1 accounts to cleanup"} | self service | re run |
277 | test_01_ISO_usage | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete ISO'} | self service | re run |
278 | test_01_lb_usage | PASSED | None | self service |
|
279 | test_01_nat_usage | PASSED | None | self service |
|
280 | test_01_public_ip_usage | PASSED | None | self service |
|
281 | test_01_snapshot_usage | PASSED | None | self service |
|
282 | test_01_template_usage | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'} | self service | re run |
283 | test_01_vm_usage | PASSED | None | self service |
|
284 | test_01_volume_usage | PASSED | None | self service |
|
285 | test_01_vpn_usage | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 582 on domR: r-959-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'} | self service | re run |
286 | test_02_cross_domain_account_add | PASSED | None | self service |
|
287 | test_03_delete_account_with_project | PASSED | None | self service |
|
288 | test_04_delete_domain_with_project | PASSED | None | self service |
|
289 | test_01_create_multiple_projects_by_account | PASSED | None | self service |
|
290 | test_05_user_project_owner_promotion | PASSED | None | self service |
|
291 | test_06_max_one_project_owner | PASSED | None | self service |
|
292 | test_07_project_resources_account_delete | PASSED | None | self service |
|
293 | test_08_cleanup_after_project_delete | PASSED | None | self service |
|
294 | test_09_project_suspend | PASSED | None | self service |
|
295 | test_10_project_activation | PASSED | None | self service |
|
296 | test_recurring_snapshot_data_disk | PASSED | None | self service |
|
297 | test_recurring_snapshot_root_disk | PASSED | None | self service |
|
298 | test_network_gc | PASSED | None | self service |
|
299 | test_restart_ntwk_no_cleanup | PASSED | None | self service |
|
300 | test_restart_ntwk_with_cleanup | PASSED | None | self service |
|
301 | test_enableVPNOverRvR | FAILED | Failed to create VPN for account: test-TestEnableVPNOverRvR-test_enableVPNOverRvR-X7XPFV - Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 479 on domR: r-813-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'} | self service | re run |
302 | test_downgradeRvR_to_VR | PASSED | None | self service |
|
303 | test_upgradeVR_to_redundantVR | PASSED | None | self service |
|
304 | test_createRegionWithExistingRegionId | PASSED | None | self service |
|
305 | test_createRegionWithExistingRegionName | PASSED | None | self service |
|
306 | test_updateRegion | PASSED | None | self service |
|
307 | test_createAccountWithUUID | PASSED | None | self service |
|
308 | test_createUserWithUUID | PASSED | None | self service |
|
309 | test_createdomainWithUUID | PASSED | None | self service |
|
310 | ContextSuite context=TestResetSSHKeyUserRights>:setup | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | expand the dependent tests |
311 | ContextSuite context=TestResetSSHKeypair>:setup | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | expand the dependent tests |
312 | test_maxAccountNetworks | PASSED | None | self service |
|
313 | test_01_vm_per_account | PASSED | None | self service |
|
314 | test_02_publicip_per_account | PASSED | None | self service |
|
315 | test_03_snapshots_per_account | PASSED | None | self service |
|
316 | test_04_volumes_per_account | PASSED | None | self service |
|
317 | test_05_templates_per_account | FAILED | Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'} | self service | rerun |
318 | test_01_publicip_per_domain | PASSED | None | self service |
|
319 | test_01_vm_per_domain | PASSED | None | self service |
|
320 | test_03_snapshots_per_domain | PASSED | None | self service |
|
321 | test_04_volumes_per_domain | PASSED | None | self service |
|
322 | test_05_templates_per_domain | FAILED | Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'} | self service |
|
323 | ContextSuite context=TestResourceLimitsDomain>:teardown | FAILED | Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u"Can't delete the domain yet because it has 1 accounts to cleanup"} | self service |
|
324 | test_01_AdvancedZoneRouterServices | PASSED | None | self service |
|
325 | test_02_NetworkGarbageCollection | PASSED | None | self service |
|
326 | test_03_RouterStartOnVmDeploy | PASSED | None | self service |
|
327 | test_01_RouterStopCreateFW | FAILED | 'Please provide the marvin configuration file with credentials to your hosts' | provisioning |
|
328 | test_01_RouterStopCreateLB | FAILED | SSH Access failed for 10.1.1.219: SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
329 | test_01_RouterStopCreatePF | FAILED | SSH Access failed for 192.168.2.9: SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
330 | test_createSharedNetwork_All | PASSED | None | self service |
|
331 | test_createSharedNetwork_accountSpecific | PASSED | None | self service |
|
332 | test_createSharedNetwork_domainSpecific | PASSED | None | self service |
|
333 | test_createSharedNetwork_projectSpecific | PASSED | None | self service |
|
334 | test_createSharedNetwork_usedVlan | SKIPPED | None | NA | remove the test |
335 | test_createSharedNetwork_usedVlan2 | PASSED | None | self service |
|
336 | test_deployVM_isolatedAndShared | FAILED | SSH Access failed for 10.1.1.96: SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
337 | test_deployVM_multipleSharedNetwork | PASSED | None | self service | Enhancement: add more validation to check that IPs are in the correct networks. |
338 | test_networkWithsubdomainaccessFalse | PASSED | None | self service |
|
339 | test_networkWithsubdomainaccessTrue | PASSED | None | self service |
|
340 | test_sharedNetworkOffering_01 | PASSED | None | self service |
|
341 | test_sharedNetworkOffering_02 | PASSED | None | self service |
|
342 | test_sharedNetworkOffering_03 | PASSED | None | self service |
|
343 | test_02_accountSnapshotClean | FAILED | 'simulator' | provisioning | is_snapshot_on_nfs |
344 | test_04_snapshot_limit | FAILED | 'simulator' | provisioning | is_snapshot_on_nfs |
345 | test_01_createVM_snapshotTemplate | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'} | provisioning |
|
346 | test_05_snapshot_events | PASSED | None | self service |
|
347 | test_01_volume_from_snapshot | FAILED | SSH failed for VM: 10.1.1.233 | provisioning |
|
348 | test_02_snapshot_data_disk | FAILED | 'simulator' | provisioning |
|
349 | test_03_snapshot_detachedDisk | FAILED | SSH failed for VM with IP: 192.168.2.14 - SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
350 | test_04_delete_snapshot | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | provisioning |
|
351 | test_07_template_from_snapshot | FAILED | SSH failed for VM with IP address: 10.1.1.233 | provisioning |
|
352 | test_01_concurrent_snapshots_live_migrate | PASSED | None | self service |
|
353 | test_02_stop_vm_concurrent_snapshots | PASSED | None | self service |
|
354 | test_03_concurrent_snapshots_create_template | FAILED | Check if result exists in list item call | self service | rerun |
355 | test_04_concurrent_snapshots_create_volume | PASSED | None | self service |
|
356 | test_01_snapshot_on_rootVolume | FAILED | 'simulator' | provisioning |
|
357 | test_01_deploy_ha_vm_startvm_false | PASSED | None | self service |
|
358 | test_02_deploy_ha_vm_from_iso | PASSED | None | self service |
|
359 | test_03_deploy_ha_vm_iso_startvm_false | PASSED | None | self service |
|
360 | test_deployVmOnGivenHost | PASSED | None | self service |
|
361 | test_01_deploy_vm_no_startvm | PASSED | None | self service |
|
362 | test_02_deploy_vm_startvm_true | PASSED | None | self service |
|
363 | test_03_deploy_vm_startvm_false | PASSED | None | self service |
|
364 | test_04_deploy_startvm_false_attach_volume | PASSED | None | self service |
|
365 | test_05_deploy_startvm_false_change_so | PASSED | None | self service |
|
366 | test_06_deploy_startvm_attach_detach | PASSED | None | self service |
|
367 | test_07_deploy_startvm_attach_iso | PASSED | None | self service |
|
368 | test_08_deploy_attached_volume | PASSED | None | self service |
|
369 | test_09_stop_vm_migrate_vol | PASSED | None | self service |
|
370 | test_deploy_vm_password_enabled | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'} | provisioning | revisit the test, why template is downloaded |
371 | test_01_deploy_vm_no_startvm | PASSED | None | self service |
|
372 | test_upload_attach_volume | PASSED | None | self service |
|
373 | test_vm_per_account | PASSED | None | self service |
|
374 | test_01_migrate_vm_with_volume | FAILED | Execute cmd: findhostsformigration failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only | provisioning |
|
375 | test_02_migrate_volume | SKIPPED | None | self service | if not pools: |
376 | test_01_lbrule_tag | PASSED | None | self service |
|
377 | test_02_natrule_tag | PASSED | None | self service |
|
378 | test_03_firewallrule_tag | PASSED | None | self service |
|
379 | test_04_vpn_tag | SKIPPED | None | self service | self.skipTest("VPN resource tags are unsupported in 4.0") |
380 | test_05_vm_tag | PASSED | None | self service |
|
381 | test_06_template_tag | FAILED | Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'} | self service |
|
382 | test_07_iso_tag | PASSED | None | self service |
|
383 | test_08_volume_tag | PASSED | None | self service |
|
384 | test_09_snapshot_tag | PASSED | None | self service |
|
385 | test_10_network_tag | PASSED | None | self service |
|
386 | test_13_tag_case_insensitive | PASSED | None | self service |
|
387 | test_14_special_char_mutiple_tags | PASSED | None | self service |
|
388 | test_15_project_tag | PASSED | None | self service |
|
389 | test_16_query_tags_other_account | PASSED | None | self service |
|
390 | test_17_query_tags_admin_account | PASSED | None | self service |
|
391 | test_18_invalid_list_parameters | PASSED | None | self service |
|
392 | test_19_delete_add_same_tag | PASSED | None | self service |
|
393 | test_20_create_tags_multiple_resources | PASSED | None | self service |
|
394 | test_21_create_tag_stopped_vm | PASSED | None | self service |
|
395 | test_22_create_tag_destroyed_vm | PASSED | None | self service |
|
396 | test_01_create_template | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'} | provisioning | test can be modified to qualify as a self service test. |
397 | test_01_create_template_volume | FAILED | Execute cmd: deployvirtualmachine failed, due to: errorCode: 530, errorText:None | self service | rerun |
398 | test_03_delete_template | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'} | self service |
|
399 | test_04_template_from_snapshot | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'} | self service | rerun |
400 | test_update_vm_name | PASSED | None | self service |
|
401 | test_01_ISO_usage | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete ISO'} | self service |
|
402 | test_01_lb_usage | PASSED | None | self service |
|
403 | test_01_nat_usage | PASSED | None | self service |
|
404 | test_01_public_ip_usage | PASSED | None | self service |
|
405 | test_01_snapshot_usage | PASSED | None | self service |
|
406 | test_01_template_usage | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'} | self service |
|
407 | test_01_vm_usage | PASSED | None | self service |
|
408 | test_01_volume_usage | PASSED | None | self service |
|
409 | test_01_vpn_usage | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 213 on domR: r-383-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'} | self service |
|
410 | ContextSuite context=TestVMPasswordEnabled>:setup | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
411 | test_vmware_affinity | SKIPPED | None | provisioning | {Koushik}Since test name has vmware marked as provisioning for now. Check why a specific vmware affinity test is there depends on vmware drs |
412 | test_vmware_anti_affinity | SKIPPED | None | provisioning | {Koushik}Since test name has vmware marked as provisioning for now. Check why a specific vmware affinity test is there depends on vmware drs |
413 | test_vm_creation_in_fully_automated_mode | PASSED | None | provisioning | revisit.depends on vmware drs |
414 | ContextSuite context=TestAttachDetachVolume>:setup | FAILED | object of type 'NoneType' has no len() | provisioning | {Koushik}Needs further investigation no need to run on simulator since this test checks max data volumes supported by a hypervisor |
415 | ContextSuite context=TestAttachVolume>:setup | FAILED | object of type 'NoneType' has no len() | provisioning | {Koushik}Needs further investigation no need to run on simulator since this test checks max data volumes supported by a hypervisor |
416 | ContextSuite context=TestAttachVolumeISO>:setup | FAILED | object of type 'NoneType' has no len() | provisioning | {Koushik}Needs further investigation no need to run on simulator since this test checks max data volumes supported by a hypervisor |
417 | test_deployVmWithCustomDisk | PASSED | None | self service |
|
418 | test_01_attach_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'} | self service |
|
419 | test_02_detach_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'The specified volume is not attached to a VM.'} | self service |
|
420 | test_03_delete_detached_volume | PASSED | None | self service |
|
421 | test_create_volume_under_domain | PASSED | None | self service |
|
422 | test_01_list_vpc_apis | PASSED | None | self service |
|
423 | test_02_restart_vpc_no_networks | PASSED | None | self service |
|
424 | test_03_restart_vpc_with_networks | PASSED | None | self service |
|
425 | test_04_delete_vpc_no_networks | PASSED | None | self service |
|
426 | test_05_delete_vpc_with_networks | PASSED | None | self service |
|
427 | test_06_list_vpc_apis_admin | PASSED | None | self service |
|
428 | test_07_restart_network_vm_running | FAILED | Failed to SSH into VM - 192.168.2.19, SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
429 | test_08_delete_vpc | FAILED | Failed to SSH into VM - 192.168.2.19, SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
430 | test_09_vpc_create | PASSED | None | self service |
|
431 | test_10_nonoverlaping_cidrs | PASSED | None | self service |
|
432 | test_11_deploy_vm_wo_network_netdomain | FAILED | Failed to SSH into VM - 192.168.2.23, SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
433 | test_12_deploy_vm_with_netdomain | PASSED | None | self service |
|
434 | test_13_deploy_vm_with_vpc_netdomain | FAILED | Failed to SSH into VM - 192.168.2.23, SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
435 | test_14_deploy_vm_1 | PASSED | None | self service |
|
436 | test_15_deploy_vm_2 | PASSED | None | self service |
|
437 | test_16_deploy_vm_for_user_by_admin | PASSED | None | self service |
|
438 | test_17_deploy_vm_for_user_by_domain_admin | PASSED | None | self service |
|
439 | test_18_create_net_for_user_diff_domain_by_doadmin | PASSED | None | self service |
|
440 | test_19_create_vpc_wo_params | PASSED | None | self service |
|
441 | test_20_update_vpc_name_display_text | PASSED | None | self service |
|
442 | test_01_create_network_network_offering | PASSED | None | self service |
|
443 | test_01_create_network_network_offering_vpcns | SKIPPED | None | provisioning | {Koushik}Test name says lot of things, need to understand what all is done requires netscaler |
444 | test_02_create_network_fail_network_offering | PASSED | None | self service |
|
445 | test_02_create_network_fail_network_offering_vpcns | SKIPPED | None | provisioning | {Koushik}Test name says lot of things, need to understand what all is done requires netscaler |
446 | test_04_create_multiple_networks_with_lb_network_offering | PASSED | None | self service |
|
447 | test_04_create_multiple_networks_with_lb_network_offering_vpcns | SKIPPED | None | provisioning | {Koushik}Test name says lot of things, need to understand what all is done requires netscaler |
448 | test_06_create_network_with_rvr | SKIPPED | None | NA | "skipped - RvR didn't support VPC currently " |
449 | test_07_create_network_unsupported_services | PASSED | None | self service |
|
450 | test_08_create_network_without_sourceNAT | PASSED | None | self service |
|
451 | test_09_create_network_shared_nwoff_network_off_shared | PASSED | None | self service |
|
452 | test_09_create_network_shared_nwoff_network_offering_vpcns | SKIPPED | None | provisioning | {Koushik}Test name says lot of things, need to understand what all is done requires netscaler |
453 | test_10_create_network_with_conserve_mode_network_offering | PASSED | None | self service |
|
454 | test_10_create_network_with_conserve_mode_network_offering_vpcns | PASSED | None | self service |
|
455 | test_01_wait_network_gc | PASSED | None | provisioning | Enhancement: add more validation |
456 | test_02_start_vm_network_gc | FAILED | Failed to SSH into VM - 192.168.2.12, SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
457 | test_03_restart_vpcvr | FAILED | Failed to SSH into VM - 192.168.2.12, SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
458 | test_01_create_network_outside_range_network_offering | PASSED | None | self service |
|
459 | test_01_create_network_outside_range_network_offering_vpcns | SKIPPED | None | provisioning | {Koushik}Test name says lot of things, need to understand what all is done requires netscaler |
460 | test_02_create_network_outside_range | PASSED | None | self service |
|
461 | test_03_create_network_inside_range_network_offering | PASSED | None | self service |
|
462 | test_03_create_network_inside_range_network_offering_vpcns | SKIPPED | None | provisioning | {Koushik}Test name says lot of things, need to understand what all is done requires netscaler |
463 | test_04_create_network_overlapping_range_network_offering | PASSED | None | self service |
|
464 | test_04_create_network_overlapping_range_network_offering_vpcns | SKIPPED | None | provisioning | requires netscaler |
465 | test_05_create_network_diff_account_network_offering | PASSED | None | self service |
|
466 | test_05_create_network_diff_account_network_offering_vpcns | SKIPPED | None | provisioning | requires netscaler |
467 | test_01_network_services_upgrade | FAILED | Failed to SSH into VM - 192.168.2.12, SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
468 | test_02_network_vpcvr2vr_upgrade | PASSED | None | provisioning | add proper validation before and after upgrade |
469 | test_01_VPC_LBRulesListing | PASSED | None | self service |
|
470 | test_02_VPC_CreateLBRuleInMultipleNetworks | FAILED | Failed to wget from VM=QA-579a7424-09b9-41bd-8394-f72056b7e1d9 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out | provisioning |
|
471 | test_03_VPC_CreateLBRuleInMultipleNetworksVRStoppedState | FAILED | Failed to wget from VM=QA-91ac472a-996e-401d-88e2-9c305c780cb8 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out | provisioning |
|
472 | test_04_VPC_CreateLBRuleInMultipleNetworksVRStoppedState | FAILED | Failed to wget from VM=QA-87956b8f-9c6c-432c-96c7-e48759ccb85e http server on public_ip=192.168.2.29 because of [Errno socket error] timed out | provisioning |
|
473 | test_05_VPC_CreateAndDeleteLBRule | FAILED | Failed to wget from VM=QA-4de5c732-b31b-4f6a-b784-671d9091d277 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out | provisioning |
|
474 | test_06_VPC_CreateAndDeleteLBRuleVRStopppedState | FAILED | Failed to wget from VM=QA-6a0f9448-94d3-476d-8271-91bc3bf6b013 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out | provisioning |
|
475 | test_07_VPC_CreateAndDeleteAllLBRule | FAILED | Failed to wget from VM=QA-94f2bc5d-e061-448a-877e-bd0199faf4cf http server on public_ip=192.168.2.29 because of [Errno socket error] timed out | provisioning |
|
476 | test_08_VPC_CreateAndDeleteAllLBRuleVRStoppedState | FAILED | Failed to wget from VM=QA-3e51092f-b67d-4769-908f-a0c9c776683a http server on public_ip=192.168.2.29 because of [Errno socket error] timed out | provisioning |
|
477 | test_09_VPC_LBRuleCreateFailMultipleVPC | FAILED | Failed to wget from VM=QA-2ff04344-932c-4c77-a26b-d71ba6226732 http server on public_ip=192.168.2.30 because of [Errno socket error] timed out | provisioning |
|
478 | test_10_VPC_FailedToCreateLBRuleNonVPCNetwork | PASSED | None | self service |
|
479 | test_11_VPC_LBRuleCreateNotAllowed | FAILED | Failed to wget from VM=QA-23b260c3-862e-4f3d-8fba-519d9a7e55d6 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out | provisioning |
|
480 | test_12_VPC_LBRuleCreateFailForRouterIP | PASSED | None | self service |
|
481 | test_13_VPC_LBRuleCreateFailForPFSourceNATIP | FAILED | Failed to SSH into VM - 192.168.2.29 | provisioning |
|
482 | test_14_VPC_LBRuleCreateFailForStaticNatRule | PASSED | None | self service |
|
483 | test_15_VPC_ReleaseIPForLBRuleCreated | PASSED | None | self service |
|
484 | test_01_network_services_VPC_StopCreatePF | FAILED | Failed to SSH into VM - 192.168.2.13 | provisioning |
|
485 | test_02_network_services_VPC_CreatePF | FAILED | Failed to SSH into VM - 192.168.2.12 | provisioning |
|
486 | test_03_network_services_VPC_StopCreateMultiplePF | FAILED | Failed to SSH into VM - 192.168.2.12 | provisioning |
|
487 | test_04_network_services_VPC_CreateMultiplePF | FAILED | Failed to SSH into VM - 192.168.2.12 | provisioning |
|
488 | test_05_network_services_VPC_StopDeletePF | FAILED | Failed to SSH into VM - 192.168.2.12 | provisioning |
|
489 | test_06_network_services_VPC_DeletePF | FAILED | Failed to SSH into VM - 192.168.2.12 | provisioning |
|
490 | test_07_network_services_VPC_StopDeleteAllPF | FAILED | Failed to SSH into VM - 192.168.2.12 | provisioning |
|
491 | test_08_network_services_VPC_DeleteAllPF | FAILED | Failed to SSH into VM - 192.168.2.12 | provisioning |
|
492 | test_09_network_services_VPC_StopDeleteAllMultiplePF | FAILED | Failed to SSH into VM - 192.168.2.12 | provisioning |
|
493 | test_10_network_services_VPC_DeleteAllMultiplePF | FAILED | Failed to SSH into VM - 192.168.2.12 | provisioning |
|
494 | test_01_VPC_StaticNatRuleCreateStoppedState | FAILED | Failed to SSH into VM - 192.168.2.8 | provisioning |
|
495 | test_02_VPC_CreateStaticNatRule | FAILED | Failed to SSH into VM - 192.168.2.8 | provisioning |
|
496 | test_03_VPC_StopCreateMultipleStaticNatRuleStopppedState | FAILED | Failed to SSH into VM - 192.168.2.8 | provisioning |
|
497 | test_04_VPC_CreateMultipleStaticNatRule | FAILED | Failed to SSH into VM - 192.168.2.8 | provisioning |
|
498 | test_05_network_services_VPC_DeleteAllPF | FAILED | Failed to SSH into VM - 192.168.2.8 | provisioning |
|
499 | test_06_network_services_VPC_DeleteAllMultiplePF | FAILED | Failed to SSH into VM - 192.168.2.8 | provisioning |
|
500 | test_01_create_vpc_offering | PASSED | None | self service |
|
501 | test_02_deploy_vms_in_vpc_nw | FAILED | Failed to SSH into VM - 192.168.2.19, SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning |
|
502 | test_03_vpc_off_without_lb | PASSED | None | self service |
|
503 | test_04_vpc_off_without_static_nat | PASSED | None | self service |
|
504 | test_05_vpc_off_without_pf | PASSED | None | self service |
|
505 | test_06_vpc_off_invalid_services | PASSED | None | self service |
|
506 | test_07_update_vpc_off | PASSED | None | self service |
|
507 | test_08_list_vpc_off | PASSED | None | self service |
|
508 | test_01_start_stop_router_after_addition_of_one_guest_network | PASSED | None | provisioining | Ehnancement: add more validation written in the steps |
509 | test_02_reboot_router_after_addition_of_one_guest_network | PASSED | None | self service |
|
510 | test_03_migrate_router_after_addition_of_one_guest_network | FAILED | Migration to host b5205777-8029-480e-9941-b7f8f89f48ba failed. The router host isstill 09c38e9a-7a22-4591-be39-f1a2bcd138a5 | provisioning |
|
511 | test_04_chg_srv_off_router_after_addition_of_one_guest_network | PASSED | None | self service |
|
512 | test_05_destroy_router_after_addition_of_one_guest_network | PASSED | None | self service |
|
513 | test_01_stop_start_router_after_creating_vpc | PASSED | None | self service |
|
514 | test_02_reboot_router_after_creating_vpc | PASSED | None | self service |
|
515 | test_03_migrate_router_after_creating_vpc | FAILED | Migration to host b5205777-8029-480e-9941-b7f8f89f48ba failed. The router host is still 09c38e9a-7a22-4591-be39-f1a2bcd138a5 | provisioning |
|
516 | test_04_change_service_offerring_vpc | PASSED | None | self service |
|
517 | test_05_destroy_router_after_creating_vpc | PASSED | None | self service |
|
518 | test_01_deploy_vms_in_network | PASSED | None | self service |
|
519 | test_02_deploy_vms_delete_network | PASSED | None | self service |
|
520 | test_03_deploy_vms_delete_add_network | PASSED | None | self service |
|
521 | test_04_deploy_vms_delete_add_network_noLb | PASSED | None | self service |
|
522 | test_05_create_network_max_limit | PASSED | None | self service |
|
523 | test_06_delete_network_vm_running | PASSED | None | self service |
|
524 | test_07_delete_network_with_rules | FAILED | List public Ips 192.168.2.9 for network should list the Ip addr 192.168.2.11 | self service | rerun and revisit |
525 | test_01_VPN_user_limit | FAILED | Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 583 on domR: r-961-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'} | self service |
|
526 | test_02_use_vpn_port | PASSED | None | self service |
|
527 | test_03_enable_vpn_use_port | FAILED | Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 585 on domR: r-965-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'} | self service |
|
528 | test_04_add_new_users | FAILED | Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 586 on domR: r-967-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'} | self service |
|
529 | test_05_add_duplicate_user | FAILED | Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 587 on domR: r-969-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'} | self service |
|
530 | test_06_add_VPN_user_global_admin | FAILED | Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 588 on domR: r-971-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'} | self service |
|
531 | test_07_add_VPN_user_domain_admin | FAILED | Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 589 on domR: r-973-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'} | self service |
|
Self Service tests: TBA
Provisioning tests: TBA
Total no. of existing automated tests for advanced zone: TBA
BVT Report -Basic Zone
| Sl. No. | test case | status | Error Description | Type | Comments |
| 1 | test_DeployVmAntiAffinityGroup | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-ed6c84c2-3602-461b-bfc0-77031d0b7b33], Please check the affinity groups provided, there may not be sufficient capacity to follow them'} | self service | |
| 2 | test_deploy_vm | PASSED | None | self service | |
| 3 | test_deployvm_userdata | PASSED | None | self service | |
| 4 | test_deployvm_userdata_post | PASSED | None | self service | |
| 5 | test_deployvm_firstfit | PASSED | None | self service | |
| 6 | test_deployvm_userconcentrated | PASSED | None | self service | |
| 7 | test_deployvm_userdispersing | PASSED | None | self service | |
| 8 | test_01_create_disk_offering | PASSED | None | self service | |
| 9 | test_02_edit_disk_offering | PASSED | None | self service | |
| 10 | test_03_delete_disk_offering | PASSED | None | self service | |
| 11 | test_UpdateConfigParamWithScope | PASSED | None | self service | |
| 12 | test_01_create_iso | PASSED | None | self service | |
| 13 | test_02_edit_iso | PASSED | None | self service | |
| 14 | test_03_delete_iso | PASSED | None | self service | |
| 15 | test_04_extract_Iso | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract iso'} | provisioning | |
| 16 | test_05_iso_permissions | PASSED | None | self service | |
| 17 | test_06_copy_iso | SKIPPED | None | provisioning | |
| 18 | test_nic_secondaryip_add_remove | PASSED | None | self service | |
| 19 | test_01_nic | FAILED | Exception during NIC test!: 'TestNic' object has no attribute 'account' | test/config issue | change test tag to run only in advanced zone |
| 20 | test_createPortablePublicIPRange | PASSED | None | self service | |
| 21 | test_01_primary_storage_iscsi | FAILED | Check storage pool type | self service | test fix |
| 22 | test_01_primary_storage_nfs | PASSED | None | self service | |
| 23 | test_createRegion | PASSED | None | self service | |
| 24 | test_01_reset_vm_on_reboot | PASSED | None | self service | |
| 25 | test_01_router_internal_basic | SKIPPED | None | provisioning | |
| 26 | test_01_scale_vm | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'This operation not permitted for this hypervisor of the vm'} | provisioning | |
| 27 | test_01_sys_vm_start | PASSED | None | self service | |
| 28 | test_02_sys_template_ready | PASSED | None | self service | |
| 29 | test_01_create_service_offering | PASSED | None | self service | |
| 30 | test_02_edit_service_offering | PASSED | None | self service | |
| 31 | test_03_delete_service_offering | PASSED | None | self service | |
| 32 | test_01_list_sec_storage_vm | PASSED | None | self service | |
| 33 | test_02_list_cpvm_vm | PASSED | None | self service | |
| 34 | test_03_ssvm_internals | SKIPPED | None | provisioning | |
| 35 | test_04_cpvm_internals | SKIPPED | None | provisioning | |
| 36 | test_05_stop_ssvm | SKIPPED | None | provisioning | |
| 37 | test_06_stop_cpvm | SKIPPED | None | provisioning | |
| 38 | test_07_reboot_ssvm | SKIPPED | None | provisioning | |
| 39 | test_08_reboot_cpvm | SKIPPED | None | provisioning | |
| 40 | test_09_destroy_ssvm | SKIPPED | None | provisioning | |
| 41 | test_10_destroy_cpvm | SKIPPED | None | provisioning | |
| 42 | test_02_edit_template | PASSED | None | self service | |
| 43 | test_03_delete_template | PASSED | None | self service | |
| 44 | test_04_extract_template | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'} | provisioning | |
| 45 | test_05_template_permissions | PASSED | None | self service | |
| 46 | test_06_copy_template | SKIPPED | None | provisioning | |
| 47 | test_07_list_public_templates | PASSED | None | self service | |
| 48 | test_08_list_system_templates | PASSED | None | self service | |
| 49 | test_deploy_vm | PASSED | None | self service | |
| 50 | test_01_stop_vm | PASSED | None | self service | |
| 51 | test_02_start_vm | PASSED | None | self service | |
| 52 | test_03_reboot_vm | PASSED | None | self service | |
| 53 | test_06_destroy_vm | PASSED | None | self service | |
| 54 | test_07_restore_vm | PASSED | None | self service | |
| 55 | test_08_migrate_vm | SKIPPED | None | provisioning | |
| 56 | test_09_expunge_vm | PASSED | None | self service | |
| 57 | test_10_attachAndDetach_iso | FAILED | SSH failed for virtual machine: 60.147.41.9 - SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | |
| 58 | test_01_create_volume | FAILED | SSH access failed for VM 60.147.41.6 - SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | |
| 59 | test_02_attach_volume | FAILED | SSH failed for VM: 60.147.41.6 - SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | |
| 60 | test_03_download_attached_volume | PASSED | None | self service | |
| 61 | test_04_delete_attached_volume | PASSED | None | self service | |
| 62 | test_05_detach_volume | PASSED | None | self service | |
| 63 | test_06_download_detached_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract volume'} | provisioning | |
| 64 | test_07_resize_fail | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Cloudstack currently only supports volumes marked as KVM or XenServer hypervisor for resize'} | provisioning | |
| 65 | test_08_resize_volume | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Cloudstack currently only supports volumes marked as KVM or XenServer hypervisor for resize'} | provisioning | |
| 66 | test_09_delete_detached_volume | PASSED | None | self service | |
| Total time(in min) | 56.39521667 |
Regression Test Report - Basic Zone:
| Sl. No. | test case | status | Error Description | Type | Comments |
| 1 | test_01_create_account | PASSED | None | self service | |
| 2 | test_01_add_vm_to_subdomain | PASSED | None | self service | |
| 3 | test_01_non_root_admin_Privileges | PASSED | None | self service | |
| 4 | test_01_user_remove_VM_running | PASSED | None | self service | |
| 5 | test_01_service_offering_hierarchy | PASSED | None | self service | |
| 6 | test_01_service_offering_siblings | PASSED | None | self service | |
| 7 | ContextSuite context=TestTemplateHierarchy>:setup | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'} | provisioning | |
| 8 | test_updateAdminDetails | PASSED | None | self service | |
| 9 | test_updateDomainAdminDetails | PASSED | None | self service | |
| 10 | test_updateUserDetails | PASSED | None | self service | |
| 11 | test_LoginApiDomain | PASSED | None | self service | |
| 12 | test_LoginApiUuidResponse | PASSED | None | self service | |
| 13 | ContextSuite context=TestFailureScenariosAddNetworkToVM>:setup | SKIPPED | None | Not Run | |
| 14 | test_01_deploy_vm_another_user | PASSED | None | self service | |
| 15 | test_02_create_aff_grp_user | PASSED | None | self service | |
| 16 | test_03_list_aff_grp_all_users | PASSED | None | self service | |
| 17 | test_04_list_all_admin_aff_grp | PASSED | None | self service | |
| 18 | test_05_list_all_users_aff_grp | PASSED | None | self service | |
| 19 | test_06_list_all_users_aff_grp_by_id | PASSED | None | self service | |
| 20 | test_07_delete_aff_grp_of_other_user | PASSED | None | self service | |
| 21 | test_01_admin_create_aff_grp | PASSED | None | self service | |
| 22 | test_02_doadmin_create_aff_grp | PASSED | None | self service | |
| 23 | test_03_user_create_aff_grp | PASSED | None | self service | |
| 24 | test_04_user_create_aff_grp_existing_name | PASSED | None | self service | |
| 25 | test_05_create_aff_grp_same_name_diff_acc | PASSED | None | self service | |
| 26 | test_06_create_aff_grp_nonexisting_type | PASSED | None | self service | |
| 27 | test_01_delete_aff_grp_by_name | PASSED | None | self service | |
| 28 | test_02_delete_aff_grp_for_acc | PASSED | None | self service | |
| 29 | test_03_delete_aff_grp_with_vms | PASSED | None | self service | |
| 30 | test_05_delete_aff_grp_id | PASSED | None | self service | |
| 31 | test_06_delete_aff_grp_name | PASSED | None | self service | |
| 32 | test_08_delete_aff_grp_by_id | PASSED | None | self service | |
| 33 | test_09_delete_aff_grp_root_admin | PASSED | None | self service | |
| 34 | test_01_deploy_vm_without_aff_grp | PASSED | None | self service | |
| 35 | test_02_deploy_vm_by_aff_grp_name | PASSED | None | self service | |
| 36 | test_03_deploy_vm_by_aff_grp_id | PASSED | None | self service | |
| 37 | test_04_deploy_vm_anti_affinity_group | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-8ad687c5-2af6-4b80-adc1-3ddc3c33d4c2], Please check the affinity groups provided, there may not be sufficient capacity to follow them'} | self service | add enough hosts |
| 38 | test_05_deploy_vm_by_id | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-e57ae7c4-7db9-4e3f-aeb7-4bfaf78983dd], Please check the affinity groups provided, there may not be sufficient capacity to follow them'} | self service | add enough hosts |
| 39 | test_06_deploy_vm_aff_grp_of_other_user_by_name | PASSED | None | self service | |
| 40 | test_07_deploy_vm_aff_grp_of_other_user_by_id | PASSED | None | self service | |
| 41 | test_08_deploy_vm_multiple_aff_grps | PASSED | None | self service | |
| 42 | test_09_deploy_vm_multiple_aff_grps | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-85503541-e176-4a9e-80a3-d25e7db164e4], Please check the affinity groups provided, there may not be sufficient capacity to follow them'} | self service | add enough hosts |
| 43 | test_10_deploy_vm_by_aff_grp_name_and_id | PASSED | None | self service | |
| 44 | test_01_list_aff_grps_for_vm | PASSED | None | self service | |
| 45 | test_02_list_multiple_aff_grps_for_vm | PASSED | None | self service | |
| 46 | test_03_list_aff_grps_by_id | PASSED | None | self service | |
| 47 | test_04_list_aff_grps_by_name | PASSED | None | self service | |
| 48 | test_05_list_aff_grps_by_non_existing_id | PASSED | None | self service | |
| 49 | test_06_list_aff_grps_by_non_existing_name | PASSED | None | self service | |
| 50 | test_07_list_all_vms_in_aff_grp | PASSED | None | self service | |
| 51 | test_01_update_aff_grp_by_ids | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-9f918f00-26ca-4677-b051-44e2baec4d7c], Please check the affinity groups provided, there may not be sufficient capacity to follow them'} | self service | add enough hosts |
| 52 | test_02_update_aff_grp_by_names | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-ee4de048-870f-44fa-892d-c958cbb3e427], Please check the affinity groups provided, there may not be sufficient capacity to follow them'} | self service | add enough hosts |
| 53 | test_03_update_aff_grp_for_vm_with_no_aff_grp | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Unable to start a VM due to insufficient capacity'} | self service | add enough hosts |
| 54 | test_04_update_aff_grp_remove_all | SKIPPED | None | Not Run | |
| 55 | test_05_update_aff_grp_on_running_vm | PASSED | None | self service | |
| 56 | test_baremetal | FAILED | Execute cmd: createnetwork failed, due to: errorCode: 431, errorText:Can't have more than one Guest network in zone with network type Basic | test/config issue | revisit this and fix tags if required |
| 57 | test_01_deploy_instance_with_is_volatile_offering | PASSED | None | self service | |
| 58 | test_02_reboot_instance_with_is_volatile_offering | PASSED | None | self service | |
| 59 | test_03_restore_vm_with_new_template | PASSED | None | self service | |
| 60 | test_04_reoccuring_snapshot_rules | FAILED | Exception not raised | self service | looks like a product bug, reverify |
| 61 | test_01_create_template | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'} | provisioning | |
| 62 | test_01_check_template_size | FAILED | Template instance has no attribute 'size' | provisioning | |
| 63 | test_02_check_size_snapshotTemplate | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'} | provisioning | |
| 64 | test_03_reuse_template_name | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'} | provisioning | |
| 65 | test_01_custom_hostname_instancename_false | PASSED | None | self service | |
| 66 | test_01_user_provided_hostname | SKIPPED | None | Not Run | |
| 67 | test_02_instancename_from_default_configuration | SKIPPED | None | Not Run | |
| 68 | test_03_duplicate_name | SKIPPED | None | Not Run | |
| 69 | test_04_edit_display_name | PASSED | None | self service | |
| 70 | test_05_unsupported_chars_in_display_name | PASSED | None | self service | |
| 71 | test_deployvm_userdata_post | FAILED | No JSON object could be decoded | provisioning | |
| 72 | test_authorizeIngressRule | FAILED | SSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | |
| 73 | test_01_default_group_with_egress | FAILED | SSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | |
| 74 | test_01_default_group_with_egress | FAILED | SSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | |
| 75 | test_deployVM_InDefaultSecurityGroup | PASSED | None | self service | |
| 76 | test_invalid_account_authroize | PASSED | None | self service | |
| 77 | test_invalid_parameters | PASSED | None | self service | |
| 78 | test_multiple_account_egress_rule_positive | FAILED | SSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | |
| 79 | test_multiple_account_egress_rule_negative | FAILED | SSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | |
| 80 | test_revoke_egress_rule | FAILED | SSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | |
| 81 | test_start_stop_vm_egress | FAILED | SSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | |
| 82 | test_01_deploy_vm_with_explicit_dedication | SKIPPED | None | Not Run | |
| 83 | test_01_deploy_vm_with_implicit_planner | SKIPPED | None | Not Run | |
| 84 | test_01_addLdapConfiguration | FAILED | addLdapConfiguration failed | self service | fix test data |
| 85 | test_01_add_ip_same_cidr | PASSED | None | self service | |
| 86 | test_02_add_ip_diff_cidr | PASSED | None | self service | |
| 87 | test_03_del_ip_range | PASSED | None | self service | |
| 88 | test_04_add_noncontiguous_ip_range | PASSED | None | self service | |
| 89 | test_05_add_overlapped_ip_range | PASSED | None | self service | |
| 90 | test_06_add_ip_range_overlapped_with_two_ranges | PASSED | None | self service | |
| 91 | test_07_add_iprange_superset | PASSED | None | self service | |
| 92 | test_08_add_iprange_subset | PASSED | None | self service | |
| 93 | ContextSuite context=TestProjectCreationNegative>:setup | SKIPPED | None | Not Run | |
| 94 | test_add_user_to_project | PASSED | None | self service | |
| 95 | ContextSuite context=TestProjectInviteRequiredTrue>:setup | SKIPPED | None | Not Run | |
| 96 | ContextSuite context=TestProjectInviteTimeout>:setup | SKIPPED | None | Not Run | |
| 97 | test_admin_project_creation | PASSED | None | self service | |
| 98 | test_01_project_limits | PASSED | None | self service | |
| 99 | test_02_project_limits_normal_user | PASSED | None | self service | |
| 100 | test_03_vm_per_project | PASSED | None | self service | |
| 101 | test_05_snapshots_per_project | PASSED | None | self service | |
| 102 | test_06_volumes_per_project | PASSED | None | self service | |
| 103 | test_07_templates_per_project | PASSED | None | self service | |
| 104 | test_01_service_offerings | PASSED | None | self service | |
| 105 | test_02_project_disk_offerings | PASSED | None | self service | |
| 106 | test_08_security_group | PASSED | None | self service | |
| 107 | test_06_create_snapshots_in_project | PASSED | None | self service | |
| 108 | test_04_public_template_use_in_project | PASSED | None | self service | |
| 109 | test_05_use_private_template_in_project | FAILED | Execute cmd: deployvirtualmachine failed, due to: errorCode: 530, errorText:None | self service | re run |
| 110 | test_01_ISO_usage | PASSED | None | self service | |
| 111 | test_01_snapshot_usage | PASSED | None | self service | |
| 112 | test_01_template_usage | PASSED | None | self service | |
| 113 | test_01_vm_usage | PASSED | None | self service | |
| 114 | test_01_volume_usage | PASSED | None | self service | |
| 115 | test_02_cross_domain_account_add | PASSED | None | self service | |
| 116 | test_03_delete_account_with_project | PASSED | None | self service | |
| 117 | test_04_delete_domain_with_project | PASSED | None | self service | |
| 118 | test_01_create_multiple_projects_by_account | PASSED | None | self service | |
| 119 | test_05_user_project_owner_promotion | PASSED | None | self service | |
| 120 | test_06_max_one_project_owner | PASSED | None | self service | |
| 121 | test_07_project_resources_account_delete | PASSED | None | self service | |
| 122 | test_08_cleanup_after_project_delete | PASSED | None | self service | |
| 123 | test_09_project_suspend | PASSED | None | self service | |
| 124 | test_10_project_activation | PASSED | None | self service | |
| 125 | test_createRegionWithExistingRegionId | PASSED | None | self service | |
| 126 | test_createRegionWithExistingRegionName | PASSED | None | self service | |
| 127 | test_updateRegion | PASSED | None | self service | |
| 128 | test_createAccountWithUUID | PASSED | None | self service | |
| 129 | test_createUserWithUUID | PASSED | None | self service | |
| 130 | test_createdomainWithUUID | PASSED | None | self service | |
| 131 | ContextSuite context=TestResetSSHKeyUserRights>:setup | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | |
| 132 | ContextSuite context=TestResetSSHKeypair>:setup | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | |
| 133 | test_01_authorizeIngressRule | FAILED | SSH Access failed for 60.147.41.7: SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | |
| 134 | test_01_deployVM_InDefaultSecurityGroup | PASSED | None | self service | |
| 135 | test_02_listSecurityGroups | PASSED | None | self service | |
| 136 | test_03_accessInDefaultSecurityGroup | PASSED | None | self service | |
| 137 | test_01_delete_security_grp_running_vm | PASSED | None | self service | |
| 138 | test_02_delete_security_grp_withoout_running_vm | PASSED | None | self service | |
| 139 | test_01_dhcpOnlyRouter | FAILED | Connection Failed | provisioning | |
| 140 | test_01_authorizeIngressRule_AfterDeployVM | FAILED | SSH access failed for ingress rule ID: bb72e3c0-5b09-4138-9a49-5f839d229543, SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | |
| 141 | test_02_revokeIngressRule_AfterDeployVM | FAILED | SSH access failed for ingress rule ID: c8737ff2-1a4e-42fe-b89c-b99e730fd459, SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | |
| 142 | test_03_stopStartVM_verifyIngressAccess | FAILED | SSH access failed for ingress rule ID: 61bdad47-8f6a-47ac-8940-9db4764f2b2f | provisioning | |
| 143 | test_01_revokeIngressRule | FAILED | SSH Access failed for 60.147.41.7: SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | |
| 144 | test_01_deployVMWithUserData | FAILED | SSH Access failed for 60.147.41.7: SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | |
| 145 | test_02_accountSnapshotClean | FAILED | 'simulator' | provisioning | cheking is_snapshot_on_nfs |
| 146 | test_01_volume_from_snapshot | FAILED | SSH failed for VM: 60.147.41.11 | provisioning | |
| 147 | test_03_snapshot_detachedDisk | FAILED | SSH failed for VM with IP: 60.147.41.11 - SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | |
| 148 | test_01_snapshot_on_rootVolume | FAILED | 'simulator' | provisioning | cheking is_snapshot_on_nfs |
| 149 | test_01_deploy_ha_vm_startvm_false | PASSED | None | self service | |
| 150 | test_02_deploy_ha_vm_from_iso | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-707178ea-d8f8-4401-88a2-e232a4f3f58f]'} | self service | re run |
| 151 | test_03_deploy_ha_vm_iso_startvm_false | PASSED | None | self service | |
| 152 | test_deployVmOnGivenHost | PASSED | None | self service | |
| 153 | test_01_deploy_vm_no_startvm | PASSED | None | self service | |
| 154 | test_02_deploy_vm_startvm_true | PASSED | None | self service | |
| 155 | test_03_deploy_vm_startvm_false | PASSED | None | self service | |
| 156 | test_04_deploy_startvm_false_attach_volume | PASSED | None | self service | |
| 157 | test_05_deploy_startvm_false_change_so | PASSED | None | self service | |
| 158 | test_06_deploy_startvm_attach_detach | PASSED | None | self service | |
| 159 | test_07_deploy_startvm_attach_iso | PASSED | None | self service | |
| 160 | test_08_deploy_attached_volume | PASSED | None | self service | |
| 161 | test_09_stop_vm_migrate_vol | SKIPPED | None | Not Run | |
| 162 | test_deploy_vm_password_enabled | FAILED | Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'} | provisioning | |
| 163 | test_upload_attach_volume | PASSED | None | self service | |
| 164 | test_vm_per_account | PASSED | None | self service | |
| 165 | test_01_migrate_vm_with_volume | FAILED | Execute cmd: findhostsformigration failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only | provisioning | |
| 166 | test_02_migrate_volume | SKIPPED | None | Not Run | |
| 167 | test_05_vm_tag | PASSED | None | self service | |
| 168 | test_06_template_tag | PASSED | None | self service | |
| 169 | test_07_iso_tag | PASSED | None | self service | |
| 170 | test_08_volume_tag | PASSED | None | self service | |
| 171 | test_09_snapshot_tag | PASSED | None | self service | |
| 172 | test_11_migrate_tagged_vm_del | FAILED | list index out of range | self service | fix test to check null list |
| 173 | test_13_tag_case_insensitive | PASSED | None | self service | |
| 174 | test_14_special_char_mutiple_tags | PASSED | None | self service | |
| 175 | test_16_query_tags_other_account | PASSED | None | self service | |
| 176 | test_17_query_tags_admin_account | PASSED | None | self service | |
| 177 | test_18_invalid_list_parameters | PASSED | None | self service | |
| 178 | test_19_delete_add_same_tag | PASSED | None | self service | |
| 179 | test_20_create_tags_multiple_resources | PASSED | None | self service | |
| 180 | test_21_create_tag_stopped_vm | PASSED | None | self service | |
| 181 | test_22_create_tag_destroyed_vm | PASSED | None | self service | |
| 182 | test_update_vm_name | PASSED | None | self service | |
| 183 | test_01_ISO_usage | PASSED | None | self service | |
| 184 | test_01_snapshot_usage | PASSED | None | self service | |
| 185 | test_01_template_usage | PASSED | None | self service | |
| 186 | test_01_vm_usage | PASSED | None | self service | |
| 187 | test_01_volume_usage | PASSED | None | self service | |
| 188 | ContextSuite context=TestVMPasswordEnabled>:setup | FAILED | SSH connection has Failed. Waited 600s. Error is Connection Failed | provisioning | |
| 189 | test_deployVmWithCustomDisk | PASSED | None | self service | |
| 190 | test_create_volume_under_domain | PASSED | None | self service | |
| Total Time(in hours) | 6.096176667 |
Overview
Content Tools
Apps