This is an exercise to extract unsupported tests on simulator from the existing smoke and regression integration test suites.

Here is the list of automated smoke/BVT/sanity tests which needs to be reviewed. There is a column 'type' added with the following values

self service
provisioning
unsupported
test issue
Not Run -skipped test

skipped tests need to be run manually.
test issues need to be fixed an re run.

BVT Report - advanced zone:

Sl. No.	test case	status	Error Description	Type	Comment
1	test_DeployVmAntiAffinityGroup	PASSED	None	self service
2	test_deploy_vm	PASSED	None	self service
3	test_deployvm_userdata	PASSED	None	provisioning	[ Koushik ] This looks same as #2 unless user data is verified. For verification you need actual setup. So this should belong to provisioning. Talluri/Koushik Fix the test to verify userdata
4	test_deployvm_userdata_post	PASSED	None	provisioning	[ Koushik ] This looks same as #2 unless user data is verified. For verification you need actual setup. So this should belong to provisioning. Talluri/Koushik Fix the test to verify userdata
5	test_deployvm_firstfit	PASSED	None	self service
6	test_deployvm_userconcentrated	PASSED	None	self service
7	test_deployvm_userdispersing	PASSED	None	self service
8	test_01_create_disk_offering	PASSED	None	self service
9	test_02_edit_disk_offering	PASSED	None	self service
10	test_03_delete_disk_offering	PASSED	None	self service
11	test_UpdateConfigParamWithScope	PASSED	None	self service
12	test_dedicateGuestVlanRange	PASSED	None	self service
13	test_internallb	PASSED	None	provisioning	Enhancement: modify this test to verify lb rules by sending request from another tier
14	test_01_create_iso	PASSED	None	self service	Enhancement: check the existence of registered of ISO in secondary deploy a VM with registered ISO. can be added as another test (provisioning)
15	test_02_edit_iso	PASSED	None	self service
16	test_03_delete_iso	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete ISO'}	self service	Rajani: this can be fixed by implementing deleteAsync in SimulatorImageStoreDriverImpl.java (Fixed this locally. will push after more testing)
17	test_04_extract_Iso	FAILED	Extract ISO Failed with invalid URL http://192.168.2.3/userdata/9a95de36-9645-40c1-b473-f6665bb9a4f0.iso (ISO id: 297135cd-020a-47cb-ae0d-efb970876eee)	provisioning	This test can be modified for simulator not to download using URL
18	test_05_iso_permissions	PASSED	None	self service
19	test_06_copy_iso	SKIPPED	None	provisioning	destination zone needs to extract the template URL
20	test_01_create_lb_rule_src_nat	FAILED	Connection Failed: SSH failed for VM with IP Address: 192.168.2.8	provisioning	avoid ssh connection
21	test_02_create_lb_rule_non_nat	FAILED	Connection Failed: SSH failed for VM with IP Address: 192.168.2.8: SSH failed for VM with IP Address: 192.168.2.8	provisioning	avoid ssh connection
22	test_assign_and_removal_lb	FAILED	Connection Failed: SSH failed for VM with IP Address: 192.168.2.8	provisioning	avoid ssh connection
23	test_nic_secondaryip_add_remove	PASSED	None	provisioning	Enhancement: add verification
24	test_delete_account	PASSED	None	self service
25	test_01_port_fwd_on_src_nat	FAILED	SSH Access failed for 10.1.1.56: SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning	avoid ssh connection
26	test_02_port_fwd_on_non_src_nat	FAILED	SSH Access failed for 10.1.1.56: SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning	avoid ssh connection
27	test_public_ip_admin_account	PASSED	None	self service
28	test_public_ip_user_account	PASSED	None	self service
29	test_reboot_router	FAILED	SSH Access failed for 192.168.2.5: Connection Failed	provisioning	avoid ssh connection
30	test_releaseIP	PASSED	None	self service
31	test_network_acl	PASSED	None	provisioning	[ Koushik ] Is it just testing creation of acl on the db? For verifying if the acl is working you need actual setup. In that case this will be provisioning. Enhancement: add actual verification Logic for rules.
32	test_01_nic	PASSED	None	provisioning	Enhancement: add validation
33	test_extendPhysicalNetworkVlan	PASSED	None	self service
34	test_createPortablePublicIPAcquire	PASSED	None	self service
35	test_createPortablePublicIPRange	PASSED	None	self service
36	test_01_primary_storage_iscsi	PASSED	None	self service	in actual VM deployment scenarios storage will be tested.
37	test_01_primary_storage_nfs	PASSED	None	self service	in actual VM deployment scenarios storage will be tested.
38	test_privategw_acl	PASSED	None	self service	Enhancement: add a new test to verification of ACL rules
39	test_dedicatePublicIpRange	PASSED	None	self service
40	test_create_pvlan_network	PASSED	None	self service
41	test_createRegion	PASSED	None	self service
42	test_01_reset_vm_on_reboot	PASSED	None	self service	Enhancement: add new test to check volume contents
43	test_01_updatevolumedetail	PASSED	None	self service
44	test_01_router_internal_basic	SKIPPED	None	provisioning	[ Koushik ] This test ssh to the router
45	test_02_router_internal_adv	SKIPPED	None	provisioning	[ Koushik ] This test ssh to the router
46	test_03_restart_network_cleanup	PASSED	None	self service
47	test_04_restart_network_wo_cleanup	SKIPPED	None	provisioning	need access to host
48	test_05_router_basic	PASSED	None	self service
49	test_06_router_advanced	PASSED	None	self service
50	test_07_stop_router	PASSED	None	self service
51	test_08_start_router	PASSED	None	self service
52	test_09_reboot_router	PASSED	None	self service
53	test_01_scale_vm	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'This operation not permitted for this hypervisor of the vm'}	provisioning	[ Koushik ] There is HV specific check in CS code and so fails for HV type 'Simulator'. For now run as provisioning test.
54	test_01_sys_vm_start	PASSED	None	self service
55	test_02_sys_template_ready	PASSED	None	self service
56	test_01_create_service_offering	PASSED	None	self service
57	test_02_edit_service_offering	PASSED	None	self service
58	test_03_delete_service_offering	PASSED	None	self service
59	test_04_change_offering_small	FAILED	SSH Access failed for 10.1.1.130: SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning	avoid ssh connection
60	test_01_snapshot_root_disk	FAILED	'simulator'	provisioning	Test script needs to be changed for simulator to avoid checking the existence of snapshot on secondary
61	test_01_list_sec_storage_vm	PASSED	None	self service
62	test_02_list_cpvm_vm	PASSED	None	self service
63	test_03_ssvm_internals	SKIPPED	None	provisioning	[ Koushik ] Based on similar test cases for router
64	test_04_cpvm_internals	SKIPPED	None	provisioning	[ Koushik ] Based on similar test cases for router
65	test_05_stop_ssvm	SKIPPED	None	provisioning	actually doing a stop and then a start. then calls test_ssvm_internals()
66	test_06_stop_cpvm	SKIPPED	None	provisioning	do
67	test_07_reboot_ssvm	SKIPPED	None	provisioning	do
68	test_08_reboot_cpvm	SKIPPED	None	provisioning	do
69	test_09_destroy_ssvm	SKIPPED	None	provisioning	do
70	test_10_destroy_cpvm	SKIPPED	None	provisioning	do
71	test_01_create_template	FAILED	Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}	self service	Delete template/ISO is eventually removing the entry from DB but errors out while trying to delete it from backend. [ Koushik ] Rajani fixed the simulator for this
72	test_02_edit_template	PASSED	None	self service
73	test_03_delete_template	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}	self service	Delete template/ISO is eventually removing the entry from DB but errors out while trying to delete it from backend. [ Koushik ] Rajani fixed the simulator for this
74	test_04_extract_template	FAILED	Extract Template Failed with invalid URL http://192.168.2.3/userdata/d408cfd8-bf7f-47ef-9aa0-84c353d24221.raw (template id: 31ea9fe5-3a0b-4425-b4ca-7aa9e0695605)	provisioning	This test can be modified for simulator not to download using URL
75	test_05_template_permissions	PASSED	None	self service
76	test_06_copy_template	SKIPPED	None	provisioning	destination zone needs to extract the template URL
77	test_07_list_public_templates	PASSED	None	self service
78	test_08_list_system_templates	PASSED	None	self service
79	test_advZoneVirtualRouter	PASSED	None	NA	duplicate test, remove it
80	test_deploy_vm	PASSED	None	self service	{Koushik}Is this a duplicate of #2 Can be removed since it is covered in test_vm_life_cycle.py
81	test_01_stop_vm	PASSED	None	self service
82	test_02_start_vm	PASSED	None	self service
83	test_03_reboot_vm	PASSED	None	self service
84	test_06_destroy_vm	PASSED	None	self service
85	test_07_restore_vm	PASSED	None	self service	Enhancement: add another test the data on the restored VM.
86	test_08_migrate_vm	PASSED	None	self service
87	test_09_expunge_vm	PASSED	None	self service
88	test_10_attachAndDetach_iso	FAILED	SSH failed for virtual machine: 10.1.1.62 - SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning	avoid ssh connection
89	test_01_create_vm_snapshots	FAILED	SSH failed for Virtual machine: 10.1.1.44	provisioning	avoid ssh connection
90	test_02_revert_vm_snapshots	FAILED	SSH failed for Virtual machine: 10.1.1.44	provisioning	avoid ssh connection
91	test_03_delete_vm_snapshots	FAILED	Check list response returns a valid list	provisioning
92	test_01_create_volume	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}	provisioning	attach volume is failing {Koushik} Rajani fixed simulator for this test does SSH connection, Hence, marking it as provisioning
93	test_02_attach_volume	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}	provisioning	attach volume is failing test does SSH connection, Hence, marking it as provisioning
94	test_03_download_attached_volume	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}	self service	attach volume is failing test is checking that downloading an attached volume fails
95	test_04_delete_attached_volume	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}	self service	attach volume is failing
96	test_05_detach_volume	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}	self service	attach volume is failing
97	test_06_download_detached_volume	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}	provisioning	attach volume is failing
98	test_07_resize_fail	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}	self service	attach volume is failing
99	test_08_resize_volume	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}	provisioning	attach volume is failing Enhancement: check the resized volume on the backend if it has actually been resized.
100	test_09_delete_detached_volume	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}	self service	attach volume is failing
101	test_vpc_remote_access_vpn	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 31 on domR: r-9-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'}	self service	vpn user creation is failing {Koushik} Rajani fixed simulator for this
102	test_vpc_site2site_vpn	PASSED	None	self service

Self Service tests: 63

Provisioning tests: 38

Total no. of existing automated tests for advanced zone: 118

Test Report Analysis:

29 out of 102 smoke tests failed.

Unsupported commands:

create vpn users. [ com.cloud.agent.api.routing.VpnUsersCfgCommand ]
delete ISO- Delete template/ISO is eventually removing the entry from DB but errors out while trying to delete it from backend.
delete Template -Delete template/ISO is eventually removing the entry from DB but errors out while trying to delete it from backend.
AttachVolumeCmd
java.lang.NullPointerException
at com.cloud.hypervisor.dao.HypervisorCapabilitiesDaoImpl.getMaxDataVolumesLimit(HypervisorCapabilitiesDaoImpl.java:90)
extract template.
scale VM

Regression test report -Advanced Zone:

Here is the list of automated regression tests which needs to be reviewed. There is a column 'type' added with the following values

self service
provisioning
unsupported
test issue
Not Run -skipped test

skipped tests need to be run manually.
test issues need to be fixed an re run.

Sl. No.	test case	status	Error Description	Type	Comment
1	test_01_create_account	PASSED	None	self service
2	test_01_add_vm_to_subdomain	PASSED	None	self service
3	test_DeleteDomain	PASSED	None	self service
4	test_forceDeleteDomain	PASSED	None	self service
5	test_01_non_root_admin_Privileges	PASSED	None	self service
6	test_01_user_remove_VM_running	PASSED	None	self service
7	test_01_service_offering_hierarchy	PASSED	None	self service
8	test_01_service_offering_siblings	PASSED	None	self service
9	ContextSuite context=TestTemplateHierarchy>:setup	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}	provisioning	expand this test to all dependent tests
10	test_updateAdminDetails	PASSED	None	self service
11	test_updateDomainAdminDetails	PASSED	None	self service
12	test_updateUserDetails	PASSED	None	self service
13	test_LoginApiDomain	PASSED	None	self service
14	test_LoginApiUuidResponse	PASSED	None	self service
15	ContextSuite context=TestAddNetworkToVirtualMachine>:setup	SKIPPED	None	Not Run	add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor
16	ContextSuite context=TestFailureScenariosAddNetworkToVM>:setup	SKIPPED	None	Not Run	add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor
17	ContextSuite context=TestFailureScenariosRemoveNicFromVM>:setup	SKIPPED	None	Not Run	add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor
18	ContextSuite context=TestFailureScenariosUpdateVirtualMachineNIC>:setup	SKIPPED	None	Not Run	add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor
19	ContextSuite context=TestRemoveNetworkFromVirtualMachine>:setup	SKIPPED	None	Not Run	add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor
20	ContextSuite context=TestUpdateVirtualMachineNIC>:setup	SKIPPED	None	Not Run	add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor
21	test_01_deploy_vm_another_user	PASSED	None	self service
22	test_02_create_aff_grp_user	PASSED	None	self service
23	test_03_list_aff_grp_all_users	PASSED	None	self service
24	test_04_list_all_admin_aff_grp	PASSED	None	self service
25	test_05_list_all_users_aff_grp	PASSED	None	self service
26	test_06_list_all_users_aff_grp_by_id	PASSED	None	self service
27	test_07_delete_aff_grp_of_other_user	PASSED	None	self service
28	test_01_admin_create_aff_grp	PASSED	None	self service
29	test_02_doadmin_create_aff_grp	PASSED	None	self service
30	test_03_user_create_aff_grp	PASSED	None	self service
31	test_04_user_create_aff_grp_existing_name	PASSED	None	self service
32	test_05_create_aff_grp_same_name_diff_acc	PASSED	None	self service
33	test_06_create_aff_grp_nonexisting_type	PASSED	None	self service
34	test_01_delete_aff_grp_by_name	PASSED	None	self service
35	test_02_delete_aff_grp_for_acc	PASSED	None	self service
36	test_03_delete_aff_grp_with_vms	PASSED	None	self service
37	test_05_delete_aff_grp_id	PASSED	None	self service
38	test_06_delete_aff_grp_name	PASSED	None	self service
39	test_08_delete_aff_grp_by_id	PASSED	None	self service
40	test_09_delete_aff_grp_root_admin	PASSED	None	self service
41	test_01_deploy_vm_without_aff_grp	PASSED	None	self service
42	test_02_deploy_vm_by_aff_grp_name	PASSED	None	self service
43	test_03_deploy_vm_by_aff_grp_id	PASSED	None	self service
44	test_04_deploy_vm_anti_affinity_group	PASSED	None	self service
45	test_05_deploy_vm_by_id	PASSED	None	self service
46	test_06_deploy_vm_aff_grp_of_other_user_by_name	PASSED	None	self service
47	test_07_deploy_vm_aff_grp_of_other_user_by_id	PASSED	None	self service
48	test_08_deploy_vm_multiple_aff_grps	PASSED	None	self service
49	test_09_deploy_vm_multiple_aff_grps	PASSED	None	self service
50	test_10_deploy_vm_by_aff_grp_name_and_id	PASSED	None	self service
51	test_01_list_aff_grps_for_vm	PASSED	None	self service
52	test_02_list_multiple_aff_grps_for_vm	PASSED	None	self service
53	test_03_list_aff_grps_by_id	PASSED	None	self service
54	test_04_list_aff_grps_by_name	PASSED	None	self service
55	test_05_list_aff_grps_by_non_existing_id	PASSED	None	self service
56	test_06_list_aff_grps_by_non_existing_name	PASSED	None	self service
57	test_07_list_all_vms_in_aff_grp	PASSED	None	self service
58	test_01_update_aff_grp_by_ids	PASSED	None	self service
59	test_02_update_aff_grp_by_names	PASSED	None	self service
60	test_03_update_aff_grp_for_vm_with_no_aff_grp	PASSED	None	self service
61	test_04_update_aff_grp_remove_all	SKIPPED	None	Not Run
62	test_05_update_aff_grp_on_running_vm	PASSED	None	self service
63	test_01_zones	PASSED	None	self service
64	test_02_pods	PASSED	None	self service
65	test_03_clusters	PASSED	None	self service
66	test_04_hosts	PASSED	None	self service
67	test_05_storage_pools	PASSED	None	self service
68	test_06_secondary_storage	FAILED	Secondary storage should be in Up state	self service	We might need to fix simulator
69	test_01_move_across_different_domains	PASSED	None	self service
70	test_02_move_across_subdomains	PASSED	None	self service
71	test_03_move_from_domain_to_subdomain	PASSED	None	self service
72	test_04_move_from_domain_to_sub_of_subdomain	PASSED	None	self service
73	test_05_move_to_domain_from_sub_of_subdomain	PASSED	None	self service
74	test_06_move_to_domain_from_subdomain	PASSED	None	self service
75	test_07_move_across_subdomain	PASSED	None	self service
76	test_08_move_across_subdomain_network_create	PASSED	None	self service
77	test_09_move_across_subdomain	PASSED	None	self service
78	test_10_move_across_subdomain_vm_running	PASSED	None	self service
79	test_11_move_across_subdomain_vm_pfrule	PASSED	None	self service
80	test_12_move_across_subdomain_vm_volumes	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}	self service	attachVolume {Koushik}Fixed by Rajani
81	test_13_move_across_subdomain_vm_snapshot	PASSED	None	self service
82	test_14_move_across_subdomain_vm_project	PASSED	None	self service
83	test_15_move_across_subdomain_account_limit	PASSED	None	self service
84	test_16_move_across_subdomain_volume_and_account_limit	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}	self service	{Koushik}Fixed by Rajani
85	test_01_deploy_instance_with_is_volatile_offering	PASSED	None	self service
86	test_02_reboot_instance_with_is_volatile_offering	PASSED	None	self service
87	test_03_restore_vm_with_new_template	PASSED	None	self service
88	test_04_reoccuring_snapshot_rules	FAILED	Exception not raised	self service	Possible bug in CS.ReRun and validate
89	test_01_firewall_rules_port_fw	PASSED	None	self service	Add more tests to actually verify the rules on the router
90	test_01_restart_network_cleanup	PASSED	None	self service
91	test_01_list_routers_admin	PASSED	None	self service
92	test_01_create_template	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}	provisioning
93	test_01_check_template_size	FAILED	Template instance has no attribute 'size'	provisioning
94	test_02_check_size_snapshotTemplate	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'}	provisioning	Rerun
95	test_03_reuse_template_name	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'}	provisioning	Rerun
96	test_01_multiple_core_vm_start_stop_instance	PASSED	None	self service
97	test_02_multiple_core_vm_migrate_instance	FAILED	Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only	provisioning	{Koushik}This is again HV specific check in code and so fails for 'Simulator' HV type
98	test_03_multiple_core_vm_delete_instance	PASSED	None	self service
99	test_04_deploy_multiple_vm_with_multiple_core	FAILED	Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only	self service	{Koushik}There looks some typo here. The test name and reason failure doesn't match. Modify the test not to unnecessary migration
100	test_01_multiple_child_domains	PASSED	None	self service
101	test_01_multiplecore_start_stop_instance	PASSED	None	self service
102	test_02_multiplecore_migrate_instance	FAILED	Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only	provisioning	{Koushik}This is again HV specific check in code and so fails for 'Simulator' HV type
103	test_03_multiplecore_delete_instance	PASSED	None	self service
104	test_04_deploy_multiple_vm_with_multiple_cpus	PASSED	None	self service	lets rename this test which is same as #108
105	test_01_stop_start_instance	PASSED	None	self service
106	test_02_migrate_instance	FAILED	Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only	provisioning	{Koushik}This is again HV specific check in code and so fails for 'Simulator' HV type
107	test_03_delete_instance	PASSED	None	self service
108	test_04_deploy_multiple_vm_with_multiple_cpus	SKIPPED	None	provisioning	{Koushik}Atleast the test name suggest that this should be self service. marking it as provisioning test as it needs vm migration
109	test_01_deploy_vm_domain_limit_reached	PASSED	None	self service
110	test_02_deploy_vm_account_limit_reached	PASSED	None	self service
111	test_03_deploy_vm_project_limit_reached	PASSED	None	self service
112	test_04_deployVm__account_limit_reached	PASSED	None	self service
113	test_01_project_counts_start_stop_instance	PASSED	None	self service
114	test_02_project_counts_migrate_instance	FAILED	Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only	provisioning
115	test_03_project_counts_delete_instance	PASSED	None	self service
116	test_01_custom_hostname_instancename_false	PASSED	None	self service
117	test_01_user_provided_hostname	SKIPPED	None	self service	depends on vm.instancename.flag
118	test_02_instancename_from_default_configuration	SKIPPED	None	self service	{Koushik}Atleast the test name suggest that this should be self service.
119	test_03_duplicate_name	SKIPPED	None	self service	{Koushik}Atleast the test name suggest that this should be self service.
120	test_04_edit_display_name	PASSED	None	self service
121	test_05_unsupported_chars_in_display_name	PASSED	None	self service
122	test_deployvm_userdata_post	FAILED	No JSON object could be decoded	provisioning	we need to add some validation on router
123	test_01_1_egress_fr1	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
124	test_01_egress_fr1	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
125	test_02_1_egress_fr2	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
126	test_02_egress_fr2	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
127	test_03_1_egress_fr3	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
128	test_03_egress_fr3	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
129	test_04_1_egress_fr4	PASSED	None	self service
130	test_04_egress_fr4	PASSED	None	self service
131	test_05_1_egress_fr5	SKIPPED	None	Not Run	WIP -Test is incomplete
132	test_05_egress_fr5	SKIPPED	None	Not Run	WIP -Test is incomplete
133	test_06_1_egress_fr6	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
134	test_06_egress_fr6	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
135	test_07_1_egress_fr7	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
136	test_07_egress_fr7	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
137	test_08_1_egress_fr8	SKIPPED	None	Not Run	WIP -Test is incomplete
138	test_08_egress_fr8	SKIPPED	None	Not Run	WIP -Test is incomplete
139	test_09_1_egress_fr9	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
140	test_09_egress_fr9	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
141	test_10_1_egress_fr10	PASSED	None	self service
142	test_10_egress_fr10	PASSED	None	self service
143	test_11_1_egress_fr11	PASSED	None	self service
144	test_11_egress_fr11	PASSED	None	self service
145	test_12_1_egress_fr12	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
146	test_12_egress_fr12	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
147	test_13_1_egress_fr13	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
148	test_13_egress_fr13	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
149	test_01_deploy_vm_with_explicit_dedication	SKIPPED	None	self service	test can be modified to add a new host just before running this test- SIMULATOR only test if empty_host: self.skipTest("Did not find any empty hosts, Skipping")
150	test_01_create_sticky_policy_default_values	FAILED	Connection Failed: SSH failed for VM with IP Address: 192.168.2.23	provisioning
151	test_02_create_sticky_policy_custom_values	FAILED	Connection Failed: SSH failed for VM with IP Address: 192.168.2.23	provisioning
152	test_03_supported_policies_by_network	PASSED	None	self service
153	test_04_delete_lb_rule	FAILED	Connection Failed: SSH failed for VM with IP Address: 192.168.2.23	provisioning
154	test_05_error_alerts_after_create	FAILED	Connection Failed: SSH failed for VM with IP Address: 192.168.2.23	provisioning
155	test_06_release_ip	FAILED	Connection Failed: SSH failed for VM with IP Address: 192.168.2.24	provisioning
156	test_07_delete_account	FAILED	Connection Failed: SSH failed for VM with IP Address: 192.168.2.23	provisioning	{Koushik}Not sure why delete account require ssh connection?
157	test_08_create_policy_router_stopped	FAILED	Connection Failed: SSH failed for VM with IP Address: 192.168.2.23	provisioning
158	test_09_create_policy_router_destroy	FAILED	Connection Failed: SSH failed for VM with IP Address: 192.168.2.23	provisioning
159	test_10_create_policy_enable_disable_vpn	FAILED	Connection Failed: SSH failed for VM with IP Address: 192.168.2.23	provisioning
160	test_11_invalid_params	PASSED	None	self service
161	test_01_deploy_vm_with_implicit_planner	SKIPPED	None	self service	test can be modified to add a new host just before running this test- SIMULATOR only test if empty_host: self.skipTest("Did not find any empty hosts, Skipping")
162	test_network_not_implemented	PASSED	None	self service
163	test_reservation_after_router_restart	PASSED	None	self service
164	test_vm_create_after_reservation	PASSED	None	self service
165	test_vm_create_outside_cidr_after_reservation	PASSED	None	self service
166	test_01_addLdapConfiguration	FAILED	addLdapConfiguration failed	self service	have proper LDAP settings configured in the test env.
167	test_01_stop_start_instance	PASSED	None	self service
168	test_02_migrate_instance	FAILED	Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only	provisioning
169	test_03_delete_instance	PASSED	None	self service
170	test_04_deploy_multiple_vm	SKIPPED	None	self service
171	test_01_stop_start_instance	PASSED	None	self service
172	test_02_migrate_instance	FAILED	Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only	provisioning
173	test_03_delete_instance	PASSED	None	self service
174	test_04_deploy_multiple_vm	FIXED	None	self service
175	test_01_change_service_offering	PASSED	None	self service
176	test_02_migrate_vm	FAILED	Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only	provisioning
177	test_03_delete_vm	PASSED	None	self service
178	test_04_deploy_multiple_vm	FIXED	None	self service
179	test_01_multiple_child_domains	PASSED	None	self service
180	test_01_deploy_vm_domain_limit_reached	PASSED	None	self service
181	test_02_deploy_vm_account_limit_reached	PASSED	None	self service
182	test_03_deploy_vm_project_limit_reached	PASSED	None	self service
183	test_04_deployVm__account_limit_reached	PASSED	None	self service
184	test_01_project_vmlifecycle_start_stop_instance	PASSED	None	self service
185	test_02_project_vmlifecycle_migrate_instance	FAILED	Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only	provisioning
186	test_03_project_vmlifecycle_delete_instance	PASSED	None	self service
187	test_add_netscaler_device	FAILED	Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user	provisioning
188	ContextSuite context=TestDeleteNetscaler>:setup	FAILED	Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user	provisioning
189	ContextSuite context=TestGuestNetworkShutDown>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
190	ContextSuite context=TestGuestNetworkWithNetScaler>:setup	FAILED	Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user	provisioning
191	test_invalid_cred	FAILED	Network service providers list should not be empty	provisioning	netscaler
192	test_invalid_private_interface	FAILED	Network service providers list should not be empty	provisioning	netscaler
193	test_invalid_public_interface	FAILED	Network service providers list should not be empty	provisioning	netscaler
194	ContextSuite context=TestNetScalerCustomCapacity>:setup	FAILED	Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user	provisioning
195	ContextSuite context=TestNetScalerDedicated>:setup	FAILED	Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user	provisioning
196	ContextSuite context=TestNetScalerNoCapacity>:setup	FAILED	Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user	provisioning
197	ContextSuite context=TestNetScalerShared>:setup	FAILED	Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user	provisioning
198	ContextSuite context=TestServiceProvider>:setup	FAILED	Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user	provisioning	addNetscalerLoadBalancer
199	ContextSuite context=TestAddMultipleVmsLb>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
200	ContextSuite context=TestDeleteCreateLBRule>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
201	ContextSuite context=TestLbOnIpWithPf>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
202	ContextSuite context=TestLbOnNonSourceNat>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
203	ContextSuite context=TestLbSourceNat>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
204	ContextSuite context=TestLoadBalancingRule>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
205	ContextSuite context=TestMultipleLbRules>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
206	ContextSuite context=TestMultipleLbRulesSameIp>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
207	ContextSuite context=TestPfOnIpWithLb>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
208	ContextSuite context=TestVmWithLb>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
209	ContextSuite context=TestLbAlgoLcRr>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
210	ContextSuite context=TestLbAlgoLcSb>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
211	ContextSuite context=TestLbAlgoRrLc>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
212	ContextSuite context=TestLbAlgoRrSb>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
213	ContextSuite context=TestLbAlgoSbLc>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
214	ContextSuite context=TestLbAlgoSbRr>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
215	ContextSuite context=TestLbWithLeastConn>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
216	ContextSuite context=TestLbWithRoundRobin>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
217	ContextSuite context=TestLbWithSourceIp>:setup	FAILED	Warning: Exception during cleanup : type object 'TestLbWithSourceIp' has no attribute '_cleanup'	provisioning	{Koushik}Is this test not dependent on Netscaler? yes
218	ContextSuite context=TestLbStickyPolicy>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
219	test_add_mul_netscaler_diff_zone	FAILED	Atleast 2 advanced mode zones should be present for this test	provisioning
220	test_add_netscaler_device	FAILED	Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user	provisioning
221	ContextSuite context=TestNOWithNetscaler>:setup	FAILED	Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
222	ContextSuite context=TestNetScalerSharedMode>:setup	FAILED	Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user	provisioning
223	ContextSuite context=TestNwOffDToSUpgrade>:setup	FAILED	Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user	provisioning	addNetscalerLoadBalancer
224	ContextSuite context=TestNwOffDedicatedNetscaler>:setup	FAILED	Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user	provisioning
225	ContextSuite context=TestNwOffNetscaler>:setup	FAILED	Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user	provisioning
226	ContextSuite context=TestNwOffSToDUpgrade>:setup	FAILED	Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user	provisioning	addNetscalerLoadBalancer
227	test_01_network_off_without_conserve_mode	PASSED	None	self service
228	test_02_network_off_with_conserve_mode	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 460 on domR: r-794-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'}	self service	{Koushik}Fixed by Rajani
229	test_create_network_with_snat	PASSED	None	self service
230	test_01_nwupgrade_netscaler_conserve_on	FAILED	Execute cmd: createnetworkoffering failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
231	test_02_nwupgrade_netscaler_conserve_off	FAILED	Execute cmd: createnetworkoffering failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'	provisioning
232	ContextSuite context=TestNonContiguousVLANRanges>:setup	FAILED	Exception: Failed to find template of type BUILTIN with OSTypeID and which is in ready state: f6621e5e-9e1a-11e3-81d6-062a00000033	self service	re run
233	test_network_state_after_destroying_vms	PASSED	None	self service
234	test_shared_network_offering_with_persistent	PASSED	None	self service
235	test_upgrade_network_offering_to_persistent	PASSED	None	self service
236	test_associate_ip_address	FAILED	'NoneType' object has no attribute 'startip'	self service	cfg file doesn't have portable ip range rerun
237	test_associate_ip_address_invalid_zone	FAILED	'NoneType' object has no attribute 'startip'	self service	cfg file doesn't have portable ip range rerun
238	test_associate_ip_address_no_free_ip	FAILED	'NoneType' object has no attribute 'startip'	self service	cfg file doesn't have portable ip range rerun
239	test_associate_ip_address_services_enable_disable	SKIPPED	None	provisioning	need ssh access
240	test_create_portable_ip_range	FAILED	'NoneType' object has no attribute 'startip'	self service	cfg file doesn't have portable ip range rerun
241	test_create_portable_ip_range_invalid_region	FAILED	'NoneType' object has no attribute 'startip'	self service	cfg file doesn't have portable ip range
242	test_create_portable_ip_range_non_root_admin	FAILED	'NoneType' object has no attribute 'startip'	self service	cfg file doesn't have portable ip range
243	test_delete_account_services_disabled	FAILED	'NoneType' object has no attribute 'startip'	self service	cfg file doesn't have portable ip range
244	test_delete_account_services_enabled	FAILED	'NoneType' object has no attribute 'startip'	self service	cfg file doesn't have portable ip range
245	test_delete_portable_ip_range	FAILED	'NoneType' object has no attribute 'startip'	self service	cfg file doesn't have portable ip range
246	test_delete_portable_ip_range_in_use	FAILED	'NoneType' object has no attribute 'startip'	self service	cfg file doesn't have portable ip range
247	test_delete_portable_ip_range_non_root_admin	FAILED	'NoneType' object has no attribute 'startip'	self service	cfg file doesn't have portable ip range
248	test_disassociate_ip_address_no_services	FAILED	'NoneType' object has no attribute 'startip'	self service	cfg file doesn't have portable ip range
249	test_disassociate_ip_address_other_account	FAILED	'NoneType' object has no attribute 'startip'	self service	cfg file doesn't have portable ip range
250	test_disassociate_ip_address_services_enabled	FAILED	'NoneType' object has no attribute 'startip'	self service	cfg file doesn't have portable ip range
251	test_list_portable_ip_range	FAILED	'NoneType' object has no attribute 'startip'	self service	cfg file doesn't have portable ip range
252	test_list_portable_ip_range_non_root_admin	FAILED	'NoneType' object has no attribute 'startip'	self service	cfg file doesn't have portable ip range
253	test_list_portable_ip_range_non_root_admin	FAILED	'NoneType' object has no attribute 'startip'	self service	cfg file doesn't have portable ip range
254	ContextSuite context=TestProjectCreationNegative>:setup	SKIPPED	None	self service	depends on global config if not isinstance(configs, list): raise unittest.SkipTest("List configurations has no config: allow.user.create.projects")
255	test_add_user_to_project	PASSED	None	self service
256	ContextSuite context=TestProjectInviteRequiredTrue>:setup	SKIPPED	None	self service	depends on global config
257	ContextSuite context=TestProjectInviteTimeout>:setup	SKIPPED	None	self service	depends on global config
258	test_admin_project_creation	PASSED	None	self service
259	test_maxAccountNetworks	PASSED	None	self service
260	test_01_project_limits	PASSED	None	self service
261	test_02_project_limits_normal_user	PASSED	None	self service
262	test_03_vm_per_project	PASSED	None	self service
263	test_04_publicip_per_project	PASSED	None	self service
264	test_05_snapshots_per_project	PASSED	None	self service
265	test_06_volumes_per_project	PASSED	None	self service
266	test_07_templates_per_project	FAILED	Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}	self service	re run
267	ContextSuite context=TestResourceLimitsProject>:teardown	FAILED	Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u"Can't delete the domain yet because it has 1 accounts to cleanup"}	self service	re run
268	test_03_network_create	PASSED	None	self service
269	test_01_service_offerings	PASSED	None	self service
270	test_02_project_disk_offerings	PASSED	None	self service
271	test_07_associate_public_ip	PASSED	None	self service
272	test_06_create_snapshots_in_project	PASSED	None	self service
273	test_04_public_template_use_in_project	FAILED	Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}	self service	re run
274	test_05_use_private_template_in_project	FAILED	Execute cmd: deployvirtualmachine failed, due to: errorCode: 530, errorText:None	self service	{Koushik}Failure needs investigation re run
275	test_05_use_private_template_in_project	FAILED	Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}	self service	re run
276	ContextSuite context=TestTemplates>:teardown	FAILED	Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u"Can't delete the domain yet because it has 1 accounts to cleanup"}	self service	re run
277	test_01_ISO_usage	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete ISO'}	self service	re run
278	test_01_lb_usage	PASSED	None	self service
279	test_01_nat_usage	PASSED	None	self service
280	test_01_public_ip_usage	PASSED	None	self service
281	test_01_snapshot_usage	PASSED	None	self service
282	test_01_template_usage	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}	self service	re run
283	test_01_vm_usage	PASSED	None	self service
284	test_01_volume_usage	PASSED	None	self service
285	test_01_vpn_usage	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 582 on domR: r-959-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'}	self service	re run
286	test_02_cross_domain_account_add	PASSED	None	self service
287	test_03_delete_account_with_project	PASSED	None	self service
288	test_04_delete_domain_with_project	PASSED	None	self service
289	test_01_create_multiple_projects_by_account	PASSED	None	self service
290	test_05_user_project_owner_promotion	PASSED	None	self service
291	test_06_max_one_project_owner	PASSED	None	self service
292	test_07_project_resources_account_delete	PASSED	None	self service
293	test_08_cleanup_after_project_delete	PASSED	None	self service
294	test_09_project_suspend	PASSED	None	self service
295	test_10_project_activation	PASSED	None	self service
296	test_recurring_snapshot_data_disk	PASSED	None	self service
297	test_recurring_snapshot_root_disk	PASSED	None	self service
298	test_network_gc	PASSED	None	self service
299	test_restart_ntwk_no_cleanup	PASSED	None	self service
300	test_restart_ntwk_with_cleanup	PASSED	None	self service
301	test_enableVPNOverRvR	FAILED	Failed to create VPN for account: test-TestEnableVPNOverRvR-test_enableVPNOverRvR-X7XPFV - Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 479 on domR: r-813-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'}	self service	re run
302	test_downgradeRvR_to_VR	PASSED	None	self service
303	test_upgradeVR_to_redundantVR	PASSED	None	self service
304	test_createRegionWithExistingRegionId	PASSED	None	self service
305	test_createRegionWithExistingRegionName	PASSED	None	self service
306	test_updateRegion	PASSED	None	self service
307	test_createAccountWithUUID	PASSED	None	self service
308	test_createUserWithUUID	PASSED	None	self service
309	test_createdomainWithUUID	PASSED	None	self service
310	ContextSuite context=TestResetSSHKeyUserRights>:setup	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning	expand the dependent tests
311	ContextSuite context=TestResetSSHKeypair>:setup	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning	expand the dependent tests
312	test_maxAccountNetworks	PASSED	None	self service
313	test_01_vm_per_account	PASSED	None	self service
314	test_02_publicip_per_account	PASSED	None	self service
315	test_03_snapshots_per_account	PASSED	None	self service
316	test_04_volumes_per_account	PASSED	None	self service
317	test_05_templates_per_account	FAILED	Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}	self service	rerun
318	test_01_publicip_per_domain	PASSED	None	self service
319	test_01_vm_per_domain	PASSED	None	self service
320	test_03_snapshots_per_domain	PASSED	None	self service
321	test_04_volumes_per_domain	PASSED	None	self service
322	test_05_templates_per_domain	FAILED	Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}	self service
323	ContextSuite context=TestResourceLimitsDomain>:teardown	FAILED	Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u"Can't delete the domain yet because it has 1 accounts to cleanup"}	self service
324	test_01_AdvancedZoneRouterServices	PASSED	None	self service
325	test_02_NetworkGarbageCollection	PASSED	None	self service
326	test_03_RouterStartOnVmDeploy	PASSED	None	self service
327	test_01_RouterStopCreateFW	FAILED	'Please provide the marvin configuration file with credentials to your hosts'	provisioning
328	test_01_RouterStopCreateLB	FAILED	SSH Access failed for 10.1.1.219: SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
329	test_01_RouterStopCreatePF	FAILED	SSH Access failed for 192.168.2.9: SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
330	test_createSharedNetwork_All	PASSED	None	self service
331	test_createSharedNetwork_accountSpecific	PASSED	None	self service
332	test_createSharedNetwork_domainSpecific	PASSED	None	self service
333	test_createSharedNetwork_projectSpecific	PASSED	None	self service
334	test_createSharedNetwork_usedVlan	SKIPPED	None	NA	remove the test
335	test_createSharedNetwork_usedVlan2	PASSED	None	self service
336	test_deployVM_isolatedAndShared	FAILED	SSH Access failed for 10.1.1.96: SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
337	test_deployVM_multipleSharedNetwork	PASSED	None	self service	Enhancement: add more validation to check that IPs are in the correct networks.
338	test_networkWithsubdomainaccessFalse	PASSED	None	self service
339	test_networkWithsubdomainaccessTrue	PASSED	None	self service
340	test_sharedNetworkOffering_01	PASSED	None	self service
341	test_sharedNetworkOffering_02	PASSED	None	self service
342	test_sharedNetworkOffering_03	PASSED	None	self service
343	test_02_accountSnapshotClean	FAILED	'simulator'	provisioning	is_snapshot_on_nfs
344	test_04_snapshot_limit	FAILED	'simulator'	provisioning	is_snapshot_on_nfs
345	test_01_createVM_snapshotTemplate	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'}	provisioning
346	test_05_snapshot_events	PASSED	None	self service
347	test_01_volume_from_snapshot	FAILED	SSH failed for VM: 10.1.1.233	provisioning
348	test_02_snapshot_data_disk	FAILED	'simulator'	provisioning
349	test_03_snapshot_detachedDisk	FAILED	SSH failed for VM with IP: 192.168.2.14 - SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
350	test_04_delete_snapshot	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}	provisioning
351	test_07_template_from_snapshot	FAILED	SSH failed for VM with IP address: 10.1.1.233	provisioning
352	test_01_concurrent_snapshots_live_migrate	PASSED	None	self service
353	test_02_stop_vm_concurrent_snapshots	PASSED	None	self service
354	test_03_concurrent_snapshots_create_template	FAILED	Check if result exists in list item call	self service	rerun
355	test_04_concurrent_snapshots_create_volume	PASSED	None	self service
356	test_01_snapshot_on_rootVolume	FAILED	'simulator'	provisioning
357	test_01_deploy_ha_vm_startvm_false	PASSED	None	self service
358	test_02_deploy_ha_vm_from_iso	PASSED	None	self service
359	test_03_deploy_ha_vm_iso_startvm_false	PASSED	None	self service
360	test_deployVmOnGivenHost	PASSED	None	self service
361	test_01_deploy_vm_no_startvm	PASSED	None	self service
362	test_02_deploy_vm_startvm_true	PASSED	None	self service
363	test_03_deploy_vm_startvm_false	PASSED	None	self service
364	test_04_deploy_startvm_false_attach_volume	PASSED	None	self service
365	test_05_deploy_startvm_false_change_so	PASSED	None	self service
366	test_06_deploy_startvm_attach_detach	PASSED	None	self service
367	test_07_deploy_startvm_attach_iso	PASSED	None	self service
368	test_08_deploy_attached_volume	PASSED	None	self service
369	test_09_stop_vm_migrate_vol	PASSED	None	self service
370	test_deploy_vm_password_enabled	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}	provisioning	revisit the test, why template is downloaded
371	test_01_deploy_vm_no_startvm	PASSED	None	self service
372	test_upload_attach_volume	PASSED	None	self service
373	test_vm_per_account	PASSED	None	self service
374	test_01_migrate_vm_with_volume	FAILED	Execute cmd: findhostsformigration failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only	provisioning
375	test_02_migrate_volume	SKIPPED	None	self service	if not pools: self.skipTest("No suitable storage pools found for volume migration. Skipping")
376	test_01_lbrule_tag	PASSED	None	self service
377	test_02_natrule_tag	PASSED	None	self service
378	test_03_firewallrule_tag	PASSED	None	self service
379	test_04_vpn_tag	SKIPPED	None	self service	self.skipTest("VPN resource tags are unsupported in 4.0")
380	test_05_vm_tag	PASSED	None	self service
381	test_06_template_tag	FAILED	Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}	self service
382	test_07_iso_tag	PASSED	None	self service
383	test_08_volume_tag	PASSED	None	self service
384	test_09_snapshot_tag	PASSED	None	self service
385	test_10_network_tag	PASSED	None	self service
386	test_13_tag_case_insensitive	PASSED	None	self service
387	test_14_special_char_mutiple_tags	PASSED	None	self service
388	test_15_project_tag	PASSED	None	self service
389	test_16_query_tags_other_account	PASSED	None	self service
390	test_17_query_tags_admin_account	PASSED	None	self service
391	test_18_invalid_list_parameters	PASSED	None	self service
392	test_19_delete_add_same_tag	PASSED	None	self service
393	test_20_create_tags_multiple_resources	PASSED	None	self service
394	test_21_create_tag_stopped_vm	PASSED	None	self service
395	test_22_create_tag_destroyed_vm	PASSED	None	self service
396	test_01_create_template	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}	provisioning	test can be modified to qualify as a self service test.
397	test_01_create_template_volume	FAILED	Execute cmd: deployvirtualmachine failed, due to: errorCode: 530, errorText:None	self service	rerun
398	test_03_delete_template	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}	self service
399	test_04_template_from_snapshot	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'}	self service	rerun
400	test_update_vm_name	PASSED	None	self service
401	test_01_ISO_usage	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete ISO'}	self service
402	test_01_lb_usage	PASSED	None	self service
403	test_01_nat_usage	PASSED	None	self service
404	test_01_public_ip_usage	PASSED	None	self service
405	test_01_snapshot_usage	PASSED	None	self service
406	test_01_template_usage	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}	self service
407	test_01_vm_usage	PASSED	None	self service
408	test_01_volume_usage	PASSED	None	self service
409	test_01_vpn_usage	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 213 on domR: r-383-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'}	self service
410	ContextSuite context=TestVMPasswordEnabled>:setup	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
411	test_vmware_affinity	SKIPPED	None	provisioning	{Koushik}Since test name has vmware marked as provisioning for now. Check why a specific vmware affinity test is there depends on vmware drs
412	test_vmware_anti_affinity	SKIPPED	None	provisioning	{Koushik}Since test name has vmware marked as provisioning for now. Check why a specific vmware affinity test is there depends on vmware drs
413	test_vm_creation_in_fully_automated_mode	PASSED	None	provisioning	revisit.depends on vmware drs
414	ContextSuite context=TestAttachDetachVolume>:setup	FAILED	object of type 'NoneType' has no len()	provisioning	{Koushik}Needs further investigation no need to run on simulator since this test checks max data volumes supported by a hypervisor
415	ContextSuite context=TestAttachVolume>:setup	FAILED	object of type 'NoneType' has no len()	provisioning	{Koushik}Needs further investigation no need to run on simulator since this test checks max data volumes supported by a hypervisor
416	ContextSuite context=TestAttachVolumeISO>:setup	FAILED	object of type 'NoneType' has no len()	provisioning	{Koushik}Needs further investigation no need to run on simulator since this test checks max data volumes supported by a hypervisor
417	test_deployVmWithCustomDisk	PASSED	None	self service
418	test_01_attach_volume	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}	self service
419	test_02_detach_volume	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'The specified volume is not attached to a VM.'}	self service
420	test_03_delete_detached_volume	PASSED	None	self service
421	test_create_volume_under_domain	PASSED	None	self service
422	test_01_list_vpc_apis	PASSED	None	self service
423	test_02_restart_vpc_no_networks	PASSED	None	self service
424	test_03_restart_vpc_with_networks	PASSED	None	self service
425	test_04_delete_vpc_no_networks	PASSED	None	self service
426	test_05_delete_vpc_with_networks	PASSED	None	self service
427	test_06_list_vpc_apis_admin	PASSED	None	self service
428	test_07_restart_network_vm_running	FAILED	Failed to SSH into VM - 192.168.2.19, SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
429	test_08_delete_vpc	FAILED	Failed to SSH into VM - 192.168.2.19, SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
430	test_09_vpc_create	PASSED	None	self service
431	test_10_nonoverlaping_cidrs	PASSED	None	self service
432	test_11_deploy_vm_wo_network_netdomain	FAILED	Failed to SSH into VM - 192.168.2.23, SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
433	test_12_deploy_vm_with_netdomain	PASSED	None	self service
434	test_13_deploy_vm_with_vpc_netdomain	FAILED	Failed to SSH into VM - 192.168.2.23, SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
435	test_14_deploy_vm_1	PASSED	None	self service
436	test_15_deploy_vm_2	PASSED	None	self service
437	test_16_deploy_vm_for_user_by_admin	PASSED	None	self service
438	test_17_deploy_vm_for_user_by_domain_admin	PASSED	None	self service
439	test_18_create_net_for_user_diff_domain_by_doadmin	PASSED	None	self service
440	test_19_create_vpc_wo_params	PASSED	None	self service
441	test_20_update_vpc_name_display_text	PASSED	None	self service
442	test_01_create_network_network_offering	PASSED	None	self service
443	test_01_create_network_network_offering_vpcns	SKIPPED	None	provisioning	{Koushik}Test name says lot of things, need to understand what all is done requires netscaler
444	test_02_create_network_fail_network_offering	PASSED	None	self service
445	test_02_create_network_fail_network_offering_vpcns	SKIPPED	None	provisioning	{Koushik}Test name says lot of things, need to understand what all is done requires netscaler
446	test_04_create_multiple_networks_with_lb_network_offering	PASSED	None	self service
447	test_04_create_multiple_networks_with_lb_network_offering_vpcns	SKIPPED	None	provisioning	{Koushik}Test name says lot of things, need to understand what all is done requires netscaler
448	test_06_create_network_with_rvr	SKIPPED	None	NA	"skipped - RvR didn't support VPC currently "
449	test_07_create_network_unsupported_services	PASSED	None	self service
450	test_08_create_network_without_sourceNAT	PASSED	None	self service
451	test_09_create_network_shared_nwoff_network_off_shared	PASSED	None	self service
452	test_09_create_network_shared_nwoff_network_offering_vpcns	SKIPPED	None	provisioning	{Koushik}Test name says lot of things, need to understand what all is done requires netscaler
453	test_10_create_network_with_conserve_mode_network_offering	PASSED	None	self service
454	test_10_create_network_with_conserve_mode_network_offering_vpcns	PASSED	None	self service
455	test_01_wait_network_gc	PASSED	None	provisioning	Enhancement: add more validation
456	test_02_start_vm_network_gc	FAILED	Failed to SSH into VM - 192.168.2.12, SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
457	test_03_restart_vpcvr	FAILED	Failed to SSH into VM - 192.168.2.12, SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
458	test_01_create_network_outside_range_network_offering	PASSED	None	self service
459	test_01_create_network_outside_range_network_offering_vpcns	SKIPPED	None	provisioning	{Koushik}Test name says lot of things, need to understand what all is done requires netscaler
460	test_02_create_network_outside_range	PASSED	None	self service
461	test_03_create_network_inside_range_network_offering	PASSED	None	self service
462	test_03_create_network_inside_range_network_offering_vpcns	SKIPPED	None	provisioning	{Koushik}Test name says lot of things, need to understand what all is done requires netscaler
463	test_04_create_network_overlapping_range_network_offering	PASSED	None	self service
464	test_04_create_network_overlapping_range_network_offering_vpcns	SKIPPED	None	provisioning	requires netscaler
465	test_05_create_network_diff_account_network_offering	PASSED	None	self service
466	test_05_create_network_diff_account_network_offering_vpcns	SKIPPED	None	provisioning	requires netscaler
467	test_01_network_services_upgrade	FAILED	Failed to SSH into VM - 192.168.2.12, SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
468	test_02_network_vpcvr2vr_upgrade	PASSED	None	provisioning	add proper validation before and after upgrade
469	test_01_VPC_LBRulesListing	PASSED	None	self service
470	test_02_VPC_CreateLBRuleInMultipleNetworks	FAILED	Failed to wget from VM=QA-579a7424-09b9-41bd-8394-f72056b7e1d9 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out	provisioning
471	test_03_VPC_CreateLBRuleInMultipleNetworksVRStoppedState	FAILED	Failed to wget from VM=QA-91ac472a-996e-401d-88e2-9c305c780cb8 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out	provisioning
472	test_04_VPC_CreateLBRuleInMultipleNetworksVRStoppedState	FAILED	Failed to wget from VM=QA-87956b8f-9c6c-432c-96c7-e48759ccb85e http server on public_ip=192.168.2.29 because of [Errno socket error] timed out	provisioning
473	test_05_VPC_CreateAndDeleteLBRule	FAILED	Failed to wget from VM=QA-4de5c732-b31b-4f6a-b784-671d9091d277 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out	provisioning
474	test_06_VPC_CreateAndDeleteLBRuleVRStopppedState	FAILED	Failed to wget from VM=QA-6a0f9448-94d3-476d-8271-91bc3bf6b013 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out	provisioning
475	test_07_VPC_CreateAndDeleteAllLBRule	FAILED	Failed to wget from VM=QA-94f2bc5d-e061-448a-877e-bd0199faf4cf http server on public_ip=192.168.2.29 because of [Errno socket error] timed out	provisioning
476	test_08_VPC_CreateAndDeleteAllLBRuleVRStoppedState	FAILED	Failed to wget from VM=QA-3e51092f-b67d-4769-908f-a0c9c776683a http server on public_ip=192.168.2.29 because of [Errno socket error] timed out	provisioning
477	test_09_VPC_LBRuleCreateFailMultipleVPC	FAILED	Failed to wget from VM=QA-2ff04344-932c-4c77-a26b-d71ba6226732 http server on public_ip=192.168.2.30 because of [Errno socket error] timed out	provisioning
478	test_10_VPC_FailedToCreateLBRuleNonVPCNetwork	PASSED	None	self service
479	test_11_VPC_LBRuleCreateNotAllowed	FAILED	Failed to wget from VM=QA-23b260c3-862e-4f3d-8fba-519d9a7e55d6 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out	provisioning
480	test_12_VPC_LBRuleCreateFailForRouterIP	PASSED	None	self service
481	test_13_VPC_LBRuleCreateFailForPFSourceNATIP	FAILED	Failed to SSH into VM - 192.168.2.29	provisioning
482	test_14_VPC_LBRuleCreateFailForStaticNatRule	PASSED	None	self service
483	test_15_VPC_ReleaseIPForLBRuleCreated	PASSED	None	self service
484	test_01_network_services_VPC_StopCreatePF	FAILED	Failed to SSH into VM - 192.168.2.13	provisioning
485	test_02_network_services_VPC_CreatePF	FAILED	Failed to SSH into VM - 192.168.2.12	provisioning
486	test_03_network_services_VPC_StopCreateMultiplePF	FAILED	Failed to SSH into VM - 192.168.2.12	provisioning
487	test_04_network_services_VPC_CreateMultiplePF	FAILED	Failed to SSH into VM - 192.168.2.12	provisioning
488	test_05_network_services_VPC_StopDeletePF	FAILED	Failed to SSH into VM - 192.168.2.12	provisioning
489	test_06_network_services_VPC_DeletePF	FAILED	Failed to SSH into VM - 192.168.2.12	provisioning
490	test_07_network_services_VPC_StopDeleteAllPF	FAILED	Failed to SSH into VM - 192.168.2.12	provisioning
491	test_08_network_services_VPC_DeleteAllPF	FAILED	Failed to SSH into VM - 192.168.2.12	provisioning
492	test_09_network_services_VPC_StopDeleteAllMultiplePF	FAILED	Failed to SSH into VM - 192.168.2.12	provisioning
493	test_10_network_services_VPC_DeleteAllMultiplePF	FAILED	Failed to SSH into VM - 192.168.2.12	provisioning
494	test_01_VPC_StaticNatRuleCreateStoppedState	FAILED	Failed to SSH into VM - 192.168.2.8	provisioning
495	test_02_VPC_CreateStaticNatRule	FAILED	Failed to SSH into VM - 192.168.2.8	provisioning
496	test_03_VPC_StopCreateMultipleStaticNatRuleStopppedState	FAILED	Failed to SSH into VM - 192.168.2.8	provisioning
497	test_04_VPC_CreateMultipleStaticNatRule	FAILED	Failed to SSH into VM - 192.168.2.8	provisioning
498	test_05_network_services_VPC_DeleteAllPF	FAILED	Failed to SSH into VM - 192.168.2.8	provisioning
499	test_06_network_services_VPC_DeleteAllMultiplePF	FAILED	Failed to SSH into VM - 192.168.2.8	provisioning
500	test_01_create_vpc_offering	PASSED	None	self service
501	test_02_deploy_vms_in_vpc_nw	FAILED	Failed to SSH into VM - 192.168.2.19, SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
502	test_03_vpc_off_without_lb	PASSED	None	self service
503	test_04_vpc_off_without_static_nat	PASSED	None	self service
504	test_05_vpc_off_without_pf	PASSED	None	self service
505	test_06_vpc_off_invalid_services	PASSED	None	self service
506	test_07_update_vpc_off	PASSED	None	self service
507	test_08_list_vpc_off	PASSED	None	self service
508	test_01_start_stop_router_after_addition_of_one_guest_network	PASSED	None	provisioining	Ehnancement: add more validation written in the steps
509	test_02_reboot_router_after_addition_of_one_guest_network	PASSED	None	self service
510	test_03_migrate_router_after_addition_of_one_guest_network	FAILED	Migration to host b5205777-8029-480e-9941-b7f8f89f48ba failed. The router host isstill 09c38e9a-7a22-4591-be39-f1a2bcd138a5	provisioning
511	test_04_chg_srv_off_router_after_addition_of_one_guest_network	PASSED	None	self service
512	test_05_destroy_router_after_addition_of_one_guest_network	PASSED	None	self service
513	test_01_stop_start_router_after_creating_vpc	PASSED	None	self service
514	test_02_reboot_router_after_creating_vpc	PASSED	None	self service
515	test_03_migrate_router_after_creating_vpc	FAILED	Migration to host b5205777-8029-480e-9941-b7f8f89f48ba failed. The router host is still 09c38e9a-7a22-4591-be39-f1a2bcd138a5	provisioning
516	test_04_change_service_offerring_vpc	PASSED	None	self service
517	test_05_destroy_router_after_creating_vpc	PASSED	None	self service
518	test_01_deploy_vms_in_network	PASSED	None	self service
519	test_02_deploy_vms_delete_network	PASSED	None	self service
520	test_03_deploy_vms_delete_add_network	PASSED	None	self service
521	test_04_deploy_vms_delete_add_network_noLb	PASSED	None	self service
522	test_05_create_network_max_limit	PASSED	None	self service
523	test_06_delete_network_vm_running	PASSED	None	self service
524	test_07_delete_network_with_rules	FAILED	List public Ips 192.168.2.9 for network should list the Ip addr 192.168.2.11	self service	rerun and revisit
525	test_01_VPN_user_limit	FAILED	Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 583 on domR: r-961-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'}	self service
526	test_02_use_vpn_port	PASSED	None	self service
527	test_03_enable_vpn_use_port	FAILED	Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 585 on domR: r-965-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'}	self service
528	test_04_add_new_users	FAILED	Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 586 on domR: r-967-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'}	self service
529	test_05_add_duplicate_user	FAILED	Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 587 on domR: r-969-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'}	self service
530	test_06_add_VPN_user_global_admin	FAILED	Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 588 on domR: r-971-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'}	self service
531	test_07_add_VPN_user_domain_admin	FAILED	Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 589 on domR: r-973-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand. Are you sure you got the right type of server?'}	self service

Self Service tests: TBA

Provisioning tests: TBA

Total no. of existing automated tests for advanced zone: TBA

BVT Report -Basic Zone

Sl. No.	test case	status	Error Description	Type	Comments
1	test_DeployVmAntiAffinityGroup	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User\|QA-ed6c84c2-3602-461b-bfc0-77031d0b7b33], Please check the affinity groups provided, there may not be sufficient capacity to follow them'}	self service
2	test_deploy_vm	PASSED	None	self service
3	test_deployvm_userdata	PASSED	None	self service
4	test_deployvm_userdata_post	PASSED	None	self service
5	test_deployvm_firstfit	PASSED	None	self service
6	test_deployvm_userconcentrated	PASSED	None	self service
7	test_deployvm_userdispersing	PASSED	None	self service
8	test_01_create_disk_offering	PASSED	None	self service
9	test_02_edit_disk_offering	PASSED	None	self service
10	test_03_delete_disk_offering	PASSED	None	self service
11	test_UpdateConfigParamWithScope	PASSED	None	self service
12	test_01_create_iso	PASSED	None	self service
13	test_02_edit_iso	PASSED	None	self service
14	test_03_delete_iso	PASSED	None	self service
15	test_04_extract_Iso	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract iso'}	provisioning
16	test_05_iso_permissions	PASSED	None	self service
17	test_06_copy_iso	SKIPPED	None	provisioning
18	test_nic_secondaryip_add_remove	PASSED	None	self service
19	test_01_nic	FAILED	Exception during NIC test!: 'TestNic' object has no attribute 'account'	test/config issue	change test tag to run only in advanced zone
20	test_createPortablePublicIPRange	PASSED	None	self service
21	test_01_primary_storage_iscsi	FAILED	Check storage pool type	self service	test fix
22	test_01_primary_storage_nfs	PASSED	None	self service
23	test_createRegion	PASSED	None	self service
24	test_01_reset_vm_on_reboot	PASSED	None	self service
25	test_01_router_internal_basic	SKIPPED	None	provisioning
26	test_01_scale_vm	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'This operation not permitted for this hypervisor of the vm'}	provisioning
27	test_01_sys_vm_start	PASSED	None	self service
28	test_02_sys_template_ready	PASSED	None	self service
29	test_01_create_service_offering	PASSED	None	self service
30	test_02_edit_service_offering	PASSED	None	self service
31	test_03_delete_service_offering	PASSED	None	self service
32	test_01_list_sec_storage_vm	PASSED	None	self service
33	test_02_list_cpvm_vm	PASSED	None	self service
34	test_03_ssvm_internals	SKIPPED	None	provisioning
35	test_04_cpvm_internals	SKIPPED	None	provisioning
36	test_05_stop_ssvm	SKIPPED	None	provisioning
37	test_06_stop_cpvm	SKIPPED	None	provisioning
38	test_07_reboot_ssvm	SKIPPED	None	provisioning
39	test_08_reboot_cpvm	SKIPPED	None	provisioning
40	test_09_destroy_ssvm	SKIPPED	None	provisioning
41	test_10_destroy_cpvm	SKIPPED	None	provisioning
42	test_02_edit_template	PASSED	None	self service
43	test_03_delete_template	PASSED	None	self service
44	test_04_extract_template	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}	provisioning
45	test_05_template_permissions	PASSED	None	self service
46	test_06_copy_template	SKIPPED	None	provisioning
47	test_07_list_public_templates	PASSED	None	self service
48	test_08_list_system_templates	PASSED	None	self service
49	test_deploy_vm	PASSED	None	self service
50	test_01_stop_vm	PASSED	None	self service
51	test_02_start_vm	PASSED	None	self service
52	test_03_reboot_vm	PASSED	None	self service
53	test_06_destroy_vm	PASSED	None	self service
54	test_07_restore_vm	PASSED	None	self service
55	test_08_migrate_vm	SKIPPED	None	provisioning
56	test_09_expunge_vm	PASSED	None	self service
57	test_10_attachAndDetach_iso	FAILED	SSH failed for virtual machine: 60.147.41.9 - SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
58	test_01_create_volume	FAILED	SSH access failed for VM 60.147.41.6 - SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
59	test_02_attach_volume	FAILED	SSH failed for VM: 60.147.41.6 - SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
60	test_03_download_attached_volume	PASSED	None	self service
61	test_04_delete_attached_volume	PASSED	None	self service
62	test_05_detach_volume	PASSED	None	self service
63	test_06_download_detached_volume	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract volume'}	provisioning
64	test_07_resize_fail	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Cloudstack currently only supports volumes marked as KVM or XenServer hypervisor for resize'}	provisioning
65	test_08_resize_volume	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Cloudstack currently only supports volumes marked as KVM or XenServer hypervisor for resize'}	provisioning
66	test_09_delete_detached_volume	PASSED	None	self service

	Total time(in min)	56.39521667

Regression Test Report - Basic Zone:

Sl. No.	test case	status	Error Description	Type	Comments
1	test_01_create_account	PASSED	None	self service
2	test_01_add_vm_to_subdomain	PASSED	None	self service
3	test_01_non_root_admin_Privileges	PASSED	None	self service
4	test_01_user_remove_VM_running	PASSED	None	self service
5	test_01_service_offering_hierarchy	PASSED	None	self service
6	test_01_service_offering_siblings	PASSED	None	self service
7	ContextSuite context=TestTemplateHierarchy>:setup	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}	provisioning
8	test_updateAdminDetails	PASSED	None	self service
9	test_updateDomainAdminDetails	PASSED	None	self service
10	test_updateUserDetails	PASSED	None	self service
11	test_LoginApiDomain	PASSED	None	self service
12	test_LoginApiUuidResponse	PASSED	None	self service
13	ContextSuite context=TestFailureScenariosAddNetworkToVM>:setup	SKIPPED	None	Not Run
14	test_01_deploy_vm_another_user	PASSED	None	self service
15	test_02_create_aff_grp_user	PASSED	None	self service
16	test_03_list_aff_grp_all_users	PASSED	None	self service
17	test_04_list_all_admin_aff_grp	PASSED	None	self service
18	test_05_list_all_users_aff_grp	PASSED	None	self service
19	test_06_list_all_users_aff_grp_by_id	PASSED	None	self service
20	test_07_delete_aff_grp_of_other_user	PASSED	None	self service
21	test_01_admin_create_aff_grp	PASSED	None	self service
22	test_02_doadmin_create_aff_grp	PASSED	None	self service
23	test_03_user_create_aff_grp	PASSED	None	self service
24	test_04_user_create_aff_grp_existing_name	PASSED	None	self service
25	test_05_create_aff_grp_same_name_diff_acc	PASSED	None	self service
26	test_06_create_aff_grp_nonexisting_type	PASSED	None	self service
27	test_01_delete_aff_grp_by_name	PASSED	None	self service
28	test_02_delete_aff_grp_for_acc	PASSED	None	self service
29	test_03_delete_aff_grp_with_vms	PASSED	None	self service
30	test_05_delete_aff_grp_id	PASSED	None	self service
31	test_06_delete_aff_grp_name	PASSED	None	self service
32	test_08_delete_aff_grp_by_id	PASSED	None	self service
33	test_09_delete_aff_grp_root_admin	PASSED	None	self service
34	test_01_deploy_vm_without_aff_grp	PASSED	None	self service
35	test_02_deploy_vm_by_aff_grp_name	PASSED	None	self service
36	test_03_deploy_vm_by_aff_grp_id	PASSED	None	self service
37	test_04_deploy_vm_anti_affinity_group	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User\|QA-8ad687c5-2af6-4b80-adc1-3ddc3c33d4c2], Please check the affinity groups provided, there may not be sufficient capacity to follow them'}	self service	add enough hosts
38	test_05_deploy_vm_by_id	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User\|QA-e57ae7c4-7db9-4e3f-aeb7-4bfaf78983dd], Please check the affinity groups provided, there may not be sufficient capacity to follow them'}	self service	add enough hosts
39	test_06_deploy_vm_aff_grp_of_other_user_by_name	PASSED	None	self service
40	test_07_deploy_vm_aff_grp_of_other_user_by_id	PASSED	None	self service
41	test_08_deploy_vm_multiple_aff_grps	PASSED	None	self service
42	test_09_deploy_vm_multiple_aff_grps	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User\|QA-85503541-e176-4a9e-80a3-d25e7db164e4], Please check the affinity groups provided, there may not be sufficient capacity to follow them'}	self service	add enough hosts
43	test_10_deploy_vm_by_aff_grp_name_and_id	PASSED	None	self service
44	test_01_list_aff_grps_for_vm	PASSED	None	self service
45	test_02_list_multiple_aff_grps_for_vm	PASSED	None	self service
46	test_03_list_aff_grps_by_id	PASSED	None	self service
47	test_04_list_aff_grps_by_name	PASSED	None	self service
48	test_05_list_aff_grps_by_non_existing_id	PASSED	None	self service
49	test_06_list_aff_grps_by_non_existing_name	PASSED	None	self service
50	test_07_list_all_vms_in_aff_grp	PASSED	None	self service
51	test_01_update_aff_grp_by_ids	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User\|QA-9f918f00-26ca-4677-b051-44e2baec4d7c], Please check the affinity groups provided, there may not be sufficient capacity to follow them'}	self service	add enough hosts
52	test_02_update_aff_grp_by_names	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User\|QA-ee4de048-870f-44fa-892d-c958cbb3e427], Please check the affinity groups provided, there may not be sufficient capacity to follow them'}	self service	add enough hosts
53	test_03_update_aff_grp_for_vm_with_no_aff_grp	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Unable to start a VM due to insufficient capacity'}	self service	add enough hosts
54	test_04_update_aff_grp_remove_all	SKIPPED	None	Not Run
55	test_05_update_aff_grp_on_running_vm	PASSED	None	self service
56	test_baremetal	FAILED	Execute cmd: createnetwork failed, due to: errorCode: 431, errorText:Can't have more than one Guest network in zone with network type Basic	test/config issue	revisit this and fix tags if required
57	test_01_deploy_instance_with_is_volatile_offering	PASSED	None	self service
58	test_02_reboot_instance_with_is_volatile_offering	PASSED	None	self service
59	test_03_restore_vm_with_new_template	PASSED	None	self service
60	test_04_reoccuring_snapshot_rules	FAILED	Exception not raised	self service	looks like a product bug, reverify
61	test_01_create_template	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}	provisioning
62	test_01_check_template_size	FAILED	Template instance has no attribute 'size'	provisioning
63	test_02_check_size_snapshotTemplate	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'}	provisioning
64	test_03_reuse_template_name	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'}	provisioning
65	test_01_custom_hostname_instancename_false	PASSED	None	self service
66	test_01_user_provided_hostname	SKIPPED	None	Not Run
67	test_02_instancename_from_default_configuration	SKIPPED	None	Not Run
68	test_03_duplicate_name	SKIPPED	None	Not Run
69	test_04_edit_display_name	PASSED	None	self service
70	test_05_unsupported_chars_in_display_name	PASSED	None	self service
71	test_deployvm_userdata_post	FAILED	No JSON object could be decoded	provisioning
72	test_authorizeIngressRule	FAILED	SSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
73	test_01_default_group_with_egress	FAILED	SSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
74	test_01_default_group_with_egress	FAILED	SSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
75	test_deployVM_InDefaultSecurityGroup	PASSED	None	self service
76	test_invalid_account_authroize	PASSED	None	self service
77	test_invalid_parameters	PASSED	None	self service
78	test_multiple_account_egress_rule_positive	FAILED	SSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
79	test_multiple_account_egress_rule_negative	FAILED	SSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
80	test_revoke_egress_rule	FAILED	SSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
81	test_start_stop_vm_egress	FAILED	SSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
82	test_01_deploy_vm_with_explicit_dedication	SKIPPED	None	Not Run
83	test_01_deploy_vm_with_implicit_planner	SKIPPED	None	Not Run
84	test_01_addLdapConfiguration	FAILED	addLdapConfiguration failed	self service	fix test data
85	test_01_add_ip_same_cidr	PASSED	None	self service
86	test_02_add_ip_diff_cidr	PASSED	None	self service
87	test_03_del_ip_range	PASSED	None	self service
88	test_04_add_noncontiguous_ip_range	PASSED	None	self service
89	test_05_add_overlapped_ip_range	PASSED	None	self service
90	test_06_add_ip_range_overlapped_with_two_ranges	PASSED	None	self service
91	test_07_add_iprange_superset	PASSED	None	self service
92	test_08_add_iprange_subset	PASSED	None	self service
93	ContextSuite context=TestProjectCreationNegative>:setup	SKIPPED	None	Not Run
94	test_add_user_to_project	PASSED	None	self service
95	ContextSuite context=TestProjectInviteRequiredTrue>:setup	SKIPPED	None	Not Run
96	ContextSuite context=TestProjectInviteTimeout>:setup	SKIPPED	None	Not Run
97	test_admin_project_creation	PASSED	None	self service
98	test_01_project_limits	PASSED	None	self service
99	test_02_project_limits_normal_user	PASSED	None	self service
100	test_03_vm_per_project	PASSED	None	self service
101	test_05_snapshots_per_project	PASSED	None	self service
102	test_06_volumes_per_project	PASSED	None	self service
103	test_07_templates_per_project	PASSED	None	self service
104	test_01_service_offerings	PASSED	None	self service
105	test_02_project_disk_offerings	PASSED	None	self service
106	test_08_security_group	PASSED	None	self service
107	test_06_create_snapshots_in_project	PASSED	None	self service
108	test_04_public_template_use_in_project	PASSED	None	self service
109	test_05_use_private_template_in_project	FAILED	Execute cmd: deployvirtualmachine failed, due to: errorCode: 530, errorText:None	self service	re run
110	test_01_ISO_usage	PASSED	None	self service
111	test_01_snapshot_usage	PASSED	None	self service
112	test_01_template_usage	PASSED	None	self service
113	test_01_vm_usage	PASSED	None	self service
114	test_01_volume_usage	PASSED	None	self service
115	test_02_cross_domain_account_add	PASSED	None	self service
116	test_03_delete_account_with_project	PASSED	None	self service
117	test_04_delete_domain_with_project	PASSED	None	self service
118	test_01_create_multiple_projects_by_account	PASSED	None	self service
119	test_05_user_project_owner_promotion	PASSED	None	self service
120	test_06_max_one_project_owner	PASSED	None	self service
121	test_07_project_resources_account_delete	PASSED	None	self service
122	test_08_cleanup_after_project_delete	PASSED	None	self service
123	test_09_project_suspend	PASSED	None	self service
124	test_10_project_activation	PASSED	None	self service
125	test_createRegionWithExistingRegionId	PASSED	None	self service
126	test_createRegionWithExistingRegionName	PASSED	None	self service
127	test_updateRegion	PASSED	None	self service
128	test_createAccountWithUUID	PASSED	None	self service
129	test_createUserWithUUID	PASSED	None	self service
130	test_createdomainWithUUID	PASSED	None	self service
131	ContextSuite context=TestResetSSHKeyUserRights>:setup	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
132	ContextSuite context=TestResetSSHKeypair>:setup	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
133	test_01_authorizeIngressRule	FAILED	SSH Access failed for 60.147.41.7: SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
134	test_01_deployVM_InDefaultSecurityGroup	PASSED	None	self service
135	test_02_listSecurityGroups	PASSED	None	self service
136	test_03_accessInDefaultSecurityGroup	PASSED	None	self service
137	test_01_delete_security_grp_running_vm	PASSED	None	self service
138	test_02_delete_security_grp_withoout_running_vm	PASSED	None	self service
139	test_01_dhcpOnlyRouter	FAILED	Connection Failed	provisioning
140	test_01_authorizeIngressRule_AfterDeployVM	FAILED	SSH access failed for ingress rule ID: bb72e3c0-5b09-4138-9a49-5f839d229543, SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
141	test_02_revokeIngressRule_AfterDeployVM	FAILED	SSH access failed for ingress rule ID: c8737ff2-1a4e-42fe-b89c-b99e730fd459, SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
142	test_03_stopStartVM_verifyIngressAccess	FAILED	SSH access failed for ingress rule ID: 61bdad47-8f6a-47ac-8940-9db4764f2b2f	provisioning
143	test_01_revokeIngressRule	FAILED	SSH Access failed for 60.147.41.7: SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
144	test_01_deployVMWithUserData	FAILED	SSH Access failed for 60.147.41.7: SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
145	test_02_accountSnapshotClean	FAILED	'simulator'	provisioning	cheking is_snapshot_on_nfs
146	test_01_volume_from_snapshot	FAILED	SSH failed for VM: 60.147.41.11	provisioning
147	test_03_snapshot_detachedDisk	FAILED	SSH failed for VM with IP: 60.147.41.11 - SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
148	test_01_snapshot_on_rootVolume	FAILED	'simulator'	provisioning	cheking is_snapshot_on_nfs
149	test_01_deploy_ha_vm_startvm_false	PASSED	None	self service
150	test_02_deploy_ha_vm_from_iso	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User\|QA-707178ea-d8f8-4401-88a2-e232a4f3f58f]'}	self service	re run
151	test_03_deploy_ha_vm_iso_startvm_false	PASSED	None	self service
152	test_deployVmOnGivenHost	PASSED	None	self service
153	test_01_deploy_vm_no_startvm	PASSED	None	self service
154	test_02_deploy_vm_startvm_true	PASSED	None	self service
155	test_03_deploy_vm_startvm_false	PASSED	None	self service
156	test_04_deploy_startvm_false_attach_volume	PASSED	None	self service
157	test_05_deploy_startvm_false_change_so	PASSED	None	self service
158	test_06_deploy_startvm_attach_detach	PASSED	None	self service
159	test_07_deploy_startvm_attach_iso	PASSED	None	self service
160	test_08_deploy_attached_volume	PASSED	None	self service
161	test_09_stop_vm_migrate_vol	SKIPPED	None	Not Run
162	test_deploy_vm_password_enabled	FAILED	Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}	provisioning
163	test_upload_attach_volume	PASSED	None	self service
164	test_vm_per_account	PASSED	None	self service
165	test_01_migrate_vm_with_volume	FAILED	Execute cmd: findhostsformigration failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only	provisioning
166	test_02_migrate_volume	SKIPPED	None	Not Run
167	test_05_vm_tag	PASSED	None	self service
168	test_06_template_tag	PASSED	None	self service
169	test_07_iso_tag	PASSED	None	self service
170	test_08_volume_tag	PASSED	None	self service
171	test_09_snapshot_tag	PASSED	None	self service
172	test_11_migrate_tagged_vm_del	FAILED	list index out of range	self service	fix test to check null list
173	test_13_tag_case_insensitive	PASSED	None	self service
174	test_14_special_char_mutiple_tags	PASSED	None	self service
175	test_16_query_tags_other_account	PASSED	None	self service
176	test_17_query_tags_admin_account	PASSED	None	self service
177	test_18_invalid_list_parameters	PASSED	None	self service
178	test_19_delete_add_same_tag	PASSED	None	self service
179	test_20_create_tags_multiple_resources	PASSED	None	self service
180	test_21_create_tag_stopped_vm	PASSED	None	self service
181	test_22_create_tag_destroyed_vm	PASSED	None	self service
182	test_update_vm_name	PASSED	None	self service
183	test_01_ISO_usage	PASSED	None	self service
184	test_01_snapshot_usage	PASSED	None	self service
185	test_01_template_usage	PASSED	None	self service
186	test_01_vm_usage	PASSED	None	self service
187	test_01_volume_usage	PASSED	None	self service
188	ContextSuite context=TestVMPasswordEnabled>:setup	FAILED	SSH connection has Failed. Waited 600s. Error is Connection Failed	provisioning
189	test_deployVmWithCustomDisk	PASSED	None	self service
190	test_create_volume_under_domain	PASSED	None	self service

	Total Time(in hours)	6.096176667

Space shortcuts

Child pages

BVT Report - advanced zone:

Test Report Analysis:

Regression test report -Advanced Zone:

BVT Report -Basic Zone

Regression Test Report - Basic Zone:

Space shortcuts

Child pages

Test Automation report on Simulator

BVT Report - advanced zone:

Test Report Analysis:

Regression test report -Advanced Zone:

BVT Report -Basic Zone

Regression Test Report - Basic Zone: