This Confluence has been LDAP enabled, if you are an ASF Committer, please use your LDAP Credentials to login. Any problems file an INFRA jira ticket please.

Child pages
  • Test Automation report on Simulator
Skip to end of metadata
Go to start of metadata

This is an exercise to extract unsupported tests  on simulator from the existing smoke and regression integration test suites.

Here is the list of automated smoke/BVT/sanity tests which needs to be reviewed. There is a column 'type' added with the following values

  1. self service
  2. provisioning
  3. unsupported
  4. test issue
  5. Not Run -skipped test
  • skipped tests need to be run manually.
  • test issues need to be fixed an re run.

BVT Report - advanced zone:

 

Sl. No.test casestatusError DescriptionTypeComment
1test_DeployVmAntiAffinityGroupPASSEDNoneself service

                                                                                                                                                                                                                                                             

2test_deploy_vmPASSEDNoneself service 
3test_deployvm_userdataPASSEDNoneprovisioning

[ Koushik ] This looks same as #2 unless user data is verified. For verification you need actual setup. So this should belong to provisioning.

Talluri/Koushik Fix the test to verify userdata

4test_deployvm_userdata_postPASSEDNoneprovisioning

[ Koushik ] This looks same as #2 unless user data is verified. For verification you need actual setup. So this should belong to provisioning.

Talluri/Koushik Fix the test to verify userdata

5test_deployvm_firstfitPASSEDNoneself service 
6test_deployvm_userconcentratedPASSEDNoneself service 
7test_deployvm_userdispersingPASSEDNoneself service 
8test_01_create_disk_offeringPASSEDNoneself service 
9test_02_edit_disk_offeringPASSEDNoneself service 
10test_03_delete_disk_offeringPASSEDNoneself service 
11test_UpdateConfigParamWithScopePASSEDNoneself service 
12test_dedicateGuestVlanRangePASSEDNoneself service 
13test_internallbPASSEDNoneprovisioningEnhancement: modify this test to verify lb rules by sending request from another tier
14test_01_create_isoPASSEDNoneself serviceEnhancement: check the existence of registered of ISO in secondary deploy a VM with registered ISO. can be added as another test (provisioning)
15test_02_edit_isoPASSEDNoneself service 
16test_03_delete_isoFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete ISO'}self serviceRajani: this can be fixed by implementing deleteAsync in SimulatorImageStoreDriverImpl.java (Fixed this locally. will push after more testing)
17test_04_extract_IsoFAILEDExtract ISO Failed with invalid URL http://192.168.2.3/userdata/9a95de36-9645-40c1-b473-f6665bb9a4f0.iso (ISO id: 297135cd-020a-47cb-ae0d-efb970876eee)provisioningThis test can be modified for simulator not to download using URL
18test_05_iso_permissionsPASSEDNoneself service 
19test_06_copy_isoSKIPPEDNoneprovisioningdestination zone needs to extract the template URL
20test_01_create_lb_rule_src_natFAILEDConnection Failed: SSH failed for VM with IP Address: 192.168.2.8provisioning

 avoid ssh connection

21test_02_create_lb_rule_non_natFAILEDConnection Failed: SSH failed for VM with IP Address: 192.168.2.8: SSH failed for VM with IP Address: 192.168.2.8provisioning avoid ssh connection
22test_assign_and_removal_lbFAILEDConnection Failed: SSH failed for VM with IP Address: 192.168.2.8provisioning avoid ssh connection
23test_nic_secondaryip_add_removePASSEDNoneprovisioningEnhancement: add verification
24test_delete_accountPASSEDNoneself service 
25test_01_port_fwd_on_src_natFAILEDSSH Access failed for 10.1.1.56: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning avoid ssh connection
26test_02_port_fwd_on_non_src_natFAILEDSSH Access failed for 10.1.1.56: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning avoid ssh connection
27test_public_ip_admin_accountPASSEDNoneself service 
28test_public_ip_user_accountPASSEDNoneself service 
29test_reboot_routerFAILEDSSH Access failed for 192.168.2.5: Connection Failedprovisioning avoid ssh connection
30test_releaseIPPASSEDNoneself service 
31test_network_aclPASSEDNoneprovisioning

[ Koushik ] Is it just testing creation of acl on the db? For verifying if the acl is working you need actual setup. In that case this will be provisioning.

Enhancement: add actual verification Logic for rules.

32test_01_nicPASSEDNoneprovisioningEnhancement: add validation
33test_extendPhysicalNetworkVlanPASSEDNoneself service 
34test_createPortablePublicIPAcquirePASSEDNoneself service 
35test_createPortablePublicIPRangePASSEDNoneself service 
36test_01_primary_storage_iscsiPASSED

None

self servicein actual VM deployment scenarios storage will be tested.
37test_01_primary_storage_nfsPASSEDNoneself servicein actual VM deployment scenarios storage will be tested.
38test_privategw_aclPASSEDNoneself serviceEnhancement: add a new test to verification of ACL rules
39test_dedicatePublicIpRangePASSEDNoneself service 
40test_create_pvlan_networkPASSEDNoneself service 
41test_createRegionPASSEDNoneself service 
42test_01_reset_vm_on_rebootPASSEDNoneself serviceEnhancement: add new test to check volume contents
43test_01_updatevolumedetailPASSEDNoneself service 
44test_01_router_internal_basicSKIPPEDNoneprovisioning[ Koushik ] This test ssh to the router
45test_02_router_internal_advSKIPPEDNoneprovisioning[ Koushik ] This test ssh to the router
46test_03_restart_network_cleanupPASSEDNoneself service 
47test_04_restart_network_wo_cleanupSKIPPEDNoneprovisioningneed access to host
48test_05_router_basicPASSEDNoneself service 
49test_06_router_advancedPASSEDNoneself service 
50test_07_stop_routerPASSEDNoneself service 
51test_08_start_routerPASSEDNoneself service 
52test_09_reboot_routerPASSEDNoneself service 
53test_01_scale_vmFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'This operation not permitted for this hypervisor of the vm'}provisioning[ Koushik ] There is HV specific check in CS code and so fails for HV type 'Simulator'. For now run as provisioning test.
54test_01_sys_vm_startPASSEDNoneself service 
55test_02_sys_template_readyPASSEDNoneself service 
56test_01_create_service_offeringPASSEDNoneself service 
57test_02_edit_service_offeringPASSEDNoneself service 
58test_03_delete_service_offeringPASSEDNoneself service 
59test_04_change_offering_smallFAILEDSSH Access failed for 10.1.1.130: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning avoid ssh connection
60test_01_snapshot_root_diskFAILED'simulator'provisioningTest script needs to be changed for simulator to avoid checking the existence of snapshot on secondary
61test_01_list_sec_storage_vmPASSEDNoneself service 
62test_02_list_cpvm_vmPASSEDNoneself service 
63test_03_ssvm_internalsSKIPPEDNoneprovisioning[ Koushik ] Based on similar test cases for router
64test_04_cpvm_internalsSKIPPEDNoneprovisioning[ Koushik ] Based on similar test cases for router
65test_05_stop_ssvmSKIPPEDNoneprovisioningactually doing a stop and then a start. then calls test_ssvm_internals()
66test_06_stop_cpvmSKIPPEDNoneprovisioningdo
67test_07_reboot_ssvmSKIPPEDNoneprovisioningdo
68test_08_reboot_cpvmSKIPPEDNoneprovisioningdo
69test_09_destroy_ssvmSKIPPEDNoneprovisioningdo
70test_10_destroy_cpvmSKIPPEDNoneprovisioningdo
71test_01_create_templateFAILEDWarning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}self service

Delete template/ISO is eventually removing the entry from DB but errors out while trying to delete it from backend.

[ Koushik ] Rajani fixed the simulator for this

72test_02_edit_templatePASSEDNoneself service 
73test_03_delete_templateFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}self service

Delete template/ISO is eventually removing the entry from DB but errors out while trying to delete it from backend.

[ Koushik ] Rajani fixed the simulator for this

74test_04_extract_templateFAILEDExtract Template Failed with invalid URL http://192.168.2.3/userdata/d408cfd8-bf7f-47ef-9aa0-84c353d24221.raw (template id: 31ea9fe5-3a0b-4425-b4ca-7aa9e0695605)

provisioning

 

This test can be modified for simulator not to download using URL
75test_05_template_permissionsPASSEDNoneself service 
76test_06_copy_templateSKIPPEDNoneprovisioningdestination zone needs to extract the template URL
77test_07_list_public_templatesPASSEDNoneself service 
78test_08_list_system_templatesPASSEDNoneself service 
79test_advZoneVirtualRouterPASSEDNoneNAduplicate test, remove it
80test_deploy_vmPASSEDNoneself service

{Koushik}Is this a duplicate of #2

Can be removed since it is covered in test_vm_life_cycle.py

81test_01_stop_vmPASSEDNoneself service 
82test_02_start_vmPASSEDNoneself service 
83test_03_reboot_vmPASSEDNoneself service 
84test_06_destroy_vmPASSEDNoneself service 
85test_07_restore_vmPASSEDNoneself serviceEnhancement: add another test the data on the restored VM.
86test_08_migrate_vmPASSEDNoneself service 
87test_09_expunge_vmPASSEDNoneself service 
88test_10_attachAndDetach_isoFAILEDSSH failed for virtual machine: 10.1.1.62 - SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 avoid ssh connection
89test_01_create_vm_snapshotsFAILEDSSH failed for Virtual machine: 10.1.1.44

provisioning

 avoid ssh connection
90test_02_revert_vm_snapshotsFAILEDSSH failed for Virtual machine: 10.1.1.44

provisioning

 avoid ssh connection
91test_03_delete_vm_snapshotsFAILEDCheck list response returns a valid list

provisioning

 
92test_01_create_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

provisioning

attach volume is failing

{Koushik} Rajani fixed simulator for this

test does SSH connection, Hence, marking it as provisioning

93test_02_attach_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

provisioning

attach volume is failing

test does SSH connection, Hence, marking it as provisioning

94test_03_download_attached_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

self service

attach volume is failing

test is checking that downloading an attached volume fails

95test_04_delete_attached_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

self service

attach volume is failing
96test_05_detach_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

self service

attach volume is failing
97test_06_download_detached_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

provisioning

attach volume is failing
98test_07_resize_failFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

self service

attach volume is failing
99test_08_resize_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

provisioning

attach volume is failing

Enhancement: check the resized volume on the backend if it has actually been resized.

100test_09_delete_detached_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

self service

attach volume is failing
101test_vpc_remote_access_vpnFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 31 on domR: r-9-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

 

vpn user creation is failing

{Koushik} Rajani fixed simulator for this

102test_vpc_site2site_vpnPASSEDNoneself service 

Self Service tests: 63

Provisioning tests: 38

Total no. of existing automated tests for advanced zone: 118

Test Report Analysis:

29 out of 102 smoke tests failed.

Unsupported commands:

  1. create vpn users. [ com.cloud.agent.api.routing.VpnUsersCfgCommand ]
  2. delete ISO- Delete template/ISO is eventually removing the entry from DB but errors out while trying to delete it from backend.
  3. delete Template -Delete template/ISO is eventually removing the entry from DB but errors out while trying to delete it from backend.
  4. AttachVolumeCmd

    java.lang.NullPointerException

        at com.cloud.hypervisor.dao.HypervisorCapabilitiesDaoImpl.getMaxDataVolumesLimit(HypervisorCapabilitiesDaoImpl.java:90)

  5. extract template.
  6. scale VM

 

Regression test report -Advanced Zone:

Here is the list of automated regression tests which needs to be reviewed. There is a column 'type' added with the following values

  1. self service
  2. provisioning
  3. unsupported
  4. test issue
  5. Not Run -skipped test
  • skipped tests need to be run manually.
  • test issues need to be fixed an re run.

Sl. No.

test case

status

Error Description

Type

Comment

1

test_01_create_account

PASSED

None

self service

 

2

test_01_add_vm_to_subdomain

PASSED

None

self service

 

3

test_DeleteDomain

PASSED

None

self service

 

4

test_forceDeleteDomain

PASSED

None

self service

 

5

test_01_non_root_admin_Privileges

PASSED

None

self service

 

6

test_01_user_remove_VM_running

PASSED

None

self service

 

7

test_01_service_offering_hierarchy

PASSED

None

self service

 

8

test_01_service_offering_siblings

PASSED

None

self service

 

9

ContextSuite context=TestTemplateHierarchy>:setup

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}

provisioning

expand this test to all dependent tests

10

test_updateAdminDetails

PASSED

None

self service

 

11

test_updateDomainAdminDetails

PASSED

None

self service

 

12

test_updateUserDetails

PASSED

None

self service

 

13

test_LoginApiDomain

PASSED

None

self service

 

14

test_LoginApiUuidResponse

PASSED

None

self service

 

15

ContextSuite context=TestAddNetworkToVirtualMachine>:setup

SKIPPED

None

Not Run

add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor

16

ContextSuite context=TestFailureScenariosAddNetworkToVM>:setup

SKIPPED

None

Not Run

add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor

17

ContextSuite context=TestFailureScenariosRemoveNicFromVM>:setup

SKIPPED

None

Not Run

add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor

18

ContextSuite context=TestFailureScenariosUpdateVirtualMachineNIC>:setup

SKIPPED

None

Not Run

add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor

19

ContextSuite context=TestRemoveNetworkFromVirtualMachine>:setup

SKIPPED

None

Not Run

add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor

20

ContextSuite context=TestUpdateVirtualMachineNIC>:setup

SKIPPED

None

Not Run

add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor

21

test_01_deploy_vm_another_user

PASSED

None

self service

 

22

test_02_create_aff_grp_user

PASSED

None

self service

 

23

test_03_list_aff_grp_all_users

PASSED

None

self service

 

24

test_04_list_all_admin_aff_grp

PASSED

None

self service

 

25

test_05_list_all_users_aff_grp

PASSED

None

self service

 

26

test_06_list_all_users_aff_grp_by_id

PASSED

None

self service

 

27

test_07_delete_aff_grp_of_other_user

PASSED

None

self service

 

28

test_01_admin_create_aff_grp

PASSED

None

self service

 

29

test_02_doadmin_create_aff_grp

PASSED

None

self service

 

30

test_03_user_create_aff_grp

PASSED

None

self service

 

31

test_04_user_create_aff_grp_existing_name

PASSED

None

self service

 

32

test_05_create_aff_grp_same_name_diff_acc

PASSED

None

self service

 

33

test_06_create_aff_grp_nonexisting_type

PASSED

None

self service

 

34

test_01_delete_aff_grp_by_name

PASSED

None

self service

 

35

test_02_delete_aff_grp_for_acc

PASSED

None

self service

 

36

test_03_delete_aff_grp_with_vms

PASSED

None

self service

 

37

test_05_delete_aff_grp_id

PASSED

None

self service

 

38

test_06_delete_aff_grp_name

PASSED

None

self service

 

39

test_08_delete_aff_grp_by_id

PASSED

None

self service

 

40

test_09_delete_aff_grp_root_admin

PASSED

None

self service

 

41

test_01_deploy_vm_without_aff_grp

PASSED

None

self service

 

42

test_02_deploy_vm_by_aff_grp_name

PASSED

None

self service

 

43

test_03_deploy_vm_by_aff_grp_id

PASSED

None

self service

 

44

test_04_deploy_vm_anti_affinity_group

PASSED

None

self service

 

45

test_05_deploy_vm_by_id

PASSED

None

self service

 

46

test_06_deploy_vm_aff_grp_of_other_user_by_name

PASSED

None

self service

 

47

test_07_deploy_vm_aff_grp_of_other_user_by_id

PASSED

None

self service

 

48

test_08_deploy_vm_multiple_aff_grps

PASSED

None

self service

 

49

test_09_deploy_vm_multiple_aff_grps

PASSED

None

self service

 

50

test_10_deploy_vm_by_aff_grp_name_and_id

PASSED

None

self service

 

51

test_01_list_aff_grps_for_vm

PASSED

None

self service

 

52

test_02_list_multiple_aff_grps_for_vm

PASSED

None

self service

 

53

test_03_list_aff_grps_by_id

PASSED

None

self service

 

54

test_04_list_aff_grps_by_name

PASSED

None

self service

 

55

test_05_list_aff_grps_by_non_existing_id

PASSED

None

self service

 

56

test_06_list_aff_grps_by_non_existing_name

PASSED

None

self service

 

57

test_07_list_all_vms_in_aff_grp

PASSED

None

self service

 

58

test_01_update_aff_grp_by_ids

PASSED

None

self service

 

59

test_02_update_aff_grp_by_names

PASSED

None

self service

 

60

test_03_update_aff_grp_for_vm_with_no_aff_grp

PASSED

None

self service

 

61

test_04_update_aff_grp_remove_all

SKIPPED

None

Not Run

 

62

test_05_update_aff_grp_on_running_vm

PASSED

None

self service

 

63

test_01_zones

PASSED

None

self service

 

64

test_02_pods

PASSED

None

self service

 

65

test_03_clusters

PASSED

None

self service

 

66

test_04_hosts

PASSED

None

self service

 

67

test_05_storage_pools

PASSED

None

self service

 

68

test_06_secondary_storage

FAILED

Secondary storage should be in Up state

self service

We might need to fix simulator

69

test_01_move_across_different_domains

PASSED

None

self service

 

70

test_02_move_across_subdomains

PASSED

None

self service

 

71

test_03_move_from_domain_to_subdomain

PASSED

None

self service

 

72

test_04_move_from_domain_to_sub_of_subdomain

PASSED

None

self service

 

73

test_05_move_to_domain_from_sub_of_subdomain

PASSED

None

self service

 

74

test_06_move_to_domain_from_subdomain

PASSED

None

self service

 

75

test_07_move_across_subdomain

PASSED

None

self service

 

76

test_08_move_across_subdomain_network_create

PASSED

None

self service

 

77

test_09_move_across_subdomain

PASSED

None

self service

 

78

test_10_move_across_subdomain_vm_running

PASSED

None

self service

 

79

test_11_move_across_subdomain_vm_pfrule

PASSED

None

self service

 

80

test_12_move_across_subdomain_vm_volumes

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

self service

attachVolume

{Koushik}Fixed by Rajani

81

test_13_move_across_subdomain_vm_snapshot

PASSED

None

self service

 

82

test_14_move_across_subdomain_vm_project

PASSED

None

self service

 

83

test_15_move_across_subdomain_account_limit

PASSED

None

self service

 

84

test_16_move_across_subdomain_volume_and_account_limit

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

self service

{Koushik}Fixed by Rajani

85

test_01_deploy_instance_with_is_volatile_offering

PASSED

None

self service

 

86

test_02_reboot_instance_with_is_volatile_offering

PASSED

None

self service

 

87

test_03_restore_vm_with_new_template

PASSED

None

self service

 

88

test_04_reoccuring_snapshot_rules

FAILED

Exception not raised

self service

Possible bug in CS.ReRun and validate

89

test_01_firewall_rules_port_fw

PASSED

None

self service

Add more tests to actually verify the rules on the router

90

test_01_restart_network_cleanup

PASSED

None

self service

 

91

test_01_list_routers_admin

PASSED

None

self service

 

92

test_01_create_template

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}

provisioning

 

93

test_01_check_template_size

FAILED

Template instance has no attribute 'size'

provisioning

 

94

test_02_check_size_snapshotTemplate

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'}

provisioning

Rerun

95

test_03_reuse_template_name

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'}

provisioning

Rerun

96

test_01_multiple_core_vm_start_stop_instance

PASSED

None

self service

 

97

test_02_multiple_core_vm_migrate_instance

FAILED

Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

provisioning

{Koushik}This is again HV specific check in code and so fails for 'Simulator' HV type

98

test_03_multiple_core_vm_delete_instance

PASSED

None

self service

 

99

test_04_deploy_multiple_vm_with_multiple_core

FAILED

Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

self service

{Koushik}There looks some typo here. The test name and reason failure doesn't match.

Modify the test not to unnecessary migration

100

test_01_multiple_child_domains

PASSED

None

self service

 

101

test_01_multiplecore_start_stop_instance

PASSED

None

self service

 

102

test_02_multiplecore_migrate_instance

FAILED

Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

provisioning

{Koushik}This is again HV specific check in code and so fails for 'Simulator' HV type

103

test_03_multiplecore_delete_instance

PASSED

None

self service

 

104

test_04_deploy_multiple_vm_with_multiple_cpus

PASSED

None

self service

lets rename this test which is same as #108

105

test_01_stop_start_instance

PASSED

None

self service

 

106

test_02_migrate_instance

FAILED

Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

provisioning

{Koushik}This is again HV specific check in code and so fails for 'Simulator' HV type

107

test_03_delete_instance

PASSED

None

self service

 

108

test_04_deploy_multiple_vm_with_multiple_cpus

SKIPPED

None

provisioning

{Koushik}Atleast the test name suggest that this should be self service.

marking it as provisioning test as it needs vm migration

109

test_01_deploy_vm_domain_limit_reached

PASSED

None

self service

 

110

test_02_deploy_vm_account_limit_reached

PASSED

None

self service

 

111

test_03_deploy_vm_project_limit_reached

PASSED

None

self service

 

112

test_04_deployVm__account_limit_reached

PASSED

None

self service

 

113

test_01_project_counts_start_stop_instance

PASSED

None

self service

 

114

test_02_project_counts_migrate_instance

FAILED

Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

provisioning

 

115

test_03_project_counts_delete_instance

PASSED

None

self service

 

116

test_01_custom_hostname_instancename_false

PASSED

None

self service

 

117

test_01_user_provided_hostname

SKIPPED

None

self service

depends on vm.instancename.flag

118

test_02_instancename_from_default_configuration

SKIPPED

None

self service

{Koushik}Atleast the test name suggest that this should be self service.

119

test_03_duplicate_name

SKIPPED

None

self service

{Koushik}Atleast the test name suggest that this should be self service.

120

test_04_edit_display_name

PASSED

None

self service

 

121

test_05_unsupported_chars_in_display_name

PASSED

None

self service

 

122

test_deployvm_userdata_post

FAILED

No JSON object could be decoded

provisioning

we need to add some validation on router

123

test_01_1_egress_fr1

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

124

test_01_egress_fr1

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

125

test_02_1_egress_fr2

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

126

test_02_egress_fr2

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

127

test_03_1_egress_fr3

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

128

test_03_egress_fr3

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

129

test_04_1_egress_fr4

PASSED

None

self service

 

130

test_04_egress_fr4

PASSED

None

self service

 

131

test_05_1_egress_fr5

SKIPPED

None

Not Run

WIP -Test is incomplete

132

test_05_egress_fr5

SKIPPED

None

Not Run

WIP -Test is incomplete

133

test_06_1_egress_fr6

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

134

test_06_egress_fr6

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

135

test_07_1_egress_fr7

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

136

test_07_egress_fr7

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

137

test_08_1_egress_fr8

SKIPPED

None

Not Run

WIP -Test is incomplete

138

test_08_egress_fr8

SKIPPED

None

Not Run

WIP -Test is incomplete

139

test_09_1_egress_fr9

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

140

test_09_egress_fr9

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

141

test_10_1_egress_fr10

PASSED

None

self service

 

142

test_10_egress_fr10

PASSED

None

self service

 

143

test_11_1_egress_fr11

PASSED

None

self service

 

144

test_11_egress_fr11

PASSED

None

self service

 

145

test_12_1_egress_fr12

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

146

test_12_egress_fr12

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

147

test_13_1_egress_fr13

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

148

test_13_egress_fr13

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

149

test_01_deploy_vm_with_explicit_dedication

SKIPPED

None

self service

test can be modified to add a new host just before running this test- SIMULATOR only test

if empty_host:
self.skipTest("Did not find any empty hosts, Skipping")

150

test_01_create_sticky_policy_default_values

FAILED

Connection Failed: SSH failed for VM with IP Address: 192.168.2.23

provisioning

 

151

test_02_create_sticky_policy_custom_values

FAILED

Connection Failed: SSH failed for VM with IP Address: 192.168.2.23

provisioning

 

152

test_03_supported_policies_by_network

PASSED

None

self service

 

153

test_04_delete_lb_rule

FAILED

Connection Failed: SSH failed for VM with IP Address: 192.168.2.23

provisioning

 

154

test_05_error_alerts_after_create

FAILED

Connection Failed: SSH failed for VM with IP Address: 192.168.2.23

provisioning

 

155

test_06_release_ip

FAILED

Connection Failed: SSH failed for VM with IP Address: 192.168.2.24

provisioning

 

156

test_07_delete_account

FAILED

Connection Failed: SSH failed for VM with IP Address: 192.168.2.23

provisioning

{Koushik}Not sure why delete account require ssh connection?

157

test_08_create_policy_router_stopped

FAILED

Connection Failed: SSH failed for VM with IP Address: 192.168.2.23

provisioning

 

158

test_09_create_policy_router_destroy

FAILED

Connection Failed: SSH failed for VM with IP Address: 192.168.2.23

provisioning

 

159

test_10_create_policy_enable_disable_vpn

FAILED

Connection Failed: SSH failed for VM with IP Address: 192.168.2.23

provisioning

 

160

test_11_invalid_params

PASSED

None

self service

 

161

test_01_deploy_vm_with_implicit_planner

SKIPPED

None

self service

test can be modified to add a new host just before running this test- SIMULATOR only test

if empty_host:
self.skipTest("Did not find any empty hosts, Skipping")

162

test_network_not_implemented

PASSED

None

self service

 

163

test_reservation_after_router_restart

PASSED

None

self service

 

164

test_vm_create_after_reservation

PASSED

None

self service

 

165

test_vm_create_outside_cidr_after_reservation

PASSED

None

self service

 

166

test_01_addLdapConfiguration

FAILED

addLdapConfiguration failed

self service

have proper LDAP settings configured in the test env.

167

test_01_stop_start_instance

PASSED

None

self service

 

168

test_02_migrate_instance

FAILED

Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

provisioning

 

169

test_03_delete_instance

PASSED

None

self service

 

170

test_04_deploy_multiple_vm

SKIPPED

None

self service

 

171

test_01_stop_start_instance

PASSED

None

self service

 

172

test_02_migrate_instance

FAILED

Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

provisioning

 

173

test_03_delete_instance

PASSED

None

self service

 

174

test_04_deploy_multiple_vm

FIXED

None

self service

 

175

test_01_change_service_offering

PASSED

None

self service

 

176

test_02_migrate_vm

FAILED

Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

provisioning

 

177

test_03_delete_vm

PASSED

None

self service

 

178

test_04_deploy_multiple_vm

FIXED

None

self service

 

179

test_01_multiple_child_domains

PASSED

None

self service

 

180

test_01_deploy_vm_domain_limit_reached

PASSED

None

self service

 

181

test_02_deploy_vm_account_limit_reached

PASSED

None

self service

 

182

test_03_deploy_vm_project_limit_reached

PASSED

None

self service

 

183

test_04_deployVm__account_limit_reached

PASSED

None

self service

 

184

test_01_project_vmlifecycle_start_stop_instance

PASSED

None

self service

 

185

test_02_project_vmlifecycle_migrate_instance

FAILED

Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

provisioning

 

186

test_03_project_vmlifecycle_delete_instance

PASSED

None

self service

 

187

test_add_netscaler_device

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

188

ContextSuite context=TestDeleteNetscaler>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

189

ContextSuite context=TestGuestNetworkShutDown>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

190

ContextSuite context=TestGuestNetworkWithNetScaler>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

191

test_invalid_cred

FAILED

Network service providers list should not be empty

provisioning

netscaler

192

test_invalid_private_interface

FAILED

Network service providers list should not be empty

provisioning

netscaler

193

test_invalid_public_interface

FAILED

Network service providers list should not be empty

provisioning

netscaler

194

ContextSuite context=TestNetScalerCustomCapacity>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

195

ContextSuite context=TestNetScalerDedicated>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

196

ContextSuite context=TestNetScalerNoCapacity>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

197

ContextSuite context=TestNetScalerShared>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

198

ContextSuite context=TestServiceProvider>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

addNetscalerLoadBalancer

199

ContextSuite context=TestAddMultipleVmsLb>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

200

ContextSuite context=TestDeleteCreateLBRule>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

201

ContextSuite context=TestLbOnIpWithPf>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

202

ContextSuite context=TestLbOnNonSourceNat>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

203

ContextSuite context=TestLbSourceNat>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

204

ContextSuite context=TestLoadBalancingRule>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

205

ContextSuite context=TestMultipleLbRules>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

206

ContextSuite context=TestMultipleLbRulesSameIp>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

207

ContextSuite context=TestPfOnIpWithLb>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

208

ContextSuite context=TestVmWithLb>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

209

ContextSuite context=TestLbAlgoLcRr>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

210

ContextSuite context=TestLbAlgoLcSb>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

211

ContextSuite context=TestLbAlgoRrLc>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

212

ContextSuite context=TestLbAlgoRrSb>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

213

ContextSuite context=TestLbAlgoSbLc>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

214

ContextSuite context=TestLbAlgoSbRr>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

215

ContextSuite context=TestLbWithLeastConn>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

216

ContextSuite context=TestLbWithRoundRobin>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

217

ContextSuite context=TestLbWithSourceIp>:setup

FAILED

Warning: Exception during cleanup : type object 'TestLbWithSourceIp' has no attribute '_cleanup'

provisioning

{Koushik}Is this test not dependent on Netscaler?

yes

218

ContextSuite context=TestLbStickyPolicy>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

219

test_add_mul_netscaler_diff_zone

FAILED

Atleast 2 advanced mode zones should be present for this test

provisioning

 

220

test_add_netscaler_device

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

221

ContextSuite context=TestNOWithNetscaler>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

222

ContextSuite context=TestNetScalerSharedMode>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

223

ContextSuite context=TestNwOffDToSUpgrade>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

addNetscalerLoadBalancer

224

ContextSuite context=TestNwOffDedicatedNetscaler>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

225

ContextSuite context=TestNwOffNetscaler>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

226

ContextSuite context=TestNwOffSToDUpgrade>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

addNetscalerLoadBalancer

227

test_01_network_off_without_conserve_mode

PASSED

None

self service

 

228

test_02_network_off_with_conserve_mode

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 460 on domR: r-794-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

{Koushik}Fixed by Rajani

229

test_create_network_with_snat

PASSED

None

self service

 

230

test_01_nwupgrade_netscaler_conserve_on

FAILED

Execute cmd: createnetworkoffering failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

231

test_02_nwupgrade_netscaler_conserve_off

FAILED

Execute cmd: createnetworkoffering failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

232

ContextSuite context=TestNonContiguousVLANRanges>:setup

FAILED

Exception: Failed to find template of type BUILTIN with OSTypeID and which is in ready state: f6621e5e-9e1a-11e3-81d6-062a00000033

self service

re run

233

test_network_state_after_destroying_vms

PASSED

None

self service

 

234

test_shared_network_offering_with_persistent

PASSED

None

self service

 

235

test_upgrade_network_offering_to_persistent

PASSED

None

self service

 

236

test_associate_ip_address

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

rerun

237

test_associate_ip_address_invalid_zone

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

rerun

238

test_associate_ip_address_no_free_ip

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

rerun

239

test_associate_ip_address_services_enable_disable

SKIPPED

None

provisioning

need ssh access

240

test_create_portable_ip_range

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

rerun

241

test_create_portable_ip_range_invalid_region

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

242

test_create_portable_ip_range_non_root_admin

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

243

test_delete_account_services_disabled

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

244

test_delete_account_services_enabled

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

245

test_delete_portable_ip_range

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

246

test_delete_portable_ip_range_in_use

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

247

test_delete_portable_ip_range_non_root_admin

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

248

test_disassociate_ip_address_no_services

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

249

test_disassociate_ip_address_other_account

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

250

test_disassociate_ip_address_services_enabled

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

251

test_list_portable_ip_range

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

252

test_list_portable_ip_range_non_root_admin

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

253

test_list_portable_ip_range_non_root_admin

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

254

ContextSuite context=TestProjectCreationNegative>:setup

SKIPPED

None

self service

depends on global config

if not isinstance(configs, list):
raise unittest.SkipTest("List configurations has no config: allow.user.create.projects")

255

test_add_user_to_project

PASSED

None

self service

 

256

ContextSuite context=TestProjectInviteRequiredTrue>:setup

SKIPPED

None

self service

depends on global config

257

ContextSuite context=TestProjectInviteTimeout>:setup

SKIPPED

None

self service

depends on global config

258

test_admin_project_creation

PASSED

None

self service

 

259

test_maxAccountNetworks

PASSED

None

self service

 

260

test_01_project_limits

PASSED

None

self service

 

261

test_02_project_limits_normal_user

PASSED

None

self service

 

262

test_03_vm_per_project

PASSED

None

self service

 

263

test_04_publicip_per_project

PASSED

None

self service

 

264

test_05_snapshots_per_project

PASSED

None

self service

 

265

test_06_volumes_per_project

PASSED

None

self service

 

266

test_07_templates_per_project

FAILED

Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}

self service

re run

267

ContextSuite context=TestResourceLimitsProject>:teardown

FAILED

Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u"Can't delete the domain yet because it has 1 accounts to cleanup"}

self service

re run

268

test_03_network_create

PASSED

None

self service

 

269

test_01_service_offerings

PASSED

None

self service

 

270

test_02_project_disk_offerings

PASSED

None

self service

 

271

test_07_associate_public_ip

PASSED

None

self service

 

272

test_06_create_snapshots_in_project

PASSED

None

self service

 

273

test_04_public_template_use_in_project

FAILED

Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}

self service

re run

274

test_05_use_private_template_in_project

FAILED

Execute cmd: deployvirtualmachine failed, due to: errorCode: 530, errorText:None

self service

{Koushik}Failure needs investigation

re run

275

test_05_use_private_template_in_project

FAILED

Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}

self service

re run

276

ContextSuite context=TestTemplates>:teardown

FAILED

Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u"Can't delete the domain yet because it has 1 accounts to cleanup"}

self service

re run

277

test_01_ISO_usage

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete ISO'}

self service

re run

278

test_01_lb_usage

PASSED

None

self service

 

279

test_01_nat_usage

PASSED

None

self service

 

280

test_01_public_ip_usage

PASSED

None

self service

 

281

test_01_snapshot_usage

PASSED

None

self service

 

282

test_01_template_usage

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}

self service

re run

283

test_01_vm_usage

PASSED

None

self service

 

284

test_01_volume_usage

PASSED

None

self service

 

285

test_01_vpn_usage

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 582 on domR: r-959-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

re run

286

test_02_cross_domain_account_add

PASSED

None

self service

 

287

test_03_delete_account_with_project

PASSED

None

self service

 

288

test_04_delete_domain_with_project

PASSED

None

self service

 

289

test_01_create_multiple_projects_by_account

PASSED

None

self service

 

290

test_05_user_project_owner_promotion

PASSED

None

self service

 

291

test_06_max_one_project_owner

PASSED

None

self service

 

292

test_07_project_resources_account_delete

PASSED

None

self service

 

293

test_08_cleanup_after_project_delete

PASSED

None

self service

 

294

test_09_project_suspend

PASSED

None

self service

 

295

test_10_project_activation

PASSED

None

self service

 

296

test_recurring_snapshot_data_disk

PASSED

None

self service

 

297

test_recurring_snapshot_root_disk

PASSED

None

self service

 

298

test_network_gc

PASSED

None

self service

 

299

test_restart_ntwk_no_cleanup

PASSED

None

self service

 

300

test_restart_ntwk_with_cleanup

PASSED

None

self service

 

301

test_enableVPNOverRvR

FAILED

Failed to create VPN for account: test-TestEnableVPNOverRvR-test_enableVPNOverRvR-X7XPFV - Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 479 on domR: r-813-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

re run

302

test_downgradeRvR_to_VR

PASSED

None

self service

 

303

test_upgradeVR_to_redundantVR

PASSED

None

self service

 

304

test_createRegionWithExistingRegionId

PASSED

None

self service

 

305

test_createRegionWithExistingRegionName

PASSED

None

self service

 

306

test_updateRegion

PASSED

None

self service

 

307

test_createAccountWithUUID

PASSED

None

self service

 

308

test_createUserWithUUID

PASSED

None

self service

 

309

test_createdomainWithUUID

PASSED

None

self service

 

310

ContextSuite context=TestResetSSHKeyUserRights>:setup

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

expand the dependent tests

311

ContextSuite context=TestResetSSHKeypair>:setup

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

expand the dependent tests

312

test_maxAccountNetworks

PASSED

None

self service

 

313

test_01_vm_per_account

PASSED

None

self service

 

314

test_02_publicip_per_account

PASSED

None

self service

 

315

test_03_snapshots_per_account

PASSED

None

self service

 

316

test_04_volumes_per_account

PASSED

None

self service

 

317

test_05_templates_per_account

FAILED

Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}

self service

rerun

318

test_01_publicip_per_domain

PASSED

None

self service

 

319

test_01_vm_per_domain

PASSED

None

self service

 

320

test_03_snapshots_per_domain

PASSED

None

self service

 

321

test_04_volumes_per_domain

PASSED

None

self service

 

322

test_05_templates_per_domain

FAILED

Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}

self service

 

323

ContextSuite context=TestResourceLimitsDomain>:teardown

FAILED

Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u"Can't delete the domain yet because it has 1 accounts to cleanup"}

self service

 

324

test_01_AdvancedZoneRouterServices

PASSED

None

self service

 

325

test_02_NetworkGarbageCollection

PASSED

None

self service

 

326

test_03_RouterStartOnVmDeploy

PASSED

None

self service

 

327

test_01_RouterStopCreateFW

FAILED

'Please provide the marvin configuration file with credentials to your hosts'

provisioning

 

328

test_01_RouterStopCreateLB

FAILED

SSH Access failed for 10.1.1.219: SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

329

test_01_RouterStopCreatePF

FAILED

SSH Access failed for 192.168.2.9: SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

330

test_createSharedNetwork_All

PASSED

None

self service

 

331

test_createSharedNetwork_accountSpecific

PASSED

None

self service

 

332

test_createSharedNetwork_domainSpecific

PASSED

None

self service

 

333

test_createSharedNetwork_projectSpecific

PASSED

None

self service

 

334

test_createSharedNetwork_usedVlan

SKIPPED

None

NA

remove the test

335

test_createSharedNetwork_usedVlan2

PASSED

None

self service

 

336

test_deployVM_isolatedAndShared

FAILED

SSH Access failed for 10.1.1.96: SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

337

test_deployVM_multipleSharedNetwork

PASSED

None

self service

Enhancement: add more validation to check that IPs are in the correct networks.

338

test_networkWithsubdomainaccessFalse

PASSED

None

self service

 

339

test_networkWithsubdomainaccessTrue

PASSED

None

self service

 

340

test_sharedNetworkOffering_01

PASSED

None

self service

 

341

test_sharedNetworkOffering_02

PASSED

None

self service

 

342

test_sharedNetworkOffering_03

PASSED

None

self service

 

343

test_02_accountSnapshotClean

FAILED

'simulator'

provisioning

is_snapshot_on_nfs

344

test_04_snapshot_limit

FAILED

'simulator'

provisioning

is_snapshot_on_nfs

345

test_01_createVM_snapshotTemplate

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'}

provisioning

 

346

test_05_snapshot_events

PASSED

None

self service

 

347

test_01_volume_from_snapshot

FAILED

SSH failed for VM: 10.1.1.233

provisioning

 

348

test_02_snapshot_data_disk

FAILED

'simulator'

provisioning

 

349

test_03_snapshot_detachedDisk

FAILED

SSH failed for VM with IP: 192.168.2.14 - SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

350

test_04_delete_snapshot

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

provisioning

 

351

test_07_template_from_snapshot

FAILED

SSH failed for VM with IP address: 10.1.1.233

provisioning

 

352

test_01_concurrent_snapshots_live_migrate

PASSED

None

self service

 

353

test_02_stop_vm_concurrent_snapshots

PASSED

None

self service

 

354

test_03_concurrent_snapshots_create_template

FAILED

Check if result exists in list item call

self service

rerun

355

test_04_concurrent_snapshots_create_volume

PASSED

None

self service

 

356

test_01_snapshot_on_rootVolume

FAILED

'simulator'

provisioning

 

357

test_01_deploy_ha_vm_startvm_false

PASSED

None

self service

 

358

test_02_deploy_ha_vm_from_iso

PASSED

None

self service

 

359

test_03_deploy_ha_vm_iso_startvm_false

PASSED

None

self service

 

360

test_deployVmOnGivenHost

PASSED

None

self service

 

361

test_01_deploy_vm_no_startvm

PASSED

None

self service

 

362

test_02_deploy_vm_startvm_true

PASSED

None

self service

 

363

test_03_deploy_vm_startvm_false

PASSED

None

self service

 

364

test_04_deploy_startvm_false_attach_volume

PASSED

None

self service

 

365

test_05_deploy_startvm_false_change_so

PASSED

None

self service

 

366

test_06_deploy_startvm_attach_detach

PASSED

None

self service

 

367

test_07_deploy_startvm_attach_iso

PASSED

None

self service

 

368

test_08_deploy_attached_volume

PASSED

None

self service

 

369

test_09_stop_vm_migrate_vol

PASSED

None

self service

 

370

test_deploy_vm_password_enabled

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}

provisioning

revisit the test, why template is downloaded

371

test_01_deploy_vm_no_startvm

PASSED

None

self service

 

372

test_upload_attach_volume

PASSED

None

self service

 

373

test_vm_per_account

PASSED

None

self service

 

374

test_01_migrate_vm_with_volume

FAILED

Execute cmd: findhostsformigration failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

provisioning

 

375

test_02_migrate_volume

SKIPPED

None

self service

if not pools:
self.skipTest("No suitable storage pools found for volume migration. Skipping")

376

test_01_lbrule_tag

PASSED

None

self service

 

377

test_02_natrule_tag

PASSED

None

self service

 

378

test_03_firewallrule_tag

PASSED

None

self service

 

379

test_04_vpn_tag

SKIPPED

None

self service

      self.skipTest("VPN resource tags are unsupported in 4.0")

380

test_05_vm_tag

PASSED

None

self service

 

381

test_06_template_tag

FAILED

Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}

self service

 

382

test_07_iso_tag

PASSED

None

self service

 

383

test_08_volume_tag

PASSED

None

self service

 

384

test_09_snapshot_tag

PASSED

None

self service

 

385

test_10_network_tag

PASSED

None

self service

 

386

test_13_tag_case_insensitive

PASSED

None

self service

 

387

test_14_special_char_mutiple_tags

PASSED

None

self service

 

388

test_15_project_tag

PASSED

None

self service

 

389

test_16_query_tags_other_account

PASSED

None

self service

 

390

test_17_query_tags_admin_account

PASSED

None

self service

 

391

test_18_invalid_list_parameters

PASSED

None

self service

 

392

test_19_delete_add_same_tag

PASSED

None

self service

 

393

test_20_create_tags_multiple_resources

PASSED

None

self service

 

394

test_21_create_tag_stopped_vm

PASSED

None

self service

 

395

test_22_create_tag_destroyed_vm

PASSED

None

self service

 

396

test_01_create_template

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}

provisioning

test can be modified to qualify as a self service test.

397

test_01_create_template_volume

FAILED

Execute cmd: deployvirtualmachine failed, due to: errorCode: 530, errorText:None

self service

rerun

398

test_03_delete_template

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}

self service

 

399

test_04_template_from_snapshot

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'}

self service

rerun

400

test_update_vm_name

PASSED

None

self service

 

401

test_01_ISO_usage

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete ISO'}

self service

 

402

test_01_lb_usage

PASSED

None

self service

 

403

test_01_nat_usage

PASSED

None

self service

 

404

test_01_public_ip_usage

PASSED

None

self service

 

405

test_01_snapshot_usage

PASSED

None

self service

 

406

test_01_template_usage

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}

self service

 

407

test_01_vm_usage

PASSED

None

self service

 

408

test_01_volume_usage

PASSED

None

self service

 

409

test_01_vpn_usage

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 213 on domR: r-383-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

 

410

ContextSuite context=TestVMPasswordEnabled>:setup

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

411

test_vmware_affinity

SKIPPED

None

provisioning

{Koushik}Since test name has vmware marked as provisioning for now. Check why a specific vmware affinity test is there

depends on vmware drs

412

test_vmware_anti_affinity

SKIPPED

None

provisioning

{Koushik}Since test name has vmware marked as provisioning for now. Check why a specific vmware affinity test is there

depends on vmware drs

413

test_vm_creation_in_fully_automated_mode

PASSED

None

provisioning

revisit.depends on vmware drs

414

ContextSuite context=TestAttachDetachVolume>:setup

FAILED

object of type 'NoneType' has no len()

provisioning

{Koushik}Needs further investigation

no need to run on simulator

since this test checks max data volumes supported by a hypervisor

415

ContextSuite context=TestAttachVolume>:setup

FAILED

object of type 'NoneType' has no len()

provisioning

{Koushik}Needs further investigation

no need to run on simulator

since this test checks max data volumes supported by a hypervisor


416

ContextSuite context=TestAttachVolumeISO>:setup

FAILED

object of type 'NoneType' has no len()

provisioning

{Koushik}Needs further investigation

no need to run on simulator

since this test checks max data volumes supported by a hypervisor


417

test_deployVmWithCustomDisk

PASSED

None

self service

 

418

test_01_attach_volume

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

self service

 

419

test_02_detach_volume

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'The specified volume is not attached to a VM.'}

self service

 

420

test_03_delete_detached_volume

PASSED

None

self service

 

421

test_create_volume_under_domain

PASSED

None

self service

 

422

test_01_list_vpc_apis

PASSED

None

self service

 

423

test_02_restart_vpc_no_networks

PASSED

None

self service

 

424

test_03_restart_vpc_with_networks

PASSED

None

self service

 

425

test_04_delete_vpc_no_networks

PASSED

None

self service

 

426

test_05_delete_vpc_with_networks

PASSED

None

self service

 

427

test_06_list_vpc_apis_admin

PASSED

None

self service

 

428

test_07_restart_network_vm_running

FAILED

Failed to SSH into VM - 192.168.2.19, SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

429

test_08_delete_vpc

FAILED

Failed to SSH into VM - 192.168.2.19, SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

430

test_09_vpc_create

PASSED

None

self service

 

431

test_10_nonoverlaping_cidrs

PASSED

None

self service

 

432

test_11_deploy_vm_wo_network_netdomain

FAILED

Failed to SSH into VM - 192.168.2.23, SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

433

test_12_deploy_vm_with_netdomain

PASSED

None

self service

 

434

test_13_deploy_vm_with_vpc_netdomain

FAILED

Failed to SSH into VM - 192.168.2.23, SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

435

test_14_deploy_vm_1

PASSED

None

self service

 

436

test_15_deploy_vm_2

PASSED

None

self service

 

437

test_16_deploy_vm_for_user_by_admin

PASSED

None

self service

 

438

test_17_deploy_vm_for_user_by_domain_admin

PASSED

None

self service

 

439

test_18_create_net_for_user_diff_domain_by_doadmin

PASSED

None

self service

 

440

test_19_create_vpc_wo_params

PASSED

None

self service

 

441

test_20_update_vpc_name_display_text

PASSED

None

self service

 

442

test_01_create_network_network_offering

PASSED

None

self service

 

443

test_01_create_network_network_offering_vpcns

SKIPPED

None

provisioning

{Koushik}Test name says lot of things, need to understand what all is done

requires netscaler

444

test_02_create_network_fail_network_offering

PASSED

None

self service

 

445

test_02_create_network_fail_network_offering_vpcns

SKIPPED

None

provisioning

{Koushik}Test name says lot of things, need to understand what all is done

requires netscaler

446

test_04_create_multiple_networks_with_lb_network_offering

PASSED

None

self service

 

447

test_04_create_multiple_networks_with_lb_network_offering_vpcns

SKIPPED

None

provisioning

{Koushik}Test name says lot of things, need to understand what all is done

requires netscaler

448

test_06_create_network_with_rvr

SKIPPED

None

NA

"skipped - RvR didn't support VPC currently "

449

test_07_create_network_unsupported_services

PASSED

None

self service

 

450

test_08_create_network_without_sourceNAT

PASSED

None

self service

 

451

test_09_create_network_shared_nwoff_network_off_shared

PASSED

None

self service

 

452

test_09_create_network_shared_nwoff_network_offering_vpcns

SKIPPED

None

provisioning

{Koushik}Test name says lot of things, need to understand what all is done

requires netscaler

453

test_10_create_network_with_conserve_mode_network_offering

PASSED

None

self service

 

454

test_10_create_network_with_conserve_mode_network_offering_vpcns

PASSED

None

self service

 

455

test_01_wait_network_gc

PASSED

None

provisioning

Enhancement: add more validation

456

test_02_start_vm_network_gc

FAILED

Failed to SSH into VM - 192.168.2.12, SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

457

test_03_restart_vpcvr

FAILED

Failed to SSH into VM - 192.168.2.12, SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

458

test_01_create_network_outside_range_network_offering

PASSED

None

self service

 

459

test_01_create_network_outside_range_network_offering_vpcns

SKIPPED

None

provisioning

{Koushik}Test name says lot of things, need to understand what all is done

requires netscaler

460

test_02_create_network_outside_range

PASSED

None

self service

 

461

test_03_create_network_inside_range_network_offering

PASSED

None

self service

 

462

test_03_create_network_inside_range_network_offering_vpcns

SKIPPED

None

provisioning

{Koushik}Test name says lot of things, need to understand what all is done

requires netscaler

463

test_04_create_network_overlapping_range_network_offering

PASSED

None

self service

 

464

test_04_create_network_overlapping_range_network_offering_vpcns

SKIPPED

None

provisioning

requires netscaler

465

test_05_create_network_diff_account_network_offering

PASSED

None

self service

 

466

test_05_create_network_diff_account_network_offering_vpcns

SKIPPED

None

provisioning

requires netscaler

467

test_01_network_services_upgrade

FAILED

Failed to SSH into VM - 192.168.2.12, SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

468

test_02_network_vpcvr2vr_upgrade

PASSED

None

provisioning

add proper validation before and after upgrade

469

test_01_VPC_LBRulesListing

PASSED

None

self service

 

470

test_02_VPC_CreateLBRuleInMultipleNetworks

FAILED

Failed to wget from VM=QA-579a7424-09b9-41bd-8394-f72056b7e1d9 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out

provisioning

 

471

test_03_VPC_CreateLBRuleInMultipleNetworksVRStoppedState

FAILED

Failed to wget from VM=QA-91ac472a-996e-401d-88e2-9c305c780cb8 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out

provisioning

 

472

test_04_VPC_CreateLBRuleInMultipleNetworksVRStoppedState

FAILED

Failed to wget from VM=QA-87956b8f-9c6c-432c-96c7-e48759ccb85e http server on public_ip=192.168.2.29 because of [Errno socket error] timed out

provisioning

 

473

test_05_VPC_CreateAndDeleteLBRule

FAILED

Failed to wget from VM=QA-4de5c732-b31b-4f6a-b784-671d9091d277 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out

provisioning

 

474

test_06_VPC_CreateAndDeleteLBRuleVRStopppedState

FAILED

Failed to wget from VM=QA-6a0f9448-94d3-476d-8271-91bc3bf6b013 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out

provisioning

 

475

test_07_VPC_CreateAndDeleteAllLBRule

FAILED

Failed to wget from VM=QA-94f2bc5d-e061-448a-877e-bd0199faf4cf http server on public_ip=192.168.2.29 because of [Errno socket error] timed out

provisioning

 

476

test_08_VPC_CreateAndDeleteAllLBRuleVRStoppedState

FAILED

Failed to wget from VM=QA-3e51092f-b67d-4769-908f-a0c9c776683a http server on public_ip=192.168.2.29 because of [Errno socket error] timed out

provisioning

 

477

test_09_VPC_LBRuleCreateFailMultipleVPC

FAILED

Failed to wget from VM=QA-2ff04344-932c-4c77-a26b-d71ba6226732 http server on public_ip=192.168.2.30 because of [Errno socket error] timed out

provisioning

 

478

test_10_VPC_FailedToCreateLBRuleNonVPCNetwork

PASSED

None

self service

 

479

test_11_VPC_LBRuleCreateNotAllowed

FAILED

Failed to wget from VM=QA-23b260c3-862e-4f3d-8fba-519d9a7e55d6 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out

provisioning

 

480

test_12_VPC_LBRuleCreateFailForRouterIP

PASSED

None

self service

 

481

test_13_VPC_LBRuleCreateFailForPFSourceNATIP

FAILED

Failed to SSH into VM - 192.168.2.29

provisioning

 

482

test_14_VPC_LBRuleCreateFailForStaticNatRule

PASSED

None

self service

 

483

test_15_VPC_ReleaseIPForLBRuleCreated

PASSED

None

self service

 

484

test_01_network_services_VPC_StopCreatePF

FAILED

Failed to SSH into VM - 192.168.2.13

provisioning

 

485

test_02_network_services_VPC_CreatePF

FAILED

Failed to SSH into VM - 192.168.2.12

provisioning

 

486

test_03_network_services_VPC_StopCreateMultiplePF

FAILED

Failed to SSH into VM - 192.168.2.12

provisioning

 

487

test_04_network_services_VPC_CreateMultiplePF

FAILED

Failed to SSH into VM - 192.168.2.12

provisioning

 

488

test_05_network_services_VPC_StopDeletePF

FAILED

Failed to SSH into VM - 192.168.2.12

provisioning

 

489

test_06_network_services_VPC_DeletePF

FAILED

Failed to SSH into VM - 192.168.2.12

provisioning

 

490

test_07_network_services_VPC_StopDeleteAllPF

FAILED

Failed to SSH into VM - 192.168.2.12

provisioning

 

491

test_08_network_services_VPC_DeleteAllPF

FAILED

Failed to SSH into VM - 192.168.2.12

provisioning

 

492

test_09_network_services_VPC_StopDeleteAllMultiplePF

FAILED

Failed to SSH into VM - 192.168.2.12

provisioning

 

493

test_10_network_services_VPC_DeleteAllMultiplePF

FAILED

Failed to SSH into VM - 192.168.2.12

provisioning

 

494

test_01_VPC_StaticNatRuleCreateStoppedState

FAILED

Failed to SSH into VM - 192.168.2.8

provisioning

 

495

test_02_VPC_CreateStaticNatRule

FAILED

Failed to SSH into VM - 192.168.2.8

provisioning

 

496

test_03_VPC_StopCreateMultipleStaticNatRuleStopppedState

FAILED

Failed to SSH into VM - 192.168.2.8

provisioning

 

497

test_04_VPC_CreateMultipleStaticNatRule

FAILED

Failed to SSH into VM - 192.168.2.8

provisioning

 

498

test_05_network_services_VPC_DeleteAllPF

FAILED

Failed to SSH into VM - 192.168.2.8

provisioning

 

499

test_06_network_services_VPC_DeleteAllMultiplePF

FAILED

Failed to SSH into VM - 192.168.2.8

provisioning

 

500

test_01_create_vpc_offering

PASSED

None

self service

 

501

test_02_deploy_vms_in_vpc_nw

FAILED

Failed to SSH into VM - 192.168.2.19, SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

502

test_03_vpc_off_without_lb

PASSED

None

self service

 

503

test_04_vpc_off_without_static_nat

PASSED

None

self service

 

504

test_05_vpc_off_without_pf

PASSED

None

self service

 

505

test_06_vpc_off_invalid_services

PASSED

None

self service

 

506

test_07_update_vpc_off

PASSED

None

self service

 

507

test_08_list_vpc_off

PASSED

None

self service

 

508

test_01_start_stop_router_after_addition_of_one_guest_network

PASSED

None

provisioining

Ehnancement: add more validation written in the steps

509

test_02_reboot_router_after_addition_of_one_guest_network

PASSED

None

self service

 

510

test_03_migrate_router_after_addition_of_one_guest_network

FAILED

Migration to host b5205777-8029-480e-9941-b7f8f89f48ba failed. The router host isstill 09c38e9a-7a22-4591-be39-f1a2bcd138a5

provisioning

 

511

test_04_chg_srv_off_router_after_addition_of_one_guest_network

PASSED

None

self service

 

512

test_05_destroy_router_after_addition_of_one_guest_network

PASSED

None

self service

 

513

test_01_stop_start_router_after_creating_vpc

PASSED

None

self service

 

514

test_02_reboot_router_after_creating_vpc

PASSED

None

self service

 

515

test_03_migrate_router_after_creating_vpc

FAILED

Migration to host b5205777-8029-480e-9941-b7f8f89f48ba failed. The router host is still 09c38e9a-7a22-4591-be39-f1a2bcd138a5

provisioning

 

516

test_04_change_service_offerring_vpc

PASSED

None

self service

 

517

test_05_destroy_router_after_creating_vpc

PASSED

None

self service

 

518

test_01_deploy_vms_in_network

PASSED

None

self service

 

519

test_02_deploy_vms_delete_network

PASSED

None

self service

 

520

test_03_deploy_vms_delete_add_network

PASSED

None

self service

 

521

test_04_deploy_vms_delete_add_network_noLb

PASSED

None

self service

 

522

test_05_create_network_max_limit

PASSED

None

self service

 

523

test_06_delete_network_vm_running

PASSED

None

self service

 

524

test_07_delete_network_with_rules

FAILED

List public Ips 192.168.2.9 for network should list the Ip addr 192.168.2.11

self service

rerun and revisit

525

test_01_VPN_user_limit

FAILED

Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 583 on domR: r-961-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

 

526

test_02_use_vpn_port

PASSED

None

self service

 

527

test_03_enable_vpn_use_port

FAILED

Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 585 on domR: r-965-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

 

528

test_04_add_new_users

FAILED

Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 586 on domR: r-967-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

 

529

test_05_add_duplicate_user

FAILED

Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 587 on domR: r-969-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

 

530

test_06_add_VPN_user_global_admin

FAILED

Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 588 on domR: r-971-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

 

531

test_07_add_VPN_user_domain_admin

FAILED

Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 589 on domR: r-973-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

 

 

Self Service tests: TBA

Provisioning tests: TBA

Total no. of existing automated tests for advanced zone: TBA

BVT Report -Basic Zone

Sl. No.test casestatusError DescriptionTypeComments
1test_DeployVmAntiAffinityGroupFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-ed6c84c2-3602-461b-bfc0-77031d0b7b33], Please check the affinity groups provided, there may not be sufficient capacity to follow them'}self service 
2test_deploy_vmPASSEDNoneself service 
3test_deployvm_userdataPASSEDNoneself service 
4test_deployvm_userdata_postPASSEDNoneself service 
5test_deployvm_firstfitPASSEDNoneself service 
6test_deployvm_userconcentratedPASSEDNoneself service 
7test_deployvm_userdispersingPASSEDNoneself service 
8test_01_create_disk_offeringPASSEDNoneself service 
9test_02_edit_disk_offeringPASSEDNoneself service 
10test_03_delete_disk_offeringPASSEDNoneself service 
11test_UpdateConfigParamWithScopePASSEDNoneself service 
12test_01_create_isoPASSEDNoneself service 
13test_02_edit_isoPASSEDNoneself service 
14test_03_delete_isoPASSEDNoneself service 
15test_04_extract_IsoFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract iso'}provisioning 
16test_05_iso_permissionsPASSEDNoneself service 
17test_06_copy_isoSKIPPEDNoneprovisioning 
18test_nic_secondaryip_add_removePASSEDNoneself service 
19test_01_nicFAILEDException during NIC test!: 'TestNic' object has no attribute 'account'test/config issuechange test tag to run only in advanced zone
20test_createPortablePublicIPRangePASSEDNoneself service 
21test_01_primary_storage_iscsiFAILEDCheck storage pool type self servicetest fix
22test_01_primary_storage_nfsPASSEDNoneself service 
23test_createRegionPASSEDNoneself service 
24test_01_reset_vm_on_rebootPASSEDNoneself service 
25test_01_router_internal_basicSKIPPEDNoneprovisioning 
26test_01_scale_vmFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'This operation not permitted for this hypervisor of the vm'}provisioning 
27test_01_sys_vm_startPASSEDNoneself service 
28test_02_sys_template_readyPASSEDNoneself service 
29test_01_create_service_offeringPASSEDNoneself service 
30test_02_edit_service_offeringPASSEDNoneself service 
31test_03_delete_service_offeringPASSEDNoneself service 
32test_01_list_sec_storage_vmPASSEDNoneself service 
33test_02_list_cpvm_vmPASSEDNoneself service 
34test_03_ssvm_internalsSKIPPEDNoneprovisioning 
35test_04_cpvm_internalsSKIPPEDNoneprovisioning 
36test_05_stop_ssvmSKIPPEDNoneprovisioning 
37test_06_stop_cpvmSKIPPEDNoneprovisioning 
38test_07_reboot_ssvmSKIPPEDNoneprovisioning 
39test_08_reboot_cpvmSKIPPEDNoneprovisioning 
40test_09_destroy_ssvmSKIPPEDNoneprovisioning 
41test_10_destroy_cpvmSKIPPEDNoneprovisioning 
42test_02_edit_templatePASSEDNoneself service 
43test_03_delete_templatePASSEDNoneself service 
44test_04_extract_templateFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}provisioning 
45test_05_template_permissionsPASSEDNoneself service 
46test_06_copy_templateSKIPPEDNoneprovisioning 
47test_07_list_public_templatesPASSEDNoneself service 
48test_08_list_system_templatesPASSEDNoneself service 
49test_deploy_vmPASSEDNoneself service 
50test_01_stop_vmPASSEDNoneself service 
51test_02_start_vmPASSEDNoneself service 
52test_03_reboot_vmPASSEDNoneself service 
53test_06_destroy_vmPASSEDNoneself service 
54test_07_restore_vmPASSEDNoneself service 
55test_08_migrate_vmSKIPPEDNoneprovisioning 
56test_09_expunge_vmPASSEDNoneself service 
57test_10_attachAndDetach_isoFAILEDSSH failed for virtual machine: 60.147.41.9 - SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
58test_01_create_volumeFAILEDSSH access failed for VM 60.147.41.6 - SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
59test_02_attach_volumeFAILEDSSH failed for VM: 60.147.41.6 - SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
60test_03_download_attached_volumePASSEDNoneself service 
61test_04_delete_attached_volumePASSEDNoneself service 
62test_05_detach_volumePASSEDNoneself service 
63test_06_download_detached_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract volume'}provisioning 
64test_07_resize_failFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Cloudstack currently only supports volumes marked as KVM or XenServer hypervisor for resize'}provisioning 
65test_08_resize_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Cloudstack currently only supports volumes marked as KVM or XenServer hypervisor for resize'}provisioning 
66test_09_delete_detached_volumePASSEDNoneself service 
      
 Total time(in min)56.39521667   

Regression Test Report - Basic Zone:

 

Sl. No.test casestatusError DescriptionTypeComments
1test_01_create_accountPASSEDNoneself service 
2test_01_add_vm_to_subdomainPASSEDNoneself service 
3test_01_non_root_admin_PrivilegesPASSEDNoneself service 
4test_01_user_remove_VM_runningPASSEDNoneself service 
5test_01_service_offering_hierarchyPASSEDNoneself service 
6test_01_service_offering_siblingsPASSEDNoneself service 
7ContextSuite context=TestTemplateHierarchy>:setupFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}provisioning 
8test_updateAdminDetailsPASSEDNoneself service 
9test_updateDomainAdminDetailsPASSEDNoneself service 
10test_updateUserDetailsPASSEDNoneself service 
11test_LoginApiDomainPASSEDNoneself service 
12test_LoginApiUuidResponsePASSEDNoneself service 
13ContextSuite context=TestFailureScenariosAddNetworkToVM>:setupSKIPPEDNoneNot Run 
14test_01_deploy_vm_another_userPASSEDNoneself service 
15test_02_create_aff_grp_userPASSEDNoneself service 
16test_03_list_aff_grp_all_usersPASSEDNoneself service 
17test_04_list_all_admin_aff_grpPASSEDNoneself service 
18test_05_list_all_users_aff_grpPASSEDNoneself service 
19test_06_list_all_users_aff_grp_by_idPASSEDNoneself service 
20test_07_delete_aff_grp_of_other_userPASSEDNoneself service 
21test_01_admin_create_aff_grpPASSEDNoneself service 
22test_02_doadmin_create_aff_grpPASSEDNoneself service 
23test_03_user_create_aff_grpPASSEDNoneself service 
24test_04_user_create_aff_grp_existing_namePASSEDNoneself service 
25test_05_create_aff_grp_same_name_diff_accPASSEDNoneself service 
26test_06_create_aff_grp_nonexisting_typePASSEDNoneself service 
27test_01_delete_aff_grp_by_namePASSEDNoneself service 
28test_02_delete_aff_grp_for_accPASSEDNoneself service 
29test_03_delete_aff_grp_with_vmsPASSEDNoneself service 
30test_05_delete_aff_grp_idPASSEDNoneself service 
31test_06_delete_aff_grp_namePASSEDNoneself service 
32test_08_delete_aff_grp_by_idPASSEDNoneself service 
33test_09_delete_aff_grp_root_adminPASSEDNoneself service 
34test_01_deploy_vm_without_aff_grpPASSEDNoneself service 
35test_02_deploy_vm_by_aff_grp_namePASSEDNoneself service 
36test_03_deploy_vm_by_aff_grp_idPASSEDNoneself service 
37test_04_deploy_vm_anti_affinity_groupFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-8ad687c5-2af6-4b80-adc1-3ddc3c33d4c2], Please check the affinity groups provided, there may not be sufficient capacity to follow them'}self serviceadd enough hosts
38test_05_deploy_vm_by_idFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-e57ae7c4-7db9-4e3f-aeb7-4bfaf78983dd], Please check the affinity groups provided, there may not be sufficient capacity to follow them'}self serviceadd enough hosts
39test_06_deploy_vm_aff_grp_of_other_user_by_namePASSEDNoneself service 
40test_07_deploy_vm_aff_grp_of_other_user_by_idPASSEDNoneself service 
41test_08_deploy_vm_multiple_aff_grpsPASSEDNoneself service 
42test_09_deploy_vm_multiple_aff_grpsFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-85503541-e176-4a9e-80a3-d25e7db164e4], Please check the affinity groups provided, there may not be sufficient capacity to follow them'}self serviceadd enough hosts
43test_10_deploy_vm_by_aff_grp_name_and_idPASSEDNoneself service 
44test_01_list_aff_grps_for_vmPASSEDNoneself service 
45test_02_list_multiple_aff_grps_for_vmPASSEDNoneself service 
46test_03_list_aff_grps_by_idPASSEDNoneself service 
47test_04_list_aff_grps_by_namePASSEDNoneself service 
48test_05_list_aff_grps_by_non_existing_idPASSEDNoneself service 
49test_06_list_aff_grps_by_non_existing_namePASSEDNoneself service 
50test_07_list_all_vms_in_aff_grpPASSEDNoneself service 
51test_01_update_aff_grp_by_idsFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-9f918f00-26ca-4677-b051-44e2baec4d7c], Please check the affinity groups provided, there may not be sufficient capacity to follow them'}self serviceadd enough hosts
52test_02_update_aff_grp_by_namesFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-ee4de048-870f-44fa-892d-c958cbb3e427], Please check the affinity groups provided, there may not be sufficient capacity to follow them'}self serviceadd enough hosts
53test_03_update_aff_grp_for_vm_with_no_aff_grpFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Unable to start a VM due to insufficient capacity'}self serviceadd enough hosts
54test_04_update_aff_grp_remove_allSKIPPEDNoneNot Run 
55test_05_update_aff_grp_on_running_vmPASSEDNoneself service 
56test_baremetalFAILEDExecute cmd: createnetwork failed, due to: errorCode: 431, errorText:Can't have more than one Guest network in zone with network type Basictest/config issuerevisit this and fix tags if required
57test_01_deploy_instance_with_is_volatile_offeringPASSEDNoneself service 
58test_02_reboot_instance_with_is_volatile_offeringPASSEDNoneself service 
59test_03_restore_vm_with_new_templatePASSEDNoneself service 
60test_04_reoccuring_snapshot_rulesFAILEDException not raisedself servicelooks like a product bug, reverify
61test_01_create_templateFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}provisioning 
62test_01_check_template_sizeFAILEDTemplate instance has no attribute 'size'provisioning 
63test_02_check_size_snapshotTemplateFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'}provisioning 
64test_03_reuse_template_nameFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'}provisioning 
65test_01_custom_hostname_instancename_falsePASSEDNoneself service 
66test_01_user_provided_hostnameSKIPPEDNoneNot Run 
67test_02_instancename_from_default_configurationSKIPPEDNoneNot Run 
68test_03_duplicate_nameSKIPPEDNoneNot Run 
69test_04_edit_display_namePASSEDNoneself service 
70test_05_unsupported_chars_in_display_namePASSEDNoneself service 
71test_deployvm_userdata_postFAILEDNo JSON object could be decodedprovisioning 
72test_authorizeIngressRuleFAILEDSSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
73test_01_default_group_with_egressFAILEDSSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
74test_01_default_group_with_egressFAILEDSSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
75test_deployVM_InDefaultSecurityGroupPASSEDNoneself service 
76test_invalid_account_authroizePASSEDNoneself service 
77test_invalid_parametersPASSEDNoneself service 
78test_multiple_account_egress_rule_positiveFAILEDSSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
79test_multiple_account_egress_rule_negativeFAILEDSSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
80test_revoke_egress_ruleFAILEDSSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
81test_start_stop_vm_egressFAILEDSSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
82test_01_deploy_vm_with_explicit_dedicationSKIPPEDNoneNot Run 
83test_01_deploy_vm_with_implicit_plannerSKIPPEDNoneNot Run 
84test_01_addLdapConfigurationFAILEDaddLdapConfiguration failedself servicefix test data
85test_01_add_ip_same_cidrPASSEDNoneself service 
86test_02_add_ip_diff_cidrPASSEDNoneself service 
87test_03_del_ip_rangePASSEDNoneself service 
88test_04_add_noncontiguous_ip_rangePASSEDNoneself service 
89test_05_add_overlapped_ip_rangePASSEDNoneself service 
90test_06_add_ip_range_overlapped_with_two_rangesPASSEDNoneself service 
91test_07_add_iprange_supersetPASSEDNoneself service 
92test_08_add_iprange_subsetPASSEDNoneself service 
93ContextSuite context=TestProjectCreationNegative>:setupSKIPPEDNoneNot Run 
94test_add_user_to_projectPASSEDNoneself service 
95ContextSuite context=TestProjectInviteRequiredTrue>:setupSKIPPEDNoneNot Run 
96ContextSuite context=TestProjectInviteTimeout>:setupSKIPPEDNoneNot Run 
97test_admin_project_creationPASSEDNoneself service 
98test_01_project_limitsPASSEDNoneself service 
99test_02_project_limits_normal_userPASSEDNoneself service 
100test_03_vm_per_projectPASSEDNoneself service 
101test_05_snapshots_per_projectPASSEDNoneself service 
102test_06_volumes_per_projectPASSEDNoneself service 
103test_07_templates_per_projectPASSEDNoneself service 
104test_01_service_offeringsPASSEDNoneself service 
105test_02_project_disk_offeringsPASSEDNoneself service 
106test_08_security_groupPASSEDNoneself service 
107test_06_create_snapshots_in_projectPASSEDNoneself service 
108test_04_public_template_use_in_projectPASSEDNoneself service 
109test_05_use_private_template_in_projectFAILEDExecute cmd: deployvirtualmachine failed, due to: errorCode: 530, errorText:Noneself servicere run
110test_01_ISO_usagePASSEDNoneself service 
111test_01_snapshot_usagePASSEDNoneself service 
112test_01_template_usagePASSEDNoneself service 
113test_01_vm_usagePASSEDNoneself service 
114test_01_volume_usagePASSEDNoneself service 
115test_02_cross_domain_account_addPASSEDNoneself service 
116test_03_delete_account_with_projectPASSEDNoneself service 
117test_04_delete_domain_with_projectPASSEDNoneself service 
118test_01_create_multiple_projects_by_accountPASSEDNoneself service 
119test_05_user_project_owner_promotionPASSEDNoneself service 
120test_06_max_one_project_ownerPASSEDNoneself service 
121test_07_project_resources_account_deletePASSEDNoneself service 
122test_08_cleanup_after_project_deletePASSEDNoneself service 
123test_09_project_suspendPASSEDNoneself service 
124test_10_project_activationPASSEDNoneself service 
125test_createRegionWithExistingRegionIdPASSEDNoneself service 
126test_createRegionWithExistingRegionNamePASSEDNoneself service 
127test_updateRegionPASSEDNoneself service 
128test_createAccountWithUUIDPASSEDNoneself service 
129test_createUserWithUUIDPASSEDNoneself service 
130test_createdomainWithUUIDPASSEDNoneself service 
131ContextSuite context=TestResetSSHKeyUserRights>:setupFAILEDSSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
132ContextSuite context=TestResetSSHKeypair>:setupFAILEDSSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
133test_01_authorizeIngressRuleFAILEDSSH Access failed for 60.147.41.7: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
134test_01_deployVM_InDefaultSecurityGroupPASSEDNoneself service 
135test_02_listSecurityGroupsPASSEDNoneself service 
136test_03_accessInDefaultSecurityGroupPASSEDNoneself service 
137test_01_delete_security_grp_running_vmPASSEDNoneself service 
138test_02_delete_security_grp_withoout_running_vmPASSEDNoneself service 
139test_01_dhcpOnlyRouterFAILEDConnection Failedprovisioning 
140test_01_authorizeIngressRule_AfterDeployVMFAILEDSSH access failed for ingress rule ID: bb72e3c0-5b09-4138-9a49-5f839d229543, SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
141test_02_revokeIngressRule_AfterDeployVMFAILEDSSH access failed for ingress rule ID: c8737ff2-1a4e-42fe-b89c-b99e730fd459, SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
142test_03_stopStartVM_verifyIngressAccessFAILEDSSH access failed for ingress rule ID: 61bdad47-8f6a-47ac-8940-9db4764f2b2fprovisioning 
143test_01_revokeIngressRuleFAILEDSSH Access failed for 60.147.41.7: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
144test_01_deployVMWithUserDataFAILEDSSH Access failed for 60.147.41.7: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
145test_02_accountSnapshotCleanFAILED'simulator'provisioningcheking is_snapshot_on_nfs
146test_01_volume_from_snapshotFAILEDSSH failed for VM: 60.147.41.11provisioning 
147test_03_snapshot_detachedDiskFAILEDSSH failed for VM with IP: 60.147.41.11 - SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
148test_01_snapshot_on_rootVolumeFAILED'simulator'provisioningcheking is_snapshot_on_nfs
149test_01_deploy_ha_vm_startvm_falsePASSEDNoneself service 
150test_02_deploy_ha_vm_from_isoFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-707178ea-d8f8-4401-88a2-e232a4f3f58f]'}self servicere run
151test_03_deploy_ha_vm_iso_startvm_falsePASSEDNoneself service 
152test_deployVmOnGivenHostPASSEDNoneself service 
153test_01_deploy_vm_no_startvmPASSEDNoneself service 
154test_02_deploy_vm_startvm_truePASSEDNoneself service 
155test_03_deploy_vm_startvm_falsePASSEDNoneself service 
156test_04_deploy_startvm_false_attach_volumePASSEDNoneself service 
157test_05_deploy_startvm_false_change_soPASSEDNoneself service 
158test_06_deploy_startvm_attach_detachPASSEDNoneself service 
159test_07_deploy_startvm_attach_isoPASSEDNoneself service 
160test_08_deploy_attached_volumePASSEDNoneself service 
161test_09_stop_vm_migrate_volSKIPPEDNoneNot Run 
162test_deploy_vm_password_enabledFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}provisioning 
163test_upload_attach_volumePASSEDNoneself service 
164test_vm_per_accountPASSEDNoneself service 
165test_01_migrate_vm_with_volumeFAILEDExecute cmd: findhostsformigration failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv onlyprovisioning 
166test_02_migrate_volumeSKIPPEDNoneNot Run 
167test_05_vm_tagPASSEDNoneself service 
168test_06_template_tagPASSEDNoneself service 
169test_07_iso_tagPASSEDNoneself service 
170test_08_volume_tagPASSEDNoneself service 
171test_09_snapshot_tagPASSEDNoneself service 
172test_11_migrate_tagged_vm_delFAILEDlist index out of rangeself servicefix test to check null list
173test_13_tag_case_insensitivePASSEDNoneself service 
174test_14_special_char_mutiple_tagsPASSEDNoneself service 
175test_16_query_tags_other_accountPASSEDNoneself service 
176test_17_query_tags_admin_accountPASSEDNoneself service 
177test_18_invalid_list_parametersPASSEDNoneself service 
178test_19_delete_add_same_tagPASSEDNoneself service 
179test_20_create_tags_multiple_resourcesPASSEDNoneself service 
180test_21_create_tag_stopped_vmPASSEDNoneself service 
181test_22_create_tag_destroyed_vmPASSEDNoneself service 
182test_update_vm_namePASSEDNoneself service 
183test_01_ISO_usagePASSEDNoneself service 
184test_01_snapshot_usagePASSEDNoneself service 
185test_01_template_usagePASSEDNoneself service 
186test_01_vm_usagePASSEDNoneself service 
187test_01_volume_usagePASSEDNoneself service 
188ContextSuite context=TestVMPasswordEnabled>:setupFAILEDSSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
189test_deployVmWithCustomDiskPASSEDNoneself service 
190test_create_volume_under_domainPASSEDNoneself service 
      
 Total Time(in hours)6.096176667   

 

 

  • No labels