Automation Results - Release 4.6.0

Updated Date: Sep 9th 2015

No	Configuration	Type	Last Updated Passrate	Current Passrate	Bugs Filed	Comments
1	Simulator Basic	BVT	100	100	NA
2	Simulator Adv	BVT	100	100	NA
3	XS Basic	BVT	96.9	92.2	CLOUDSTACK-8823	8823-SSH failures Bug - check dnsmasq running or not- to be analyzed.
4	XS Adv	BVT	98.1	94.2	CLOUDSTACK-8697 CLOUDSTACK-8823	8697-Internal LB rule to VM fails
5	XS EIP	BVT	97.0	92.6	CLOUDSTACK-8823	8823-SSH failures Bug - check dnsmasq running or not- to be analyzed.
6	KVM Basic	BVT	92.8	91.3	CLOUDSTACK-8823	Bug -check dnsmasq running or not- to be analyzed.
7	KVM Adv	BVT	95.3	92.5	CLOUDSTACK-8823 CLOUDSTACK-8697	8697 -Internal LB rule to VM fails
8	KVM EIP	BVT	94.2	86.6	CLOUDSTACK-8823	8823-SSH failures Bug - check dnsmasq running or not - to be analyzed.
9	VMWare Adv	BVT	96.1	92.3
10	HyperV Adv	BVT	NA	98
11	Simulator Basic	Regression	78.1	83.1
12	Simulator Adv	Regression	91.8	92.5
13	XS Basic	Regression	60.0	62.7
14	XS Adv	Regression	75.6	75.3
15	XS EIP	Regression	33.3	64.7
16	KVM Basic	Regression	55.2	68.1
17	KVM Adv	Regression	71.0	75.0
18	KVM EIP	Regression	48.2	58.7
19	VMWare Adv	Regression	72.8	68.4
20	HyperV Adv	Regression	NA	NA	TBD	have an env issue

Failed Tests

Type	Test Suite	Tests Failed	Bugs filed	Comments
BVT	integration.smoke.test_internal_lb.TestInternalLb.test_internallb	1	CLOUDSTACK-8697
BVT	integration.smoke.test_network_acl.TestNetworkACL.test_network_acl	1
BVT	integration.smoke.test_privategw_acl.TestPrivateGwACL.test_privategw_acl	1
BVT	integration.smoke.test_routers.TestRouterServices.test_01_router_internal_basic	1
BVT	integration.smoke.test_snapshots.TestSnapshotRootDisk.test_01_snapshot_root_disk	1
BVT	integration.smoke.test_ssvm.TestSSVMs.test_07_reboot_ssvm	1
BVT	integration.smoke.test_ssvm.TestSSVMs.test_08_reboot_cpvm	1
BVT	integration.smoke.test_vm_life_cycle.TestVMLifeCycle.test_10_attachAndDetach_iso	1
BVT	integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volume_snapshot	1
BVT	integration.smoke.test_volumes.TestCreateVolume.test_01_create_volume	1
BVT	integration.smoke.test_volumes.TestVolumes.test_02_attach_volume	1
BVT	integration.smoke.test_vpc_vpn.TestVpcRemoteAccessVpn.test_vpc_remote_access_vpn	1	CLOUDSTACK-8690
BVT	integration.smoke.test_vpc_vpn.TestVpcSite2SiteVpn.test_vpc_site2site_vpn	1	CLOUDSTACK-8710
Regression	integration.component.test_multiple_ips_per_nic	35
Regression	integration.component.test_vpc_vm_life_cycle	28	CLOUDSTACK-8685
Regression	integration.component.test_escalations_instances	22
Regression	integration.component.test_lb_secondary_ip	20
Regression	integration.component.test_egress_fw_rules	19	CLOUDSTACK-8681
Regression	integration.component.test_affinity_groups	18
Regression	integration.component.test_dynamic_compute_offering	18
Regression	integration.component.test_assign_vm	16
Regression	integration.component.test_persistent_networks	16
Regression	integration.component.test_vpc_network_lbrules	15	CLOUDSTACK-8685
Regression	integration.component.test_vpc	14	CLOUDSTACK-8685
Regression	integration.component.test_escalations_ipaddresses	12
Regression	integration.component.test_escalations_volumes	12
Regression	integration.component.test_ps_limits	12
Regression	integration.component.test_add_remove_network	11
Regression	integration.component.test_escalations_networks	11
Regression	integration.component.test_interop_xd_ccp	10
Regression	integration.component.test_shared_networks	10
Regression	integration.component.test_tags	10
Regression	integration.component.test_vpc_network_pfrules	10	CLOUDSTACK-8685
Regression	integration.component.test_organization_states	8
Regression	integration.component.test_stopped_vm	8
Regression	integration.component.test_vpc_vms_deployment	8	CLOUDSTACK-8685
Regression	integration.component.test_cpu_limits	7
Regression	integration.component.test_project_resources	7
Regression	integration.component.test_snapshots	7
Regression	integration.component.test_vpn_users	7
Regression	integration.component.test_blocker_bugs	6
Regression	integration.component.test_haproxy	6
Regression	integration.component.test_memory_limits	6
Regression	integration.component.test_network_offering	6
Regression	integration.component.test_ps_domain_limits	6
Regression	integration.component.test_resource_limits	6
Regression	integration.component.test_security_groups	6
Regression	integration.component.test_vpc_network	6	CLOUDSTACK-8685
Regression	integration.component.test_vpc_network_staticnatrule	6	CLOUDSTACK-8685
Regression	integration.component.test_vpc_offerings	6	CLOUDSTACK-8685
Regression	integration.component.test_accounts	5
Regression	integration.component.test_cpu_domain_limits	5
Regression	integration.component.test_ip_reservation	5
Regression	integration.component.test_mm_domain_limits	5
Regression	integration.component.test_project_limits	5
Regression	integration.component.test_snapshots_improvement	5
Regression	integration.component.test_egress_rules	4	CLOUDSTACK-8681
Regression	integration.component.test_escalations_templates	4
Regression	integration.component.test_netscaler_lb	4
Regression	integration.component.test_overcommit	4
Regression	integration.component.test_portable_ip	4
Regression	integration.component.test_projects	4
Regression	integration.component.test_ss_limits	4
Regression	integration.component.test_acl_isolatednetwork	3
Regression	integration.component.test_cpu_project_limits	3
Regression	integration.component.test_mm_project_limits	3
Regression	integration.component.test_ps_max_limits	3
Regression	integration.component.test_ps_resize_volume	3
Regression	integration.component.test_redundant_router_cleanups	3
Regression	integration.component.test_regions	3
Regression	integration.component.test_reset_ssh_keypair	3
Regression	integration.component.test_ss_domain_limits	3
Regression	integration.component.test_ss_max_limits	3
Regression	integration.component.test_allocation_states	2
Regression	integration.component.test_base_image_updation	2
Regression	integration.component.test_cpu_max_limits	2
Regression	integration.component.test_escalations_snapshots	2
Regression	integration.component.test_mm_max_limits	2
Regression	integration.component.test_netscaler_configs	2
Regression	integration.component.test_redundant_router_upgrades	2
Regression	integration.component.test_routers	2
Regression	integration.component.test_templates	2
Regression	integration.component.test_vpc_routers	2
Regression	integration.component.test_browse_templates2	1
Regression	integration.component.test_concurrent_snapshots_limit	1
Regression	integration.component.test_deploy_vm_userdata_reg	1
Regression	integration.component.test_escalation_listTemplateDomainAdmin	1
Regression	integration.component.test_escalations_vmware	1
Regression	integration.component.test_implicit_planner	1
Regression	integration.component.test_netscaler_nw_off	1
Regression	integration.component.test_non_contiguous_vlan	1
Regression	integration.component.test_project_configs	1
Regression	integration.component.test_redundant_router_services	1
Regression	integration.component.test_snapshot_limits	1
Regression	integration.component.test_ss_project_limits	1
Regression	integration.component.test_update_vm	1
Regression	integration.component.test_usage	1
Regression	integration.component.test_VirtualRouter_alerts	1
Regression	integration.component.test_vm_passwdenabled	1
Regression	integration.component.test_volumes	1
Regression	integration.component.test_vpc_redundant	1

Space shortcuts

Child pages

Failed Tests