This Confluence has been LDAP enabled, if you are an ASF Committer, please use your LDAP Credentials to login. Any problems file an INFRA jira ticket please.

Child pages
  • Test Categories and Quick-test in Marvin
Skip to end of metadata
Go to start of metadata

This page describes how to use newly introduced categories and the quick-test label with when running marvin tests

 

Quick-test

The label spells 'quick-test' and it's idea is to run a set of tests from the smoke tests that would guarantee the build is good for any further testing. It aims to solve the 24h+ test execution time of regular smoke test run by giving a quick results to the developer in less than 2h run (in Trillian env this test execution takes about 1.5h) 

Usage: 

nosetests --with-marvin --marvin-config=[config] --hypervisor=xenserver -a tags=quick-test [file(s)]

Categories

The marvin tests within the integration directory has been categorized in the following categories:

  • accounts

  • deploy-vm

  • roles
  • service-offerings
  • storage
  • routers
  • networks
  • usage
  • templates
  • vpc

Here's list of test groups per category: 

Accounts

component/test_acl_isolatednetwork.py
component/test_acl_isolatednetwork_delete.py
component/test_acl_listsnapshot.py
component/test_acl_listvm.py
component/test_acl_listvolume.py
component/test_acl_sharednetwork.py
component/test_acl_sharednetwork_deployVM-impersonation.py
component/test_ldap.py
component/test_ldap_auto_import.py

deploy-vm

smoke/test_deploy_vgpu_enabled_vm.py
smoke/test_deploy_virtio_scsi_vm.py
smoke/test_deploy_vm_iso.py
smoke/test_deploy_vm_root_resize.py
smoke/test_deploy_vm_with_userdata.py
smoke/test_deploy_vms_with_varied_deploymentplanners.py
smoke/test_list_ids_parameter.py
smoke/test_multipleips_per_nic.py
smoke/test_nested_virtualization.py
smoke/test_network_acl.py
smoke/test_nic.py
smoke/test_nic_adapter_type.py
smoke/test_password_server.py
smoke/test_primary_storage.py
smoke/test_privategw_acl.py
smoke/test_reset_vm_on_reboot.py
smoke/test_scale_vm.py
smoke/test_secondary_storage.py
smoke/test_service_offerings.py
smoke/test_ssvm.py
smoke/test_usage_events.py
smoke/test_vm_life_cycle.py
smoke/test_vm_snapshots.py
smoke/test_volumes.py
smoke/test_vpc_vpn.py
component/test_deploy_vgpu_vm.py
component/test_deploy_vm_userdata_multi_nic.py
component/test_deploy_vm_userdata_reg.py
component/test_stopped_vm.py
component/test_vm_passwdenabled.py
component/test_vpc_vm_life_cycle.py

 

 

routers

component/test_VirtualRouter_alerts.py
component/test_egress_fw_rules.py
component/test_egress_rules.py
component/test_escalations_routers.py
component/test_ip_reservation.py
component/test_routers.py
component/test_vpc_routers.py
smoke/test_internal_lb.py
smoke/test_loadbalance.py
smoke/test_multipleips_per_nic.py
smoke/test_nic_adapter_type.py
smoke/test_router_dhcphosts.py
smoke/test_router_dns.py
smoke/test_routers.py
smoke/test_routers_iptables_default_policy.py
smoke/test_routers_network_ops.py

networks

component/test_acl_isolatednetwork.py
component/test_acl_isolatednetwork_delete.py
component/test_acl_sharednetwork.py
component/test_acl_sharednetwork_deployVM-impersonation.py
component/test_add_remove_network.py
component/test_advancedsg_networks.py
component/test_dhcp_dns_offload.py
component/test_egress_fw_rules.py
component/test_egress_rules.py
component/test_escalations_networks.py
component/test_invalid_gw_nm.py
component/test_ip_reservation.py
component/test_lb_secondary_ip.py
component/test_multiple_ip_ranges.py
component/test_multiple_ips_per_nic.py
component/test_multiple_public_interfaces.py
component/test_non_contiguous_vlan.py
component/test_persistent_networks.py
component/test_portable_ip.py
component/test_redundant_router_cleanups.py
component/test_redundant_router_services.py
component/test_redundant_router_upgrades.py
component/test_region_vpc.py
component/test_shared_networks.py
component/test_vpc.py
component/test_vpc_distributed_routing_offering.py
component/test_vpc_network.py
component/test_vpc_network_internal_lbrules.py
component/test_vpc_network_lbrules.py
component/test_vpc_network_pfrules.py
component/test_vpc_network_staticnatrule.py
component/test_vpc_routers.py
component/test_vpc_vm_life_cycle.py
component/test_vpc_vms_deployment.py
component/test_vpn_service.py
component/test_vpn_users.py
smoke/test_guest_vlan_range.py
smoke/test_internal_lb.py
smoke/test_loadbalance.py
smoke/test_network.py
smoke/test_network_acl.py
smoke/test_non_contigiousvlan.py
smoke/test_privategw_acl.py
smoke/test_public_ip_range.py
smoke/test_pvlan.py
smoke/test_router_dhcphosts.py
smoke/test_router_dns.py
smoke/test_routers_iptables_default_policy.py
smoke/test_routers_network_ops.py

 

roles

smoke/test_dynamicroles.py
smoke/test_staticroles.py

 

 

vpc

component/maint/test_vpc.py
component/maint/test_vpc_host_maintenance.py
component/maint/test_vpc_on_host_maintenance.py
component/test_vpc.py
component/test_vpc_distributed_routing_offering.py
component/test_vpc_network.py
component/test_vpc_network_internal_lbrules.py
component/test_vpc_network_lbrules.py
component/test_vpc_network_pfrules.py
component/test_vpc_network_staticnatrule.py
component/test_vpc_offerings.py
component/test_vpc_routers.py
component/test_vpc_vm_life_cycle.py
component/test_vpc_vms_deployment.py
smoke/test_network_acl.py
smoke/test_privategw_acl.py
smoke/test_vpc_redundant.py
smoke/test_vpc_router_nics.py
smoke/test_vpc_vpn.py

service-offerings

component/test_dynamic_compute_offering.py
component/test_network_offering.py
component/test_vpc_distributed_routing_offering.py
component/test_vpc_offerings.py
smoke/test_disk_offerings.py
smoke/test_service_offerings.py
testpaths/testpath_custom_disk_offering.py

storage

component/maint/test_ha_pool_maintenance.py
component/maint/test_zone_level_local_storage_setting.py
component/test_migrate_vol_to_maintained_pool.py
component/test_ps_domain_limits.py
component/test_ps_limits.py
component/test_ps_max_limits.py
component/test_ps_project_limits.py
component/test_ps_resize_volume.py
component/test_ps_resource_limits_volume.py
component/test_ss_domain_limits.py
component/test_ss_limits.py
component/test_ss_max_limits.py
component/test_ss_project_limits.py
component/test_storage_motion.py
smoke/test_metrics_api.py
smoke/test_over_provisioning.py
smoke/test_primary_storage.py
smoke/test_secondary_storage.py
testpaths/testpath_storage_migration.py

usage

component/test_usage.py
smoke/test_usage_events.py

Usage: 

nosetests --with-marvin --marvin-config=[config] --hypervisor=xenserver -a tags=[category] [file(s)]

Further readings:

Marvin - Testing with Python

Writing tests with nose

CLOUDSTACK-10017 - Getting issue details... STATUS