Testing QEMU

Details about how to test QEMU and how it is integrated into our CI testing infrastructure.

• Testing in QEMU
  • Testing with “make check”
    • Unit tests
    • QTest
    • Writing portable test cases
    • QAPI schema tests
    • check-block
  • QEMU iotests
    • Writing a new test case
    • Debugging a test case
    • Test case groups
  • Container based tests
    • Introduction
    • Docker Prerequisites
    • Podman Prerequisites
    • Quickstart
    • Registry
    • Images
    • Tests
    • Debugging a Docker test failure
    • Options
  • Thread Sanitizer
    • Thread Sanitizer in Docker
    • Building and Testing with TSan
    • TSan Suppressions
    • TSan Annotations
  • docker-binfmt-image-debian-% targets
    • Setting up binfmt_misc
    • Example invocation
  • VM testing
    • Quickstart
    • QEMU binaries
    • Make jobs
    • Debugging
    • Manual invocation
    • Adding new guests
  • Image fuzzer testing
  • Functional tests using Python
  • Integration tests using the Avocado Framework
  • Testing with “make check-tcg”
    • Running subset of tests
    • Running individual tests
    • TCG test dependencies
  • Other TCG Tests
    • KVM Unit Tests
    • Linux Test Project
  • GCC gcov support
• QTest Device Emulation Testing Framework
  • Qtest Driver Framework
    • QGraph concepts
    • Creating a new driver and its interface
    • Adding a new test
    • Qgraph API reference
  • QTest Protocol
    • Valid requests
  • libqtest API reference
    • qtest_initf()
    • qtest_vinitf()
    • qtest_init()
    • qtest_init_with_env()
    • qtest_init_with_env_and_capabilities()
    • qtest_init_without_qmp_handshake()
    • qtest_connect()
    • qtest_qmp_handshake()
    • qtest_init_with_serial()
    • qtest_system_reset()
    • qtest_system_reset_nowait()
    • qtest_wait_qemu()
    • qtest_kill_qemu()
    • qtest_quit()
    • qtest_qmp_fds()
    • qtest_qmp()
    • qtest_qmp_send()
    • qtest_qmp_send_raw()
    • qtest_socket_server()
    • qtest_vqmp_fds()
    • qtest_vqmp()
    • qtest_qmp_vsend_fds()
    • qtest_qmp_vsend()
    • qtest_qmp_receive_dict()
    • qtest_qmp_receive()
    • qtest_qmp_set_event_callback()
    • qtest_qmp_eventwait()
    • qtest_qmp_eventwait_ref()
    • qtest_qmp_event_ref()
    • qtest_hmp()
    • qtest_vhmp()
    • qtest_get_irq()
    • qtest_irq_intercept_in()
    • qtest_irq_intercept_out()
    • qtest_irq_intercept_out_named()
    • qtest_set_irq_in()
    • qtest_outb()
    • qtest_outw()
    • qtest_outl()
    • qtest_inb()
    • qtest_inw()
    • qtest_inl()
    • qtest_writeb()
    • qtest_writew()
    • qtest_writel()
    • qtest_writeq()
    • qtest_readb()
    • qtest_readw()
    • qtest_readl()
    • qtest_readq()
    • qtest_memread()
    • qtest_rtas_call()
    • qtest_csr_call()
    • qtest_bufread()
    • qtest_memwrite()
    • qtest_bufwrite()
    • qtest_memset()
    • qtest_clock_step_next()
    • qtest_clock_step()
    • qtest_clock_set()
    • qtest_big_endian()
    • qtest_get_arch()
    • qtest_has_accel()
    • qtest_add_func()
    • qtest_add_data_func()
    • qtest_add_data_func_full()
    • qtest_add
    • qtest_add_abrt_handler()
    • qtest_remove_abrt_handler()
    • qtest_vqmp_assert_success_ref()
    • qtest_vqmp_assert_success()
    • qtest_vqmp_fds_assert_success_ref()
    • qtest_vqmp_fds_assert_success()
    • qtest_qmp_assert_failure_ref()
    • qtest_vqmp_assert_failure_ref()
    • qtest_qmp_assert_success_ref()
    • qtest_qmp_assert_success()
    • qtest_qmp_fds_assert_success_ref()
    • qtest_qmp_fds_assert_success()
    • qtest_cb_for_every_machine()
    • qtest_resolve_machine_alias()
    • qtest_has_machine()
    • qtest_has_machine_with_env()
    • qtest_has_cpu_model()
    • qtest_has_device()
    • qtest_qmp_device_add_qdict()
    • qtest_qmp_device_add()
    • qtest_qmp_add_client()
    • qtest_qmp_device_del_send()
    • qtest_qmp_device_del()
    • qtest_probe_child()
    • qtest_set_expected_status()
    • qtest_qom_set_bool()
    • qtest_qom_get_bool()
    • qtest_pid()
    • have_qemu_img()
    • mkimg()
• Functional testing with Python
  • Running tests
  • Logging
  • Introduction to writing tests
    • The qemu_test.QemuSystemTest base test class
  • QEMUMachine
    • QEMU binary selection
    • Debugging hung QEMU
  • Attribute reference
    • QemuBaseTest
    • QemuUserTest
    • QemuSystemTest
  • Asset handling
  • Skipping tests
    • QEMU_TEST_ALLOW_LARGE_STORAGE
    • QEMU_TEST_ALLOW_UNTRUSTED_CODE
    • QEMU_TEST_FLAKY_TESTS
    • QEMU_TEST_ALLOW_SLOW
• Integration testing with Avocado
  • Running tests
  • Manual Installation
  • Overview
    • The avocado_qemu.QemuSystemTest base test class
    • The avocado_qemu.LinuxTest base test class
  • QEMUMachine
    • QEMU binary selection
  • Attribute reference
    • Test
    • LinuxTest
  • Parameter reference
    • Test
    • LinuxTest
  • Skipping tests
    • AVOCADO_ALLOW_LARGE_STORAGE
    • SPEED
    • AVOCADO_ALLOW_UNTRUSTED_CODE
    • AVOCADO_TIMEOUT_EXPECTED
    • QEMU_TEST_FLAKY_TESTS
  • Uninstalling Avocado
• ACPI/SMBIOS testing using biosbits
  • Introduction
  • Description of the test framework
• CI
  • Definition of terms
    • Automated tests
    • Unit testing
    • Functional testing
    • System testing
    • Flaky tests
    • Gating
    • Continuous Integration (CI)
    • References
  • Custom CI/CD variables
    • Set variable globally in the user’s CI namespace
    • Set variable manually when pushing a branch or tag to the user’s repository
    • Setting aliases in your git config
    • Variable naming and grouping
    • Maintainer controlled job variables
    • Contributor controlled runtime variables
    • Other misc variables
  • Jobs on Custom Runners
    • Machine Setup Howto
• Fuzzing
  • Basics
  • Building the fuzzers
  • Useful libFuzzer flags
  • Generating Coverage Reports
  • Adding a new fuzzer
  • The Generic Fuzzer
  • OSS-Fuzz
  • Building Crash Reproducers
  • Implementation Details / Fuzzer Lifecycle
• Block I/O error injection using blkdebug
  • Background
  • Rules
  • Events
  • State transitions
  • Suspend and resume
• Block driver correctness testing with blkverify
  • Introduction
  • How it works
  • Example