Page tree
Skip to end of metadata
Go to start of metadata

Scratch space to brainstorm ideas for improving HDFS test stability

Unit tests

  • Update tests using build/test/data, /tmp, etc. to use correct temp
  • Flaky tests
    • TestDFSStripedOutputStreamWithFailure ( HDFS-11600 - Getting issue details... STATUS )
    • TestWebHdfsTimeouts
    • TestErasureCodingPoliciesWithRandomECPolicy
    • TestErasureCodingPolicies
    • TestDFSStripedOutputStream
    • TestDFSStripedInputStream
    • TestDecommission
    • TestUnsetAndChangeDirectoryEcPolicy
    • TestMaintenanceState
    • TestDataNodeErasureCodingMetrics
    • TestReconstructStripedFile
    • TestReadStripedFileWithDNFailure
  • MiniDFSCluster improvements
    • Reduce the number of threads that get started by MiniDFSCluster
  • Over-reliance on MiniDFSCluster
  • Ignored or skipped tests
    •  TestGlobPaths
    • TestHdfsNativeCodeLoader

    • TestSymlinkHdfsFileSystem

    • TestAppendDifferentChecksum

    • TestDecommission

    • TestDFSUpgrade

    • TestFileConcurrentReader

    • TestParallelReadUtil

    • TestWebHDFSAcl

Branch-2 nightly DNF https://builds.apache.org/view/H-L/view/Hadoop/job/hadoop-qbt-branch2-java7-linux-x86/

Build

 

  • No labels