HADOOP-17596. ABFS: Change default Readahead Queue Depth from num(processors) to const #3106

sumangala-patki · 2021-06-15T10:09:25Z

Contributed by Sumangala Patki.

(cherry picked from commit 76d92eb)

…cessors) to const (apache#2795) . Contributed by Sumangala Patki. (cherry picked from commit 76d92eb)

hadoop-yetus · 2021-06-15T11:24:00Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 38s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 1s		codespell was not available.
+0 🆗	markdownlint	0m 1s		markdownlint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ branch-3.3 Compile Tests _
-1 ❌	mvninstall	30m 30s	/branch-mvninstall-root.txt	root in branch-3.3 failed.
+1 💚	compile	0m 37s		branch-3.3 passed
+1 💚	checkstyle	0m 29s		branch-3.3 passed
+1 💚	mvnsite	0m 40s		branch-3.3 passed
+1 💚	javadoc	0m 32s		branch-3.3 passed
+1 💚	spotbugs	1m 3s		branch-3.3 passed
+1 💚	shadedclient	16m 3s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 31s		the patch passed
+1 💚	compile	0m 28s		the patch passed
+1 💚	javac	0m 28s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	0m 19s		the patch passed
+1 💚	mvnsite	0m 31s		the patch passed
+1 💚	javadoc	0m 22s		the patch passed
+1 💚	spotbugs	1m 2s		the patch passed
+1 💚	shadedclient	15m 57s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	1m 56s		hadoop-azure in the patch passed.
+1 💚	asflicense	0m 35s		The patch does not generate ASF License warnings.
		73m 2s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3106/1/artifact/out/Dockerfile
GITHUB PR	#3106
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell markdownlint
uname	Linux 9bd7642b85c1 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	branch-3.3 / `e888bb3`
Default Java	Private Build-1.8.0_292-8u292-b10-0ubuntu1~18.04-b10
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3106/1/testReport/
Max. process+thread count	617 (vs. ulimit of 5500)
modules	C: hadoop-tools/hadoop-azure U: hadoop-tools/hadoop-azure
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3106/1/console
versions	git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by	Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

sumangala-patki · 2021-06-17T10:52:19Z

TEST RESULTS

HNS Account Location: East US 2
NonHNS Account Location: East US 2, Central US

HNS-OAuth

[INFO] Tests run: 99, Failures: 0, Errors: 0, Skipped: 0
[WARNING] Tests run: 556, Failures: 0, Errors: 0, Skipped: 98
[ERROR] Errors: 
[ERROR]   ITestAbfsReadWriteAndSeek.testReadAndWriteWithDifferentBufferSizesAndSeek:62->testReadWriteAndSeek:78 » TestTimedOut
[ERROR]   ITestAbfsFileSystemContractSecureDistCp>AbstractContractDistCpTest.testDistCpWithIterator:635 » TestTimedOut
[ERROR] Tests run: 265, Failures: 0, Errors: 2, Skipped: 52

HNS-SharedKey

[INFO] Tests run: 99, Failures: 0, Errors: 0, Skipped: 0
[WARNING] Tests run: 556, Failures: 0, Errors: 0, Skipped: 54
[ERROR] Errors: 
[ERROR]   ITestAbfsReadWriteAndSeek.testReadAndWriteWithDifferentBufferSizesAndSeek:62->testReadWriteAndSeek:78 » TestTimedOut
[ERROR]   ITestAbfsFileSystemContractDistCp>AbstractContractDistCpTest.testDistCpWithIterator:635 » TestTimedOut
[ERROR]   ITestAbfsFileSystemContractSecureDistCp>AbstractContractDistCpTest.testDistCpWithIterator:635 » TestTimedOut 
[ERROR] Tests run: 265, Failures: 0, Errors: 3, Skipped: 40

NonHNS-SharedKey

[INFO] Tests run: 99, Failures: 0, Errors: 0, Skipped: 0
[WARNING] Tests run: 556, Failures: 0, Errors: 0, Skipped: 276
[ERROR] Errors: 
[ERROR]   ITestAbfsReadWriteAndSeek.testReadAndWriteWithDifferentBufferSizesAndSeek:62->testReadWriteAndSeek:78 » TestTimedOut
[ERROR]   ITestAbfsFileSystemContractDistCp>AbstractContractDistCpTest.testDistCpWithIterator:635 » TestTimedOut
[ERROR]   ITestAbfsFileSystemContractSecureDistCp>AbstractContractDistCpTest.testDistCpWithIterator:635 » TestTimedOut
[ERROR] Tests run: 265, Failures: 0, Errors: 3, Skipped: 40

Existing JIRAs for tracking the timeout failures: AbstractContractDistCpTest, ITestAbfsReadWriteAndSeek

hadoop-yetus · 2021-06-17T12:29:17Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	9m 37s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	markdownlint	0m 0s		markdownlint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ branch-3.3 Compile Tests _
+1 💚	mvninstall	34m 58s		branch-3.3 passed
+1 💚	compile	0m 37s		branch-3.3 passed
+1 💚	checkstyle	0m 25s		branch-3.3 passed
+1 💚	mvnsite	0m 43s		branch-3.3 passed
+1 💚	javadoc	0m 32s		branch-3.3 passed
+1 💚	spotbugs	1m 2s		branch-3.3 passed
+1 💚	shadedclient	19m 35s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 35s		the patch passed
+1 💚	compile	0m 31s		the patch passed
+1 💚	javac	0m 31s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	0m 18s		the patch passed
+1 💚	mvnsite	0m 35s		the patch passed
+1 💚	javadoc	0m 23s		the patch passed
+1 💚	spotbugs	1m 11s		the patch passed
+1 💚	shadedclient	19m 36s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	1m 59s		hadoop-azure in the patch passed.
+1 💚	asflicense	0m 32s		The patch does not generate ASF License warnings.
		94m 6s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3106/2/artifact/out/Dockerfile
GITHUB PR	#3106
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell markdownlint
uname	Linux 74028626e844 4.15.0-136-generic #140-Ubuntu SMP Thu Jan 28 05:20:47 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	branch-3.3 / `5ab045b`
Default Java	Private Build-1.8.0_292-8u292-b10-0ubuntu1~18.04-b10
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3106/2/testReport/
Max. process+thread count	513 (vs. ulimit of 5500)
modules	C: hadoop-tools/hadoop-azure U: hadoop-tools/hadoop-azure
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3106/2/console
versions	git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by	Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

surendralilhore · 2021-07-10T09:39:03Z

+1

…from num(processors) to const (apache#3106) Contributed by Sumangala Patki. (cherry picked from commit 76d92eb) Change-Id: I8f478547efb58de78fa4419e65e70be5a22ab5e6

HADOOP-17596. ABFS: Change default Readahead Queue Depth from num(pro…

e888bb3

…cessors) to const (apache#2795) . Contributed by Sumangala Patki. (cherry picked from commit 76d92eb)

trigger yetus

5ab045b

sumangala-patki marked this pull request as ready for review June 18, 2021 05:15

surendralilhore merged commit aa6a9ca into apache:branch-3.3 Jul 10, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

HADOOP-17596. ABFS: Change default Readahead Queue Depth from num(processors) to const #3106

HADOOP-17596. ABFS: Change default Readahead Queue Depth from num(processors) to const #3106

sumangala-patki commented Jun 15, 2021

hadoop-yetus commented Jun 15, 2021

sumangala-patki commented Jun 17, 2021

hadoop-yetus commented Jun 17, 2021

surendralilhore commented Jul 10, 2021

HADOOP-17596. ABFS: Change default Readahead Queue Depth from num(processors) to const #3106

HADOOP-17596. ABFS: Change default Readahead Queue Depth from num(processors) to const #3106

Conversation

sumangala-patki commented Jun 15, 2021

hadoop-yetus commented Jun 15, 2021

sumangala-patki commented Jun 17, 2021

hadoop-yetus commented Jun 17, 2021

surendralilhore commented Jul 10, 2021