|author||lordcheng10 <firstname.lastname@example.org>||Wed Jul 31 17:25:37 2019 +0800|
|committer||Jason Gustafson <email@example.com>||Wed Jul 31 02:25:37 2019 -0700|
KAFKA-8722; Ensure record CRC is always verified when appending to log (#7124) We found that when record.offset is not equal to the offset we are expecting, kafka will set the variable inPlaceAssignment to false. When inPlaceAssignment is false, data will not be verified. This patch adds the missing CRC verification. Reviewers: Jason Gustafson <firstname.lastname@example.org>
See our web site for details on the project.
Kafka requires Gradle 2.0 or higher.
Java 7 should be used for building in order to support both Java 7 and Java 8 at runtime.
cd kafka_source_dir gradle
Now everything else will work.
Follow instructions in http://kafka.apache.org/documentation.html#quickstart
./gradlew javadoc ./gradlew javadocJar # builds a javadoc jar for each module ./gradlew scaladoc ./gradlew scaladocJar # builds a scaladoc jar for each module ./gradlew docsJar # builds both (if applicable) javadoc and scaladoc jars for each module
./gradlew cleanTest test
./gradlew -Dtest.single=RequestResponseSerializationTest core:test
./gradlew core:test --tests kafka.api.ProducerFailureHandlingTest.testCannotSendToInternalTopic ./gradlew clients:test --tests org.apache.kafka.clients.MetadataTest.testMetadataUpdateWaitTime
Change the log4j setting in either
./gradlew -i -Dtest.single=RequestResponseSerializationTest core:test
./gradlew clean ./gradlew releaseTarGz
The above command will fail if you haven't set up the signing key. To bypass signing the artifact, you can run:
./gradlew releaseTarGz -x signArchives
The release file can be found inside
Note that if building the jars with a version other than 2.10.6, you need to set the
SCALA_VERSION variable or change it in
bin/kafka-run-class.sh to run the quick start.
You can pass either the major version (eg 2.11) or the full version (eg 2.11.8):
./gradlew -PscalaVersion=2.11 jar ./gradlew -PscalaVersion=2.11 test ./gradlew -PscalaVersion=2.11 releaseTarGz
This is for
./gradlew core:jar ./gradlew core:test
Note that this is not strictly necessary (IntelliJ IDEA has good built-in support for Gradle projects, for example).
./gradlew eclipse ./gradlew idea
Please note for this to work you should create/update
~/.gradle/gradle.properties) and assign the following variables
mavenUrl= mavenUsername= mavenPassword= signing.keyId= signing.password= signing.secretKeyRingFile=
./gradlew core:dependencies --configuration runtime
./gradlew checkstyleMain checkstyleTest
This will most commonly be useful for automated builds where the full resources of the host running the build and tests may not be dedicated to Kafka's build.
The following options should be set with a
-D switch, for example
./gradlew -Dorg.gradle.project.maxParallelForks=1 test.
commitId: sets the build commit ID as .git/HEAD might not be correct if there are local commits added for build purposes.
org.gradle.project.mavenUrl: sets the URL of the maven deployment repository (
file://path/to/repocan be used to point to a local repository).
org.gradle.project.maxParallelForks: limits the maximum number of processes for each task.
org.gradle.project.showStandardStreams: shows standard out and standard error of the test JVM(s) on the console.
org.gradle.project.skipSigning: skips signing of artifacts.
org.gradle.project.testLoggingEvents: unit test events to be logged, separated by comma. For example
./gradlew -Dorg.gradle.project.testLoggingEvents=started,passed,skipped,failed test
To contribute follow the instructions here: