tag | 353cd2068474f4d7cb21f34d960fc23b4d2eefd1 | |
---|---|---|
tagger | penghui <penghui@apache.org> | Tue Jun 08 13:03:21 2021 +0800 |
object | 63126b9d6606863c1b889f75737623e1fa9e1638 |
Release v2.8.0-candidate-2
commit | 63126b9d6606863c1b889f75737623e1fa9e1638 | [log] [tgz] |
---|---|---|
author | Matteo Merli <mmerli@apache.org> | Mon Jun 07 22:02:00 2021 -0700 |
committer | penghui <penghui@apache.org> | Tue Jun 08 13:02:17 2021 +0800 |
tree | bea83116e17caa4bd3ca018fce6608a10351368c | |
parent | 73172334d15e29b7755e5792d7c577f48e54554d [diff] |
Revert "[Issue 8751] Update Dockerfile for Pulsar and Dashboard to Cr… (#10861) This reverts commit 4264a67a84d9a9f4a49cebc591c46b252dcf4e45. ### Motivation The change https://github.com/apache/pulsar/pull/8796 has broken the Pulsar Functions running on Kubernetes. The Pulsar Functions Kubernetes runtime generates a secret and mounts it using mode `256`. That means the secret is only able to read by the user. The StatefulSet created by Kubernetes runtime mounts the secrets under the `root` user. Hence only the root user is able to read the secret. This results in any functions submitted will fail to read the authentication information. Because all the Kubernetes resources generated by the Kubernetes runtime are hardcoded. There is no easy way to change the security context for the function statefulsets. Let's revert this change for 2.8.0, until we can address the issues in the Kubernetes runtime. (cherry picked from commit 4f556a2ce5b277abbac47cbaf571d4502553f994)
Pulsar is a distributed pub-sub messaging platform with a very flexible messaging model and an intuitive client API.
Learn more about Pulsar at https://pulsar.apache.org
This repository is the main repository of Apache Pulsar. Pulsar PMC also maintains other repositories for components in the Pulsar ecosystem, including connectors, adapters, and other language clients.
Requirements:
Compile and install:
$ mvn install -DskipTests
mvn install -Pcore-modules,-main
Run Unit Tests:
$ mvn test
Run Individual Unit Test:
$ cd module-name (e.g: pulsar-client) $ mvn test -Dtest=unit-test-name (e.g: ConsumerBuilderImplTest)
Run Selected Test packages:
$ cd module-name (e.g: pulsar-broker) $ mvn test -pl module-name -Dinclude=org/apache/pulsar/**/*.java
Start standalone Pulsar service:
$ bin/pulsar standalone
Check https://pulsar.apache.org for documentation and examples.
Docker images must be built with Java 8 for branch-2.7
or previous branches because of issue 8445. Java 11 is the recommended JDK version in master
/branch-2.8
.
This builds the docker images apachepulsar/pulsar-all:latest
and apachepulsar/pulsar:latest
.
mvn clean install -DskipTests mvn package -Pdocker,-main -am -pl docker/pulsar-all -DskipTests
After the images are built, they can be tagged and pushed to your custom repository. Here's an example of a bash script that tags the docker images with the current version and git revision and pushes them to localhost:32000/apachepulsar
.
image_repo_and_project=localhost:32000/apachepulsar pulsar_version=$(mvn initialize help:evaluate -Dexpression=project.version -pl . -q -DforceStdout) gitrev=$(git rev-parse HEAD | colrm 10) tag="${pulsar_version}-${gitrev}" echo "Using tag $tag" docker tag apachepulsar/pulsar-all:latest ${image_repo_and_project}/pulsar-all:$tag docker push ${image_repo_and_project}/pulsar-all:$tag docker tag apachepulsar/pulsar:latest ${image_repo_and_project}/pulsar:$tag docker push ${image_repo_and_project}/pulsar:$tag
Apache Pulsar is using lombok so you have to ensure your IDE setup with required plugins.
Open Project Settings.
Click File -> Project Structure -> Project Settings -> Project.
Select the JDK version.
From the JDK version drop-down list, select Download JDK... or choose an existing recent Java 11 JDK version.
In the download dialog, select version 11. You can pick a version from many vendors. Unless you have a specific preference, choose AdoptOpenJDK (Hotspot).
Open Maven Importing Settings dialog by going to Settings -> Build, Execution, Deployment -> Build Tools -> Maven -> Importing.
Choose Use Project JDK for JDK for Importer setting. This uses the Java 11 JDK for running Maven when importing the project to IntelliJ. Some of the configuration in the Maven build is conditional based on the JDK version. Incorrect configuration gets chosen when the “JDK for Importer” isn't the same as the “Project JDK”.
Validate that the JRE setting in Maven -> Runner dialog is set to Use Project JDK.
Open Annotation Processors Settings dialog box by going to Settings -> Build, Execution, Deployment -> Compiler -> Annotation Processors.
Select the following buttons:
Set the generated source directories to be equal to the Maven directories:
Click OK.
Install the lombok plugin in intellij.
Open Code Style Settings dialog box by going to Settings -> Editor -> Code Style.
Click on the :gear: symbol -> Import scheme -> Intellij IDEA code style XML
Pick the file ${pulsar_dir}/src/idea-code-style.xml
On the dialog box that opens, click OK.
Ensure the scheme you just created is selected in Scheme dropdown then click OK.
Install the Checkstyle-IDEA plugin.
Open Checkstyle Settings dialog box by going to Settings -> Tools -> Checkstyle.
Set Checkstyle version to 8.37.
Set Scan scope to Only Java sources (including tests).
Click + button in the Configuration section to open a dialog to choose the checkfile file.
Activate the configuration you just added by toggling the corresponding box.
Click OK.
When working on the Pulsar core modules in IntelliJ, reduce the number of active projects in IntelliJ to speed up IDE actions and reduce unrelated IDE warnings.
Run the “Generate Sources and Update Folders For All Projects” action from the Maven UI toolbar. You can also find the action by the name in the IntelliJ “Search Everywhere” window that gets activated by pressing the Shift key twice. Running the action takes about 10 minutes for all projects. This is faster when the “core-modules” profile is the only active profile.
In the case of compilation errors with missing Protobuf classes, ensure to run the “Generate Sources and Update Folders For All Projects” action.
All of the Pulsar source code doesn't compile properly in IntelliJ and there are compilation errors.
mvn test -Dtest=TestClassName
command.Follow the instructions here to configure your Eclipse setup.
Refer to the docs README.
Name | Scope | |||
---|---|---|---|---|
users@pulsar.apache.org | User-related discussions | Subscribe | Unsubscribe | Archives |
dev@pulsar.apache.org | Development-related discussions | Subscribe | Unsubscribe | Archives |
Pulsar slack channel at https://apache-pulsar.slack.com/
You can self-register at https://apache-pulsar.herokuapp.com/
Licensed under the Apache License, Version 2.0: http://www.apache.org/licenses/LICENSE-2.0
This distribution includes cryptographic software. The country in which you currently reside may have restrictions on the import, possession, use, and/or re-export to another country, of encryption software. BEFORE using any encryption software, please check your country's laws, regulations and policies concerning the import, possession, or use, and re-export of encryption software, to see if this is permitted. See http://www.wassenaar.org/ for more information.
The U.S. Government Department of Commerce, Bureau of Industry and Security (BIS), has classified this software as Export Commodity Control Number (ECCN) 5D002.C.1, which includes information security software using or performing cryptographic functions with asymmetric algorithms. The form and manner of this Apache Software Foundation distribution makes it eligible for export under the License Exception ENC Technology Software Unrestricted (TSU) exception (see the BIS Export Administration Regulations, Section 740.13) for both object code and source code.
The following provides more details on the included cryptographic software: Pulsar uses the SSL library from Bouncy Castle written by http://www.bouncycastle.org.