tree: 7f796aae1764e91c0220ecda2ffd9fb330e0f849 [search]
  1. README.md
  2. rfc-template.md
rfcs/README.md

Iggy RFCs

The “RFC” (request for comments) process is intended to provide a consistent and controlled path for changes to Iggy (such as new features) so that all stakeholders can be confident about the direction of the project.

Many changes, including bug fixes and documentation improvements can be implemented and reviewed via the normal GitHub pull request workflow.

Some changes though are “substantial”, and we ask that these be put through a bit of a design process and produce a consensus among the Iggy community and the maintainers.

Table of Contents

When you need to follow this process

You need to follow this process if you intend to make “substantial” changes to the Iggy server, the wire protocol, the SDKs, the connectors runtime, or the RFC process itself. What constitutes a “substantial” change is evolving based on community norms and varies depending on what part of the project you are proposing to change, but may include the following.

  • Any change to the wire protocol or the on-disk format that is not a bugfix.
  • A new storage, replication, or consumption model, or a change to how an existing one behaves.
  • Removing features, including those behind a feature flag.
  • Large additions to the SDK surface that every SDK must then implement.

Some changes do not require an RFC:

  • Rephrasing, reorganizing, refactoring, or otherwise “changing shape does not change meaning”.
  • Additions that strictly improve objective, numerical quality criteria (warning removal, speedup, better platform coverage, more parallelism, trap more errors, etc.)
  • Additions only likely to be noticed by other developers-of-iggy, invisible to users-of-iggy.

If you submit a pull request to implement a new feature without going through the RFC process, it may be closed with a polite request to submit an RFC first.

Before creating an RFC

A hastily-proposed RFC can hurt its chances of acceptance. Low quality proposals, proposals for previously-rejected features, or those that don't fit into the near-term roadmap, may be quickly rejected, which can be demotivating for the unprepared contributor. Laying some groundwork ahead of the RFC can make the process smoother.

Although there is no single way to prepare for submitting an RFC, it is generally a good idea to pursue feedback from other project developers beforehand, to ascertain that the RFC may be desirable; having a consistent impact on the project requires concerted effort toward consensus-building.

The most common preparations for writing and submitting an RFC include talking the idea over on our Discord server, discussing the topic in GitHub Discussions, and occasionally posting “pre-RFCs” there. A pre-RFC thread is separate from the RFC's own Discussion, which is opened later, once the RFC is accepted. You may file issues on this repo for discussion, but these are not actively looked at by the maintainers.

As a rule of thumb, receiving encouraging feedback from long-standing project developers, and particularly from the maintainers, is a good indication that the RFC is worth pursuing.

What the process is

In short, to get a major feature added to Iggy, one must first get the RFC accepted. A maintainer labels the RFC's pull request accepted once Iggy wants the change, and from then on the RFC is “active” and may be implemented with the goal of eventual inclusion into Iggy. Its design is still debated and revised until the RFC is merged into the rfcs/ directory of this repository as a markdown file, which makes the design final.

  • Fork the Iggy repository.
  • Copy rfcs/rfc-template.md to rfcs/rfc-0-my-feature.md (where “my-feature” is descriptive). Don't assign an RFC number yet; 0 marks an unassigned number, and one is assigned when the RFC is accepted and the file is renamed accordingly. See RFC numbering.
  • Fill in the RFC. Put care into the details: RFCs that do not present convincing motivation, demonstrate lack of understanding of the design's impact, or are disingenuous about the drawbacks or alternatives tend to be poorly-received.
  • Submit a pull request titled rfc(<scope>): <subject>, choosing the scope as described in the commit message section of CONTRIBUTING.md, which also covers a scope that matches nothing yet. The pull request carries the text, and a maintainer labels it rfc. A maintainer gives it an initial review within a week. The initial review decides whether Iggy wants the change at all and whether it needs an RFC, and gives editorial comments on the writing. It does not settle the design. The outcome is recorded as a label rather than a comment, as are the later changes of state, so the labels on the pull request always show where the RFC stands (see RFC labels). If Iggy does not want the change, the pull request is closed with the reason. If the change does not need an RFC, the pull request is closed and the change goes through the normal pull request workflow. While editorial changes are pending, the maintainer labels the pull request S-waiting-on-author. Once the change is wanted and the text reads well, the maintainer labels the pull request accepted.
  • Now that your RFC has an open pull request, update the “RFC PR” link at the top of the file to point at it.
  • An accepted pull request keeps the S-waiting-on-review label for the lifetime of the RFC, because the debate happens outside the pull request and the stale bot otherwise closes a pull request after 14 days without activity on it.
  • Within a week of the accepted label, the author opens a GitHub Discussion in the RFCs category titled RFC: <feature>, linking the pull request and quoting the summary. The maintainer who added the label then assigns the RFC number and opens the tracking issue, linking the pull request and the Discussion (see RFC numbering). The author renames the file to its number and fills in the “Discussion” and “Iggy Issue” links at the top of it in one commit. The Discussion is where the design is debated; the pull request keeps editorial review. The author moves design comments left on the pull request to the Discussion, with a link.
  • Build consensus and integrate feedback. RFCs that have broad support are much more likely to make progress than those that don't receive any comments. Feel free to reach out to the maintainers in particular to get help identifying stakeholders and obstacles.
  • The maintainers will discuss the RFC, as much as possible in the Discussion itself. Offline discussion will be summarized in the Discussion.
  • RFCs rarely go through this process unchanged, especially as alternatives and drawbacks are shown. You can make edits, big and small, to the RFC to clarify or change the design, but make changes as new commits to the pull request, and reply in the Discussion with the commit hash and permalinks to the changed lines, explaining your changes. Specifically, do not squash or rebase commits after they are visible on the pull request.
  • At some point, a maintainer will propose a “motion for final comment period” (FCP) in the Discussion, along with a disposition for the RFC. The disposition is normally merge, which makes the design final. Close is a rare exception for an accepted RFC that Iggy no longer wants: its tracking issue is closed as not planned, and its number is never reused.
    • This step is taken when enough of the tradeoffs have been discussed that the maintainers are in a position to make a decision. That does not require consensus amongst all participants in the Discussion (which is usually impossible). However, the argument supporting the disposition on the RFC needs to have already been clearly articulated, and there should not be a strong consensus against that position outside of the maintainers. Maintainers use their best judgment in taking this step, and the FCP itself ensures there is ample time and notification for stakeholders to push back if it is made prematurely.
    • For RFCs with lengthy discussion, the motion to FCP is usually preceded by a summary comment trying to lay out the current state of the discussion and major tradeoffs/points of disagreement.
    • Before actually entering FCP, the maintainers must sign off; this is often the point at which many of them first review the RFC in full depth. The maintainer who proposed the motion records the sign-offs in the Discussion, announces there when the FCP starts and when it ends, and labels the pull request final-comment-period while it runs.
  • The FCP lasts ten calendar days, so that it is open for at least 5 business days. The Discussion is mirrored to the dev mailing list, but replies on the list do not reach the Discussion, so final objections must be raised in the Discussion itself.
  • In most cases, the FCP period is quiet, and the RFC is merged: the pull request is squash-merged, and the maintainer posts a summary comment in the Discussion linking the merged RFC. However, sometimes substantial new arguments or ideas are raised, the FCP is canceled, and the RFC goes back into development mode. If the reasoning behind the decision is not clear from the Discussion, the maintainers add a comment there describing it.

RFC labels

Each change of an RFC's state is recorded as a label on its pull request.

  • rfc: the pull request carries an RFC.
  • S-waiting-on-author: the initial review asked for editorial changes to the text.
  • accepted: Iggy wants the change. The RFC is active and may be implemented, and it moves to the discussion stage, where its design is still debated and can still change until the RFC is merged.
  • S-waiting-on-review: keeps the stale bot from closing the pull request while the debate happens in the Discussion.
  • final-comment-period: the FCP is running.

A merged pull request is an RFC whose design is final, and a closed one was declined, withdrawn, or rarely dropped after acceptance, so neither needs a label of its own.

RFC numbering

RFC numbers are small sequential integers without zero padding, assigned when an RFC is accepted, so the first RFC is rfc-1. Once the author has opened the Discussion, the maintainer who labeled the pull request accepted takes the next free number, opens the tracking issue for the implementation, linking the pull request and the Discussion, and tells the author both. Numbers are assigned by a maintainer so that two RFCs accepted at the same time cannot claim the same one. The author then renames rfcs/rfc-0-my-feature.md to that number, for example rfcs/rfc-7-my-feature.md, and fills in the “Iggy Issue” link. A number is never reused, even if its RFC is later closed.

Pull request numbers are not used as RFC numbers because this repository's counter is shared with every other pull request, which would make RFC numbers large, sparse, and meaningless as a sequence. Until an RFC is accepted it is referred to by its feature name.

The RFC life-cycle

Once an RFC becomes “active” then authors may implement it and submit the feature as a pull request to the Iggy repository. Being “active” is not a rubber stamp, and in particular still does not mean the feature will ultimately be merged; it does mean that in principle all the major stakeholders have agreed to the feature and are amenable to merging it.

An active RFC's design can still change in the Discussion until the RFC is merged. Implementation that starts before then follows those revisions, and an implementation pull request that depends on a part of the design still under debate may wait for it to settle.

Every active RFC has an associated issue tracking its implementation in the Iggy repository, so it can be assigned a priority via the triage process that the maintainers use for all issues. If you are interested in working on the implementation for an “active” RFC, but cannot determine if someone else is already working on it, feel free to ask on that issue.

Furthermore, the fact that a given RFC has been accepted and is “active” implies nothing about what priority is assigned to its implementation, nor does it imply anything about whether an Iggy developer has been assigned the task of implementing the feature. While it is not necessary that the author of the RFC also write the implementation, it is by far the most effective way to see an RFC through to completion: authors should not expect that other project developers will take on responsibility for implementing their accepted feature.

An RFC may depend on another RFC. It can become active before the other is written, but the work that depends on it does not start until that RFC is active.

Modifications to merged RFCs can be done in follow-up pull requests. We strive to write each RFC in a manner that it will reflect the final design of the feature; but the nature of the process means that we cannot expect every merged RFC to actually reflect what the end result will be at the time of the next major release.

In general, once merged, RFCs should not be substantially changed. Only very minor changes should be submitted as amendments. More substantial changes should be new RFCs, with a note added to the original RFC. Exactly what counts as a “very minor change” is up to the maintainers to decide.

Help this is all too informal

The process is intended to be as lightweight as reasonable for the present circumstances. As usual, we are trying to let the process be driven by consensus and community norms, not impose more structure than necessary.

License

The contents of this directory are licensed under the Apache License, Version 2.0, like the rest of the repository.

This README and rfc-template.md are adapted from the rust-lang/rfcs repository, which is licensed under the MIT and Apache 2.0 licenses.

Contributions

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in the work by you, as defined in the Apache-2.0 license, shall be licensed as above, without any additional terms or conditions.