You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 3 Current »

Code

Status

Done

Steps

  1. Create a new Apache Git repo (our champion i.e Olivier should be able to help with that since he has necessary permissions). This will come with a Apache Git repo's Github mirror. 
  2. Open an INFRA JIRA ticket to start the migration (as described in next step). 
  3. Transfer ownership of the linkedin/gobblin repository to an Apache INFRA person. See this page for details on what gets kept and lost. The Apache INFRA will seed the Apache Git repo with linkedin/gobblin repository content and re-designate the linkedin/gobblin repository as Apache Git repo mirror. 
  4. Update documentation. 

Jiras

INFRA-13650 - Getting issue details... STATUS

INFRA-14689 - Getting issue details... STATUS

GOBBLIN-1 - Getting issue details... STATUS

Results 

Apache Git Repo: https://git1-us-west.apache.org/repos/asf?p=incubator-gobblin.git;a=summary

Apache Git Repo Github mirror: https://github.com/apache/incubator-gobblin

Website

Status

In Progress

Steps

  1. Open an INFRA JIRA ticket to request a new git repo for site content. 
  2. Make prerequisite changes to current content. (Refer to Olivier's comment on GOBBLIN-2 )
  3. Publish content on new git repo to populate the website. (Move documentation from ReadTheDocs to the website. )

Jiras

INFRA-14663 - Getting issue details... STATUS

GOBBLIN-2 - Getting issue details... STATUS

Results

Website: https://gobblin.apache.org/

Mailing lists

Status

Done

Steps

  1. Post notification to Google groups pointing to new mailing lists. 
  2. Lock down Google groups.

Jiras

GOBBLIN-160 - Getting issue details... STATUS

Notes

  1. As part of Incubation, Olivier (champion) has already requested and got mailing lists (dev, users, commits, private) provisioned for us. 

Issues

Status

Done

Steps

  1. Open an INFRA JIRA ticket to request for new JIRA instance. 
  2. Close all possible redundant issues on Github. 
  3. Write a script to read from Github API and create corresponding open issues on Apache JIRA with all relevant history and comments. 
  4. Close out migrated issues and mark them with a Github label. 

Jiras

INFRA-13642 - Getting issue details... STATUS

GOBBLIN-161 - Getting issue details... STATUS

Note

  1. Issues will be disabled on Github when the Github repository transfers under Apache organization.  

Results

JIRA instance: https://issues.apache.org/jira/browse/GOBBLIN

Closed Issues: https://github.com/linkedin/gobblin/issues?q=is%3Aissue+is%3Aclosed+label%3A%22Moved+to+Apache+Jira%22

Pull Requests

Status

Done

Steps

  1. Update PR instructions to put JIRA issue numbers in PR titles.  
  2. Add Github label to identify PRs without JIRA issues in title.  
  3. Ensure that tooling in Jenkins is enabled for auto-closing issues based on PR title.  

Jiras

GOBBLIN-162 - Getting issue details... STATUS

Wiki

Status

Done

Steps

  1. Open an INFRA JIRA ticket to create a wiki space. 
  2. Create relevant wiki pages.  
  3. Define how content is distributed between wiki and the website going forward. 

Jiras

INFRA-14626 - Getting issue details... STATUS

GOBBLIN-163 - Getting issue details... STATUS

Results

Wiki Space: Gobblin Home

Jenkins

Status

In Progress

Steps

  1. Open an INFRA JIRA ticket to setup and enable Jenkins for code base. 
  2. Explore setting up pre-commit hook such as Yetis.  
  3. Configure Gobblin on Jenkins instance. 

Jiras

GOBBLIN-164 - Getting issue details... STATUS

Package Rename

Status

In Progress

Steps

  1. Rename packages and schema namespaces from gobblin and com.linkedin.gobblin to org.apache.gobblin 
    The entities to take care of: 
    • Java packages
    • Avro schema and namespaces
    • RESTLi schema and namespaces
    • META-INF services
    • SQL references
    • Reflection
    • Alias Resolution
    • Pull and config files
    • Config store hierarchy
    • Default config references
    • Fully qualified names
    • Hardcoded class and package names
    • Powermock / mockito change in exclusion / inclusion params
    • Build changes to operate on different package structure
    • Typed references / imports / extension of classes and implementation of interfaces
    • Shell / launcher scripts
    • Documentation / Javadocs
  2. The existing configuration will continue to remain the same so that no migration is required for it. 
  3. The class names will have new packages, so users will have to rename them in configs; and custom implementations will have to be updated. 
  4. The state-store will be unreadable with new changes, so we would need a shim for that. 
  5. Two versions must be maintained (previous major version v0.x for gobblin / com.linkedin.gobblin namespace and v1.x for org.apache.gobblin)

Jiras

GOBBLIN-178 - Getting issue details... STATUS

Notes

Email to send out on Google Groups announcing the migration 

As part of the Gobblin project's recent move to Apache, we are migrating the mailing lists to Apache infrastructure as well, so that the existing Google groups will become read-only at some point in the near future.
To keep receiving updates about Gobblin or to participate in development discussions, please subscribe to the following lists:
user@gobblin.incubator.apache.org -- for usage questions, help and announcements. [Subscribe] [Archives] 
dev@gobblin.incubator.apache.org -- for people who want to contribute code to Gobblin. [Subscribe] [Archives] 
commits@gobblin.incubator.apache.org -- for people who want to contribute code to Gobblin. [Subscribe] [Archives] 
Additionally, the Gobblin Gitter chat rooms: [Gobblin Lobby] [Gobblin Cluster] is where many Gobblin developers and users hang out to answer questions and chat.
The other infrastructure and process changes with Apache migration are: 
1) Migration of linkedin/gobblin code base to Apache's Git repository. [In Progress] 
2) Migration of Google groups mailing list (this list) to Apache mailing lists. [In Progress]
3) Migration of Travis CI to use the Apache infrastructure. [Scheduled]
4) Migration of Wiki to Apache Confluence wiki. [Scheduled]
5) Migration of Github Issues to Apache JIRA. [Done] 
6) Migration of all existing pull requests to the Apache Github mirror repository. [Scheduled] 
We will track the progress of the above items on Gobblin's Apache mailing lists.
What you should do:

* Sign up for the Apache user, dev and commits mailing list (as described above) 
* Sign up for an Apache JIRA account and open any issues that you care about in Apache Gobblin JIRA project (https://issues.apache.org/jira/browse/GOBBLIN)
* Sign up for an Apache Confluence account (https://cwiki.apache.org/confluence/display/GOBBLIN)
* Stop creating GitHub issues immediately. Create new problem reports as JIRAs now. 

Questions

Can we merge pull requests via the magical green button in GitHub?

Not currently. The way GitHub mirroring is setup, the repository is read-only, so no merge button appears in the GitHub UI. This means that committers will have to manually pull PRs locally, merge them into Apache master, push them back to Apache's git repository, and close the pull request.

There is an experimental project in Apache to enable bi-directional mirroring, so the merge button will work, but it's currently private. We can apply to get access, but I don't think that we should count on this in the short term. Application requires discussing on our private@ list, then having the project char contact the board as well as the infra team.

Will existing pull requests and issues continue to exist after the repository is transferred?

Yes. We'll have to link them to JIRA tickets by adding a JIRA ticket ID to their title, though.

Can we use GitHub issues?

No. 

How will pull requests work?

See this page for a description. Basically, the same as normal, except that the PR must have a JIRA number in the title, and there will be no green merge button in GitHub (see above).

 

  • No labels