/!\ *FINAL* (!)
This report has been submitted to the Board. Please do not edit further.
Incubator PMC report for July 2014
Timeline
Wed July 02 | Podling reports due by end of day |
Sun July 06 | Shepherd reviews due by end of day |
Sun July 06 | Summary due by end of day |
Tue July 08 | Mentor signoff due by end of day |
Wed July 09 | Report submitted to Board |
Wed July 16 | Board meeting |
Shepherd Assignments
Alan D. Cabrera | Kalumet |
Alan D. Cabrera | NPanday |
Andrei Savu | Optiq |
Andrei Savu | Parquet |
Justin Mclean | DataFu |
Konstantin Boudnik | S4 |
Konstantin Boudnik | Flink |
Matthew Franklin | Samza |
Matthew Franklin | Usergrid |
Raphael Bircher | Aurora |
Raphael Bircher | VXQuery |
Roman Shaposhnik | DeviceMap |
Roman Shaposhnik | ODF Toolkit |
Ross Gardler | Ripple |
Suresh Marru | MetaModel |
Report content
Incubator PMC report for July 2014 The Apache Incubator is the entry path into the ASF for projects and codebases wishing to become part of the Foundation's efforts. There are currently 34 podlings under incubation, with three votes to graduate as the report is being closed. All three VOTEs have passed. S4 has voted to retire, but the retirement tasks have not yet been finished. Fleece has joined the incubator, as of 9 June 2014. * Community New IPMC members: Jean-Louis Monteiro Romain Manni-Bucau Vinod Kumar Vavilapalli Konstantin Boudnik People who left the IPMC: David Crossley Joe Schaeffer * New Podlings Fleece * Graduations The board has motions for the following: Tez Celix VXQuery * Releases The following releases were made since the last Incubator report: apache-storm-0.9.2-incubating mrql-0.9.2-incubating samza-0.7.0-incubating * IP Clearance No IP Clearance requests submitted to the Incubator in this timeframe. * Miscellaneous S4 voted to retire. SGA received for Optiq from DynamoBI Corporation. Discussion about exit criteria for podlings, including a suggested set of criteria that would trigger a VOTE to retire if a podling is not active enough. Consensus not yet reached. Stratos has graduated but still needs to finish graduation tasks. -------------------- Summary of podling reports -------------------- * Still getting started at the Incubator Brooklyn Fleece Optiq Parquet * Not yet ready to graduate No release: Aurora DataFu DeviceMap Flink log4cxx2 NPanday Wave Community growth: MetaModel Ripple Slider Usergrid * Ready to graduate Kalumet Samza The Board has motions for the following: Tez Celix VXQuery * Retiring S4 * Did not report, expected next month ODF Toolkit ---------------------------------------------------------------------- Table of Contents Aurora Brooklyn DataFu DeviceMap Fleece Flink Kalumet MetaModel NPanday ODF Toolkit Optiq Parquet Ripple S4 Samza Slider Usergrid VXQuery ---------------------------------------------------------------------- -------------------- Aurora Aurora is a service scheduler used to schedule jobs onto Apache Mesos. Aurora has been incubating since 2013-10-01. Three most important issues to address in the move towards graduation: 1. First release, progress being tracked in ticket AURORA-147 2. Establish a consistent development process and release rhythm. 3. Expanding the community and continuing to add new committers. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? - None at this time. How has the community developed since the last report? Latest Additions: * PMC addition: Mark Chu-Carroll, 2014-02-03 * Contributor addition: Mark Chu-Carroll, 2014-01-14 Issue backlog status since last report: * Created: 257 * Resolved: 161 Mailing list activity since last report: * @dev 254 messages * issues 987 messages * @reviews 1487 messages How has the project developed since the last report? - IRC weekly meetings, digests sent to dev@ list - Automating release workflows - Fixing issues brought up in our first release candidate Date of last release: - No releases as of yet. We have created our first release candidate, 0.5.0-rc0, and working to fix issues found within it. 0.5.0-rc1 being targeted within the next week Signed-off-by: [X](aurora) Jake Farrell [ ](aurora) Benjamin Hindman [ ](aurora) Chris Mattmann [X](aurora) Henry Saputra Shepherd/Mentor notes: -------------------- Brooklyn Brooklyn is a framework for modeling, monitoring, and managing applications through autonomic blueprints. Brooklyn has been incubating since 2014-05-01. Three most important issues to address in the move towards graduation: 1. Performing our first release under Apache 2. Completing migration into the Incubator - largest task is populating Jira with existing issues 3. Growing a diverse community and PPMC Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? No. How has the community developed since the last report? A small number of new users have appeared, contributing posts to the mailing lists, Jira issues for bug reports and suggested improvements, and a code contribution. How has the project developed since the last report? The "boostrapping" process is well underway, with active mailing lists, website, and a burst of commit activity. Date of last release: No releases under Apache yet. When were the last committers or PMC members elected? Andrea Turli and Sam Corbett have become committers and joined the PPMC on 2014-04-01 and -02 respectively. Their committer accounts are currently being processed. Signed-off-by: [ ](brooklyn) Matt Hogstrom [ ](brooklyn) Alex Karasulu [ ](brooklyn) David Nalley [ ](brooklyn) Marcel Offermans [ ](brooklyn) Jean-Baptiste Onofré [ ](brooklyn) Olivier Lamy [X](brooklyn) Chip Childers [ ](brooklyn) Andrei Savu [X](brooklyn) Joe Brockmeier [ ](brooklyn) Jim Jagielski Shepherd/Mentor notes: (cc) As the report notes, Brooklyn is slowly (but surely) converting over to the ASF infrastructure and processes. They are making good progress at this time. -------------------- DataFu DataFu provides a collection of Hadoop MapReduce jobs and functions in higher level languages based on it to perform data analysis. It provides functions for common statistics tasks (e.g. quantiles, sampling), PageRank, stream sessionization, and set and bag operations. DataFu also provides Hadoop jobs for incremental data processing in MapReduce. DataFu has been incubating since 2014-01-05. Three most important issues to address in the move towards graduation: 1. Building an ASF-based community. 2. Release. 3. Decide on the future home of the project. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? None. How has the community developed since the last report? Will Vaughan gave a talk on DataFu at ApacheCon in April, and Casey Stella gave a talk on Pig and DataFu at the Hadoop Summit in June. How has the project developed since the last report? Lots of JIRAs on bug fixes and new features, especially in April and May. Work slowed significantly in June, which probably means it's time for a release to mark our progress thus far. Date of last release: None. Six month of incubation. When were the last committers or PMC members elected? 2014-02-22 Signed-off-by: [ ](datafu) Ashutosh Chauhan [X](datafu) Roman Shaposhnik [ ](datafu) Ted Dunning Shepherd/Mentor notes: (jmclean) : Mentor active, no obvious issues. -------------------- DeviceMap Apache DeviceMap is a data repository containing device information, images and other relevant information for all sorts of mobile devices, e.g. smartphones and tablets. While the focus is initially on that data, APIs will also be created to use and manage it. DeviceMap has been incubating since 2012-01-03. The report was not delivered on time from the project itself, as a mentor I (bdelacretaz) have sent the following challenges to the project's dev list to try and get the current somewhat active PPMC members to take over: 1. Challenge #1: provide regular reports 2. Challenge #2: make a release 3. Challenge #3: form a PMC with 4-5 members to graduate Those should really not be challenges but at this point that felt like an appropriate way of indicating the importance of those actions. There's already promising responses, we'll see if those translate into concrete actions. Apart from that there's been some good discussions in the last weeks, but no concrete results yet. Best is probably to evaluate the progress on the above challenges next month to make a decision about the future of the project. Date of last release: No releases yet When were the last committers or PMC members elected? May 2013 Signed-off-by: [x](devicemap) Bertrand Delacretaz [ ](devicemap) Kevan Miller [ ](devicemap) Andrew Savory Shepherd/Mentor notes: (rvs) The report is missing. This on-n-off seems to continue with the project. I know that some of the mentors are recommending giving it more time, but it seems like we need to establish some metrics to at least get the community in shape to do the basics (like reporting and releasing). Without any kind of forcing function I am not sure what the future for this project really is. (bdelacretaz) Agreed - I have now provided a mentor report above. -------------------- Fleece Implementation of JSon Processing Java specification. Fleece has been incubating since 2014-06-09. Three most important issues to address in the move towards graduation: 1. Finish bootstrapping project, update clutch.xml and update incubator status page. 2. Expanding the community, increase user list activity and adding new committers. 3. Develop a set of testcases which prove correct parsing behaviour. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? * none How has the community developed since the last report? * First communication/discussions via mailing lists took place, first issues reported and fixed. How has the project developed since the last report? * Incubator status page, the mailing lists and the initial website have been setup. Initial code have been imported. Date of last release: * No releases as of yet When were the last committers or PMC members elected? * N/A Signed-off-by: [X](fleece) Justin Mclean [ ](fleece) Christian Grobmeier [ ](fleece) Daniel Kulp Shepherd/Mentor notes: (jmclean) : Everything set up, off to a good start, no issues. -------------------- Flink Flink is an open source system for expressive, declarative, fast, and efficient data analysis. Flink combines the scalability and programming flexibility of distributed MapReduce-like platforms with the efficiency, out-of-core execution, and query optimization capabilities found in parallel databases. Flink was originally known as Stratosphere when it entered the Incubator. Flink has been incubating since 2014-04-14. Three most important issues to address in the move towards graduation: 1. The new name ("Flink") has still not been confirmed by the trademark team. 2. Setup of release infrastructure and first release 3. Continue with community growth Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? None. How has the community developed since the last report? Two presentations (Meetup in Nice by a committer, one in Budapest by a contributor), new users are showing up on the mailing list and on JIRA. How has the project developed since the last report? Most of the infrastructure setup has been done. Users start using the new mailing lists. In the last month, 21 authors have pushed 120 commits to master. On master, 910 files have changed and there have been 74,313 additions and 37,094 deletions. Date of last release: 2014-05-31 (no incubator release yet) When were the last committers or PMC members elected? None. Signed-off-by: [ ](flink) Sean Owen [ ](flink) Ted Dunning [ ](flink) Owen O'Malley [X](flink) Henry Saputra [ ](flink) Ashutosh Chauhan [X](flink) Alan Gates Shepherd/Mentor notes: Mentors look active; dev maillist is active. No obvious issues. -------------------- Kalumet Kalumet a complete environment manager and deployer including J2EE environments (application servers, applications, etc), softwares, and resources. Kalumet has been incubating since 2011-09-20. Community Developement: Apache Kalumet 0.6-incubating version has been released. However, due to some misunderstanding, the release vote has not been completed by 3 IPMC. Especially, some legal files issues have been raised. We are preparing a 0.6.1-incubating release to fix the legal files and submit to IPMC vote. We are in the way of promoting the documentation on the website. Project Development: We are preparing the 0.6.1-incubating (plan for July, 14) to fix the legal files issues raised on 0.6-incubating release and have a complete IPMC vote. We are preparing the 0.7-incubating release with the development changes. Local branches have been created containing: - new model and REST API - new webconsole (remove of Echo framework) These local branches will be merged on the 0.7-incubating branch (master). Before Graduation: - The documentation has been updated and aligned with the 0.6-incubating release. The documentation will be promoted on the website and "linked" in announcement e-mails as soon as the 0.6.1-incubating release has been voted. - The 0.7-incubating release will fix the graduation issue, especially in term of license (removal of Echo2 framework for the UI). Post Graduation: - Kalumet scripts. It's the extension of the "software" concept globally to all Kalumet resources. It will allow users to create custom deployment/update plan, with a set of fine-grained steps. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of: None so far. Date of last release: 2013-11-22 Date of next release: 2014-07-14 When were the last committers or PMC members elected? None Signed-off-by: [ ](kalumet) Jim Jagielski [ ](kalumet) Henri Gomez [X](kalumet) Jean-Baptiste Onofre [ ](kalumet) Olivier Lamy Shepherd/Mentor notes: -------------------- MetaModel MetaModel is a data access framework, providing a common interface for exploration and querying of different types of datastores. MetaModel has been incubating since 2013-06-12. Three most important issues to address in the move towards graduation: 1. More contributors to increase diversity of the community 2. Finalize 4.1 release to demonstrate new functionality and evolution within Apache 3. Connect with other projects from Apache's ecosystem such as HBase, Phoenix, Cassandra, Optiq Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? None How has the community developed since the last report? A few new people have started to work actively on the mailing list. It is still a small community, and growth is needed. On the positive side we do see certain new individuals starting to contribute continuously to the project. We have been working on blogging, tweeting etc. to create more out-going communication about MetaModel. We feel that more of such activity is needed. How has the project developed since the last report? Apache MetaModel 4.1.0-incubating was released on Jan 21. This time with a new release engineer, which meant that the release instructions were re-iterated and updated. Communication on mailing list is improving and we see more diversity of requests. For instance, connectivity to Hadoop and HBase was previously not very active but now it's is taking a good share of the focus. Date of last release: May 12th When were the last committers or PMC members elected? June 2013 (but a new committer is being invited just now) Signed-off-by: [X](metamodel) Henry Saputra [X](metamodel) Arvind Prabhakar [ ](metamodel) Matt Franklin [X](metamodel) Noah Slater Shepherd/Mentor notes: -------------------- NPanday NPanday allows projects using the .NET framework to be built with Apache Maven. NPanday has been incubating since 2010-08-13. Since the last report in April, a few obstacles have been removed: - the status page was updated with the current podling state and correct mentors - svnpubsub was enabled so the website can be updated again - a number of JIRA issues have been cleaned up to prepare for the release Not blocking, but outstanding things to do: - resolve issues with Jenkins builds with infrastructure - finish closing out JIRA issues that have been partially finished for release - apply suitable patches that have been overlooked in the past and try to reconnect with contributors Three most important issues to address in the move towards graduation: 1. Ship the changes on trunk as a release and make it easier for new users to get up to speed when interested in the project 2. Get a critical mass of committers/PPMC members that can respond to contributors, apply patches, nominate committers, and vote on releases 3. Provide guidance on how to get involved in contributing The incubator is already aware of the low level of activity, that many of the PPMC are now disengaged and lack of mentors for the project. Konstantin Boudnik has put his hand up to help out and that discussion is in progress. There continues to be interest in a new release from users, and new interest from some in making contributions that continue to be followed up. Date of last release: 2011-05-16 The last committer was added on 2011-04-19. There have not been any PPMC additions since inception. Signed-off-by: [ ](npanday) Raphael Bircher Shepherd/Mentor notes: -------------------- Optiq Optiq is a highly customizable engine for parsing and planning queries on data in a wide variety of formats. It allows database-like access, and in particular a SQL interface and advanced query optimization, for data not residing in a traditional database. Optiq has been incubating since 2014-05-19. Three most important issues to address in the move towards graduation: 1. Migrate fully to Apache infrastructure (next: web site and nightly builds). 2. Re-organize code into org.apache.optiq namespace. 3. Regular releases. 4. Build an ASF community. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? With the mentors' permission, we released an unofficial release, optiq-0.8. Optiq has been making regular releases, approximately monthly, and this has built momentum in the community. Continuing this practice helps hold the community together. We intend to that the next release (0.9, end of July) is an official Apache Incubator release. How has the community developed since the last report? This is our first report. The community remains very similar to the point where we joined the Incubator. We are doing outreach. * Julian Hyde gave two talks related to Optiq at Hadoop Summit. * Julian Hyde attended the ACM SIGMOD conference and discussed Optiq with several researchers. Optiq was mentioned in several talks there. * An online meeting (via Google hangouts) for the community is scheduled for July 1st. How has the project developed since the last report? This is our first report. Adopting Apache infrastructure: * We have completed necessary SGAs, and transferred code from github to Apache git, and begun committing to Apache git. (Original github site still online, but marked "retired" with redirection page.) * We have transferred github issues to Apache JIRA, and are using Apache JIRA for issue management. * Some members have complained that the traffic on dev@ is too great - requesting an issues@ mailing list for jira update traffic. We made an unofficial release (optiq-0.8) on 2014-06-27. Date of last release: No releases yet under the Incubator. (But see unofficial release 0.8, above.) When were the last committers or PMC members elected? No new committers since we joined the Incubator. Signed-off-by: [ ](optiq) Ted Dunning [ ](optiq) Alan Gates [ ](optiq) Steven Noels Shepherd/Mentor notes: -------------------- Parquet Parquet is a columnar storage format for Hadoop. Parquet has been incubating since 2014-05-20 . Three most important issues - Finish bootstrapping project(completed), IP clearance (completed), initial website (in progress) - Expanding the community and adding new committers - 1st release Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? - None at this time Latest Additions: * PMC addition: N/A * Contributor addition: N/A Issue backlog status since last report: * Created: 8 * Resolved: 2 Mailing list activity since last report: * @dev 69 messages How has the project developed since the last report? - All bootstrap tickets have been completed and status page updated - Mailing lists created, Jira setup, Code imported - Jira issues starting to be imported to issues.apache.org - Website in the works and will be available soon, infra for this is all ready setup - Working on documenting contributing guide and committers workflow - We have now setup the mechanisms to accept contributions through the Apache Github and have already accepted one external contribution. Date of last release: - No releases as of yet. Signed-off-by: [X](parquet) Todd Lipcon [X](parquet) Jake Farrell [ ](parquet) Chris Mattmann [X](parquet) Roman Shaposhnik [X](parquet) Tom White Shepherd/Mentor notes: -------------------- Ripple Ripple is a browser based mobile phone emulator designed to aid in the development of HTML5 based mobile applications. Ripple is a cross platform and cross runtime testing/debugging tool. It currently supports such runtimes as Cordova, WebWorks aand the Mobile Web. Ripple has been incubating since 2012-10-16. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? The overall decision of what to do with Ripple as an ASF project, and whether it can become a sub-project of Cordova is still under discussion. Additionally, there are discussion threads proposing how to more tightly integrate and use Ripple within Cordova. How has the community developed since the last report? A new committer was voted in. Raymond Camden. How has the project developed since the last report? Minor user contributions. Date of last release: N/A When were the last committers or PMC members elected? June, 2014. Signed-off-by: [ ](ripple) Jukka Zitting [X](ripple) Christian Grobmeier [ ](ripple) Andrew Savory Shepherd/Mentor notes: -------------------- Samza Samza is a stream processing system for running continuous computation on infinite streams of data. Samza has been incubating since 2013-07-30. Three most important issues to address in the move towards graduation: 1. Possible second Incubator release, otherwise ready to go. 2. 3. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? None. How has the community developed since the last report? Voted in two new committers/PPMC members, both from outside of the original code contributor. Martin Kleppmann presented on the project at Berlin Buzzwords, Sriram Subramanian will be presenting in Seattle in August. How has the project developed since the last report? Currently in middle of first incubator release. 94 issues opened in since last reporting window, 86 resolved. Date of last release: Vote for 0.7.0 release has just passed in podling, now being run in Incubator. When were the last committers or PMC members elected? June 12. Signed-off-by: [ ](samza) Chris Douglas [ ](samza) Arun Murthy [X](samza) Roman Shaposhnik Shepherd/Mentor notes: -------------------- Slider Slider is a collection of tools and technologies to package, deploy, and manage long running applications on Apache Hadoop YARN clusters. Slider has been incubating since 2014-04-29. Three most important issues to address in the move towards graduation: 1. Building a user community 2. Getting those users to contribute their work back 3. Improving the application to make it easier to use Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? No How has the community developed since the last report? * We've made our first ASF-based release and are starting to get people discussing it on our dev list -our sole mailing list to date. This shows some take up, but it also identifies the challenge in diagnosing problems. We need to provide more application-side diagnostics to help both users and ourselves. How has the project developed since the last report? * As stated, we've made our first ASF release. We plan to do this monthly for the next few months, to get our release process refined, as we as evolve the application from users' experiences. * We've fully migrated to the ASF JIRA server, and have been cross-filing issues with sibling Apache projects -notably YARN- so helping gain awareness of us and our needs. So far the other projects have been very helpful. * We're trying to contribute some of our changes back into the Hadoop and Bigtop projects -our workflow YARN services and service launcher to Hadoop; improvements to the test runner shell for Bigtop. These will spread the benefits of these features, and tighten our relationship with those projects on which we depend. Date of last release: 2014-06-02 When were the last committers or PMC members elected? 2014-05 Signed-off-by: [ ](slider) Arun C Murthy [ ](slider) Devaraj Das [X](slider) Jean-Baptiste Onofré [X](slider) Mahadev Konar Shepherd/Mentor notes: -------------------- Usergrid Usergrid is Backend-as-a-Service (BaaS) composed of an integrated database (Cassandra), application layer and client tier with SDKs for developers. Usergrid has been incubating since 2013-10-03. Three most important issues to address in the move towards graduation: 1. Obtain Usergrid release 1.0 2. Resolve relationship with Apache in general 3. Continue to grow community Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? Recently, Usergrid has been through the wars with regards to its development ethos, entire development process and most importantly code commit process. The latter has been an issue which resulted in one particular Apache Member having his account temporarily disabled, and a new contributor workflow that the project believes does satisfy board and infrastructure requirements: https://cwiki.apache.org/confluence/display/usergrid/Usergrid+Contribution+Workflow It has not been an easy month for Usergrid however the community spirit is higher than it ever has been and the community is in a strong position to meet Incubator criteria. An extremely positive note here is that the Usergrid community has been actively expanding throughout the above process. This is something we can all learn from. How has the community developed since the last report? The Usergrid community has been growing steadily and very encouragingly based on community VOTE's. We welcome contributions to Usergrid. Most importantly, many members of the existing Usergrid PPMC have been (extremely) actively involved in Usergrid's dissemination and expansion. * 74 subscribed to dev@ How has the project developed since the last report? Many, many commits. Usergrid is very healthy with regards to its development. What needs to be addressed however is the following: * Resolve commit process... MAJOR * Reflect commit messages to commit@ Date of last release: Usergrid (incubating) has not made an official release as of date. The community areactively working towards a release for 1.0. When were the last committers or PMC members elected? Askhat Asanaliev Wed, 23 Apr 2014 16:59:35 GMT Signed-off-by: [X](usergrid) Dave Johnson [X](usergrid) Jake Farrell [ ](usergrid) Jim Jagielski [X](usergrid) Lewis John Mcgibbney [ ](usergrid) Luciano Resende Shepherd/Mentor notes: -------------------- VXQuery A standards compliant parallel XML Query processor. VXQuery has been incubating since 2009-07-06. The second release has been released (by a different release manager). The PPMC has voted on the composition of the PMC (=committers) and the graduation vote is ongoing on the dev-list. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? No. How has the community developed since the last report? No change. How has the project developed since the last report? There has been work on better handling of big XML files and greater functional coverage. Date of last release: 2013-12-06 When were the last committers or PMC members elected? Marvin Humphrey was added to the PPMC as a mentor in November 2013. Steven Jacobs was elected as a committer in September 2013. Signed-off-by: [ ](vxquery) Anthony Elder [ ](vxquery) Jochen Wiedmann [x](vxquery) Marvin Humphrey [ ](vxquery) Sanjiva Weerawarana [ ](vxquery) Radu Preotiuc-Pietro Shepherd/Mentor notes: