/!\ *FINAL* (!)
Incubator PMC report for August 2015
Timeline
Wed August 05 | Podling reports due by end of day |
Sun August 09 | Shepherd reviews due by end of day |
Sun August 09 | Summary due by end of day |
Tue August 11 | Mentor signoff due by end of day |
Wed August 12 | Report submitted to Board |
Wed August 19 | Board meeting |
Shepherd Assignments
Andrei Savu | AsterixDB |
Andrei Savu | Kylin |
Drew Farris | Blur |
John Ament | Calcite |
John Ament | Droids |
Justin Mclean | BatchEE |
Matthew Franklin | DataFu |
Matthew Franklin | Tamaya |
Matthew Franklin | Twill |
P. Taylor Goetz | FreeMarker |
P. Taylor Goetz | Trafodion |
Raphael Bircher | Sirona |
Raphael Bircher | Slider |
Ross Gardler | Ripple |
Suresh Marru | ODF Toolkit |
Suresh Marru | REEF |
Suresh Marru | TinkerPop |
Timothy Chen | Climate Model Diagnostic Analyzer |
Timothy Chen | Kalumet |
Report content
No Format |
---|
Incubator PMC report for August 2015 The Apache Incubator is the entry path into the ASF for projects and codebases wishing to become part of the Foundation's efforts. There are 43 podlings currently under incubation. * Community New IPMC members: Flavio Junquiero People who left the IPMC: (none) * New Podlings No new podlings entered the incubator this month. * Graduations The board has motions for the following: Ignite Lens * Releases The following releases were made since the last Incubator report: 2015-07-27 - apache-brooklyn-0.7.0-incubating 2015-07-24 - Apache-Twill-0.6.0-incubating 2015-07-23 - Apache-Zeppelin-0.5.0-incubating release 2015-07-22 - apache-ripple-emulator-0.9.30-incubating 2015-07-21 - apache-ignite-1.3.0-incubating 2015-07-21 - apache-samoa-0.3.0-incubating 2015-07-21 - apache-kylin-0.7.2-incubating 2015-07-16 - apache-tinkerpop-3.0.0-incubating 2015-07-16 - apache-usergrid-1.0.2-incubating 2015-07-16 - apache-nifi-0.2.0-incubating 2015-07-16 - apache-groovy-2.4.4-incubating 2015-07-16 - apache-lens-2.2.0-beta-incubating 2015-07-09 - apache-sentry-1.5.1-incubating 2015-07-09 - apache-atlas-0.5-incubating * IP Clearance JBoss HornetQ code grant to the ActiveMQ PMC. * Legal / Trademarks * Infrastructure Marvin board report reminders went out this month. There was much rejoicing. * Miscellaneous * Report Manager: John D. Ament -------------------- Summary of podling reports -------------------- * Still getting started at the Incubator AsterixDB Climate Model Diagnostic Analyzer DataFu FreeMarker * Not yet ready to graduate No release: Blur Tamaya Community growth: Kylin TinkerPop Trafodion Twill * Ready to graduate Calcite The Board has motions for the following: Ignite Lens * Did not report, expected next month BatchEE (Shepherd notes remaining) Droids (Shepherd notes remaining) Kalumet REEF Ripple Slider ---------------------------------------------------------------------- Table of Contents AsterixDB BatchEE (notes only) Blur Calcite Climate Model Diagnostic Analyzer DataFu Droids (notes only) FreeMarker Kylin ODF Toolkit Sentry Sirona Tamaya TinkerPop Trafodion Twill ---------------------------------------------------------------------- -------------------- AsterixDB Apache AsterixDB is a scalable big data management system (BDMS) that provides storage, management, and query capabilities for large collections of semi-structured data. AsterixDB has been incubating since 2015-02-28. Three most important issues to address in the move towards graduation: 1. Migrate issues from Google Code 2. Do an Apache release. 3. Grow community Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? 1. The most urgent issue right now is to migrate the issues from the Google Code tracker to the ASF JIRA (INFRA-9954) as Google Code turns read-only on Aug 24. The issue was open with sporadic activity for some time. Recently, the frequency of the interactions with infra has increased significantly (thanks!), but the problem is not solved yet. 2. There was a discussion on the use of a Gerrit instance hosted at UCI for code reviews in this project. After an initial assumption that this was contrary to Apache policy and the subsequent a) clarification on how Gerrit is being used (every AsterixDB commit is explicitly made by a committer to the ASF git repo - not by Gerrit), b) configuration of Gerrit that all notifications are sent the the project's mailing list, and c) addition of a step at Gerrit account creation that requires that an ICLA is on file at the ASF the current state of the discussion is that this is a) not contrary to policy but also b) not ideal as the regular workflow depends on non-ASF resources. Ideally the code review tool would be hosted by infra, but capacity is an issue. How has the community developed since the last report? Getting more requests on opportunities to contribute and also some contributions. How has the project developed since the last report? - New website is up - YARN support added - Other development is ongoing Date of last release: No Releases yet. When were the last committers or PMC members elected? No new elected PPMC and/or committers since entering incubator. Signed-off-by: [x](asterixdb) Ate Douma [ ](asterixdb) Chris Mattmann [ ](asterixdb) Henry Saputra [x](asterixdb) Jochen Wiedmann [x](asterixdb) Ted Dunning -------------------- BatchEE BatchEE projects aims to provide a JBatch implementation (aka JSR352) and a set of useful extensions for this specification. BatchEE has been incubating since 2013-10-03. Shepherd/Mentor notes: Justin Mclean: Did not report (3rd time in a row). Low mailing list activity. -------------------- Blur Blur is a search platform capable of searching massive amounts of data in a cloud computing environment. Blur has been incubating since 2012-07-24. Three most important issues to address in the move towards graduation: 1. At this point we need to have more releases, more often. 2. 3. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? No How has the community developed since the last report? - Subscriptions: user@ - 55[-2]; dev@ - 67[0] How has the project developed since the last report? Many bug fixes, plus a release vote was called. It did not pass due to some licensing issues with a javascript library in a web application that is apart of the Blur project. It has recently been resolved, we will call a vote for a new release in the beginning of August. Date of last release: 2014-07-29 (The vote for the 0.2.4 release was called on 2015-07-02) When were the last committers or PMC members elected? 2014-07-28 Signed-off-by: [ ](blur) Doug Cutting [X](blur) Patrick Hunt [X](blur) Tim Williams Shepherd/Mentor notes: -------------------- Calcite Calcite is a highly customizable engine for parsing and planning queries on data in a wide variety of formats. It allows database-like access, and in particular a SQL interface and advanced query optimization, for data not residing in a traditional database. (Renamed from Optiq on 2014-09-30.) Calcite has been incubating since 2014-05-19. Three most important issues to address in the move towards graduation: 1. Add more PPMC members. 2. Demonstrate community robustness by rotating project tasks among multiple project members. 3. There is no third thing. We are almost ready to graduate. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? None. How has the community developed since the last report? The last report was in April. (We are reporting a month late, because we missed the July report.) In July, there were 148 messages on dev@, 37 commits, 44 issues created, 39 issues resolved by 10 contributors. Diversity is improving. The 1.4 release will be the first release for which Julian Hyde was not release manager. Julian Hyde won best lightning talk at XLDB 2015 in May with the talk "Apache Calcite: One planner fits all". Tom Barber spoke about Calcite at ApacheCon NA in April. Collaborations with other Apache projects continue: * Phoenix has built a remote JDBC driver using Calcite’s Avatica component. * Phoenix is replacing their SQL parser & planner with Calcite. * Samza is developing support for streaming SQL queries using Calcite for parsing and planning. * Kylin upgraded from 0.9.2 to 1.3. * Collaboration with Hive and Drill continues. How has the project developed since the last report? We completed releases 1.2 and 1.3, and are preparing 1.4. Date of last release: 2015-05-30 apache-calcite-1.3.0-incubating When were the last committers or PMC members elected? 2015-04-24 5 new committers 2014-12-31 1 new PPMC member Signed-off-by: [X](calcite) Ted Dunning [X](calcite) Alan Gates [X](calcite) Steven Noels Shepherd/Mentor notes: Ted Dunning: This is turning into a serious community. They should consider graduation. johndament: Podling seems to be in good shape. They may want to consider beginning the graduation process. -------------------- Climate Model Diagnostic Analyzer CMDA provides web services for multi-aspect physics-based and phenomenon- oriented climate model performance evaluation and diagnosis through the comprehensive and synergistic use of multiple observational data, reanalysis data, and model outputs. Climate Model Diagnostic Analyzer has been incubating since 2015-05-08. Three most important issues to address in the move towards graduation: 1. Start developing at the ASF 2. Start using ASF JIRA 3. Get code pushed to ASF Git repo Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? N/A How has the community developed since the last report? See below How has the project developed since the last report? CMDA has not really gotten started at the ASF yet. Very little has changed since the last report. The most important thing is getting the community started. At the moment the CMDA JIRA is completely empty and the code base has yet to be pushed to the git repo. Mailing list activity is largely non-existent and there's no website up for the project yet. Hopefully these hurdles will be crossed during this next month so that more active develop can start for the project. Date of last release: None yet When were the last committers or PMC members elected? None yet Signed-off-by: [ ](climatemodeldiagnosticanalyzer) James W. Carman [ ](climatemodeldiagnosticanalyzer) Chris Mattmann [X](climatemodeldiagnosticanalyzer) Michael James Joyce [ ](climatemodeldiagnosticanalyzer) Kim Whitehall [ ](climatemodeldiagnosticanalyzer) Gregory D. Reddin -------------------- DataFu DataFu provides a collection of Hadoop MapReduce jobs and functions in higher level languages based on it to perform data analysis. It provides functions for common statistics tasks (e.g. quantiles, sampling), PageRank, stream sessionization, and set and bag operations. DataFu also provides Hadoop jobs for incremental data processing in MapReduce. DataFu has been incubating since 2014-01-05. Three most important issues to address in the move towards graduation: 1. Do first release 2. Grow user and contributor base 3. Increased committer activity Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? * Performing the initial release remains the most important milestone. However, the majority of the known tasks for this have been completed. The remaining tasks are related to documentation. We are able to generate a signed, versioned source release from the build system. How has the community developed since the last report? * A couple new contributors have submitted patches. One of these has been committed and the other is nearly ready to be committed. How has the project developed since the last report? * The build system has been updated to provide tasks for generating signed, versioned source releases. Documentation has been updated as well with instructions on how to do this. * Apache DataFu has been updated to run against Hadoop 2. There was an issue running the Hourglass integration tests against Hadoop 2, which had been blocking this update. * A couple new patches from two new contributors for Pig UDFs have been submitted. One of these is an improvement to the HyperLogLog UDF cardinality estimator that makes it much more efficient. The other is a helper for getting a tuple out of a bag. * A patch has been submitted for a UDF to incrementally process date-partitioned data in Pig. This provides similar functionality that is available in Hourglass. Date of last release: * Not yet released When were the last committers or PMC members elected? * November 2014 Signed-off-by: [ ](datafu) Ashutosh Chauhan [X](datafu) Roman Shaposhnik [X](datafu) Ted Dunning Shepherd/Mentor notes: Ted Dunning: The generation of signed releases on shared hardware has historically raised serious security questions from infra. I think that this process needs to be vetted very carefully. -------------------- Droids Droids aims to be an intelligent standalone robot framework that allows to create and extend existing droids (robots). Droids has been incubating since 2008-10-09. Shepherd/Mentor notes: johndament: Did not report. Podling seems to be in bad shape. Prior reports indicated similar issues. -------------------- FreeMarker FreeMarker is a template engine, i.e. a generic tool to generate text output based on templates. FreeMarker is implemented in Java as a class library for programmers. FreeMarker has been incubating since 2015-07-01. Three most important issues to address in the move towards graduation: 1. IP clearance 2. Move to ASF infrastructure, especially the code repository 3. Finding contributors Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? None How has the community developed since the last report? We are in early stage of incubation (like source code wasn't imported yet), so there's no change. How has the project developed since the last report? We have collected the required Software Grants and ICLA-s. We are working on the migration to the ASF infrastructure and preparing for the IP clearance process. Date of last release: There was no release from the Incubator yet When were the last committers or PMC members elected? We only have the initial comitters and inital PMC members yet. Signed-off-by: [X](freemarker) Jacopo Cappellato [ ](freemarker) Jean-Frederic Clere [ ](freemarker) David E. Jones [X](freemarker) Ralph Goers [ ](freemarker) Sergio Fernández Shepherd/Mentor notes: P. Taylor Goetz: Freemarker is still ramping up. -------------------- Kylin Kylin is a distributed and scalable OLAP engine built on Hadoop to support extremely large datasets. Kylin has been incubating since 2014-11-25. Three most important issues to address in the move towards graduation: 1. Grow community to add more PPMC members, contributors 2. Rotate community tasks between PPMC members 3. Well manage features (streaming and batch) within coming releases Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? * Nothing How has the community developed since the last report? 1. In July, there were 610 messages on dev@, 52 issues created, 22 issues resolved 2. Qianhao Zhou has presented Apache Kylin at China Hadoop Summit 2015 Shanghai on July 24, 2015 3. Debashis Saha and Luke Han has presented Apache Kylin at Hadoop Summit 2015 San Jose on June 9, 2015 4. Hongbin Ma has presented Apache Kylin at OSC (Open source innovation meetup) Shanghai on June 14, 2015 5. Fabian Wilckens has spoken about Apache Kylin at Berlin BuzzWords on June 1, 2015 6. Medha Samant has presented Apache Kylin at Drill Meetup Bayarea on May 26, 2015 How has the project developed since the last report? 1. Released 0.7.1 and 0.7.2, is preparing release 0.7.3 2. Cleanup and GC tool of cube build job 3. Early streaming features bring into 0.8 branch, continuing refactoring to support lambda architecture 4. Metadata migration tool 5. Kafka as streaming source 6. In-memory cubing for streaming 7. Upgraded Calcite to 1.3 to support better SQL functions and bug fixes 8. Bug fixes Date of last release: 2015-07-21 v0.7.2-incubating released 2015-06-10 v0.7.1-incubating released (First Apache Release) When were the last committers or PMC members elected? 1. Two new mentors joined Apache Kylin PMC: Julian Hyde and Taylor Goetz Signed-off-by: [ ](kylin) Owen O'Malley [X](kylin) Ted Dunning [X](kylin) Henry Saputra [X](kylin) Julian Hyde [X](kylin) P. Taylor Goetz Shepherd/Mentor notes: Ted Dunning: This is a very active and inclusive community. -------------------- ODF Toolkit Java modules that allow programmatic creation, scanning and manipulation of OpenDocument Format (ISO/IEC 26300 == ODF) documents ODF Toolkit has been incubating since 2011-08-01. Three most important issues to address in the move towards graduation: 1. Grow the community 2. Generate additional releases 3. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? Very quiet. How has the community developed since the last report? No new committers. New tickets have been raised by interested users. Date of last release: 2014-06-02 When were the last committers or PMC members elected? 2012-10-29 Signed-off-by: [ ](odftoolkit) Sam Ruby [ ](odftoolkit) Nick Burch [ ](odftoolkit) Yegor Kozlov Shepherd/Mentor notes: ------------------------- Sentry Sentry is a highly modular system for providing fine grained role based authorization to both data and metadata stored on an Apache Hadoop cluster. Sentry has been incubating since 2013-08-08. Three most important issues to address in the move towards graduation: 1. Encourage more feature and direction discussions on the dev list rather than jira. 2. Continue reporting on time 3. Improve release schedules Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? * Community has fixed all the issues raised except for the ongoing efforts mentioned in the previous section. * Community has released Sentry 1.5.1 after fixing the earlier release issues. * Making project direction more visible: Created a roadmap page on wiki, so that there is one place every one can see what is community working on or aspiring to work on. * Project is now doing monthly reporting How has the community developed since the last report? We had 73 messages on dev list last month. (Got number from http://markmail.org/list/org.apache.sentry.dev) How has the project developed since the last report? About 42 issues were created and about 46 resolved(Numbers from jira). Date of last release: 2015-07-14 When were the last committers or PMC members elected? Colin Ma, Dapeng Sun, Guoquan Shen and Xiaomeng Huang were added as committers on 12/24/2014. No new PPMC members have been added since the project has entered the incubator. Signed-off-by: [X](sentry) Arvind Prabhakar [ ](sentry) Joe Brockmeier [ ](sentry) David Nalley [ ](sentry) Olivier Lamy [X](sentry) Patrick Hunt [ ](sentry) Thomas White Shepherd/Mentor notes: -------------------- Sirona Monitoring Solution. Sirona has been incubating since 2013-10-15. Three most important issues to address in the move towards graduation: 1. Increase community Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? Nothing. How has the community developed since the last report? Not a lot. How has the project developed since the last report? Ongoing incremental improvements and bug fixes. Discussing/preparing a new release. Date of last release: 2014-06-26 When were the last committers or PMC members elected? None added since project has started Signed-off-by: [X](sirona) Olivier Lamy [ ](sirona) Henri Gomez [ ](sirona) Jean-Baptiste Onofre [ ](sirona) Tammo van Lessen [ ](sirona) Mark Struberg -------------------- Tamaya Tamaya is a highly flexible configuration solution based on an modular, extensible and injectable key/value based design, which should provide a minimal but extendible modern and functional API leveraging SE, ME and EE environments. Tamaya has been incubating since 2014-11-14. Three most important issues to address in the move towards graduation: 1. We need more active contributors. 2. We must provide support for Java EE. 3. We must release more often. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? No. How has the community developed since the last report? Streamlining all features and preparingthe first release took more time as originally suggested due to absences of key people involved. It has shown that additional committers are urgently needed. There were several that have shown interest, but unfortunately this did not lead to additional contributors. We hope that presentations at ApacheCon, Devoxx and several other conferences as well as articles at JAXenter and more will help to improve the community until end of year. How has the project developed since the last report? We have now an agreed core set of APIs and extensions that provide a healthy and usefule base for the future. The extensions are all well tested and documented, so we should be able tome come up if a good quality with our first release. The first release 0.1-incubating is now in the vote on PMC, so we are now on track to further wider community awereness for our project. Anatole has a article series on the topic in the biggest German technical paper and also will blog regularly on it, once the release is out. As a star spec lead his network should definitively help to grow community then. Date of last release: None. But first release is discussed in the PMC as of now, so within the next 1-2 week it should be out. When were the last committers or PMC members elected? See last report (no new committers or PMC members). Signed-off-by: [X](tamaya) John D. Ament [ ](tamaya) Mark Struberg [ ](tamaya) Gerhard Petracek [ ](tamaya) David Blevins Shepherd/Mentor notes: johndament: The small community came together quickly following existing ASF best practices to get their first together. Thank you especially to Justin Mclean for pre-reviewing the release to catch any issues. Once Tamaya gets through some community growth, they will be well functioning. -------------------- TinkerPop Apache TinkerPop is a graph computing framework. Apache TinkerPop has been incubating since 2015-01-16. Three most important issues to address in the move towards graduation: 1. Grow community. 2. N/A. 3. N/A. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? N/A. How has the community developed since the last report? TinkerPop has added a new contributor (Matt Frantz). Furthermore with the release of TinkerPop 3.0.0-incubating (i.e. GA), more graph vendors will start to implement the framework given the stability of the API. How has the project developed since the last report? - Released 3.0.0-incubating. - Currently working on 3.1.0 and 3.0.1 branches. Date of last release: July 9, 2015 When were the last committers or PMC members elected? A new committer -- Matt Frantz (July 8, 2015) Signed-off-by: [X] (tinkerpop) Rich Bowen -------------------- Trafodion Trafodion is a webscale SQL-on-Hadoop solution enabling transactional or operational workloads on Hadoop. Trafodion has been incubating since 2015-05-24. Four most important issues to address in the move towards graduation: 1. Develop community and a deeper understanding of the Apache Way. Move all communication to project public lists. 2. Complete wiki migration and website build. 3. Resolve remaining license conflicts. 4. Make our first Apache (incubating) release. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? None. How has the community developed since the last report? * All issues are now discussed through JIRAs. * An on boarding process for new contributors has been documented in the wiki. * We have 30 contributors from more than 4 organizations. * Accepted to present at ApacheCon in Budapest on September 30. * At least 2 users have been guided through public lists as they try out the product. How has the project developed since the last report? * Website up at http://trafodion.incubator.apache.org/ * 5 pages added to the wiki at https://cwiki.apache.org/confluence/display/TRAFODION/ * Daily builds are being done using a CI system outside of ASF Infrastructure. * 17 authors have made 29 commits to master in July. 165 files changed, 9518 lines additions, 5742 deletions. * With migration from previous issue tracking system completed we have 1415 JIRAs created and 36 resolved in July 2015 Date of last release: We have not done a release of Trafodion since incubation. When were the last committers or PMC members elected? Steve Varnau elected as committer on July 16, 2015. Signed-off-by: [X](trafodion) Andrew Purtell [ ](trafodion) Devaraj Das [ ](trafodion) Enis Söztutar [ ](trafodion) Lars Hofhansl [X](trafodion) Michael Stack [X](trafodion) Roman Shaposhnik Shepherd/Mentor notes: P. Taylor Goetz: Podling is still ramping up. Mentors engaged in the process. -------------------- Twill Twill is an abstraction over Apache Hadoop YARN that reduces the complexity of developing distributed applications, allowing developers to focus more on their business logic. Twill has been incubating since 2013-11-14. Three most important issues to address in the move towards graduation: 1. Encouraging more contributions in open manner 2. More regular release cycles and roadmap 3. Increase adoptions Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? * Need help from mentors to verify releases to get binding votes in dev list before going to general incubator list How has the community developed since the last report? * New release 0.6.0-incubating on July 24, 2015 * 19 JIRA issues resolved since last report * Add 2 new external contributors * Add a new PPMC member How has the project developed since the last report? * Version 0.6.0-incubating is released * Fixing issue to support MapR distribution * Adding new PPMC member: Henry Saputra Date of last release: 2015-07-24 0.6.0-incubating When were the last committers or PMC members elected? 2015-08-04 Henry Saputra Signed-off-by: [ ](twill) Arun C Murthy [ ](twill) Tom White [X](twill) Patrick Hunt [ ](twill) Andrei Savu Shepherd/Mentor notes: |