/!\ *FINAL* (!)
Incubator PMC report for May 2015
Timeline
Wed May 06 |
Podling reports due by end of day |
Sun May 10 |
Shepherd reviews due by end of day |
Sun May 10 |
Summary due by end of day |
Tue May 12 |
Mentor signoff due by end of day |
Wed May 13 |
Report submitted to Board |
Wed May 20 |
Board meeting |
Shepherd Assignments
Andrei Savu |
AsterixDB |
Andrei Savu |
Groovy |
Drew Farris |
BatchEE |
Justin Mclean |
Myriad |
Konstantin Boudnik |
Blur |
Konstantin Boudnik |
Kylin |
Matthew Franklin |
Droids |
Matthew Franklin |
Twill |
P. Taylor Goetz |
NiFi |
P. Taylor Goetz |
REEF |
Raphael Bircher |
Tamaya |
Raphael Bircher |
TinkerPop |
Suresh Marru |
CommonsRDF |
Suresh Marru |
Slider |
Timothy Chen |
Singa |
Timothy Chen |
Sirona |
Report content
Incubator PMC report for May 2015 The Apache Incubator is the entry path into the ASF for projects and codebases wishing to become part of the Foundation's efforts. Things have been going well in incubator lately with no major problems to highlight. The last member election added a large number of new members and several of these have taken the opportunity to join the IPMC. A (good) challenge for the Incubator will be to make sure that these people feel welcome and make contributions by shepherding and mentoring. * Community New IPMC members: Amareshwari Sriramadasu David Lester Kim Whitehall P. Taylor Goetz Michael Joyce Jitendra Pandey * New Podlings Geode * Graduations The board has motions for the following: Parquet * Releases The following releases were made since the last Incubator report: 2015-04-02 apache-ignite-1.0.0 2015-04-02 apahce-johnzon-0.7 2015-04-15 apache-parquet-mr-1.6.0 2015-04-16 apache-calcite-1.2.0 2015-04-25 apache-streams-project-0.2 2015-04-27 apache-tinkerpop-3.0.0.M8-incubating * IP Clearance Apache Storm Azure Eventhub Integration Donation of Apache Flex documentation by Adobe Donation of Apache Usergrid source code by Apigee. * Legal / Trademarks * Infrastructure The "Marvin" report reminders fired in a timely manner for the first time in several months and were sent to the proper podlings. A replacement script had been contemplated but now that there is less urgency it seems likely that we will continue to use the existing facilities. The only problem was that the script worked against an old board report. This issue has reportedly been fixed as well. * Miscellaneous -------------------- Summary of podling reports -------------------- * Still getting started at the Incubator AsterixDB Myriad * Not yet ready to graduate No release: CommonsRDF Groovy Kylin Singa Tamaya Zeppelin Community growth: NiFi Slider TinkerPop Twill * Ready to graduate Blur * Low Activity Droids ODF Toolkit * Did not report, expected next month BatchEE REEF Sirona ---------------------------------------------------------------------- Table of Contents AsterixDB Blur CommonsRDF Droids Groovy Kylin Myriad NiFi ODF Toolkit Singa Slider Tamaya TinkerPop Twill Zeppelin ---------------------------------------------------------------------- -------------------- AsterixDB Apache AsterixDB is a scalable big data management system (BDMS) that provides storage, management, and query capabilities for large collections of semi- structured data. AsterixDB has been incubating since 2015-02-28. Three most important issues to address in the move towards graduation: 1. Get the site up. 2. Do an Apache release. 3. Grow community Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? No, still getting started. How has the community developed since the last report? The SGA has been signed and the code has been imported. More discussions happen on the Apache lists now. How has the project developed since the last report? SGA and code drop done, need to get the site (and maybe the Wiki) up as well. Date of last release: No Releases yet. When were the last committers or PMC members elected? No elected PMC and/or committers Signed-off-by: [x](asterixdb) Ate Douma [x](asterixdb) Chris Mattmann [x](asterixdb) Henry Saputra [x](asterixdb) Jochen Wiedmann [x](asterixdb) Ted Dunning -------------------- Blur Blur is a search platform capable of searching massive amounts of data in a cloud computing environment. Blur has been incubating since 2012-07-24. Three most important issues to address in the move towards graduation: 1. We anticipate pursuing graduation after our upcoming release. 2. 3. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? None. How has the community developed since the last report? - Subscriptions: user@ - 57[-3]; dev@ - 67[+1] How has the project developed since the last report? Many bug fixes related to stability and bulk incremental ingestion. Date of last release: 2014-07-29 When were the last committers or PMC members elected? 2014-07-28 Signed-off-by: [ ](blur) Doug Cutting [X](blur) Patrick Hunt [X](blur) Tim Williams Shepherd/Mentor notes: Konstantin Boudnik (cos): Human activity on Dev list is almost zero: high 90% of the emails are from CI system or JIRA notificaitons. Tim Williams (twilliams): The comment above is from a shepherd, not a mentor. Further discussion: http://s.apache.org/HWi -------------------- CommonsRDF Commons RDF is a set of interfaces and classes for RDF 1.1 concepts and behaviours. The commons-rdf-api module defines interfaces and testing harness. The commons-rdf-simple module provides a basic reference implementation to exercise the test harness and clarify API contracts. CommonsRDF has been incubating since 2015-03-06. Three most important issues to address in the move towards graduation: 1. Grow the CommonsRDF Community such that we can progress towards graduation 2. Further engage the podling with the nuances of the Apache Incubation process 3. Drive towards the first incubating release Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? Peter Ansell resigned from the PPMC, but remains affiliated with the project. How has the community developed since the last report? Development and coding practices agreed. Newcomers are joining discussions, adding feature requests. Mailing list subscribers numbers were not included in last report. Numbers for April 2015: dev@ ======> 16 subscribers, 333 messages commits@ ======> 9 subscribers, 248 messages How has the project developed since the last report? There has been a bunch of development activity going on at CommonsRDF with over 200 dev@ messages in March and 300 in April. Website and documentation established at http://commonsrdf.incubator.apache.org. All project communication and development has been migrated to Apache Infrastructure. The project has been introduced to the W3C Data on the Web Best Practices Working Group to increase the community. There is also an ongoing thread relating to the first project incubating release with a release candidate currently being voted on. Date of last release: XXXX-XX-XX When were the last committers or PMC members elected? N/A Signed-off-by: [X](commonsrdf) Rob Vesse [X](commonsrdf) John D Ament [ ](commonsrdf) Gary Gregory [X](commonsrdf) Lewis J. McGibbney (Champion) [X](ipmc) Chris Mattmann Shepherd/Mentor notes: Chris Mattmann: Peter Ansell's resignation from the IPMC isn't related to this project, right? Rob Vesse: Peter Ansell's resignation was due to frustrations at the speed of progress particularly around some technical discussions that he had felt had previously been resolved prior to this project entering the Incubator and so he has chosen to focus his efforts on other projects. The project does seem to now have resolved those issues and has been able to move forward with a first release candidate. John Ament: Peter Ansell resigned from the PPMC/Podling, not the IPMC. -------------------- Droids Droids aims to be an intelligent standalone robot framework that allows to create and extend existing droids (robots). Droids has been incubating since 2008-10-09. Three most important issues to address in the move towards graduation: 1. Activity 2. Name Search Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? None. Name search needs to be concluded. Availability looks better this quarter for completing that task. How has the community developed since the last report? No change How has the project developed since the last report? No Change Date of last release: 2012-10-15 When were the last committers or PMC members elected? 2012-05-07 Signed-off-by: [x](droids) Thorsten Scherler [x](droids) Richard Frovarp Shepherd/Mentor notes: Chris Mattmann: Droids has been incubating for quite a while - is it time to graduate or retire? -------------------- Groovy Apache Groovy is a multi-faceted programming language for the Java platform. Groovy is a powerful, optionally typed and dynamic language, with static- typing and static compilation capabilities, aimed at multiplying developers’ productivity thanks to a concise, familiar and easy to learn syntax. It integrates smoothly with any Java program, and immediately delivers to your application powerful features, including scripting capabilities, Domain- Specific Language authoring, runtime and compile-time meta-programming and functional programming. Groovy has been incubating since 2015-03-24 The most important issues to address in the move towards graduation: 1. We still have to get our new release process ready for making our first release under the incubator banner 2. We need to continue encouraging our users to use our new resources at Apache instead of using the old ones at Codehaus (in particular mailing-lists which are still running at Codehaus) Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? We noticed some issues with JIRA rights that we brought to the attention to our mentors. How has the community developed since the last report? With the JIRA creation and the mirroring on Github, the project received new tickets and also code contributions through pull requests. So the the community has followed the project at Apache, and has managed to move to using our new resources there, and new users contributing. How has the project developed since the last report? Since the last report, the JIRA issue tracker has been created and Codehaus JIRA issues have been moved in. We also got a "notifications" mailing-list created for JIRA notification emails. The Git repository has also been created and the code was imported in Apache's Git, and mirrored on Github. Date of last release: Not yet released under the Apache incubation umbrella. When were the last committers or PMC members elected? No new election. Signed-off-by: [ ](groovy) Andrew Bayer [X](groovy) Konstantin Boudnik [X](groovy) Bertrand Delacretaz [X](groovy) Jim Jagielski [X](groovy) Emmanuel Lecharny [X](groovy) Roman Shaposhnik Shepherd/Mentor notes: Andrei Savu: Integration into the Incubator is going well. -------------------- Kylin Kylin is a distributed and scalable OLAP engine built on Hadoop to support extremely large datasets. Kylin has been incubating since 2014-11-25. Three most important issues to address in the move towards graduation: 1. Make the first release from apache, it's in progress now, status tracking under: KYLIN-669 2. Grow user and contributor base, increase the number of active committers 3. Add more documentation to support new users and contributors. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? * Nothing How has the community developed since the last report? 1. Kylin joined Spark Meetup Bay Area on March 23 to discussed "Adding Spark Support to Apache Kylin" 2. Kylin has been presented at Hadoop Summit Europe by Ted Dunning on April 16 3. Kylin has been presented at Database Technology Conference 2015 Beijing by Yang Li on April 19 4. Luke Han presented Kylin's open source topic at QCon 2015 Beijing on April 23 5. Kylin has been presented at Strata+Hadoop World London 2015 by Luke Han and Yang Li on May 6 6. Kylin will be present at HBaseCon 2015 by Seshu Adunuthula on May 7 8. Offical twitter account created: @ApacheKylin * Followers 235 9. Issue backlog status since last report: * Created: 124 * Resolved: 61 10. Mailing list activity since last report: * @dev 475 messages in April and 421 messages in March How has the project developed since the last report? 1. Binary package for user to install without build from source which reduced a lot deployment issues. 2. Streaming OLAP function prototype. 3. New Cubing Algorithm Date of last release: None yet, the community is activity working on the first release: KYLIN-669 When were the last committers or PMC members elected? 1. 3 news committers has been elected on April 8: Shaofeng Shi, Qianhao Zhou, Jason Zhong Signed-off-by: [ ](kylin) Owen O'Malley [x](kylin) Ted Dunning [x](kylin) Henry Saputra Shepherd/Mentor notes: Konstantin Boudnik: No issues with the project: mail lists are very active. -------------------- Myriad Myriad enables co-existence of Apache Hadoop YARN and Apache Mesos together on the same cluster and allows dynamic resource allocations across both Hadoop and other applications running on the same physical data center infrastructure. Myriad has been incubating since 2015-03-01. Three most important issues to address in the move towards graduation: 1. Fill out the ip-clearance form and donate the Myriad code to ASF. 2. Migrate the code and issues from github, change all links/references. 3. Figure out how and when to release a new "version" of Myriad. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? None. How has the community developed since the last report? More than 100 emails on dev@. Began open community-wide meetings/hangouts. One new community member from China, and more from MapR. Gave presentations at ApacheCon, Data Science MD, and East Bay Big Data Group. Upcoming presentations at China Mesos User Group and at MesosCon in August. How has the project developed since the last report? Significant recent commits/PRs include: 1. Committed: Remote binary distribution (PR#83) 2. Committed: Configuration via REST API (PR#84) 3. In review: Multi-project build (PR#77) 4. In progress: Web UI Dashboard (PR#82) 5. In progress: Fine-grained scaling (PR#91) 6. In progress: High availability for the Scheduler/RM (PR#94) 7. In progress: Dockerizing the Scheduler/ResourceManager (PR#95) Date of last release: No releases yet. Still at 0.0.1 in the source. Will plan a release after we migrate to Apache git. When were the last committers or PMC members elected? Need to grant Apache git karma to initial committers and migrate the code base. Then we will vote in new committers from the existing developer community. Signed-off-by: [ ](myriad) Benjamin Hindman [ ](myriad) Danese Cooper [x](myriad) Ted Dunning [ ](myriad) Luciano Resende Shepherd/Mentor notes: Justin Mclean (jmclean): Mentors active, no issues, project just starting out. -------------------- NiFi NiFi is a dataflow system based on the concepts of flow-based programming. NiFi has been incubating since 2014-11-24. Three most important issues to address in the move towards graduation: 1. Continue to grow the community and support the new user base 2. Establish rhythm for releases and improve documentation and procedures 3. Provide a clear and expedient process for code contribution and review Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? None. How has the community developed since the last report? - We have a new PPMC member - Aldrin Piri. - We completed our second release on March 17 2015. - Two talks were given at ApacheCon NA 2015 featuring Apache NiFi (incubating) - The first Apache NiFi meetup was held in the Baltimore/Washington area. - The project has code contributions from more than 25 people. - The mailing lists are quite active with developer questions and an increasing amount of user focused questions. The dev list has 118 registered addresses. Commits has 30 and our brand new 'users' list established in mid April has 20. How has the project developed since the last report? - We have produced our second release within the Apache Incubator. - We are in the closing stages of our third release and includes bug fixes, new features, and improved documentation with significant representation of contribution outside of the PPMC. Date of last release: 2015-03-16 When were the last committers or PMC members elected? 2015-03-17 Signed-off-by: [X](nifi) Billie Rinaldi [ ](nifi) Arvind Prabhakar [X](nifi) Sergio Fernandez [ ](nifi) Benson Margulies [ ](nifi) Brock Noland [X](nifi) Drew Farris [X](nifi) Andrew Purtell Shepherd/Mentor notes: P. Taylor Goetz (ptgoetz): Mentors engaged. Podling seems to be doing well with no issues requiring mentor assistance. -------------------- ODF Toolkit This report is a catch up from last month which we missed. Java modules that allow programmatic creation, scanning and manipulation of OpenDocument Format (ISO/IEC 26300 == ODF) documents ODF Toolkit has been incubating since 2011-08-01. Three most important issues to address in the move towards graduation: 1. Grow the community in terms of committers 2. Have regular releases 3. Decide if we would like to be a top level project or join an existing project, or move to the attic. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? Nothing new, very quiet. But we are not dead yet :-) How has the community developed since the last report? No new committers, some minor activity re tickets in Jira How has the project developed since the last report? The latest release has been added as a Maven artifact in response to a user request. Date of last release: 2014-06-02 When were the last committers or PMC members elected? 2012-10-29 Signed-off-by: [X](ipmc) Chris Mattmann Shepherd Notes: Chris Mattmann: - perhaps think about joining Apache POI and/or Tika? -------------------- Singa Singa is a distributed deep learning platform. Singa has been incubating since 2015-03-17. Three most important issues to address in the move towards graduation: 1. Grow the community of developers and users. 2. Build the homepage and add more documentations. 2. Prepare for the first release. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? N/A. How has the community developed since the last report? Three software engineers from NetEase have joined the dev@ list. They have been working on deep learning using GPUs for speech processing. How has the project developed since the last report? 1. We have updated the Incubation Status file. 2. We have finished migrating the code to Apache git repository. 3. We have discussed on the features and development schedule for first release. 4. A new communication framework has been implemented to unify the training architectures used by existing systems. 5. We have added GNU autotools for installing Singa. Date of last release: N/A. When were the last committers or PMC members elected? N/A. Signed-off-by: [ ](singa) Daniel Dai [ ](singa) Alan Gates [x](singa) Ted Dunning [ ](singa) Thejas Nair -------------------- Slider Slider is a collection of tools and technologies to package, deploy, and manage long running applications on Apache Hadoop YARN clusters. Slider has been incubating since 2014-04-29. Three most important issues to address in the move towards graduation: 1. Building a diverse developer and user community 2. Achieving broader adoption of the existing code and slider-deployable applications (examples: HBase, Accumulo) 3. Making slider better at deploying other applications, so improving takeup. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? None How has the community developed since the last report? We are getting some questions from users on the list and an occasional patch submitted. A number of features added to the recent releases were driven by user needs. How has the project developed since the last report? We completed release 0.61.0-incubating in February with more complex release artifacts than we had released previously. We also released 0.70.1-incubating in March. Planning is under way for releasing 0.80 in May 2015. Date of last release: 2015-03-31: Slider 0.70.1-incubating 2015-02-19: Slider 0.61.0-incubating When were the last committers or PMC members elected? 2014-09-27: Gour Saha, committer and PPMC member Signed-off-by: [ ](slider) Arun C Murthy [ ](slider) Devaraj Das [ ](slider) Jean-Baptiste Onofré [x](slider) Mahadev Konar -------------------- Tamaya Tamaya is a highly flexible configuration solution based on an modular, extensible and injectable key/value based design, which should provide a minimal but extendible modern and functional API leveraging SE, ME and EE environments. Tamaya has been incubating since 2014-11-14. Three most important issues to address in the move towards graduation: 1. Publish a first release until mid year. 2. Keep focus for a reasonable functionality and way forward. 3. Keep up/increase community engagement, increase publicity by further evangelizing it. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? No. How has the community developed since the last report? Two people have shown very interested 1) on the mailing list, or 2) even helped with some work at ZH Hackergarten. Crcial will be going out with a first release asap. How has the project developed since the last report? We successfully backported API/core to Java 7. Overall project quality increased. Some API aspects were reevaluated and several bugfixes and new features were added. Also a lot of documentation and examples were added, so we definitively approach a first release. Date of last release: N/A (not released anything). When were the last committers or PMC members elected? 25th January 2015 (Reinhard Sandtner) Signed-off-by: [X](tamaya) John D. Ament [X](tamaya) Mark Struberg [ ](tamaya) Gerhard Petracek [ ](tamaya) David Blevins Shepherd/Mentor notes: John Ament: Podling is beginning the process towards the first release. -------------------- TinkerPop TinkerPop is a graph computing framework written in Java TinkerPop has been incubating since 2015-01-16. Three most important issues to address in the move towards graduation: 1. Get more committers on the project. 2. Get TinkerPop 3.0.0.GA out. 3. Get vendors migrated from TP2 to TP3 Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? None. How has the community developed since the last report? Vendors are starting to use dev@ to communicate requirements for their respective products. How has the project developed since the last report? We released 3.0.0.M8-incubating -- our first Apache release. Date of last release: April 6, 2015 When were the last committers or PMC members elected? None. Signed-off-by: [ ](tinkerpop) Rich Bowen [ ](tinkerpop) Daniel Gruno [ ](tinkerpop) Hadrian Zbarcea [ ](tinkerpop) Matt Franklin [ ](tinkerpop) David Nalley -------------------- Twill Twill is an abstraction over Apache Hadoop® YARN to reduce the complexity of developing distributed applications. Twill has been incubating since 2013-11-14. Top three items to resolve before graduation: - More committers from different organizations. - Regular releases. - Increase adoption. Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? - None at this time. How has the community developed since the last report? - 14 new JIRA issues filed since last report (2015-02-01) - 12 JIRA issues resolved since last report (2015-02-01) - 4 new contributors submitted patches How has the project developed since the last report? - Version 0.6.0-incubating is being worked upon - New project using Twill: Fluo - transaction layer that enables incremental processing on big data - Twill ported to work on Mapr distribution Date of last release: - 2015-02-27: 0.5.0-incubating What are the plans for the next period? - Encourage contributions from active users - Identify potential committers - Improve documentation and website When were the last committers or PMC members elected? - No new committers since incubation. Signed-off-by: [ ](twill) Vinod K [ ](twill) Arun C Murthy [ ](twill) Tom White [X](twill) Patrick Hunt -------------------- Zeppelin A collaborative data analytics and visualisation tool for distributed, general-purpose data processing systems such as Apache Spark, Apache Flink, etc. Zeppelin has been incubating since 2014-12-23. Three most important issues to address in the move towards graduation: 1. Do an Apache release 2. Community growth: more committers from different organisations 3. Increase adoption Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of? None. How has the community developed since the last report? More people submitting patches and feature requests then in previous month: 30 patches has been merged and 40 patches has been submitted from 21 different contributors. Traffic in users@ grew a lot in last month with new users asking and new contributors answering questions: +27 subscribers in dev@, +58 subscribers in users@ since last month. Introduction to Zeppelin was well received on ApacheCon 2015, it generated some interest from other projects in collaboration\integration which resulted in discussions dev@ and new JIRA issues. How has the project developed since the last report? Complete PODLINGNAMESEARCH-64 Generic JDBC as well as TajoJDBC and HiveJDBC interpreters were contributed by individual contributors as well as a bunch bugs were fixed. Pluggable notebook persistence layer was abstracted. Rich GUI inside Notebook was added (custom AngularJS code) Date of last release: None When were the last committers or PMC members elected? 2015-03-27 Signed-off-by: [X](zeppelin) Konstantin Boudnik [x](zeppelin) Henry Saputra [X](zeppelin) Roman Shaposhnik [x](zeppelin) Ted Dunning [ ](zeppelin) Hyunsik Choi