The announcement page have been moved to https://airflow.apache.org/announcements/
Note : Follow @ApacheAirflow on Twitter for the latest news and announcements!
July 20, 2020
Airflow PMC welcomes Leah Cole (Github: @leahecole) and Ry Walker (Github: @ryw) as new Airflow Committers.
July 10, 2020
We've just released Airflow v1.10.11
https://pypi.org/project/apache-airflow/1.10.11/
https://airflow.apache.org/docs/1.10.11/
https://airflow.apache.org/docs/1.10.11/changelog.html
306 commits since 1.10.10 (12 New Features, 90 Improvements, 53 Bug Fixes, and several doc changes)
Jul 8, 2020
Airflow PMC welcomes Daniel Imberman, (Github:dimberman), Tomek Turbaszek, (Github:turbaszek), and Kamil Breguła (Github:mik-laj) as new PMC members, and QP Hou (Github:houqp) as a committer.
Congrats!
Jul 6, 2020
The (virtual) Airflow Summit has begun – you can watch along at airflowsummit.org
Jun 24, 2020
We've just released Airflow Backport Provider Packages 2020.6.24
The Backport provider packages make it possible to easily use Airflow 2.0 Operators, Hooks, Sensors, Secrets, Transfers in Airflow 1.10. More stats below, but the Backport Provider packages increase the number of easily-available integrations for Airflow 1.10 users by a whopping 55%.
- We have 58 backport packages in total. 599 classes (Operators, Hooks, Transfers, Sensors, Secrets)
- We have 213 new (!) classes that have not been easily available to 1.10 users so far:
- Operators: 150
- Transfers: 12
- Sensors: 14
- Hooks: 37
- Secrets: 0
- We have 386 classes that were moved. Quite a number of those (hard to say exactly how many) got new features, options, parameters.
- Operators: 204
- Transfers: 36
- Sensors: 46
- Hooks: 96
- Secrets: 4
Apr 9, 2020
We've just released Airflow v1.10.10
https://pypi.org/project/apache-airflow/1.10.10/
https://airflow.apache.org/docs/1.10.10/
https://airflow.apache.org/docs/1.10.10/changelog.html
199 commits since 1.10.9 (11 New Features, 43 Improvements, 44 Bug Fixes, and several doc changes)
Mar 31, 2020
Airflow PMC welcomes Jiajie Zhong (Github:zhongjiajie) as its new committer. Congrats!
and
Second Warsaw Airflow Meetup is happening next week and it will be an online event!
https://www.meetup.com/pl-PL/Warsaw-Airflow-Meetup/events/269763588/
Feb 7, 2020
We've just released Airflow v1.10.8
https://pypi.org/project/apache-airflow/1.10.8/
https://airflow.apache.org/docs/1.10.8/
http://airflow.apache.org/docs/1.10.8/changelog.html#airflow-1-10-8-2020-01-07
160 commits since 1.10.7 (4 new features, 42 improvements, 36 bug fixes, and several doc changes)
and
We've just released Airflow 1.10.9 (this one is a quick fix to work around the breaking release of Werkzeug 1.0)
https://pypi.org/project/apache-airflow/1.10.9/
https://airflow.apache.org/docs/1.10.9/
2 commits since 1.10.8 :)
Dec 24, 2019
We've just released Airflow v1.10.7
https://pypi.org/project/apache-airflow/1.10.7/
https://airflow.readthedocs.io/en/1.10.7/
https://github.com/apache/airflow/blob/1.10.7/CHANGELOG.txt
217 commits since 1.10.6 including some Critical Bugfixes and Performance Improvements (17 new features, 57 improvements, 52 bug fixes, and several doc changes)
Dec 20, 2019
Airflow PMC welcomes Tomasz Urbaszek (Github:turbaszek) as its new committer. Congrats!
Nov 30, 2019
Airflow PMC welcomes Kengo Seki (Github:sekikn) to both its committer and PMC ranks. Congrats!
Nov 27, 2019
New website for Apache Airflow is live : https://airflow.apache.org Same URL with more & better webpages
Nov 22, 2019
Airflow PMC has voted in & promoted
Jarek Potiuk (@higrys) to be a PMC Member.
Jarek has been one of the most active community members and has spread the word about Airflow Well deserved Jarek, congratulations
Nov 21, 2019
Airflow PMC has voted in & promoted Aizhamal Nurmamat kyzy (@Aizhamal) and Kevin Yang (@Kevin Yang) to be a part of Airflow PMC.
Oct 28, 2019
We've just released @ApacheAirflow v1.10.6
https://pypi.org/project/apache-airflow/1.10.6/
https://airflow.apache.org/1.10.6/
168 commits since 1.10.5 (including 6 new features, 35 improvements, 38 bug fixes, and the usual swathe of doc fixes and CI improvements)
Oct 18, 2019
Airflow PMC has voted in & promoted Jarek Potiuk (@higrys) to be a PMC Member.
Jarek has been one of the most active community members and has spread the word about Airflow Well deserved Jarek, congratulations
Sep 24, 2019
What do you think of our new logo? #AirflowLogo #ApacheAirflow
Sep 18, 2019
Two meetups are happening soon:
- Seattle, WA on Thursday 19th: https://www.meetup.com/Seattle-Apache-Airflow-Users-Group/events/263013440/
- London, UK on Tuesday 24th: https://www.meetup.com/London-Apache-Airflow-Meetup/events/264521028/
We'll put links to any recordings here once they are available.
Sep 9, 2019
The PMC has just added two new Airflow Committers :
• Felix Uellendall (https://github.com/feluelle/)
• Chao-han Tsai (https://github.com/milton0825/)
Sep 4, 2019
We've just released @ApacheAirflow v1.10.5
https://pypi.org/project/apache-airflow/1.10.5/
https://airflow.apache.org/1.10.5/
95 commits since 1.10.4 (including 3 new features, 17 improvements, 23 bug fixes, and lots more doc fixes and CI improvements)
Aug 6, 2019
We've just released @ApacheAirflow v1.10.4
https://pypi.org/project/apache-airflow/1.10.4/
https://airflow.apache.org/1.10.4/
377 commits since 1.10.3 (including 50 new features, 107 improvements, 91 bug fixes, and lots more doc fixes and CI improvements)
May 15, 2019
The community welcomes the latest Apache Airflow meetup group: The Melbourne Apache Airflow meetup. Stay tuned for its first meetup event!
May 2, 2019
The Apache Airflow PMC welcomes a slew of new committers to it ranks! The following contributors are now Airflow Committers:
- Daniel Imberman
- Jarek Potiuk
- Bas Harenslak
- Joshua Carp
- Kevin Yang
- Kamil Bregula
Congratulations folks - Very well deserved.
Apr 10, 2019
New Apache Airflow release 1.10.3 is out!
Source, Binary "Sdist" & binary wheel release : https://www.apache.org/dist/airflow/1.10.3/
Pypi : https://pypi.org/project/apache-airflow/1.10.3/ (Run `pip install apache-airflow`)
Release Notes : https://airflow.apache.org/1.10.3/changelog.html#airflow-1-10-3-2019-04-09
This release no longer needs the SLUGIFY_USES_TEXT_UNIDECODE/AIRFLOW_GPL_UNIDECODE environment variables at install time to avoid the GPL dependency!
Apr 3, 2019
The Apache Airflow NYC meetup is having its next meetup on April 29, 2019 – more details here
If you are in or around NYC, please be sure to check it out!
Mar 18, 2019
The Apache Airflow PMC welcomes new committer, Daniel Imberman (a.k.a. dimberman).
Mar 7, 2019
The Apache Airflow PMC welcomes new committer, Xiaodong Deng (a.k.a. XD, XD-DENG)
Feb 14, 2019
We are pleased to announce our newest Meetup, this one in Portland, Oregon, USA: https://www.meetup.com/Portland-Apache-Airflow-Meetup/
New Apache Airflow release 1.10.2 is out!
Source & Binary "Sdist" release : https://dist.apache.org/repos/dist/release/airflow/1.10.2/
Pypi : https://pypi.python.org/pypi/apache-airflow (Run `pip install apache-airflow`)
Release Notes : https://airflow.apache.org/changelog.html#airflow-1-10-2-2019-01-19
By default one of Airflow's dependencies installs a GPL dependency (unidecode). To avoid this dependency set SLUGIFY_USES_TEXT_UNIDECODE=yes in your environment when you install or upgrade Airflow. To force installing the GPL version set AIRFLOW_GPL_UNIDECODE. One of these two environment variables must be specified.
The Apache Airflow Paris meetup is having its second meetup on Feb 6, 2019 – more details here
If you are in or around Paris, please be sure to check it out!
Jan 8, 2019
Apache Airflow graduates from the Incubator and is now a TLP!
- ASF PR announcements
- GlobeNewswire http://globenewswire.com/news-release/2019/01/08/1681851/0/en/The-Apache-Software-Foundation-Announces-Apache-Airflow-as-a-Top-Level-Project.html
- ASF "Foundation" Blog https://s.apache.org/LeeE
- @TheASF Twitter Feed https://twitter.com/TheASF/status/1082593312421208064
- The ASF on LinkedIn https://www.linkedin.com/company/the-apache-software-foundation
- You can find more announcements on our twitter account as well : https://twitter.com/ApacheAirflow
Community Blogs
Nov 21, 2018
New Apache Airflow release 1.10.1-incubating is out!
Source & Binary "Sdist" release : https://dist.apache.org/repos/dist/release/incubator/airflow/1.10.1-incubating/
Pypi : https://pypi.python.org/pypi/apache-airflow (Run `pip install apache-airflow`)
Release Notes : https://github.com/apache/incubator-airflow/blob/v1-10-test/CHANGELOG.txt
By default one of Airflow's dependencies installs a GPL dependency (unidecode). To avoid this dependency set SLUGIFY_USES_TEXT_UNIDECODE=yes in your environment when you install or upgrade Airflow. To force installing the GPL version set AIRFLOW_GPL_UNIDECODE. One of these two environment variables must be specified.
We are excited to announce that the Paris Apache Airflow Meetup will be hosting its inaugural meetup on Nov 21
Speakers include Chauffeur Prive (event organizer). More to come soon!
Sept 17, 2018
The Singapore Big Data Meetup will host "Intro to Airflow" via @XD-DENG on Sept 27, 2018! Check it out! http://bit.ly/2PMgABT
Sept 10, 2018
We are excited to announce that the London Apache Airflow Meetup will be hosting its inaugural meetup on Sept 20
Speakers include London committer Ash Berlin-Taylor & Ben Marengo from Just Eat!
Sept 9, 2018
The Bay Area Apache Airflow Meetup group will be hosting its next meetup at Google on Sept 24!
Five 20-minute talks followed by 6 lightning sessions! Come one, come all!
Sept 8, 2018
We welcome the 7th & latest regional Apache Airflow Meetup, this one in Seattle : https://lnkd.in/dYt2hE8
Aug 26, 2018
The Apache Airflow Meetup group in Amsterdam will be hosting its 2nd meetup at GoDataDriven on Sep 12.
Aug 20, 2018
New Apache Airflow release 1.10.0-incubating is out!
Source & Binary "Sdist" release : https://dist.apache.org/repos/dist/release/incubator/airflow/1.10.0-incubating/
Pypi : https://pypi.python.org/pypi/apache-airflow (Run `pip install apache-airflow`)
Release Notes : https://github.com/apache/incubator-airflow/blob/8100f1f/CHANGELOG.txt
By default one of Airflow's dependencies installs a GPL dependency (unidecode). To avoid this dependency set SLUGIFY_USES_TEXT_UNIDECODE=yes in your environment when you install or upgrade Airflow. To force installing the GPL version set AIRFLOW_GPL_UNIDECODE. One of these two environment variables must be specified.
Aug 3, 2018
The Apache Airflow PPMC welcomes new committer and PPMC member, Tao Feng (a.k.a. feng-tao)
Jun 1, 2018
We're happy to welcome a new Apache Airflow Meetup group -- this one in London, UK : https://www.meetup.com/London-Apache-Airflow-Meetup/
May 23, 2018
We're happy to welcome a new Apache Airflow Meetup group -- this one in Chicago : https://www.meetup.com/Chicago-Apache-Airflow-incubating-Meetup/
The Apache Airflow PPMC welcomes new committer and PPMC member, Kaxil Naik (a.k.a. Kaxil)
The Bay Area Apache Airflow Meetup group will be hosting a meetup on April 11 at WePay.
Speakers from Slack, Google, and WePay will be presenting.
Feb 15, 2018
The Apache Airflow PPMC welcomes new committer and PPMC member, Ash Berlin-Taylor (a.k.a. ashb)
Jan 2, 2018
New Apache Airflow release 1.9.0-incubating is out!
Source & Binary "Sdist" release : https://dist.apache.org/repos/dist/release/incubator/airflow/1.9.0-incubating/
Pypi : https://pypi.python.org/pypi/apache-airflow (Run `pip install apache-airflow`)
Release Notes : https://github.com/apache/incubator-airflow/blob/master/CHANGELOG.txt
Special Thanks to Chris Riccomini (criccomini) and Bolke de Bruin (bolkedebruin) for tirelessly shepherding this release!
Nov 30, 2017
The Apache Airflow PPMC welcomes new committer and PPMC member, Joy Gao (a.k.a. joygao)
Nov 27, 2017
The Apache Airflow Meetup group in Amsterdam will be hosting its 1st meetup (Heineken) on Dec 21.
Niels Zeilemaker from GoDataDriven will present Using Azure Container Instances as a cheap method to run Heineken data science workloads, and Daniel van der Ende from ING Wholesale banking Advanced Analytics will talk about Data Tests using Apache Airflow.
We''re happy to welcome a new Apache Airflow Meetup group in Amsterdam : https://www.meetup.com/Amsterdam-Airflow-meetup/
Nov 1, 2017
Next Bay Area Airflow meet-up hosted by Airbnb this December (Dec 4) : https://www.meetup.com/Bay-Area-Apache-Airflow-Incubating-Meetup/events/244525050/
Slides available at https://drive.google.com/drive/folders/154jnUADKfrHXLUDvJBQOl8aiBwpaw9-w
Oct 1, 2017
The Apache Airflow PPMC welcomes new committer and PPMC member, Fokko Driespong (a.k.a. fokko)
Sept 6, 2017
New Apache Airflow release 1.8.2-incubating is out!
Source & Binary "Sdist" release : https://dist.apache.org/repos/dist/release/incubator/airflow/1.8.2-incubating/
Pypi : https://pypi.python.org/pypi/apache-airflow
Release Notes : http://bit.ly/2gH9QFx
Special Thanks to Maxime Beauchemin (mistercrunch) for tirelessly shepherding this release!
We''re happy to welcome a new Apache Meetup group in Tokyo : https://www.meetup.com/Tokyo-Apache-Airflow-incubating-Meetup/
Their first event is being held on May 11 : https://www.meetup.com/Tokyo-Apache-Airflow-incubating-Meetup/events/238731591/
Slides :
Building data pipelines with Apache Airflow (Kaizen Platform) via @takus : https://speakerdeck.com/takus/building-data-pipelines-with-apache-airflow
Yahoo! Japan's path from Oozie to Apache Airflow via @tmk_ueks : https://speakerdeck.com/hatappi/airflowkarakuroko2nicheng-rihuan-etawake
Apache Airflow and Kuroko 2 @hatappi : https://www.slideshare.net/techblogyahoo/oozieairflow-apacheairflow-oozie
March 19, 2017
The first official Apache Airflow release (1.8.0-incubating) is out!
Git Tag : https://github.com/apache/incubator-airflow/releases/tag/1.8.0%2Bapache.incubating
Change log : 205 commits as shown in Changelog (1.8.0-incubating)
Tarball : https://dist.apache.org/repos/dist/release/incubator/airflow/1.8.0-incubating/
You can install via :
pip install https://dist.apache.org/repos/dist/release/incubator/airflow/1.8.0-incubating/airflow-1.8.0+apache.incubating.tar.gz
PyPi : coming soon, check https://pypi.python.org/pypi/airflow
Once available, you can install via :
pip install airflow --upgrade
Note : remember to run airflow upgradedb after installation
Thanks to everyone in the community that helped bring this about. A special thanks is due to Bolke de Bruin (bolkedebruin) for valiantly shepherding this release!
Mar 14, 2017
The Apache Airflow PPMC welcomes new committer and PPMC member, Alex Guziel (a.k.a. saguziel)
Feb 3, 2017
We''re happy to welcome a new Apache Meetup group in NYC : https://www.meetup.com/NYC-Apache-Airflow-incubating-Meetup/
Feb 2, 2017
Next Bay Area Apache Airflow Meet-up (at PayPal) on Mar 14 : http://bit.ly/2knyNHv
Jan 30, 2017
Next New York Apache Airflow Meet-up (at Blue Apron) on Feb 1
Sign-up : https://docs.google.com/spreadsheets/d/1WmfgZeExSVdLf-u1uh3IleeHy8QTwaJ4BkkSkVM-X1E/edit#gid=0
Time: 6:30 - 9pm EST
Location: 40 W 23rd St. New York, NY 10010 (5th floor)
Nov 28, 2016
The Apache Airflow PPMC welcomes new committer and PPMC member, Alex Van Boxel (a.k.a. alexvanboxel)
Video from the Nov 16 meet-up (at WePay) is now available at : https://wepayinc.app.box.com/s/1183ra3z8gxf8fridysu4wbjckg1s05v
Oct 12, 2016
New Apache Airflow Meet-up (at WePay) on Nov 16 : http://bit.ly/2dwKNls
Sept 21, 2016
New Apache Airflow Meet-up (at Stripe) on Sept 21 : http://www.meetup.com/Bay-Area-Apache-Airflow-Incubating-Meetup/events/233316814/
Sept 6, 2016
New Warsaw (Poland) Hadoop User Group Meet-up on Sept 14 : http://www.meetup.com/warsaw-hug/events/233912332/
August 19, 2016
The Apache Airflow PPMC welcomes new committer and PPMC member, Li Xuanji (a.k.a. zodiac)
August 16, 2016
The Apache Airflow PPMC welcomes new committer and PPMC member, Sumit Maheshwari (a.k.a. msumit)
June 15, 2016
Video of yesterday's Apache Airflow Meet-up talk featuring talks from WePay, Agari, and Yahoo is now available at http://bit.ly/1S69hOr
May 27, 2016
The first-ever Airflow Contributor Meeting will take place at 11AM PST on June 1st.
https://airbnb.webex.com/join/gurer.kiratli
Ways to mitigate risks when rolling out new Airflow releases into production
Clarifying the process for working on large efforts
Refreshing the current roadmap
Communicate about how Airbnb will share information about sprints and internal roadmap moving forward
May 20, 2016
Airflow 1.7.1.2released: Pypi or via Git tag – 214 commits as per CHANGELOG.txt
To install via Pypi,
on a fresh install (e.g. fresh virtualenv install) or
pip install airflow (or pip install airflow==1.7.1.2)
or upgrade via
pip install airflow --upgrade
Special thanks to Dan Davydov (aoen) for tirelessly shepherding this release!
May 20, 2016
Steven Yvinec-Kruyk (syvineckruyk) joins the Apache Airflow Committer and PPMC group today. Please give him a hearty welcome and of course.. ask him to review your PRs and answer any questions you may have
April 29, 2016
Want to keep abreast of new Apache Airflow updates (e.g. releases, meet-ups, new features, conference talks, etc... ), follow our newly-minted Twitter account : @ApacheAirflow
April 27, 2016
We are starting the migration to Apache Infrastructure (e.g. Github Issues --> Jira, Airbnb/Airflow Github to Apache/Airflow Github, Airbnb/Airflow Github Wiki to Apache Airflow Confluence Wiki)
- The progress and migration status will be tracked on Migrating to Apache
- We expect this to take roughly 1 week. On and after May 4, we expect to be using Apache infrastructure exclusively. To prepare for that day, start using the new Apache infrastructure and follow instructions on - AIRFLOW-11Getting issue details... STATUS to set up your accounts.
April 22, 2016
@r39132 (Sid) will be speaking on July 23 at Data Day Seattle
- If there is enough interest, I'd be happy to also speak at a meetup
April 12, 2016
A 1.7.1. lightweight tag was mistakenly pushed to master - we don't yet have a viable 1.7.1 release candidate. On April 12, @r39132
deleted the tag on master
April 6, 2016
We now have an Apache Airflow meet-up group for folks in the Bay Area: Sign up today to get notified of upcoming meet-ups!
March 28, 2016
Folks, A new release (1.7.0
) is out via Pypi and git tag
March 24, 2016
Folks, A new release candidate version of Airflow is ready for the community to try :1.7.0rc1
- Please check it out and report any issues that you see
March 19, 2016
This week, we applied for Airflow's entry to the Apache Incubator
- Airflow Proposal
- We promoted several contributors to committers based on a proven track-record of contributions to the project and a strong commitment to improving the project going forward
- We published a WIP Roadmap [ARCHIVED] and welcome comments and input from the community
March 1, 2016
Airbnb will be hosting the very first Airflow meetup at Airbnb HQ (888 Brannan, in SF) on March 28th.
We're planning on doing this regularly, and want to put a good line up of food, drinks and talks for you all.
It should be pretty informal, but here's a draft of the schedule for the night:
meet, geet and eat
updates on the project, roadmap & upcoming Airbnb sprints
present advanced/complex Airbnb Airflow use cases (A/B testing framework, anomaly detection or something of that nature)
Sid Anand will share about how they use Airflow at Agari
Q/A for the core project team
Community open mic, step up and make announcements if you're recruiting, looking for help, planning on working on a feature, ...
Define list of subjects of interest on a whiteboard for breaking into subject specific subgroups for discussion
Please RSVP here: https://www.airbnb.com/meetups/daywndmbd-airflow
We're planning on starting to have Airflow meetups regularly, so stay tuned!