Delete comments <a href="http://www.aptis.info/portfolio/delete-all-comments/" target="_blank" title="Help"> <span class="aui-icon aui-icon-small aui-iconfont-help aptis-delete-all-comments-title-icon">Help</span> </a>

I think it's a good idea to support multiple executors natively without the nee...

Hussein Awala | Jan 15, 2024

Actually now when you mentioned it husseinawala The answer is - I think - yeah...

Jarek Potiuk | Jan 15, 2024

Completely agree with Hussein and Jarek here. Fwiw this came up in our internal...

Shubham Mehta | Jan 15, 2024

Thanks for the feedback folks! There is nothing stopping multiple executors of ...

Niko Oliveira | Jan 15, 2024

onikolas shubh.mehta → that's cool. yep. I understand that configuraiton is cur...

Jarek Potiuk | Jan 16, 2024

Not to digress too much from Executors, but just to close this out. <multi-ten...

Shubham Mehta | Jan 16, 2024

Thanks for the AIP - I am also looking forward for the implementation! I was al...

Jens Scheffler | Jan 19, 2024

My comments after reading it in detail (and starting with what jscheffl ) wrote...

Jarek Potiuk | Jan 19, 2024

Agreed, I planned to go with empty string/null here, but this solidifies it. T...

Niko Oliveira | Jan 22, 2024

> Re: core/parallelism: "Not sure how to configure it without more structured ...

Jarek Potiuk | Jan 22, 2024

i think per-executor parallelism makes sense too. the problem of configuration...

Daniel Standish | Jun 24, 2024

I agree with this. This seems like a safe way to go. Another suggestion to avo...

Amogh Desai | Jan 23, 2024

Another option would be to allow user to designate a default callback executor....

Daniel Standish | Apr 02, 2024

Daniel you're right! The DAG Processor Separation AIP mentions a future where c...

Niko Oliveira | Apr 05, 2024

I think it should per entirely flag/config driven per airflow deployment. If s...

Amogh Desai | Jan 23, 2024

Thank you for the AIP, onikolas It was a great read, I came across the comment...

Amogh Desai | Jan 23, 2024

Thanks for taking the time to read! Replied in kind to each bullet: You can u...

Niko Oliveira | Jan 26, 2024

it would seem better to force each executor to define its own shortname, so it ...

Daniel Standish | Apr 02, 2024

I like the latter, using the classname as a short name if no alias is provided....

Niko Oliveira | Apr 05, 2024

So why do they ask for same executor concurrently. Is it because they want e.g...

Daniel Standish | Apr 05, 2024

Ok so this implies that, the user might change the executor of choice for a spe...

Daniel Standish | Apr 02, 2024

e.g. what if you ran it on the default executor as a mistake.... and now you ne...

Daniel Standish | Apr 02, 2024

Just to be clear, do you mean in the case of a backfill? Since if you change th...

Niko Oliveira | Apr 05, 2024

I'm not talking about backfill. Talking about a task that ran and completed, b...

Daniel Standish | Apr 05, 2024

I can understand that some user might want it to use the executor "originally" ...

Daniel Standish | Apr 05, 2024

> I'm not talking about backfill. Talking about a task that ran and completed,...

Niko Oliveira | Apr 05, 2024

I definitely complain about airflow being too configurable sometimes . I thin...

Daniel Standish | Apr 05, 2024

what if it's no longer available? task unrunnable?

Daniel Standish | Apr 02, 2024

Yupp, we warn to the user (described later in the doc). They either need to mak...

Niko Oliveira | Apr 05, 2024

The text highlighted here suggests that the executor can't be changed... since ...

Daniel Standish | Apr 08, 2024

re this one Agree, those DAGs should fail at parsing time. Otherwise there w...

Daniel Standish | Apr 02, 2024

Marking it for Airflow 2.10 release, onikolas to get it done in the next few w...

Kaxil Naik | Jun 24, 2024

Delete comments Help