Skip to content

Inherit#2

Open
rosshendrickson-wf wants to merge 11 commits into
masterfrom
inherit
Open

Inherit#2
rosshendrickson-wf wants to merge 11 commits into
masterfrom
inherit

Conversation

@rosshendrickson-wf

Copy link
Copy Markdown
Owner

Addresses concerns over completion checks and cleanup tasks occurring in the default queue in BigSky. Cleanup tasks now go to a 'clean' queue (name is open to debate, maybe slow). The completion checks will inherit the queue that the tasks added to the context are running in. This is a subtle difference than inheriting the queue that the context itself is created in and allows greater freedom to shard async's across different queues and balance out their own performance. It was also easier to implement so there is that. This PR is for soliciting feedback. After we're happy I'll do a real CR against Webfilings Master. There will also have to be a single BigSky PR to add the clean queue. Dave said he's ok with that and that he is fine with completions being in the default queue if they do not set their asyncs up correctly because then they can fix it themselves instead of creating a fallback queue for furious completion tasks.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we make this config options of some sort?

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, this should probably be configurable in furious.yaml.

@beaulyddon-wf

Copy link
Copy Markdown

@tannnermiller-wf @tylertreat-wf @johnlockwood-wf

can you give this a look

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Import ordering should be alphabetical :)

@tylertreat-wf

Copy link
Copy Markdown

Looks good besides the minor comments.

Comment thread example/context_inherit.py Outdated

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's not clear how demonstrating the new inheritance behavior provides any value to the end user. Why do they care?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants