Skip to content

Split the loading of concatenated feature count tables in two steps#73

Open
kevinrue wants to merge 5 commits intomasterfrom
split
Open

Split the loading of concatenated feature count tables in two steps#73
kevinrue wants to merge 5 commits intomasterfrom
split

Conversation

@kevinrue
Copy link
Collaborator

  1. concatenate the tables and write the result to a compressed text file (cluster job)
  2. load to database (head node)

@snsansom
Copy link
Collaborator

Hi Kevin,

This looks good - as you proposed we should also add the active_if statements so that loading of results to the database can be disabled for large samples.

Best wishes,
Steve

@kevinrue
Copy link
Collaborator Author

The last commit seems to have taken care of it on my side, tested on a project. Perhaps you want to test it yourself on a toy project to double check before merging?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants