Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Alignment free deduplication #87

Merged
merged 21 commits into from
Apr 30, 2024
Merged
Changes from 1 commit
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
a460a1c
init calib
Joon-Klaps Jan 31, 2024
c6dc197
Update CALIB module and nextflow.config
Joon-Klaps Jan 31, 2024
ae6c2de
addding tag length in test config
Joon-Klaps Jan 31, 2024
b97cc80
Merge branch 'dev' into 27-deduplicate-umis-at-fastq-level
Joon-Klaps Apr 16, 2024
94ded55
switch from calib to humid
Joon-Klaps Apr 16, 2024
9b797ae
Add HUMID to the list of pre-processing steps in README.md
Joon-Klaps Apr 17, 2024
ebe0d08
Update software versions in nf-core/custom/dumpsoftwareversions/main.…
Joon-Klaps Apr 17, 2024
6882d4c
Update umi extraction and cleaning steps in multiqc_config.yml and mo…
Joon-Klaps Apr 17, 2024
5952aec
Update UMI extraction and cleaning steps in multiqc_config.yml and mo…
Joon-Klaps Apr 17, 2024
8805390
Add HUMID module for UMI deduplication in nf-core/humid
Joon-Klaps Apr 17, 2024
8913ab9
Add HUMID module for UMI deduplication in nf-core/humid
Joon-Klaps Apr 17, 2024
2f9d824
Update default value for "skip_fastqc" option in nextflow_schema.json
Joon-Klaps Apr 19, 2024
ba22281
Refactor get_taxid function to handle both file names and file-like o…
Joon-Klaps Apr 19, 2024
433bce3
Fix typo in extract_clust.py
Joon-Klaps Apr 19, 2024
5bb04ac
Update UMI extraction and cleaning steps in multiqc_config.yml and mo…
Joon-Klaps Apr 19, 2024
d26fe13
documentation on humid deduplication strategies
Joon-Klaps Apr 29, 2024
f3631ab
Update UMI deduplication strategy and parameters
Joon-Klaps Apr 29, 2024
bd52cd9
fix linting
Joon-Klaps Apr 29, 2024
cceefa8
config mistake
Klaps-bot Apr 29, 2024
8e07f0a
Merge branch '27-deduplicate-umis-at-fastq-level' of https://github.c…
Klaps-bot Apr 29, 2024
34f60fc
Merge branch 'dev' into 27-deduplicate-umis-at-fastq-level
Joon-Klaps Apr 30, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Add HUMID module for UMI deduplication in nf-core/humid
Joon-Klaps committed Apr 17, 2024
commit 88053902f34362dd37543ee2aa6315355b27545b
3 changes: 2 additions & 1 deletion conf/tests/test_umi.config
Original file line number Diff line number Diff line change
@@ -30,8 +30,9 @@ params {
fastp_deduplicate = true
fastp_dedup_accuracy = 2
skip_umi_extract = false
umi_deduplicate = 'both'
host_k2_db = 'https://github.com/nf-core/test-datasets/raw/viralrecon/genome/kraken2/kraken2_hs22.tar.gz'
assemblers ='spades'
assemblers = 'spades'

skip_metagenomic_diversity = true
save_databases = true
5 changes: 5 additions & 0 deletions modules.json
Original file line number Diff line number Diff line change
@@ -142,6 +142,11 @@
"git_sha": "3a5fef109d113b4997c9822198664ca5f2716208",
"installed_by": ["modules"]
},
"humid": {
"branch": "master",
"git_sha": "c4174581360d2bc32c08cd39cb6a1d1c82212ff6",
"installed_by": ["modules"]
},
"ivar/consensus": {
"branch": "master",
"git_sha": "3f5420aa22e00bd030a2556dfdffc9e164ec0ec5",
12 changes: 6 additions & 6 deletions modules/nf-core/humid/main.nf

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

74 changes: 74 additions & 0 deletions modules/nf-core/humid/meta.yml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

134 changes: 134 additions & 0 deletions modules/nf-core/humid/tests/main.nf.test

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

131 changes: 131 additions & 0 deletions modules/nf-core/humid/tests/main.nf.test.snap

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

9 changes: 9 additions & 0 deletions modules/nf-core/humid/tests/nextflow.config

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 2 additions & 0 deletions modules/nf-core/humid/tests/tags.yml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

4 changes: 2 additions & 2 deletions nextflow.config
Original file line number Diff line number Diff line change
@@ -23,7 +23,8 @@ params {
with_umi = false
skip_umi_extract = true
umi_discard_read = 0 // 0 = no discard
skip_humid = false
umi_separator = ":"
umi_deduplicate = 'read'
humid_mismatches = 2

// > Trim
@@ -110,7 +111,6 @@ params {
intermediate_mapper = mapper
iterative_refinement_cycles = 2
deduplicate = true
umi_separator = ":"
variant_caller = 'ivar' // ivar, bcftools
call_intermediate_variants = false
intermediate_variant_caller = variant_caller
2 changes: 1 addition & 1 deletion subworkflows/local/bam_deduplicate.nf
Original file line number Diff line number Diff line change
@@ -18,7 +18,7 @@ workflow BAM_DEDUPLICATE {
reference = bam_ref_fai.map{meta, bam, fasta, fai -> [ meta, fasta ] }
faidx = bam_ref_fai.map{meta, bam, fasta, fai -> [ meta, fai ] }

if ( umi ) {
if ( params.with_umi && ['mapping','both'].contains(params.umi_deduplicate) ) {
SAMTOOLS_INDEX( bam )
ch_bam_bai = bam.join(SAMTOOLS_INDEX.out.bai, by: [0])
ch_versions = ch_versions.mix(SAMTOOLS_INDEX.out.versions)
2 changes: 1 addition & 1 deletion subworkflows/local/preprocessing_illumina.nf
Original file line number Diff line number Diff line change
@@ -80,7 +80,7 @@ workflow PREPROCESSING_ILLUMINA {
.set { failed_reads }

// deduplicate UMI's with HUMID
if (params.with_umi && !params.skip_humid) {
if (params.with_umi && ['read', 'both'].contains(params.umi_deduplicate) && params.deduplicate ) {
HUMID (
ch_reads_trim,
[[:],[]]