| Back to Multiple platform build/check report for BioC 3.22: simplified long |
|
This page was generated on 2025-12-01 12:01 -0500 (Mon, 01 Dec 2025).
| Hostname | OS | Arch (*) | R version | Installed pkgs |
|---|---|---|---|---|
| nebbiolo2 | Linux (Ubuntu 24.04.3 LTS) | x86_64 | 4.5.2 (2025-10-31) -- "[Not] Part in a Rumble" | 4878 |
| merida1 | macOS 12.7.6 Monterey | x86_64 | 4.5.2 (2025-10-31) -- "[Not] Part in a Rumble" | 4610 |
| taishan | Linux (openEuler 24.03 LTS) | aarch64 | 4.5.0 (2025-04-11) -- "How About a Twenty-Six" | 4669 |
| Click on any hostname to see more info about the system (e.g. compilers) (*) as reported by 'uname -p', except on Windows and Mac OS X | ||||
| Package 460/2361 | Hostname | OS / Arch | INSTALL | BUILD | CHECK | BUILD BIN | ||||||||
| COTAN 2.10.0 (landing page) Galfrè Silvia Giulia
| nebbiolo2 | Linux (Ubuntu 24.04.3 LTS) / x86_64 | OK | OK | OK | |||||||||
| merida1 | macOS 12.7.6 Monterey / x86_64 | OK | OK | OK | OK | |||||||||
| taishan | Linux (openEuler 24.03 LTS) / aarch64 | OK | OK | OK | ||||||||||
|
To the developers/maintainers of the COTAN package: - Allow up to 24 hours (and sometimes 48 hours) for your latest push to git@git.bioconductor.org:packages/COTAN.git to reflect on this report. See Troubleshooting Build Report for more information. - Use the following Renviron settings to reproduce errors and warnings. - If 'R CMD check' started to fail recently on the Linux builder(s) over a missing dependency, add the missing dependency to 'Suggests:' in your DESCRIPTION file. See Renviron.bioc for more information. |
| Package: COTAN |
| Version: 2.10.0 |
| Command: /Library/Frameworks/R.framework/Resources/bin/R CMD check --install=check:COTAN.install-out.txt --library=/Library/Frameworks/R.framework/Resources/library --no-vignettes --timings COTAN_2.10.0.tar.gz |
| StartedAt: 2025-11-28 04:11:03 -0500 (Fri, 28 Nov 2025) |
| EndedAt: 2025-11-28 04:39:57 -0500 (Fri, 28 Nov 2025) |
| EllapsedTime: 1733.2 seconds |
| RetCode: 0 |
| Status: OK |
| CheckDir: COTAN.Rcheck |
| Warnings: 0 |
##############################################################################
##############################################################################
###
### Running command:
###
### /Library/Frameworks/R.framework/Resources/bin/R CMD check --install=check:COTAN.install-out.txt --library=/Library/Frameworks/R.framework/Resources/library --no-vignettes --timings COTAN_2.10.0.tar.gz
###
##############################################################################
##############################################################################
* using log directory ‘/Users/biocbuild/bbs-3.22-bioc/meat/COTAN.Rcheck’
* using R version 4.5.2 (2025-10-31)
* using platform: x86_64-apple-darwin20
* R was compiled by
Apple clang version 14.0.0 (clang-1400.0.29.202)
GNU Fortran (GCC) 14.2.0
* running under: macOS Monterey 12.7.6
* using session charset: UTF-8
* using option ‘--no-vignettes’
* checking for file ‘COTAN/DESCRIPTION’ ... OK
* checking extension type ... Package
* this is package ‘COTAN’ version ‘2.10.0’
* package encoding: UTF-8
* checking package namespace information ... OK
* checking package dependencies ... INFO
Imports includes 26 non-default packages.
Importing from so many packages makes the package vulnerable to any of
them becoming unavailable. Move as many as possible to Suggests and
use conditionally.
* checking if this is a source package ... OK
* checking if there is a namespace ... OK
* checking for hidden files and directories ... OK
* checking for portable file names ... OK
* checking for sufficient/correct file permissions ... OK
* checking whether package ‘COTAN’ can be installed ... OK
* checking installed package size ... OK
* checking package directory ... OK
* checking ‘build’ directory ... OK
* checking DESCRIPTION meta-information ... OK
* checking top-level files ... OK
* checking for left-over files ... OK
* checking index information ... OK
* checking package subdirectories ... OK
* checking code files for non-ASCII characters ... OK
* checking R files for syntax errors ... OK
* checking whether the package can be loaded ... OK
* checking whether the package can be loaded with stated dependencies ... OK
* checking whether the package can be unloaded cleanly ... OK
* checking whether the namespace can be loaded with stated dependencies ... OK
* checking whether the namespace can be unloaded cleanly ... OK
* checking whether startup messages can be suppressed ... OK
* checking dependencies in R code ... OK
* checking S3 generic/method consistency ... OK
* checking replacement functions ... OK
* checking foreign function calls ... OK
* checking R code for possible problems ... OK
* checking Rd files ... OK
* checking Rd metadata ... OK
* checking Rd cross-references ... OK
* checking for missing documentation entries ... OK
* checking for code/documentation mismatches ... OK
* checking Rd \usage sections ... OK
* checking Rd contents ... OK
* checking for unstated dependencies in examples ... OK
* checking contents of ‘data’ directory ... OK
* checking data for non-ASCII characters ... OK
* checking data for ASCII and uncompressed saves ... OK
* checking files in ‘vignettes’ ... OK
* checking examples ... OK
Examples with CPU (user + system) or elapsed time > 5s
user system elapsed
UniformClusters 77.381 0.752 78.792
CalculatingCOEX 59.219 1.075 60.884
HandlingClusterizations 58.196 0.679 59.334
HeatmapPlots 37.301 0.908 38.318
ParametersEstimations 24.115 0.734 24.901
COTAN_ObjectCreation 13.229 0.351 14.114
GenesStatistics 12.266 0.176 12.440
RawDataCleaning 8.163 0.177 8.334
Conversions 5.818 0.103 5.929
* checking for unstated dependencies in ‘tests’ ... OK
* checking tests ...
Running ‘outputTestDatasetCreation.R’
Running ‘spelling.R’
Running ‘testthat.R’
OK
* checking for unstated dependencies in vignettes ... OK
* checking package vignettes ... OK
* checking running R code from vignettes ... SKIPPED
* checking re-building of vignette outputs ... SKIPPED
* checking PDF version of manual ... OK
* DONE
Status: OK
COTAN.Rcheck/00install.out
############################################################################## ############################################################################## ### ### Running command: ### ### /Library/Frameworks/R.framework/Resources/bin/R CMD INSTALL COTAN ### ############################################################################## ############################################################################## * installing to library ‘/Library/Frameworks/R.framework/Versions/4.5-x86_64/Resources/library’ * installing *source* package ‘COTAN’ ... ** this is package ‘COTAN’ version ‘2.10.0’ ** using staged installation ** R ** data ** inst ** byte-compile and prepare package for lazy loading ** help *** installing help indices ** building package indices ** installing vignettes ** testing if installed package can be loaded from temporary location ** testing if installed package can be loaded from final location ** testing if installed package keeps a record of temporary installation path * DONE (COTAN)
COTAN.Rcheck/tests/outputTestDatasetCreation.Rout
R version 4.5.2 (2025-10-31) -- "[Not] Part in a Rumble"
Copyright (C) 2025 The R Foundation for Statistical Computing
Platform: x86_64-apple-darwin20
R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.
R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.
Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.
>
> # Creates the files to be reloaded by the tests for comparisons
>
> outputTestDatasetCreation <-
+ function(testsDir = file.path("tests", "testthat")) {
+ utils::data("test.dataset", package = "COTAN")
+ options(parallelly.fork.enable = TRUE)
+ setLoggingLevel(3L)
+
+ obj <- COTAN(raw = test.dataset)
+ obj <- initializeMetaDataset(objCOTAN = obj, GEO = " ",
+ sequencingMethod = "artificial",
+ sampleCondition = "test")
+
+ obj <- proceedToCoex(objCOTAN = obj, cores = 6L, saveObj = FALSE)
+
+ if (FALSE) {
+ saveRDS(obj, file = file.path(testsDir,"test.COTAN.RDS"))
+ }
+
+ cells.names.test <-
+ getCells(objCOTAN = obj)[c(1L:10L, 591L:610L, 991L:1000L)]
+ genes.names.test <-
+ getGenes(objCOTAN = obj)[c(131L:140L, 291L:310L, 591L: 600L)]
+ saveRDS(cells.names.test, file.path(testsDir, "cells.names.test.RDS"))
+ saveRDS(genes.names.test, file.path(testsDir, "genes.names.test.RDS"))
+
+ pcaRaw <- runPCA(x = getRawData(objCOTAN = obj), rank = 10L,
+ BSPARAM = IrlbaParam(), get.rotation = FALSE)[["x"]]
+
+ pca.raw.test <- pcaRaw[genes.names.test, ]
+ saveRDS(pca.raw.test, file.path(testsDir, "pca.raw.test.RDS"))
+
+ dispersion.test <- getDispersion(objCOTAN = obj)[genes.names.test]
+ saveRDS(dispersion.test, file.path(testsDir, "dispersion.test.RDS"))
+
+ raw.norm.test <-
+ getNuNormData(objCOTAN = obj)[genes.names.test, cells.names.test]
+ saveRDS(raw.norm.test, file.path(testsDir, "raw.norm.test.RDS"))
+
+ coex.test <-
+ getGenesCoex(objCOTAN = obj, genes = genes.names.test, zeroDiagonal = FALSE)
+ saveRDS(coex.test, file.path(testsDir, "coex.test.RDS"))
+
+ lambda.test <- getLambda(objCOTAN = obj)[genes.names.test]
+ saveRDS(lambda.test, file.path(testsDir, "lambda.test.RDS"))
+
+ GDI.test <- calculateGDI(objCOTAN = obj)
+ GDI.test <- GDI.test[genes.names.test, ]
+ saveRDS(GDI.test, file.path(testsDir, "GDI.test.RDS"))
+
+ nu.test <- getNu(objCOTAN = obj)[cells.names.test]
+ saveRDS(nu.test, file.path(testsDir, "nu.test.RDS"))
+
+ pvalues.test <- calculatePValue(objCOTAN = obj,
+ geneSubsetCol = genes.names.test,
+ geneSubsetRow = genes.names.test)
+ saveRDS(pvalues.test, file.path(testsDir, "pvalues.test.RDS"))
+
+ groupMarkers <- list(G1 = c("g-000010", "g-000020", "g-000138"),
+ G2 = c("g-000300", "g-000330", "g-000660"),
+ G3 = c("g-000510", "g-000530", "g-000550",
+ "g-000570", "g-000590"))
+
+ gcsData <- genesCoexSpace(objCOTAN = obj,
+ primaryMarkers = unlist(groupMarkers),
+ numGenesPerMarker = 11L)
+
+ genes.coex.space.test <- gcsData[["GCS"]]
+ saveRDS(genes.coex.space.test,
+ file.path(testsDir, "genes.coex.space.test.RDS"))
+
+ genesClustersData <-
+ establishGenesClusters(objCOTAN = obj,
+ groupMarkers = groupMarkers,
+ numGenesPerMarker = 11L,
+ kCuts = 6L, distance = "cosine",
+ hclustMethod = "ward.D2")
+
+ pca.genes.clusters.test <- genesClustersData[["pca_clusters"]]
+ saveRDS(pca.genes.clusters.test,
+ file.path(testsDir, "pca.genes.clusters.test.RDS"))
+
+ # Make it a less strict check as it is only for testing
+ checker <- new("AdvancedGDIUniformityCheck")
+ checker <- shiftCheckerThresholds(checker, 0.1)
+
+ initialResolution <- 1.3
+ splitData <- cellsUniformClustering(objCOTAN = obj,
+ checker = checker,
+ initialResolution = initialResolution,
+ useCoexEigen = TRUE,
+ dataMethod = "LL",
+ numReducedComp = 50L,
+ cores = 6L, optimizeForSpeed = TRUE,
+ deviceStr = "cuda", saveObj = FALSE)
+
+ split.clusters.test <- splitData[["clusters"]]
+ saveRDS(split.clusters.test,
+ file = file.path(testsDir, "split.clusters.test.RDS"))
+
+ test.dataset.clusters1 <- split.clusters.test
+ save(test.dataset.clusters1, compress = TRUE,
+ file = file.path("data", "test.dataset.clusters1.rda"))
+
+ obj <- addClusterization(objCOTAN = obj,
+ clName = "split",
+ clusters = splitData[["clusters"]],
+ coexDF = splitData[["coex"]])
+
+ coex.clusters.test <- splitData[["coex"]][genes.names.test, ]
+ saveRDS(coex.clusters.test, file.path(testsDir, "coex.clusters.test.RDS"))
+
+ pvalDF <- pValueFromDEA(splitData[["coex"]],
+ getNumCells(objCOTAN = obj),
+ adjustmentMethod = "none")
+
+ pvalues.clusters.test <- pvalDF[genes.names.test, ]
+ saveRDS(pvalues.clusters.test,
+ file.path(testsDir, "pvalues.clusters.test.RDS"))
+
+ mergedData <- mergeUniformCellsClusters(objCOTAN = obj,
+ clusters = splitData[["clusters"]],
+ checkers = checker,
+ batchSize = 1L,
+ cores = 6L,
+ distance = "cosine",
+ hclustMethod = "ward.D2",
+ saveObj = FALSE)
+
+ merge.clusters.test <- mergedData[["clusters"]]
+ saveRDS(merge.clusters.test,
+ file = file.path(testsDir, "merge.clusters.test.RDS"))
+
+ test.dataset.clusters2 <- merge.clusters.test
+ save(test.dataset.clusters2, compress = TRUE,
+ file = file.path("data", "test.dataset.clusters2.rda"))
+
+ obj <- addClusterization(objCOTAN = obj,
+ clName = "merge",
+ clusters = mergedData[["clusters"]],
+ coexDF = mergedData[["coex"]])
+ }
>
> proc.time()
user system elapsed
0.410 0.120 0.491
COTAN.Rcheck/tests/spelling.Rout
R version 4.5.2 (2025-10-31) -- "[Not] Part in a Rumble"
Copyright (C) 2025 The R Foundation for Statistical Computing
Platform: x86_64-apple-darwin20
R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.
R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.
Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.
> if (requireNamespace("spelling", quietly = TRUE))
+ spelling::spell_check_test(vignettes = TRUE, error = FALSE,
+ skip_on_cran = TRUE)
All Done!
>
> proc.time()
user system elapsed
0.350 0.124 0.436
COTAN.Rcheck/tests/testthat.Rout
R version 4.5.2 (2025-10-31) -- "[Not] Part in a Rumble"
Copyright (C) 2025 The R Foundation for Statistical Computing
Platform: x86_64-apple-darwin20
R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.
R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.
Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.
> Sys.setenv(R_TESTS = "")
> library(testthat)
> library(COTAN)
> library(zeallot)
> test_check("COTAN")
Setting new log level to 4
Initializing `COTAN` meta-data
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.82692408561707
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.74103593826294
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0067901611328125
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0209729671478271
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.868268013000488
Total calculations elapsed time: 3.63706707954407
Calculate genes' COEX (legacy): DONE
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 5 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 4 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 5.49991893768311
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 7 cells batches
Total calculations elapsed time: 0.971091032028198
Estimate `nu`: DONE
`nu` change (abs) | max: 1.75595238095238 | median: 1.07156808035714 | mean: 1.07156808035714
Estimate `dispersion`/`nu`: START
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.86623907089233
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03734183779544 | max: 4.61112297272667 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.907705068588257
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0295487661210321 | median: 0.016072261901129 | mean: 0.016072261901129
`nu` mean: 1.69786080481514
Marginal errors | max: 1.95799528048 | median 1.32268477389029 | mean: 1.33563364783916
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.81185293197632
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.0585450475968788 | max: 3.52739274166646 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.951501846313477
Estimate `nu`: DONE
`nu` change (abs) | max: 0.417150556912302 | median: 0.240156504520849 | mean: 0.240156504520849
`nu` mean: 0.823005947608547
Marginal errors | max: 0.837672524335755 | median 0.704691669139065 | mean: 0.646575831699997
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.84919095039368
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.328845855849147 | max: 4.03031691940854 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.947911977767944
Estimate `nu`: DONE
`nu` change (abs) | max: 0.164439840041 | median: 0.0957105992188852 | mean: 0.0957105992188852
`nu` mean: 1.06872924082212
Marginal errors | max: 0.260109847946692 | median 0.21392791155499 | mean: 0.197565106613054
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.79243803024292
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.229469002841045 | max: 3.87206403670079 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.917026996612549
Estimate `nu`: DONE
`nu` change (abs) | max: 0.05539667181205 | median: 0.0321044921874999 | mean: 0.0321044921874999
`nu` mean: 0.97670782037545
Marginal errors | max: 0.095347789718808 | median 0.0796003827042702 | mean: 0.0725509735761708
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.72122693061829
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.263830434255107 | max: 3.92953043775907 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.927202939987183
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0196209299693411 | median: 0.0114037947200925 | mean: 0.0114037947200925
`nu` mean: 1.00821713524925
Marginal errors | max: 0.0329495161656741 | median 0.0273479725376307 | mean: 0.0250296751521306
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.80604600906372
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.251734659898779 | max: 3.9096133246649 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.904369115829468
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0069104540740097 | median: 0.0040109538496062 | mean: 0.0040109538496062
`nu` mean: 0.997100499775596
Marginal errors | max: 0.0116950057438405 | median 0.00972280144874116 | mean: 0.00889105008777591
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.80729293823242
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.256009779031907 | max: 3.91667271750655 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.893244028091431
Estimate `nu`: DONE
`nu` change (abs) | max: 0.00251004753849005 | median: 0.00146484374999994 | mean: 0.00146484374999994
`nu` mean: 1.00104520378849
Marginal errors | max: 0.00430755646112857 | median 0.00358203399504298 | mean: 0.00327684342604027
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.73730993270874
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.254429717857093 | max: 3.91406908073254 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.943755149841309
Estimate `nu`: DONE
`nu` change (abs) | max: 0.00104629156456748 | median: 0.000592910406456731 | mean: 0.000592910406456731
`nu` mean: 0.999546618841889
Marginal errors | max: 0.00162038706091039 | median 0.00134441676098973 | mean: 0.00123030512553282
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.73800492286682
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.255022049769696 | max: 3.91504587939868 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.911309957504272
Estimate `nu`: DONE
`nu` change (abs) | max: 0.000418450901304768 | median: 0.000244140625000028 | mean: 0.000244140625000028
`nu` mean: 1.0001743102763
Marginal errors | max: 0.00071569233034019 | median 0.000597297218559056 | mean: 0.000545906995079193
Total calculations elapsed time: 48.9512729644775
Estimate `dispersion`/`nu`: DONE
Estimate `dispersion`/`nu`: START
Initializing `COTAN` meta-data
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.9220130443573
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.99471187591553
Calculating genes' COEX normalization factor
Fraction of genes' with very low expected contingency tables: 0.181818181818182
Calculate genes' normalization factor elapsed time: 0.00160098075866699
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0065460205078125
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.01059317588806
Total calculations elapsed time: 4.01345205307007
Calculate genes' COEX (legacy): DONE
Calculate cells' COEX (legacy): START
Retrieving expected cells' contingency table
calculating NN.. done
calculating YN..NY..YY..t().. done
Expected cells' contingency table elapsed time: 2.87935900688171
Calculating cells' COEX normalization factor
Fraction of cells' with very low expected contingency tables: 0
Calculate cells' normalization factor elapsed time: 0.00177407264709473
Retrieving observed cells' yes/yes contingency table
calculating YY.. done
Observed cells' contingency table elapsed time: 0.00490999221801758
Estimating cells' COEX
Calculate cells' COEX elapsed time: 0.998698949813843
Total calculations elapsed time: 3.88474202156067
Calculate cells' COEX (legacy): DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0163290500640869
Calculate `GDI`: DONE
Total calculations elapsed time: 2.95779418945312
Calculate GDI dataframe: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00596308708190918
Calculate `GDI`: DONE
Total calculations elapsed time: 2.8836669921875
Calculate GDI dataframe: DONE
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Running genes' selection: START
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Running genes' selection: START
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Running genes' selection: START
Selected 5 genes using HGDI selector
Running genes' selection: DONE
Running genes' selection: START
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer counts
Calculating gene variances
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating feature variances of standardized and clipped values
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Selected 5 genes using HVG_Seurat selector
Running genes' selection: DONE
Running genes' selection: START
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer data
Calculating gene means
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating gene variance to mean ratios
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Running genes' selection: START
Given 5 genes as input
Running genes' selection: DONE
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 1.91001296043396
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 1.89756202697754
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Selected 8 genes using HGDI selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 1.9773690700531
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer counts
Calculating gene variances
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating feature variances of standardized and clipped values
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Selected 8 genes using HVG_Seurat selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 3.24153590202332
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Elaborating COEX Eigen Vectors - START
Elaborating COEX Eigen Vectors - DONE
Total calculations elapsed time: 3.00387191772461
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Elaborating COEX Eigen Vectors - START
Elaborating COEX Eigen Vectors - DONE
Total calculations elapsed time: 2.98010587692261
Elaborating Reduced dimensionality Data Matrix - DONE
Initializing `COTAN` meta-data
Initializing `COTAN` meta-data
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`/`nu`: START
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 2.02310109138489
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 1.00005602836609
Estimate `nu`: DONE
`nu` change (abs) | max: 1.75719246031746 | median: 1.07229953342014 | mean: 1.07229953342014
`nu` mean: 1.68489292689732
Marginal errors | max: 1.735699617106 | median 1.37997441333659 | mean: 1.32181397451301
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.98448491096497
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.0655494303592343 | max: 3.54400580804152 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 1.03578209877014
Estimate `nu`: DONE
`nu` change (abs) | max: 0.402649984216273 | median: 0.231868788425666 | mean: 0.231868788425666
`nu` mean: 0.829218804209393
Marginal errors | max: 0.803248939260364 | median 0.677504196374571 | mean: 0.619386446933351
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.91222810745239
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.326019058449519 | max: 4.02612397202046 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.968852043151855
Estimate `nu`: DONE
`nu` change (abs) | max: 0.158004893526231 | median: 0.0919692884670312 | mean: 0.0919692884670312
`nu` mean: 1.0660356050592
Marginal errors | max: 0.25067700287536 | median 0.206241644985115 | mean: 0.190402167377958
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 2.03818488121033
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.230397316576369 | max: 3.87365659194104 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 1.04058218002319
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0532774732102337 | median: 0.0308837890624999 | mean: 0.0308837890624999
`nu` mean: 0.977606315852266
Marginal errors | max: 0.0916920322976189 | median 0.0765360853958175 | mean: 0.0697673030094082
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.97701907157898
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.263457616228195 | max: 3.928924407347 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 1.02948594093323
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0187878665732679 | median: 0.0109155550210726 | mean: 0.0109155550210726
`nu` mean: 1.0078723115522
Marginal errors | max: 0.0315207323253404 | median 0.0261635598193228 | mean: 0.0239435763640456
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 2.01246285438538
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.251890641847533 | max: 3.90987172241566 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 1.0195779800415
Estimate `nu`: DONE
`nu` change (abs) | max: 0.00649137083358098 | median: 0.00376680890457393 | mean: 0.00376680890457393
`nu` mean: 0.997275438070993
Marginal errors | max: 0.0109748802265024 | median 0.00912386940474885 | mean: 0.00834350038184262
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 2.07505989074707
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.255902752363649 | max: 3.91649655995187 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 1.11707401275635
Estimate `nu`: DONE
`nu` change (abs) | max: 0.00230094227000666 | median: 0.00132529141000018 | mean: 0.00132529141000018
`nu` mean: 1.00097565086001
Marginal errors | max: 0.00376864912836616 | median 0.00313421412286186 | mean: 0.00286709489297632
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 2.0275821685791
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.254520292119112 | max: 3.91421850264948 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 1.00876092910767
Estimate `nu`: DONE
`nu` change (abs) | max: 0.000837013154366462 | median: 0.000488281250000028 | mean: 0.000488281250000028
`nu` mean: 0.999651268095634
Marginal errors | max: 0.00144055320514802 | median 0.00119489364392944 | mean: 0.00109355439757213
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 2.13006711006165
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.255046800817986 | max: 3.91508667609651 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 1.01035904884338
Estimate `nu`: DONE
`nu` change (abs) | max: 0.000418448154490214 | median: 0.000244140624999917 | mean: 0.000244140624999917
`nu` mean: 1.00017430752949
Marginal errors | max: 0.000715683388516908 | median 0.0005972847342397 | mean: 0.00054589991652314
Total calculations elapsed time: 55.3099570274353
Estimate `dispersion`/`nu`: DONE
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.32032418251038
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00144386291503906
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00387215614318848
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.19395089149475
Total calculations elapsed time: 4.51959109306335
Calculate genes' COEX (legacy): DONE
Calculate cells' COEX (legacy): START
Retrieving expected cells' contingency table
calculating NN.. done
calculating YN..NY..YY..t().. done
Expected cells' contingency table elapsed time: 3.15932297706604
Calculating cells' COEX normalization factor
Calculate cells' normalization factor elapsed time: 0.00145506858825684
Retrieving observed cells' yes/yes contingency table
calculating YY.. done
Observed cells' contingency table elapsed time: 0.00408196449279785
Estimating cells' COEX
Calculate cells' COEX elapsed time: 1.0593090057373
Total calculations elapsed time: 4.2241690158844
Calculate cells' COEX (legacy): DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00573992729187012
Calculate `GDI`: DONE
Total calculations elapsed time: 3.02902007102966
Calculate GDI dataframe: DONE
Calculate genes' partial COEX: START
Retrieving expected genes' partial contingency table
calculating partial NN.. done
calculating partial NY..YN..YY.. done
Calculating genes' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0.325
Retrieving observed genes' yes/yes partial contingency table
calculating partial YY.. done
Estimating genes' partial COEX
Total calculations elapsed time: 8.19763994216919
Calculate genes' partial COEX: DONE
Calculate cells' partial COEX: START
Retrieving expected cells' partial contingency table
calculating partial NN.. done
calculating partial YN..NY..YY.. done
Calculating cells' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0
Retrieving observed cells' yes/yes partial contingency table
calculating partial YY.. done
Estimating cells' partial COEX
Total calculations elapsed time: 8.11752915382385
Calculate cells' partial COEX: DONE
Asked to drop 2 genes and 0 cells
Asked to drop 0 genes and 4 cells
Asked to drop 2 genes and 2 cells
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
calculating YY.. done
calculating YY.. done
calculating YN..NY..NN..t().. done
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 4.06103706359863
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
calculating NN.. done
calculating NN.. done
calculating NY..YN..YY..t().. done
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.11104297637939
Calculating genes' COEX normalization factor
Fraction of genes' with very low expected contingency tables: 0.181818181818182
Calculate genes' normalization factor elapsed time: 0.00164794921875
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00333499908447266
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.02591395378113
Total calculations elapsed time: 4.14193987846375
Calculate genes' COEX (legacy): DONE
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.00922703742981
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00114202499389648
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00310587882995605
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.04012203216553
Total calculations elapsed time: 4.05359697341919
Calculate genes' COEX (legacy): DONE
Calculate genes' partial COEX: START
Retrieving expected genes' partial contingency table
calculating partial NN.. done
calculating partial NY..YN..YY.. done
Calculating genes' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0.1
Retrieving observed genes' yes/yes partial contingency table
calculating partial YY.. done
Estimating genes' partial COEX
Total calculations elapsed time: 8.49142909049988
Calculate genes' partial COEX: DONE
Calculate genes' partial COEX: START
Retrieving expected genes' partial contingency table
calculating partial NN.. done
calculating partial NY..YN..YY.. done
Calculating genes' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0.4
Retrieving observed genes' yes/yes partial contingency table
calculating partial YY.. done
Estimating genes' partial COEX
Total calculations elapsed time: 8.5943489074707
Calculate genes' partial COEX: DONE
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
calculating YY.. done
calculating YY.. done
calculating NY..YN..NN..t().. done
Estimate `dispersion`/`nu`: START
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 4.07435011863708
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 1.09491300582886
Estimate `nu`: DONE
`nu` change (abs) | max: 1.75719246031746 | median: 1.07229953342014 | mean: 1.07229953342014
`nu` mean: 1.68489292689732
Marginal errors | max: 0.255290533439036 | median 0.0807313765005375 | mean: 0.101968565509113
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 4.18580913543701
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03709166563768 | max: 4.61069655774133 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 1.16511416435242
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0273438105507502 | median: 0.0148852611818011 | mean: 0.0148852611818011
`nu` mean: 1.69735147626627
Marginal errors | max: 0.00330148418741771 | median 0.00111713187082163 | mean: 0.00132007186542999
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 4.97440314292908
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03887279473672 | max: 4.60974134092906 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.996447086334229
Estimate `nu`: DONE
`nu` change (abs) | max: 0 | median: 0 | mean: 0
`nu` mean: 1.69735147626627
Marginal errors | max: 5.14174422185931e-05 | median 1.6818224857218e-07 | mean: 5.57649710835051e-06
Total calculations elapsed time: 26.1541218757629
Estimate `dispersion`/`nu`: DONE
calculating NN.. done
calculating NN.. done
calculating YN..NY..YY..t().. done
Calculate cells' COEX (legacy): START
Retrieving expected cells' contingency table
calculating NN.. done
calculating YN..NY..YY..t().. done
Expected cells' contingency table elapsed time: 3.50834202766418
Calculating cells' COEX normalization factor
Fraction of cells' with very low expected contingency tables: 0
Calculate cells' normalization factor elapsed time: 0.00211095809936523
Retrieving observed cells' yes/yes contingency table
calculating YY.. done
Observed cells' contingency table elapsed time: 0.00331306457519531
Estimating cells' COEX
Calculate cells' COEX elapsed time: 1.15341782569885
Total calculations elapsed time: 4.6671838760376
Calculate cells' COEX (legacy): DONE
Calculate cells' partial COEX: START
Retrieving expected cells' partial contingency table
calculating partial NN.. done
calculating partial YN..NY..YY.. done
Calculating cells' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0
Retrieving observed cells' yes/yes partial contingency table
calculating partial YY.. done
Estimating cells' partial COEX
Total calculations elapsed time: 8.05987501144409
Calculate cells' partial COEX: DONE
Calculate cells' partial COEX: START
Retrieving expected cells' partial contingency table
calculating partial NN.. done
calculating partial YN..NY..YY.. done
Calculating cells' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0
Retrieving observed cells' yes/yes partial contingency table
calculating partial YY.. done
Estimating cells' partial COEX
Total calculations elapsed time: 7.60960984230042
Calculate cells' partial COEX: DONE
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`/`nu`: START
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 3.73551988601685
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.97394323348999
Estimate `nu`: DONE
`nu` change (abs) | max: 1.75719246031746 | median: 1.07229953342014 | mean: 1.07229953342014
`nu` mean: 1.68489292689732
Marginal errors | max: 0.255290533439036 | median 0.0807313765005375 | mean: 0.101968565509113
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 4.00338697433472
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03709166563768 | max: 4.61069655774133 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 1.1167368888855
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0273438105507502 | median: 0.0148852611818011 | mean: 0.0148852611818011
`nu` mean: 1.69735147626627
Marginal errors | max: 0.00330148418741771 | median 0.00111713187082163 | mean: 0.00132007186542999
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 3.79581999778748
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03887279473672 | max: 4.60974134092906 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.960791110992432
Estimate `nu`: DONE
`nu` change (abs) | max: 0 | median: 0 | mean: 0
`nu` mean: 1.69735147626627
Marginal errors | max: 5.14174422185931e-05 | median 1.6818224857218e-07 | mean: 5.57649710835051e-06
Total calculations elapsed time: 23.8580870628357
Estimate `dispersion`/`nu`: DONE
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.22745680809021
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00121712684631348
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00527596473693848
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.0168890953064
Total calculations elapsed time: 4.25083899497986
Calculate genes' COEX (legacy): DONE
Calculating S: START
Calculating S: DONE
Calculating G: START
calculating YY.. done
calculating YN..NY..NN..t().. done
calculating NN.. done
calculating NY..YN..YY..t().. done
Estimating G
Total calculations elapsed time: 7.46351289749146
Calculating G: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values genome wide on columns and genome wide on rows
Total calculations elapsed time: 0.00456809997558594
calculating PValues: DONE
Using G
Calculating G: START
calculating YY.. done
calculating YN..NY..NN..t().. done
calculating NN.. done
calculating NY..YN..YY..t().. done
Estimating G
Total calculations elapsed time: 7.33353805541992
Calculating G: DONE
calculating PValues: START
Get p-values on a set of genes on columns and on a set of genes on rows
Total calculations elapsed time: 7.33612990379333
calculating PValues: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00712990760803223
Calculate `GDI`: DONE
Total calculations elapsed time: 3.04063081741333
Calculate GDI dataframe: DONE
Calculate GDI dataframe: START
Using G
Calculating G: START
calculating YY.. done
calculating YN..NY..NN..t().. done
calculating NN.. done
calculating NY..YN..YY..t().. done
Estimating G
Total calculations elapsed time: 6.68532609939575
Calculating G: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00628900527954102
Calculate `GDI`: DONE
Total calculations elapsed time: 9.63199901580811
Calculate GDI dataframe: DONE
Calculate `GDI`: START
Calculating S: START
Calculating S: DONE
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00847005844116211
Calculate `GDI`: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.007904052734375
Calculate `GDI`: DONE
Initializing `COTAN` meta-data
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.995967864990234
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.41548991203308
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 3.38181591033936
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.4754958152771
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0184140205383301
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0748410224914551
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.986385107040405
Total calculations elapsed time: 4.55513596534729
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 5.52055501937866
Dataset analysis elapsed time: 9.89833879470825
COTAN dataset analysis: DONE
Initializing `COTAN` meta-data
Condition test
n cells 1000
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.976170778274536
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.34657096862793
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 3.33495211601257
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.54087686538696
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0156891345977783
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0731680393218994
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.00384879112244
Total calculations elapsed time: 4.63358283042908
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 5.62647795677185
Dataset analysis elapsed time: 9.93760085105896
COTAN dataset analysis: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and on a set of genes on rows
Total calculations elapsed time: 0.0316040515899658
calculating PValues: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0396320819854736
Calculate `GDI`: DONE
Total calculations elapsed time: 2.96108484268188
Calculate GDI dataframe: DONE
Initializing `COTAN` meta-data
Condition test
n cells 1000
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 1.00783395767212
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.25867795944214
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 3.24929189682007
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.61159610748291
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0171411037445068
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0787718296051025
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.07991814613342
Total calculations elapsed time: 4.78742718696594
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 5.77885007858276
Dataset analysis elapsed time: 10.035975933075
COTAN dataset analysis: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and genome wide on rows
Total calculations elapsed time: 0.0281338691711426
calculating PValues: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0415561199188232
Calculate `GDI`: DONE
Total calculations elapsed time: 3.05677199363708
Calculate GDI dataframe: DONE
Initializing `COTAN` meta-data
Condition test
n cells 1000
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 1.02484393119812
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.33445596694946
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 3.35793709754944
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.53511309623718
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0198328495025635
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0772640705108643
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.997179985046387
Total calculations elapsed time: 4.629390001297
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 5.57516598701477
Dataset analysis elapsed time: 9.95794701576233
COTAN dataset analysis: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and on a set of genes on rows
Total calculations elapsed time: 0.00889492034912109
calculating PValues: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0407068729400635
Calculate `GDI`: DONE
Total calculations elapsed time: 2.99698805809021
Calculate GDI dataframe: DONE
Initializing `COTAN` meta-data
Asked to drop 0 genes and 960 cells
COTAN dataset analysis: START
Asked to drop 83 genes and 0 cells
Genes/cells selection done: dropped [83] genes and [0] cells
Working on [517] genes and [40] cells
Dataset cleaning elapsed time: 1.01292586326599
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.02734184265137
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.267567793681876 | max: 101.923257389521 | % negative: 52.6112185686654
Model parameter estimation elapsed time: 2.99818396568298
COTAN genes' COEX estimation not requested
Only genes' COEX elapsed time: 0.994517087936401
Dataset analysis elapsed time: 5.00562691688538
COTAN dataset analysis: DONE
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.98304390907288
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0102789402008057
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.015329122543335
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.0129668712616
Total calculations elapsed time: 4.02161884307861
Calculate genes' COEX (legacy): DONE
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.89414405822754
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00889992713928223
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0146529674530029
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.963137149810791
Total calculations elapsed time: 3.88083410263062
Calculate genes' COEX (legacy): DONE
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 2.9814829826355
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00900697708129883
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0149650573730469
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.98517107963562
Total calculations elapsed time: 3.99062609672546
Calculate genes' COEX (legacy): DONE
Hangling COTAN object with condition: test
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and on a set of genes on rows
Total calculations elapsed time: 0.00652480125427246
calculating PValues: DONE
Handling genes type: G2
Handling genes type: G3
Initializing `COTAN` meta-data
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Clean plots: START
PCA: START
PCA: DONE
Hierarchical clustering: START
Hierarchical clustering: DONE
Total calculations elapsed time: 2.30930018424988
Clean plots: DONE
Dataset cleaning elapsed time: 6.26331210136414
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.39812922477722
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 3.47982907295227
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.55427002906799
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0122158527374268
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0786800384521484
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.96445107460022
Total calculations elapsed time: 4.60961699485779
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 5.61878895759583
Dataset analysis elapsed time: 15.3619301319122
COTAN dataset analysis: DONE
Saving elaborated data locally at: /tmp/Rtmp78t5bT/test.cotan.RDS
Creating new clusterization: START
Elaborating Reduced dimensionality Data Matrix - START
Elaborating COEX Eigen Vectors - START
Elaborating COEX Eigen Vectors - DONE
Total calculations elapsed time: 3.22083592414856
Elaborating Reduced dimensionality Data Matrix - DONE
Computing nearest neighbor graph
Computing SNN
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 1000
Number of edges: 44886
Running Louvain algorithm with multilevel refinement...
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Maximum modularity in 10 random starts: 0.4008
Number of communities: 4
Elapsed time: 0 seconds
Used resolution for Seurat clusterization is: 1.3
Total calculations elapsed time: 5.07546186447144
Creating new clusterization: DONE
Creating cells' uniform clustering: START
In iteration 1 the number of cells to re-cluster is 1000 cells belonging to 0 clusters
Asked to drop no genes or cells
Creating new clusterization: START
Elaborating Reduced dimensionality Data Matrix - START
Elaborating COEX Eigen Vectors - START
Elaborating COEX Eigen Vectors - DONE
Total calculations elapsed time: 3.42347192764282
Elaborating Reduced dimensionality Data Matrix - DONE
Computing nearest neighbor graph
Computing SNN
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 1000
Number of edges: 36652
Running Louvain algorithm with multilevel refinement...
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Maximum modularity in 10 random starts: 0.3743
Number of communities: 4
Elapsed time: 0 seconds
Used resolution for Seurat clusterization is: 1.3
Total calculations elapsed time: 5.01209902763367
Creating new clusterization: DONE
Creating PDF UMAP in file: /tmp/Rtmp78t5bT/test/reclustering/pdf_umap_1.pdf
UMAP plot: START
Calculating UMAP: START
04:33:56 UMAP embedding parameters a = 0.9922 b = 1.112
04:33:56 Read 1000 rows and found 65 numeric columns
04:33:56 Using Annoy for neighbor search, n_neighbors = 30
04:33:56 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
04:33:56 Writing NN index file to temp file /tmp/Rtmp78t5bT/fileed4b69b0cca3
04:33:56 Searching Annoy index using 1 thread, search_k = 3000
04:33:56 Annoy recall = 100%
04:33:57 Commencing smooth kNN distance calibration using 1 thread with target n_neighbors = 30
04:33:59 Initializing from normalized Laplacian + noise (using RSpectra)
04:33:59 Commencing optimization for 500 epochs, with 39044 positive edges
04:33:59 Using rng type: pcg
Using method 'umap'
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
04:34:03 Optimization finished
Calculating UMAP: DONE
Total calculations elapsed time: 6.9319531917572
UMAP plot: DONE
UMAP plot: START
Calculating UMAP: START
04:34:03 UMAP embedding parameters a = 0.9922 b = 1.112
04:34:03 Read 1000 rows and found 65 numeric columns
04:34:03 Using Annoy for neighbor search, n_neighbors = 30
04:34:03 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
04:34:04 Writing NN index file to temp file /tmp/Rtmp78t5bT/fileed4b5bf69148
04:34:04 Searching Annoy index using 1 thread, search_k = 3000
04:34:04 Annoy recall = 100%
04:34:05 Commencing smooth kNN distance calibration using 1 thread with target n_neighbors = 30
04:34:07 Initializing from normalized Laplacian + noise (using RSpectra)
04:34:07 Commencing optimization for 500 epochs, with 39044 positive edges
04:34:07 Using rng type: pcg
Using method 'umap'
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
04:34:10 Optimization finished
Calculating UMAP: DONE
Total calculations elapsed time: 6.95328903198242
UMAP plot: DONE
* checking uniformity of cluster '0' of 4 clusters
Asked to drop 0 genes and 687 cells
COTAN dataset analysis: START
Asked to drop 43 genes and 0 cells
Genes/cells selection done: dropped [43] genes and [0] cells
Working on [557] genes and [313] cells
Dataset cleaning elapsed time: 1.01586294174194
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 11 iterations
Total calculations elapsed time: 2.09568095207214
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.126565269702225 | max: 788.372048308528 | % negative: 38.5996409335727
Model parameter estimation elapsed time: 3.18865895271301
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.13071203231812
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.010408878326416
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0354301929473877
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.05501580238342
Total calculations elapsed time: 4.23156690597534
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 5.25779008865356
Dataset analysis elapsed time: 9.46231198310852
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0000' with 313 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0424149036407471
Calculate `GDI`: DONE
Total calculations elapsed time: 3.06391310691833
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0891060829162598
Clean plots: DONE
GDI plot
Removed 0 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0000, with size 313, is uniform
Cluster 01_0000's shift to uniformity: -0.0175178017151407
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.0412926391382406, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.37948219828486, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.0323159784560144, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.43089123341116, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.00179533213644524, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.44383613651629, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 1, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.47612588512221, isUniform = TRUE, clusterSize = 313
cluster 01_0000 is uniform
* checking uniformity of cluster '1' of 4 clusters
Asked to drop 0 genes and 743 cells
COTAN dataset analysis: START
Asked to drop 51 genes and 0 cells
Genes/cells selection done: dropped [51] genes and [0] cells
Working on [549] genes and [257] cells
Dataset cleaning elapsed time: 1.00927805900574
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 10 iterations
Total calculations elapsed time: 2.10581398010254
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.112503099391263 | max: 646.681464270838 | % negative: 40.8014571948998
Model parameter estimation elapsed time: 3.11019992828369
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.2212450504303
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00988101959228516
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0336968898773193
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.07227110862732
Total calculations elapsed time: 4.33709406852722
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 5.33418798446655
Dataset analysis elapsed time: 9.45366597175598
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0001' with 257 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0374109745025635
Calculate `GDI`: DONE
Total calculations elapsed time: 3.11870288848877
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0831129550933838
Clean plots: DONE
GDI plot
Removed 1 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0001, with size 257, is uniform
Cluster 01_0001's shift to uniformity: -0.0466523594845978
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00910746812386157, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.3503476405154, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00728597449908925, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.37278730407692, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.3866416314687, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.45240567481124, isUniform = TRUE, clusterSize = 257
cluster 01_0001 is uniform
* checking uniformity of cluster '2' of 4 clusters
Asked to drop 0 genes and 758 cells
COTAN dataset analysis: START
Asked to drop 77 genes and 0 cells
Genes/cells selection done: dropped [77] genes and [0] cells
Working on [523] genes and [242] cells
Dataset cleaning elapsed time: 1.02359700202942
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.10167002677917
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.166254045792573 | max: 224.924342782861 | % negative: 42.6386233269598
Model parameter estimation elapsed time: 3.13818383216858
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.1171178817749
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00929713249206543
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0304329395294189
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.04634809494019
Total calculations elapsed time: 4.20319604873657
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 5.21288204193115
Dataset analysis elapsed time: 9.37466287612915
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0002' with 242 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0351700782775879
Calculate `GDI`: DONE
Total calculations elapsed time: 3.20159316062927
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0910358428955078
Clean plots: DONE
GDI plot
Removed 2 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0002, with size 242, is uniform
Cluster 01_0002's shift to uniformity: -0.0473527936300246
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00764818355640535, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.34964720636998, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00764818355640535, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.37472946305404, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.38771313919655, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.43097703442027, isUniform = TRUE, clusterSize = 242
cluster 01_0002 is uniform
* checking uniformity of cluster '3' of 4 clusters
Asked to drop 0 genes and 812 cells
COTAN dataset analysis: START
Asked to drop 79 genes and 0 cells
Genes/cells selection done: dropped [79] genes and [0] cells
Working on [521] genes and [188] cells
Dataset cleaning elapsed time: 1.23993396759033
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 6 iterations
Total calculations elapsed time: 2.40510416030884
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.210007411487223 | max: 67.8701314818728 | % negative: 45.6813819577735
Model parameter estimation elapsed time: 3.47849106788635
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.25805401802063
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00944781303405762
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0297770500183105
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.18820810317993
Total calculations elapsed time: 4.48548698425293
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 5.63310194015503
Dataset analysis elapsed time: 10.3515269756317
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0003' with 188 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0372030735015869
Calculate `GDI`: DONE
Total calculations elapsed time: 3.36231398582458
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.09598708152771
Clean plots: DONE
GDI plot
Removed 4 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0003, with size 188, is uniform
Cluster 01_0003's shift to uniformity: -0.0672912272436446
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00383877159309021, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.32970877275636, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00191938579654511, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.35752445041519, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.37495297633951, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.40148843025229, isUniform = TRUE, clusterSize = 188
cluster 01_0003 is uniform
Found 4 uniform and 0 non-uniform clusters
Stopping: too few cells left to cluster
Unclustered cell left: 0
The final raw clusterization contains [ 4 ] different clusters: 01_0000, 01_0001, 01_0002, 01_0003
Differential Expression Analysis - START
* DEA on cluster '1' with 313 cells
* DEA on cluster '2' with 257 cells
* DEA on cluster '3' with 242 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0750839710235596
Differential Expression Analysis - DONE
Applied reordering to clusterization is:
1 -> 3, 2 -> 1, 3 -> 2, 4 -> 4
Total calculations elapsed time: 94.5480620861053
Creating cells' uniform clustering: DONE
Applied reordering to clusterization is:
1 -> 1, 2 -> 2, 3 -> 3, 4 -> 4
Asked to drop 0 genes and 812 cells
COTAN dataset analysis: START
Asked to drop 79 genes and 0 cells
Genes/cells selection done: dropped [79] genes and [0] cells
Working on [521] genes and [188] cells
Dataset cleaning elapsed time: 1.07922101020813
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 6 iterations
Total calculations elapsed time: 2.27557015419006
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.210007411487223 | max: 67.8701314818728 | % negative: 45.6813819577735
Model parameter estimation elapsed time: 3.33599209785461
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.46257209777832
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00998306274414062
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0273599624633789
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.10544085502625
Total calculations elapsed time: 4.60535597801208
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 5.70724487304688
Dataset analysis elapsed time: 10.1224579811096
COTAN dataset analysis: DONE
Checking uniformity for the cluster 'Cluster_4' with 188 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0350818634033203
Calculate `GDI`: DONE
Total calculations elapsed time: 3.38331294059753
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0917730331420898
Clean plots: DONE
GDI plot
Removed 4 low GDI genes (such as the fully-expressed) in GDI plot
Cluster Cluster_4, with size 188, is uniform
Cluster Cluster_4's shift to uniformity: -0.0672912272436446
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00383877159309021, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.32970877275636, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00191938579654511, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.35752445041519, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.37495297633951, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.40148843025229, isUniform = TRUE, clusterSize = 188
Differential Expression Analysis - START
* DEA on cluster '-1' with 50 cells
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 280 cells
* DEA on cluster '4' with 171 cells
Total calculations elapsed time: 0.0625228881835938
Differential Expression Analysis - DONE
Applied reordering to clusterization is:
1 -> 4, 2 -> 3, 3 -> 2, 4 -> 1, -1 -> -1
Applied reordering to clusterization is:
1 -> 1, 2 -> 2, 3 -> 3, 4 -> 4, -1 -> -1
Creating cells' uniform clustering: START
In iteration 1 the number of cells to re-cluster is 1000 cells belonging to 0 clusters
Asked to drop no genes or cells
Creating new clusterization: START
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer counts
Calculating gene variances
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating feature variances of standardized and clipped values
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Selected 600 genes using HVG_Seurat selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 4.58694100379944
Elaborating Reduced dimensionality Data Matrix - DONE
Computing nearest neighbor graph
Computing SNN
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 1000
Number of edges: 67288
Running Louvain algorithm with multilevel refinement...
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Maximum modularity in 10 random starts: 0.3650
Number of communities: 5
Elapsed time: 0 seconds
Used resolution for Seurat clusterization is: 1.3
Total calculations elapsed time: 6.31984400749207
Creating new clusterization: DONE
Using passed in clusterization
Creating PDF UMAP in file: /tmp/Rtmp78t5bT/test/reclustering/pdf_umap_1.pdf
UMAP plot: START
Calculating UMAP: START
04:35:51 UMAP embedding parameters a = 0.9922 b = 1.112
04:35:51 Read 1000 rows and found 40 numeric columns
04:35:51 Using Annoy for neighbor search, n_neighbors = 30
04:35:51 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
04:35:51 Writing NN index file to temp file /tmp/Rtmp78t5bT/fileed4b4c63d931
04:35:51 Searching Annoy index using 1 thread, search_k = 3000
04:35:52 Annoy recall = 100%
04:35:53 Commencing smooth kNN distance calibration using 1 thread with target n_neighbors = 30
04:35:55 Found 2 connected components, falling back to 'spca' initialization with init_sdev = 1
04:35:55 Using 'irlba' for PCA
04:35:55 PCA: 2 components explained 36.15% variance
04:35:55 Scaling init to sdev = 1
04:35:55 Commencing optimization for 500 epochs, with 41630 positive edges
04:35:55 Using rng type: pcg
Using method 'umap'
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
04:35:58 Optimization finished
Calculating UMAP: DONE
Total calculations elapsed time: 7.15371489524841
UMAP plot: DONE
UMAP plot: START
Calculating UMAP: START
04:35:59 UMAP embedding parameters a = 0.9922 b = 1.112
04:35:59 Read 1000 rows and found 40 numeric columns
04:35:59 Using Annoy for neighbor search, n_neighbors = 30
04:35:59 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
04:35:59 Writing NN index file to temp file /tmp/Rtmp78t5bT/fileed4b3236e663
04:35:59 Searching Annoy index using 1 thread, search_k = 3000
04:35:59 Annoy recall = 100%
04:36:00 Commencing smooth kNN distance calibration using 1 thread with target n_neighbors = 30
04:36:02 Found 2 connected components, falling back to 'spca' initialization with init_sdev = 1
04:36:02 Using 'irlba' for PCA
04:36:02 PCA: 2 components explained 36.15% variance
04:36:02 Scaling init to sdev = 1
04:36:02 Commencing optimization for 500 epochs, with 41630 positive edges
04:36:02 Using rng type: pcg
Using method 'umap'
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
04:36:06 Optimization finished
Calculating UMAP: DONE
Total calculations elapsed time: 7.22420787811279
UMAP plot: DONE
* checking uniformity of cluster '1' of 2 clusters
Asked to drop 0 genes and 500 cells
COTAN dataset analysis: START
Asked to drop 38 genes and 0 cells
Genes/cells selection done: dropped [38] genes and [0] cells
Working on [562] genes and [500] cells
Dataset cleaning elapsed time: 1.09367394447327
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.2888720035553
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.108871643378045 | max: 295.971778839086 | % negative: 35.0533807829181
Model parameter estimation elapsed time: 3.31119108200073
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.3029420375824
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0101680755615234
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0463719367980957
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.98705005645752
Total calculations elapsed time: 4.34653210639954
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 5.3148558139801
Dataset analysis elapsed time: 9.7197208404541
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0001' with 500 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0421080589294434
Calculate `GDI`: DONE
Total calculations elapsed time: 3.03355479240417
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.090444803237915
Clean plots: DONE
GDI plot
Removed 2 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0001, with size 500, is uniform
Cluster 01_0001's shift to uniformity: -0.0417301990665568
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.0124555160142349, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.35526980093344, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00889679715302491, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.38536328181506, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.40346106115488, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.42565794715045, isUniform = TRUE, clusterSize = 500
cluster 01_0001 is uniform
* checking uniformity of cluster '2' of 2 clusters
Asked to drop 0 genes and 500 cells
COTAN dataset analysis: START
Asked to drop 44 genes and 0 cells
Genes/cells selection done: dropped [44] genes and [0] cells
Working on [556] genes and [500] cells
Dataset cleaning elapsed time: 1.10740303993225
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.24836301803589
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0636486786621688 | max: 141.389145035675 | % negative: 36.1510791366906
Model parameter estimation elapsed time: 3.20903182029724
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.17911195755005
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00992012023925781
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0473949909210205
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.980103015899658
Total calculations elapsed time: 4.21653008460999
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 5.22399210929871
Dataset analysis elapsed time: 9.5404269695282
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0002' with 500 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0394699573516846
Calculate `GDI`: DONE
Total calculations elapsed time: 2.97409200668335
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0849390029907227
Clean plots: DONE
GDI plot
Removed 2 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0002, with size 500, is uniform
Cluster 01_0002's shift to uniformity: -0.0413872276843443
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00719424460431655, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.35561277231566, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00359712230215827, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.37204026755188, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.38757136821582, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.40876953414106, isUniform = TRUE, clusterSize = 500
cluster 01_0002 is uniform
Found 2 uniform and 0 non-uniform clusters
Stopping: too few cells left to cluster
Unclustered cell left: 0
The final raw clusterization contains [ 2 ] different clusters: 01_0001, 01_0002
Differential Expression Analysis - START
* DEA on cluster '1' with 500 cells
* DEA on cluster '2' with 500 cells
Total calculations elapsed time: 0.054689884185791
Differential Expression Analysis - DONE
Applied reordering to clusterization is:
1 -> 1, 2 -> 2
Total calculations elapsed time: 58.581326007843
Creating cells' uniform clustering: DONE
findClustersMarkers - START
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
* Analysis of cluster: '3'
* Analysis of cluster: '4'
Total calculations elapsed time: 3.9267578125
Log Fold Change Analysis - DONE
Total calculations elapsed time: 3.95404577255249
findClustersMarkers - DONE
findClustersMarkers - START
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
* Analysis of cluster: '3'
* Analysis of cluster: '4'
Total calculations elapsed time: 4.01614499092102
Log Fold Change Analysis - DONE
Total calculations elapsed time: 4.0407600402832
findClustersMarkers - DONE
findClustersMarkers - START
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.055513858795166
Differential Expression Analysis - DONE
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
* Analysis of cluster: '3'
* Analysis of cluster: '4'
Total calculations elapsed time: 4.14411616325378
Log Fold Change Analysis - DONE
Total calculations elapsed time: 4.21944808959961
findClustersMarkers - DONE
[1] "Tested cluster: 1"
Asked to drop 0 genes and 743 cells
COTAN dataset analysis: START
Asked to drop 51 genes and 0 cells
Genes/cells selection done: dropped [51] genes and [0] cells
Working on [549] genes and [257] cells
Dataset cleaning elapsed time: 1.01897192001343
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 10 iterations
Total calculations elapsed time: 2.1004159450531
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.112503099391263 | max: 646.681464270838 | % negative: 40.8014571948998
Model parameter estimation elapsed time: 3.10583114624023
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.20253801345825
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00971102714538574
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0379259586334229
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.01008296012878
Total calculations elapsed time: 4.26025795936584
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 5.3585159778595
Dataset analysis elapsed time: 9.48331904411316
COTAN dataset analysis: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0362601280212402
Calculate `GDI`: DONE
Total calculations elapsed time: 3.01897501945496
Calculate GDI dataframe: DONE
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Initializing `COTAN` meta-data
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.26560401916504
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Initializing `COTAN` meta-data
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 1.00701022148132
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.27392220497131
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 3.28265190124512
COTAN genes' COEX estimation not requested
Only genes' COEX elapsed time: 1.04630494117737
Dataset analysis elapsed time: 5.33596706390381
COTAN dataset analysis: DONE
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer counts
Calculating gene variances
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating feature variances of standardized and clipped values
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Centering and scaling data matrix
|
| | 0%
|
|======================================================================| 100%
PC_ 1
Positive: g-000397, g-000525, g-000460, g-000458, g-000535, g-000217, g-000194, g-000497, g-000432, g-000383
g-000318, g-000486, g-000464, g-000588, g-000549, g-000368, g-000252, g-000151, g-000209, g-000538
g-000325, g-000514, g-000524, g-000244, g-000320, g-000201, g-000499, g-000309, g-000290, g-000483
Negative: g-000415, g-000506, g-000496, g-000579, g-000572, g-000421, g-000455, g-000328, g-000178, g-000567
g-000405, g-000296, g-000387, g-000501, g-000493, g-000481, g-000343, g-000528, g-000551, g-000414
g-000367, g-000594, g-000159, g-000517, g-000574, g-000229, g-000222, g-000533, g-000243, g-000306
PC_ 2
Positive: g-000141, g-000093, g-000089, g-000033, g-000123, g-000557, g-000330, g-000156, g-000142, g-000095
g-000061, g-000235, g-000032, g-000186, g-000056, g-000259, g-000027, g-000041, g-000333, g-000386
g-000009, g-000395, g-000048, g-000116, g-000340, g-000418, g-000035, g-000332, g-000086, g-000040
Negative: g-000088, g-000158, g-000255, g-000115, g-000054, g-000472, g-000554, g-000391, g-000253, g-000226
g-000051, g-000147, g-000541, g-000077, g-000224, g-000194, g-000290, g-000293, g-000313, g-000118
g-000121, g-000220, g-000467, g-000500, g-000341, g-000039, g-000091, g-000249, g-000426, g-000288
PC_ 3
Positive: g-000126, g-000083, g-000086, g-000117, g-000130, g-000010, g-000498, g-000333, g-000047, g-000179
g-000340, g-000035, g-000531, g-000140, g-000527, g-000049, g-000316, g-000031, g-000014, g-000073
g-000218, g-000445, g-000129, g-000175, g-000105, g-000581, g-000404, g-000025, g-000266, g-000354
Negative: g-000096, g-000575, g-000370, g-000337, g-000319, g-000364, g-000308, g-000293, g-000147, g-000307
g-000038, g-000492, g-000541, g-000185, g-000008, g-000482, g-000562, g-000097, g-000222, g-000084
g-000141, g-000377, g-000224, g-000223, g-000136, g-000434, g-000277, g-000426, g-000139, g-000093
PC_ 4
Positive: g-000006, g-000043, g-000462, g-000279, g-000180, g-000576, g-000087, g-000584, g-000498, g-000333
g-000189, g-000088, g-000451, g-000059, g-000135, g-000281, g-000106, g-000429, g-000316, g-000578
g-000303, g-000031, g-000581, g-000026, g-000122, g-000561, g-000546, g-000164, g-000353, g-000300
Negative: g-000072, g-000012, g-000129, g-000052, g-000097, g-000262, g-000080, g-000056, g-000025, g-000092
g-000354, g-000334, g-000423, g-000228, g-000002, g-000010, g-000086, g-000147, g-000185, g-000172
g-000124, g-000009, g-000077, g-000476, g-000126, g-000145, g-000065, g-000268, g-000152, g-000348
PC_ 5
Positive: g-000051, g-000150, g-000088, g-000476, g-000344, g-000116, g-000428, g-000012, g-000523, g-000394
g-000101, g-000127, g-000069, g-000214, g-000049, g-000357, g-000075, g-000081, g-000576, g-000342
g-000439, g-000018, g-000070, g-000079, g-000015, g-000550, g-000600, g-000247, g-000218, g-000331
Negative: g-000105, g-000037, g-000110, g-000054, g-000090, g-000389, g-000022, g-000578, g-000289, g-000147
g-000547, g-000011, g-000477, g-000433, g-000200, g-000348, g-000404, g-000003, g-000250, g-000109
g-000402, g-000241, g-000595, g-000341, g-000560, g-000385, g-000413, g-000352, g-000573, g-000265
Computing nearest neighbor graph
Computing SNN
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 1000
Number of edges: 68112
Running Louvain algorithm with multilevel refinement...
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Maximum modularity in 10 random starts: 0.5999
Number of communities: 3
Elapsed time: 0 seconds
Clusterizations found: RNA_snn_res.0.8, seurat_clusters
Conditions found: orig.ident
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 1.10728788375854
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.24988484382629
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 3.23281502723694
COTAN genes' COEX estimation not requested
Only genes' COEX elapsed time: 1.01747298240662
Dataset analysis elapsed time: 5.3575758934021
COTAN dataset analysis: DONE
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 1.006502866745
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.27870893478394
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 3.25264501571655
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.74475908279419
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0113348960876465
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0755839347839355
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.02617311477661
Total calculations elapsed time: 4.85785102844238
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 5.85154390335083
Dataset analysis elapsed time: 10.1106917858124
COTAN dataset analysis: DONE
Calculating gene co-expression space - START
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and genome wide on rows
Total calculations elapsed time: 0.00748300552368164
calculating PValues: DONE
Number of selected secondary markers: 6
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0135500431060791
Calculate `GDI`: DONE
Number of columns (V set - secondary markers): 6
Number of rows (U set): 60
Total calculations elapsed time: 1.02566981315613
Calculating gene co-expression space - DONE
Calculating gene co-expression space - START
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and genome wide on rows
Total calculations elapsed time: 0.0108771324157715
calculating PValues: DONE
Number of selected secondary markers: 98
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0124669075012207
Calculate `GDI`: DONE
Number of columns (V set - secondary markers): 98
Number of rows (U set): 60
Total calculations elapsed time: 1.05171084403992
Calculating gene co-expression space - DONE
Establishing gene clusters - START
Calculating gene co-expression space - START
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and genome wide on rows
Total calculations elapsed time: 0.010908842086792
calculating PValues: DONE
Number of selected secondary markers: 98
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0124928951263428
Calculate `GDI`: DONE
Number of columns (V set - secondary markers): 98
Number of rows (U set): 60
Total calculations elapsed time: 1.06448602676392
Calculating gene co-expression space - DONE
Total calculations elapsed time: 1.22535991668701
Establishing gene clusters - DONE
Initializing `COTAN` meta-data
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 1.01980519294739
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.40838289260864
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 3.3949089050293
COTAN genes' COEX estimation not requested
Only genes' COEX elapsed time: 0.983654975891113
Dataset analysis elapsed time: 5.3983690738678
COTAN dataset analysis: DONE
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0589630603790283
Differential Expression Analysis - DONE
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
* Analysis of cluster: '3'
* Analysis of cluster: '4'
Total calculations elapsed time: 4.08803105354309
Log Fold Change Analysis - DONE
clustersDeltaExpression - START
Handling cluster '1' with mean UDE 1.10997640736885
Handling cluster '2' with mean UDE 1.00770245700749
Handling cluster '3' with mean UDE 0.95940682189354
Handling cluster '4' with mean UDE 0.907328369455933
clustersDeltaExpression - DONE
In group G1 there are 3 detected over 3 genes
In group G2 there are 2 detected over 3 genes
In group G3 there are 5 detected over 5 genes
Merging cells' uniform clustering: START
The merge algorithm will use 2 passes
Start merging nearest clusters - the main threshold is: 1.297
Start merging nearest clusters: iteration 1
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0569891929626465
Differential Expression Analysis - DONE
Updating check results for the 0 already tested pairs to align to new checker
1 new clusters pairs to be tested for merging:
c("1", "2")
*1_2-merge
Asked to drop 0 genes and 501 cells
COTAN dataset analysis: START
Asked to drop 16 genes and 0 cells
Genes/cells selection done: dropped [16] genes and [0] cells
Working on [584] genes and [499] cells
Dataset cleaning elapsed time: 1.06693387031555
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 10 iterations
Total calculations elapsed time: 2.19112181663513
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0608154544840047 | max: 1260.06995351592 | % negative: 35.6164383561644
Model parameter estimation elapsed time: 3.17590308189392
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.3095531463623
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0122239589691162
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0455999374389648
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.04930591583252
Total calculations elapsed time: 4.41668295860291
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 5.41745591163635
Dataset analysis elapsed time: 9.66029286384583
COTAN dataset analysis: DONE
Checking uniformity for the cluster '1_2-merge' with 499 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0435280799865723
Calculate `GDI`: DONE
Total calculations elapsed time: 3.23484182357788
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0871920585632324
Clean plots: DONE
GDI plot
Removed 1 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 1_2-merge, with size 499, is not uniform
Cluster 1_2-merge's shift to uniformity: 0.056658113643415
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.297, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.178082191780822, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.35365811364341, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.307, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.148972602739726, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.37149326865972, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.4, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.00513698630136986, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.38256306292788, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.4, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 3, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.42111642638128, isUniform = FALSE, clusterSize = 499
Clusters 1 and 2 cannot be merged
Finished the first batch - no merges were executed
Loop calculations elapsed time: 19.4509508609772
Start merging nearest clusters: iteration 2
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0548720359802246
Differential Expression Analysis - DONE
Updating check results for the 1 already tested pairs to align to new checker
1 new clusters pairs to be tested for merging:
c("3", "4")
*3_4-merge
Asked to drop 0 genes and 499 cells
COTAN dataset analysis: START
Asked to drop 37 genes and 0 cells
Genes/cells selection done: dropped [37] genes and [0] cells
Working on [563] genes and [501] cells
Dataset cleaning elapsed time: 1.08017992973328
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 11 iterations
Total calculations elapsed time: 2.41731595993042
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.107568326617881 | max: 698.639334552754 | % negative: 32.1492007104796
Model parameter estimation elapsed time: 3.57282304763794
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.51279711723328
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0104598999023438
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0469129085540771
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.15896916389465
Total calculations elapsed time: 4.72913908958435
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 5.95325207710266
Dataset analysis elapsed time: 10.6062550544739
COTAN dataset analysis: DONE
Checking uniformity for the cluster '3_4-merge' with 501 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0440890789031982
Calculate `GDI`: DONE
Total calculations elapsed time: 3.57176494598389
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.109720945358276
Clean plots: DONE
GDI plot
Removed 0 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 3_4-merge, with size 501, is not uniform
Cluster 3_4-merge's shift to uniformity: 0.081310750472311
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.297, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.259325044404973, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.37831075047231, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.307, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.216696269982238, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.41473792188166, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.4, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.0301953818827709, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.43341610223239, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.4, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 17, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.46173948790286, isUniform = FALSE, clusterSize = 501
Clusters 3 and 4 cannot be merged
No clusters will be merged
None of the remaining tested cluster pairs could be merged
Executed all merges for threshold 1.297 out of 2 checks
Start merging nearest clusters - the main threshold is: 1.397
Start merging nearest clusters: iteration 3
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0639519691467285
Differential Expression Analysis - DONE
Updating check results for the 2 already tested pairs to align to new checker
1 new clusters pairs to be tested for merging:
c("2", "4")
*2_4-merge
Asked to drop 0 genes and 570 cells
COTAN dataset analysis: START
Asked to drop 9 genes and 0 cells
Genes/cells selection done: dropped [9] genes and [0] cells
Working on [591] genes and [430] cells
Dataset cleaning elapsed time: 1.11590719223022
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.35818696022034
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0739592351622374 | max: 400.051960722894 | % negative: 25.7191201353638
Model parameter estimation elapsed time: 3.5357608795166
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 3.59222912788391
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0110929012298584
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0482339859008789
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.1227560043335
Total calculations elapsed time: 4.77431201934814
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 5.92183804512024
Dataset analysis elapsed time: 10.5735061168671
COTAN dataset analysis: DONE
Checking uniformity for the cluster '2_4-merge' with 430 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0499298572540283
Calculate `GDI`: DONE
Total calculations elapsed time: 3.45737910270691
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.112590074539185
Clean plots: DONE
GDI plot
Removed 0 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 2_4-merge, with size 430, is not uniform
Cluster 2_4-merge's shift to uniformity: 3.07228472969514
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.583756345177665, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 3.7954982715656, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.576988155668359, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 4.08354952912925, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.524534686971235, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 4.42722016730736, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 310, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 4.57228472969514, isUniform = FALSE, clusterSize = 430
Clusters 2 and 4 cannot be merged
Clusters 1 and 2 will be merged
Clusters 4 and 3 will be merged
Executed 2 merges
Loop calculations elapsed time: 21.6841189861298
Start merging nearest clusters: iteration 4
Differential Expression Analysis - START
* DEA on cluster '1_2-merge' with 499 cells
* DEA on cluster '3_4-merge' with 501 cells
Total calculations elapsed time: 0.0597770214080811
Differential Expression Analysis - DONE
Updating check results for the 3 already tested pairs to align to new checker
1 new clusters pairs to be tested for merging:
c("1_2-merge", "3_4-merge")
*1_2-merge_3_4-merge-merge
Asked to drop no genes or cells
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 1.08402109146118
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 2.51186513900757
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916502 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 3.64677405357361
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 4.08116888999939
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0121049880981445
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0879740715026855
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.1701819896698
Total calculations elapsed time: 5.35142993927002
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 6.46078205108643
Dataset analysis elapsed time: 11.1915771961212
COTAN dataset analysis: DONE
Checking uniformity for the cluster '1_2-merge_3_4-merge-merge' with 1000 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.04498291015625
Calculate `GDI`: DONE
Total calculations elapsed time: 3.50309896469116
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.105733871459961
Clean plots: DONE
GDI plot
Removed 0 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 1_2-merge_3_4-merge-merge, with size 1000, is not uniform
Cluster 1_2-merge_3_4-merge-merge's shift to uniformity: 3.86988385120409
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.69, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 4.54596809454193, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.678333333333333, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 4.93144728766684, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.593333333333333, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 5.2532296852478, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 356, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 5.36988385120409, isUniform = FALSE, clusterSize = 1000
Clusters 1_2-merge and 3_4-merge cannot be merged
No clusters will be merged
None of the remaining tested cluster pairs could be merged
Executed all merges for threshold 1.397 out of 4 checks
The final merged clusterization contains [2] different clusters: 1_2-merge, 3_4-merge
Differential Expression Analysis - START
* DEA on cluster '1' with 499 cells
* DEA on cluster '2' with 501 cells
Total calculations elapsed time: 0.0582711696624756
Differential Expression Analysis - DONE
Applied reordering to clusterization is:
1 -> 1, 2 -> 2
Total calculations elapsed time: 84.2677690982819
Merging cells' uniform clustering: DONE
Applied reordering to clusterization is:
1 -> 1, 2 -> 2
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
Total calculations elapsed time: 2.2725670337677
Log Fold Change Analysis - DONE
[1] "Tested cluster: 1"
Asked to drop 0 genes and 501 cells
COTAN dataset analysis: START
Asked to drop 16 genes and 0 cells
Genes/cells selection done: dropped [16] genes and [0] cells
Working on [584] genes and [499] cells
Dataset cleaning elapsed time: 1.19067192077637
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 10 iterations
Total calculations elapsed time: 2.46302509307861
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0608154544840047 | max: 1260.06995351592 | % negative: 35.6164383561644
Model parameter estimation elapsed time: 3.58779406547546
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 4.02193903923035
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0116438865661621
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0478000640869141
Estimating genes' COEX
Calculate genes' COEX elapsed time: 1.17205810546875
Total calculations elapsed time: 5.25344109535217
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 6.38243889808655
Dataset analysis elapsed time: 11.1609048843384
COTAN dataset analysis: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0449368953704834
Calculate `GDI`: DONE
Total calculations elapsed time: 3.33904695510864
Calculate GDI dataframe: DONE
Dispersion bisection: straddling used 2 iterations
Dispersion bisection: used 8 iterations
Dispersion bisection: straddling used 1 iterations
Dispersion bisection: used 9 iterations
Dispersion Newton-Raphson: used up to 4 iterations
Dispersion Newton-Raphson: used up to 4 iterations
parallel dispersion bisection: straddling used up to 2 iterations
Parallel dispersion bisection: used up to 9 iterations
Parallel dispersion Newton-Raphson: used up to 4 iterations
[ FAIL 0 | WARN 3 | SKIP 0 | PASS 572 ]
[ FAIL 0 | WARN 3 | SKIP 0 | PASS 572 ]
>
> proc.time()
user system elapsed
792.285 8.034 825.621
COTAN.Rcheck/COTAN-Ex.timings
| name | user | system | elapsed | |
| COTAN_Legacy | 0.003 | 0.001 | 0.005 | |
| COTAN_ObjectCreation | 13.229 | 0.351 | 14.114 | |
| CalculatingCOEX | 59.219 | 1.075 | 60.884 | |
| ClustersList | 0.017 | 0.005 | 0.022 | |
| Conversions | 5.818 | 0.103 | 5.929 | |
| GenesStatistics | 12.266 | 0.176 | 12.440 | |
| HandleMetaData | 0.061 | 0.005 | 0.066 | |
| HandlingClusterizations | 58.196 | 0.679 | 59.334 | |
| HandlingConditions | 0.126 | 0.006 | 0.131 | |
| HeatmapPlots | 37.301 | 0.908 | 38.318 | |
| Installing_torch | 0.001 | 0.001 | 0.003 | |
| LoggingFunctions | 0.003 | 0.002 | 0.005 | |
| ParametersEstimations | 24.115 | 0.734 | 24.901 | |
| RawDataCleaning | 8.163 | 0.177 | 8.334 | |
| RawDataGetters | 0.061 | 0.005 | 0.066 | |
| UniformClusters | 77.381 | 0.752 | 78.792 | |
| getColorsVector | 0.001 | 0.001 | 0.002 | |