Skip to content

Incorrect progress reporting for Semantic Scholar loader #252

@olegs

Description

@olegs
26 Mar 2021 20:41:34,456 [main] SemanticScholarLoader INFO  Started parsing articles /home/student/ss/s2-corpus-045.gz
26 Mar 2021 20:41:34,457 [main] ArchiveParser   INFO  Collecting stats in /home/student/.pubtrends/semantic_scholar_stats.tsv
26 Mar 2021 20:41:48,247 [main] ArchiveParser   INFO  Finished batch 1 adding (/home/student/ss/s2-corpus-045.gz) 1%
26 Mar 2021 20:42:02,617 [main] ArchiveParser   INFO  Finished batch 2 adding (/home/student/ss/s2-corpus-045.gz) 2%
26 Mar 2021 20:42:16,444 [main] ArchiveParser   INFO  Finished batch 3 adding (/home/student/ss/s2-corpus-045.gz) 3%
26 Mar 2021 20:42:18,999 [main] ArchiveParser   INFO  Finished batch 4 adding (/home/student/ss/s2-corpus-045.gz) 4%
26 Mar 2021 20:42:18,999 [main] ArchiveParser   INFO  Writing stats to /home/student/.pubtrends/semantic_scholar_stats.tsv
26 Mar 2021 20:42:19,000 [main] SemanticScholarLoader INFO  Finished parsing articles

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions