Skip to content
GitLab
Projects Groups Topics Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
  • V VO-scraper
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributor statistics
    • Graph
    • Compare revisions
  • Issues 1
    • Issues 1
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Container Registry
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar

To receive notifications about scheduled maintenance, please subscribe to the mailing-list gitlab-operations@sympa.ethz.ch. You can subscribe to the mailing-list at https://sympa.ethz.ch

  • Georg Teufelberger
  • VO-scraper
  • Issues
  • #3
Closed
Open
Issue created Sep 18, 2020 by Georg Teufelberger@tgeorgOwner

Make local filenames more unique

Add a unique number at the end of filenames of downloaded recordings (preferably based on the filename of the online file) to prevent skipping videos with the same (local) filename.

Scenario:

For live streams, ETH started to offer two versions (projector and blackboard). Since they do not differ in recording name and the vo-scraper generally uses file names to prevent re-downloads of older clips, this means that only one of the two versions will be downloaded. Worse, when using the history file (--history) this will result in the second recording also being added to the history file, preventing future downloads.

Breakage:

This will change the filename of new downloaded videos and subsequently only prevent re-download if the video on disk already has the new filename.

Therefore, this will cause a re-download of all recordings specified by the user if they rely solely on existing filenames to prevent downloading old videos again.

Users making use of the history file via --history will not be affected.

Assignee
Assign to
Time tracking