Only partial list of files available

[ensozero]

Everything works as it should, except that only a partial list of files are linked and downloadable. For example, one user lists 209 videos on their profile, and yet only 63 are linked and downloadable.

Is this a known issue?

[Alexo88]

some of the videos are paid, are you sure that all the videos are free?

[ensozero]

Yes, I'm completely sure. This user has zero paid content, and OFDL recognizes 209 but downloads 63.

[Alexo88]

you can try with SCrawler, maybe you won't get the same, the fact that it doesn't download all the videos is normal in several repositories I tried.

[someguy75]

It seems that the post API only returns 50 results when called with a limit of 100. The subsequent offsets are calculated assuming that the full amount is returned so some will be skipped.

OFDL/module/snafylno.py

Lines 791 to 800 in 36bc39c

	limit = 100
	flag = profile.get_flag()
	if ((flag & PICTURES) or (flag & VIDEOS)) and \
	not (profile.gathered_flags & (PICTURES | VIDEOS)):
	offset_range = math.ceil(total_post / 100)
	offsets = list(range(offset_range))
	for offset in offsets:
	new_offset = offset * 100
	link = self.post_api.format(profile.id(), limit, new_offset)

[Hashirama]

Ya I'll look into it.

[longusnickus]

Some videos have DRM Protection. It shows the right amount of videos, but they cannot be downloaded.
In Firefox: Shift+Right Click on a Video/Image
You can download all media like that, execpt when a video has DRM