Beginner help with file and directory naming

[Shinymokuba]

I seemingly have everything downloaded and it was working at the beginning when using simple commands like

gallery-dl "url" -d "directory"

However when I started to trial and error to see what works and what doesn't, it started to give me "[download][warning] OSError: [Errno 22]". After hours of trying different things, I went back and tested the command that worked originally and it gave the same error. I think this might be an issue with cookies and the site is blocking me, but I don't have the mental to keep trying things that I don't understand, so I'm finally reaching out for help.

I am looking for a command for weibo that has the directory as shown "D:\Art\{user}" and then have the file name be "{user} {date YY-MM-DD} - {original filename}.{ext}". This is what I was initially trying to do before I ran into that error above.

I was also trying to test things with the config file but that made me even more confused and nothing was working so I deleted it. Also, what does everyone use to edit the .json file because the only thing I have is note pad or similar default programs that can edit it.

I am trying to download specifically from weibo and danbooru because those aren't supported by jdownloader, which is what I normally use.

[BanementI]

1. provide an example weibu link so i can do the file name formatting for you
2. the "OSError: [Errno 22]" is an issue with permissions, provide the -v (verbose) output of the command you are getting that error with

[Shinymokuba]

First off, I just want to say thank you for the help.

1. https://www.weibo.com/u/5970182962?tabtype=album
2. While I was trying to recreate the error I found that the downloads weren't showing any errors and it was just working... sorta. Here is the verbose you requested of the error and below that is how I recreated, luckily I kept the terminal command prompt open just in case I needed to see my log history (I don't really know how to export it).

gallery-dl -v "https://www.weibo.com/u/5970182962?tabtype=album" -d "N:\Art\2d Art\Artists\Dongsheng\"
[gallery-dl][debug] Version 1.26.9
[gallery-dl][debug] Python 3.11.3 - Windows-10-10.0.19045-SP0
[gallery-dl][debug] requests 2.31.0 - urllib3 1.26.16
[gallery-dl][debug] Configuration Files []
[gallery-dl][debug] Starting DownloadJob for 'https://www.weibo.com/u/5970182962?tabtype=album'
[weibo][debug] Using WeiboAlbumExtractor for 'https://www.weibo.com/u/5970182962?tabtype=album'
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): weibo.com:443
[urllib3.connectionpool][debug] https://weibo.com:443 "GET /ajax/profile/getImageWall?uid=5970182962 HTTP/1.1" 200 None
[weibo][debug] Sleeping 1.73 seconds (request)
[urllib3.connectionpool][debug] https://weibo.com:443 "GET /ajax/statuses/show?id=5035896609181151 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): wx3.sinaimg.cn:443
[urllib3.connectionpool][debug] https://wx3.sinaimg.cn:443 "GET /large/006w2hjAgy1hpv9u2io1xj32yo1o0qv5.jpg HTTP/1.1" 200 1898895

[download][warning] OSError: [Errno 22] Invalid argument: '\\\\?\\N:\\Art\\2d Art\\Artists\\Dongsheng"\\weibo\\-冬笙\\5035896609181151_01.jpg.part'
[download][error] Failed to download 5035896609181151_01.jpg
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): wx1.sinaimg.cn:443
[urllib3.connectionpool][debug] https://wx1.sinaimg.cn:443 "GET /large/006w2hjAgy1hpv9uaik83j32c03h0kjn.jpg HTTP/1.1" 200 3762158

[download][warning] OSError: [Errno 22] Invalid argument: '\\\\?\\N:\\Art\\2d Art\\Artists\\Dongsheng"\\weibo\\-冬笙\\5035896609181151_02.jpg.part'
[download][error] Failed to download 5035896609181151_02.jpg
[urllib3.connectionpool][debug] Starting new HTTPS connection (2): wx3.sinaimg.cn:443
[urllib3.connectionpool][debug] https://wx3.sinaimg.cn:443 "GET /large/006w2hjAgy1hpvaeeagnhj32yo1o0npd.jpg HTTP/1.1" 200 1749171

[download][warning] OSError: [Errno 22] Invalid argument: '\\\\?\\N:\\Art\\2d Art\\Artists\\Dongsheng"\\weibo\\-冬笙\\5028567712794867_17.jpg.part'
[download][error] Failed to download 5028567712794867_17.jpg
[urllib3.connectionpool][debug] https://weibo.com:443 "GET /ajax/profile/getImageWall?uid=5970182962&sinceid=5028567728652483_5028239594489908%7C1034%3A5028221347889180_20240429_-1 HTTP/1.1" 200 None
[weibo][debug] Sleeping 1.05 seconds (request)
[urllib3.connectionpool][debug] https://weibo.com:443 "GET /ajax/statuses/show?id=5028091300151575 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] Starting new HTTPS connection (10): wx2.sinaimg.cn:443
[urllib3.connectionpool][debug] https://wx2.sinaimg.cn:443 "GET /large/006w2hjAly1hp6d8e6vvxj32c033se81.jpg HTTP/1.1" 200 1512687

The download warnings kept repeating for all 80 images it was trying to download aside from the last one with the "[weibo][debug] Sleeping 1.05 seconds (request)", which came up 4 times for this album. I did't include the repeats to save space but if you need them I can post it.

cmd 1

gallery-dl "https://www.weibo.com/u/5970182962?tabtype=album" -d "N:\Art\2d Art\Artists\Dongsheng\"

cmd 2

gallery-dl "https://www.weibo.com/u/5970182962?tabtype=album&uid=5970182962&index=0" -D "N:\Art\2d Art\Artists\Dongsheng\" -X "{user}"

cmd 3

gallery-dl "https://www.weibo.com/u/5970182962?tabtype=album" -d "N:\Art\2d Art\Artists"

I've just labelled the commands that I used for easier reference. The first thing I tried after first installing gallery-dl was cmd 1 with no errors and a successful download. I then tested a few custom directories that didn't do what I wanted but gave no errors. cmd 2 was the first time the error appeared and I'm unsure if its the cause or just a coincidence. Looking back, I honestly don't know why I thought this would work but it's in the history.

Fast forward to today when I am trying to copy the verbose for you and I try cmd 3. It not only works but never seems to get an error message. So I try cmd 1 again but it still produces the error, which is strange because the only difference between the two commands is one folder directory.

That's everything worth noting so far. Sorry if the rambling was useless, I just want to provide as much info as I can.

[Hrxn]

OSError: [Errno 22] can also be caused if the output is rejected by four filesystem, i.e. if the length of the output path is too long, or unsupported char encodings etc.

What's the filesystem of your N:?

[Shinymokuba]

It's saying the file system is NTFS, which is the same for all the drives on my computer.

[mikf]

[download][warning] OSError: [Errno 22] Invalid argument: '\\?\N:\Art\2d Art\Artists\Dongsheng"\weibo\-冬笙\5035896609181151_02.jpg.part'

Dongsheng"

NTFS does not allow " characters in its paths. They should be handled by path-restrict, but for some reason this doesn't properly work here.

Try it with -d "N:\Art\2d Art\Artists\Dongsheng"
There might be something weird going on with character escaping when ending with \".

[Shinymokuba]

That's the solution it works without the last backslash, which is a stupid error on my part, I guess I was testing too many things and it slipped my mind. I also went back to see my history and every it ended in the backslash it produced the error. Thank you so much for the help.

As a side note how do you highlight the text like you did with backslash"

If it' not too much to ask can you help me with the file name system, it would save me a lot of time. Test link:
https://www.weibo.com/u/5970182962?tabtype=album

I am looking for a command for weibo that has the directory as shown "D:\Art{user}" and then have the file name be "{user} {date YY-MM-DD} - {original filename}.{ext}".

Again thank you so much, I always seem to stumble on the most mundane things.

[mikf]

As a side note how do you highlight the text like you did with backslash"

With back ticks. `\"` becomes \".

the directory as shown "D:\Art{user}"

-d "D:\Art" -o directory="[\"{user['screen_name']}\"]"

have the file name be "{user} {date YY-MM-DD} - {original filename}.{ext}".

-f "{status['user']['screen_name']} {status['date']:%y-%m-%d} - {filename}.{extension}"

[Shinymokuba]

Thank you for everything, that works perfectly for what I need.