Hi there! I’m @hitstun from @FloatingIsFun , where we get easily distracted by floaty things. I’m so glad @Martineski is here and I’m not running the only functioning art collection on the Fediverse anymore. Hopefully my SauceNAO Pixiv scraping tool can help you guys post those cool Pixiv stuff on this and your other sublemmies. Can we get other Imaginary subreddits to make the jump?
Alright, can you explain me what this scraping tool does exactly? Thanks.
Sure thing!
- User pastes an image URL into cell B2
- Google Sheets loads the page for a SauceNAO.com search limited to Pixiv, parsing it as XML
- From the SauceNAO results, it reads the title, page URL, artist name, and artist URL from that XML
- Google Translate tries to translate the title and artist name into the user’s language if it’s not already
- Google Sheets also tries to load the Pixiv image page and scrape the canonical URL from its XML
- Using all this scraped information, it stitches them together into post titles and source comments you can copy and paste
- It also does a SauceNAO search for non-Pixiv source and gives their URLs if any are available
OMG! It works with links that are not directly to pixiv! Thank you so muuuuch! It will make it so much easier for me to find and add links to the original posts with images because so far I was uploading images with only creator and image id’s. You showed up right when I wanted to start (in ~2 days) adding links to the images in my posts.
Edit: but how would the tool work when multiple people are trying to use it?
Well, users would fight over the URL entry field and have to copy the results they need before the URL changes again. Also, SauceNAO and the IMPORTXML commands will both start limiting us and giving errors if we make several requests within a few minutes.
requests within a few minutes.
Dammit, if you check my sublemmies then you will notice that I have a lot of images where I have to change the title of the post need to include direct links to the artwork and artist’s socials.
You can mitigate this a little bit by making your own private copy of the Google Sheet. That way, nobody else can enter stuff into the sheet and mess with you. But, your copy won’t get updated if I add DeviantArt support.
When you will be updating it?
Originally posted on Reddit March 28, 2023
Reddit (colored), (inks), (pencils), Instagram, INPRNT
Title: Kiki’s Delivery Service re-imagined flying through Flatiron NYC, colored
Artist: TurtleboatI saw this on /r/ghibli and this belongs here even more than it belongs on /r/FloatingIsFun. A modern day Kiki would make loads of money in food delivery, especially when delivering to those tall buildings! Check out all those Ghibli easter eggs, too.
