Recalbox Forum

    • Register
    • Login
    • Search
    • Recent
    • Tags
    • recalbox.com
    • Gitlab repository
    • Documentation
    • Discord

    [BATCH] Scrape your roms on your PC - fastscraper

    Community projects
    multiconsole scraper fastscraper
    37
    221
    240607
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • paradadf
      paradadf Staff @Gonzakpo last edited by paradadf

      @Gonzakpo you can change the folder name and location in the for-loop in the main part. If you need help, tell me where exactly you want to store it and I'll find the correct way (or die trying!).
      Mamedb is down since today so maybe by fba, mame and neogeo was the problem? Or every other system too? sselph's scraper hasn't enabled arcade systems yet.

      If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

      voljega Gonzakpo 2 Replies Last reply Reply Quote 0
      • voljega
        voljega Banned @paradadf last edited by

        @paradadf Does this script works for Atari2600 scrapping ? And what is the size of the download images ?

        paradadf 1 Reply Last reply Reply Quote 0
        • paradadf
          paradadf Staff @voljega last edited by

          @voljega it works and right now it is set to 400px width, you can change it on the parameters with any text editor.

          If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

          1 Reply Last reply Reply Quote 0
          • Gonzakpo
            Gonzakpo @paradadf last edited by

            @paradadf said in [BATCH] Scrape your roms on your PC - fastscraper:

            @Gonzakpo you can change the folder name and location in the for-loop in the main part. If you need help, tell me where exactly you want to store it and I'll find the correct way (or die trying!).
            Mamedb is down since today so maybe by fba, mame and neogeo was the problem? Or every other system too? sselph's scraper hasn't enabled arcade systems yet.

            Yes, the problem is for mame. So I have to wait for mamedb to be up again.

            About the image folder, I know how to modify the script. I'm just pointing that if I change the variable "imagePath" to anything I want like "game_images" it changes the ppath stored in the gamelist.xml but NOT the actual place where the images are downloaded. I'm just saying that It would be nice if you use the same variable "imagePath" for both things (gamelist path and stored folder) so they match. I know how to modify it, I'm just suggesting you an improvement of the script 😛

            Anyway, thanks for your help!!

            paradadf 1 Reply Last reply Reply Quote 0
            • paradadf
              paradadf Staff @Gonzakpo last edited by paradadf

              @Gonzakpo ahh okk, now I understood xD. I'm on my phone right now, but I believe there are two two different variables from scraper.exe. But I'll take a look to see if it's a convinient change to somehow "merge" these. Thanks!
              You can use the Universal XML Scraper instead... look for it in the forum if you don't know it yet. It has many more features and works with all systems.

              If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

              1 Reply Last reply Reply Quote 0
              • paradadf
                paradadf Staff last edited by

                @Gonzakpo Thank you very much for your feedback! I found an easy fix... (I hope!).

                Download fastscraper ver 29.10.2016

                If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                Gonzakpo 1 Reply Last reply Reply Quote 0
                • Gonzakpo
                  Gonzakpo @paradadf last edited by

                  @paradadf said in [BATCH] Scrape your roms on your PC - fastscraper:

                  @Gonzakpo Thank you very much for your feedback! I found an easy fix... (I hope!).

                  Download fastscraper ver 29.10.2016

                  Great! It's working as excepted now 🙂 Thank you.

                  I will try the other scraper you recommended.

                  1 Reply Last reply Reply Quote 0
                  • Yoakin
                    Yoakin last edited by

                    Hi. I'm new to Recalbox so excuse my silly noob quesion. 🙂
                    First of all, this is working great on PC, thanks a million for that. I ran the fastscraper and ES is displaying all game information perfectly on Windows.
                    But when I copy the downloaded images folder and gamelist.xml to the corresponding rom folders on Recalbox (or copy the entire rom folder for that matter) the information doesn't show when I restart. What am I doing wrong?

                    voljega 1 Reply Last reply Reply Quote 0
                    • voljega
                      voljega Banned @Yoakin last edited by

                      @Yoakin you should kill emulation statione before copying tge gamelist.xml. look at wiki

                      1 Reply Last reply Reply Quote 0
                      • SkarlosVilliers
                        SkarlosVilliers last edited by

                        why anyone make some video tutorials of this??? im veeeeeeeery noob on this 😞 i´ve been trying with a lot of methods (im in MAC) with no luck at all -.-, i let my computer work for 1 entire night apparently scrapping but after finish.... no images displayed on my recalbox (4.0 with Raspi 3)... any noob help please? last method i use was

                        Log in your recalbox in SSH like explained on the wiki then type those 2 commands :

                        wget https://raw.githubusercontent.com/substring/fullscrape/master/fullscrape.sh
                        chmod u+x ./fullscrape.sh
                        Now you can run fullscrape.sh :
                        ./fullscrape.sh
                        Here are the possible options
                        -u : update mode only. It will just scrape roms that were not scraped yet. Quite useful if you already spent some time scraping, or if the previous scrape crashed
                        systemname : you can specify several systems seperated by space (nes snes n64 gb gbc gba megadrive mastersystem sega32x gamegear pcengine atari2600 lynx psx scummvm segacd mame fba fba_libretro neogeo)
                        Examples :
                        ./fullscrape.sh : hold tight baby, will scrape everything in its way, dead or alive. You would usually run this only the frist time when you dropped all your roms and want to scrape all
                        ./fullscrape.sh -u : update mode, only scrape non scraped roms
                        ./fullscrape.sh nes fba : full rescrape of nes anf fba systems
                        ./fullscrape.sh -u n64 psx mame : only update n64 psx and mame systems
                        WARNING : fba_libretro has a little bug, that will be corrected in 4.0.0 : scraping can’t be displayed. This can be manually solved if you really really are desperate …

                        paradadf 1 Reply Last reply Reply Quote 0
                        • paradadf
                          paradadf Staff @SkarlosVilliers last edited by

                          @SkarlosVilliers wrong thread... this is about the fastscraper, not the fullscraper.

                          https://forum.recalbox.com/topic/1622/tuto-scraper-ses-roms-depuis-sa-recalbox-en-shell-also-in-english

                          If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                          SkarlosVilliers 1 Reply Last reply Reply Quote 0
                          • SkarlosVilliers
                            SkarlosVilliers @paradadf last edited by

                            @paradadf
                            thanks for your answer, i mean i use a lot of methods, no one worked, only post that because is the last method i use u.u and no work. in terminal shows the download of all systems but recalbox doesn´t show nothing 😞 thanks

                            paradadf 1 Reply Last reply Reply Quote 0
                            • paradadf
                              paradadf Staff @SkarlosVilliers last edited by paradadf

                              @SkarlosVilliers ehhh... did you mind reading the title? Or at least the very first post? It is a BATCH file and those work only on Windows.
                              And again... this is something completely different than the fullscraper, so your post will be disregarded here.

                              If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                              1 Reply Last reply Reply Quote 0
                              • johnDoe_1
                                johnDoe_1 Banned last edited by

                                Hello,

                                Nice soft ! 🙂

                                How to add "Standard (3img)" and "Standard (4img)" to prefer images please ?

                                1 Reply Last reply Reply Quote 0
                                • screech
                                  screech last edited by

                                  @Genetik57 not the same soft 😉 here you are in the BATCH version 😉

                                  You refere to 3img or 4img MIX profil, they are only avalaible in universal xml scraper
                                  (And you can change it in the Mix Profil Menu 😉 )

                                  Clean your Romset with Universal ROM Cleaner
                                  Scrape your Romset with Universal XML Scraper

                                  johnDoe_1 1 Reply Last reply Reply Quote 0
                                  • johnDoe_1
                                    johnDoe_1 Banned @screech last edited by

                                    @screech Mince, j'utilise les deux logiciels pour compléter mes scrapes 😕 Fastscraper est rapide comme l'éclaire, dommage qu'il n'y a pas cette fonction

                                    1 Reply Last reply Reply Quote 0
                                    • screech
                                      screech last edited by

                                      petite astuce pour UXS V2 : si tu participes à la BDD : http://www.screenscraper.fr/ et que tu t'identifie avec tes identifiants screenscraper sur UXS, tu peux scraper plus vite 😉

                                      Clean your Romset with Universal ROM Cleaner
                                      Scrape your Romset with Universal XML Scraper

                                      1 Reply Last reply Reply Quote 0
                                      • Anonpebbles
                                        Anonpebbles last edited by

                                        This tool is amazing thank you! I was just wondering if there was a way to remove the Region at the end of the Game title? eg. Mario Paint (JU). Thanks!

                                        Rpi 3 wew

                                        paradadf 1 Reply Last reply Reply Quote 0
                                        • paradadf
                                          paradadf Staff @Anonpebbles last edited by

                                          @davidwrightini just edit the batch to:
                                          set useNoIntroName=-use_nointro_name=false

                                          and you will get the name from SS instead.

                                          If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                          1 Reply Last reply Reply Quote 0
                                          • Erinjy
                                            Erinjy last edited by Erinjy

                                            I have a problem: i put newest scraper.exe from scraper_windows_amd64.zip and your .bat into the roms folder of my pi3 via wlan. but the bar doesnt find the scraper.exe, although i can normally start the scraper.exe there. Hes saying something about UNC folder.

                                            Any hints?
                                            Thx

                                            paradadf 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Want to support us ?

                                            90
                                            Online

                                            99.6k
                                            Users

                                            28.1k
                                            Topics

                                            187.1k
                                            Posts

                                            Copyright © 2021 recalbox.com