Recalbox Forum

    • Register
    • Login
    • Search
    • Recent
    • Tags
    • recalbox.com
    • Gitlab repository
    • Documentation
    • Discord

    [BATCH] Scrape your roms on your PC - fastscraper

    Community projects
    multiconsole scraper fastscraper
    37
    221
    240631
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • The D
      The D Banned last edited by

      Wow! This thing is fast and powerful. I'm glad I stumbled upon it!

      One question- is there a way to prevent the addition of the regions to the display name?

      paradadf 1 Reply Last reply Reply Quote 0
      • paradadf
        paradadf Staff @The D last edited by

        @The-D try editing this to:
        -use_nointro_name=false

        If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

        1 Reply Last reply Reply Quote 0
        • paradadf
          paradadf Staff last edited by

          Little update:

          Now you can type all to scrape all the folders at once.
          fastscraper_console

          I added some extra extension so that, for example, ScummVM can now be scraped, assuming you followed this instructions.

          Please, don't forget to contribute to ScreenScraper and make the database bigger!
          PC DOS, PC Win3.xx, PC Win9X and PC Windows are newly added systems, so you can now scrape Cave Story and Doom games. (Thinking about doxbox and future ports ;))

          Download fastscraper ver. 24.10.2016

          If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

          1 Reply Last reply Reply Quote 0
          • Gonzakpo
            Gonzakpo last edited by

            Hi. Thanks for the script. I've just found a little error on it. If I change the parameter where downloaded images are stored, it just changes the value in the gamelist xml. It doesn't change the actual place where they are downloaded (the command is hardcoded to download always on downloaded_images).

            By the way, two days ago everything was working great. And now most of my roms are giving me "hash not found" although I verified the hashes and they have not changed. Well known games like 1942 are giving me "hash not found". Is something wrong with the scraper.exe ? I'm using the latest one.

            paradadf 1 Reply Last reply Reply Quote 0
            • paradadf
              paradadf Staff @Gonzakpo last edited by paradadf

              @Gonzakpo you can change the folder name and location in the for-loop in the main part. If you need help, tell me where exactly you want to store it and I'll find the correct way (or die trying!).
              Mamedb is down since today so maybe by fba, mame and neogeo was the problem? Or every other system too? sselph's scraper hasn't enabled arcade systems yet.

              If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

              voljega Gonzakpo 2 Replies Last reply Reply Quote 0
              • voljega
                voljega Banned @paradadf last edited by

                @paradadf Does this script works for Atari2600 scrapping ? And what is the size of the download images ?

                paradadf 1 Reply Last reply Reply Quote 0
                • paradadf
                  paradadf Staff @voljega last edited by

                  @voljega it works and right now it is set to 400px width, you can change it on the parameters with any text editor.

                  If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                  1 Reply Last reply Reply Quote 0
                  • Gonzakpo
                    Gonzakpo @paradadf last edited by

                    @paradadf said in [BATCH] Scrape your roms on your PC - fastscraper:

                    @Gonzakpo you can change the folder name and location in the for-loop in the main part. If you need help, tell me where exactly you want to store it and I'll find the correct way (or die trying!).
                    Mamedb is down since today so maybe by fba, mame and neogeo was the problem? Or every other system too? sselph's scraper hasn't enabled arcade systems yet.

                    Yes, the problem is for mame. So I have to wait for mamedb to be up again.

                    About the image folder, I know how to modify the script. I'm just pointing that if I change the variable "imagePath" to anything I want like "game_images" it changes the ppath stored in the gamelist.xml but NOT the actual place where the images are downloaded. I'm just saying that It would be nice if you use the same variable "imagePath" for both things (gamelist path and stored folder) so they match. I know how to modify it, I'm just suggesting you an improvement of the script 😛

                    Anyway, thanks for your help!!

                    paradadf 1 Reply Last reply Reply Quote 0
                    • paradadf
                      paradadf Staff @Gonzakpo last edited by paradadf

                      @Gonzakpo ahh okk, now I understood xD. I'm on my phone right now, but I believe there are two two different variables from scraper.exe. But I'll take a look to see if it's a convinient change to somehow "merge" these. Thanks!
                      You can use the Universal XML Scraper instead... look for it in the forum if you don't know it yet. It has many more features and works with all systems.

                      If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                      1 Reply Last reply Reply Quote 0
                      • paradadf
                        paradadf Staff last edited by

                        @Gonzakpo Thank you very much for your feedback! I found an easy fix... (I hope!).

                        Download fastscraper ver 29.10.2016

                        If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                        Gonzakpo 1 Reply Last reply Reply Quote 0
                        • Gonzakpo
                          Gonzakpo @paradadf last edited by

                          @paradadf said in [BATCH] Scrape your roms on your PC - fastscraper:

                          @Gonzakpo Thank you very much for your feedback! I found an easy fix... (I hope!).

                          Download fastscraper ver 29.10.2016

                          Great! It's working as excepted now 🙂 Thank you.

                          I will try the other scraper you recommended.

                          1 Reply Last reply Reply Quote 0
                          • Yoakin
                            Yoakin last edited by

                            Hi. I'm new to Recalbox so excuse my silly noob quesion. 🙂
                            First of all, this is working great on PC, thanks a million for that. I ran the fastscraper and ES is displaying all game information perfectly on Windows.
                            But when I copy the downloaded images folder and gamelist.xml to the corresponding rom folders on Recalbox (or copy the entire rom folder for that matter) the information doesn't show when I restart. What am I doing wrong?

                            voljega 1 Reply Last reply Reply Quote 0
                            • voljega
                              voljega Banned @Yoakin last edited by

                              @Yoakin you should kill emulation statione before copying tge gamelist.xml. look at wiki

                              1 Reply Last reply Reply Quote 0
                              • SkarlosVilliers
                                SkarlosVilliers last edited by

                                why anyone make some video tutorials of this??? im veeeeeeeery noob on this 😞 i´ve been trying with a lot of methods (im in MAC) with no luck at all -.-, i let my computer work for 1 entire night apparently scrapping but after finish.... no images displayed on my recalbox (4.0 with Raspi 3)... any noob help please? last method i use was

                                Log in your recalbox in SSH like explained on the wiki then type those 2 commands :

                                wget https://raw.githubusercontent.com/substring/fullscrape/master/fullscrape.sh
                                chmod u+x ./fullscrape.sh
                                Now you can run fullscrape.sh :
                                ./fullscrape.sh
                                Here are the possible options
                                -u : update mode only. It will just scrape roms that were not scraped yet. Quite useful if you already spent some time scraping, or if the previous scrape crashed
                                systemname : you can specify several systems seperated by space (nes snes n64 gb gbc gba megadrive mastersystem sega32x gamegear pcengine atari2600 lynx psx scummvm segacd mame fba fba_libretro neogeo)
                                Examples :
                                ./fullscrape.sh : hold tight baby, will scrape everything in its way, dead or alive. You would usually run this only the frist time when you dropped all your roms and want to scrape all
                                ./fullscrape.sh -u : update mode, only scrape non scraped roms
                                ./fullscrape.sh nes fba : full rescrape of nes anf fba systems
                                ./fullscrape.sh -u n64 psx mame : only update n64 psx and mame systems
                                WARNING : fba_libretro has a little bug, that will be corrected in 4.0.0 : scraping can’t be displayed. This can be manually solved if you really really are desperate …

                                paradadf 1 Reply Last reply Reply Quote 0
                                • paradadf
                                  paradadf Staff @SkarlosVilliers last edited by

                                  @SkarlosVilliers wrong thread... this is about the fastscraper, not the fullscraper.

                                  https://forum.recalbox.com/topic/1622/tuto-scraper-ses-roms-depuis-sa-recalbox-en-shell-also-in-english

                                  If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                  SkarlosVilliers 1 Reply Last reply Reply Quote 0
                                  • SkarlosVilliers
                                    SkarlosVilliers @paradadf last edited by

                                    @paradadf
                                    thanks for your answer, i mean i use a lot of methods, no one worked, only post that because is the last method i use u.u and no work. in terminal shows the download of all systems but recalbox doesn´t show nothing 😞 thanks

                                    paradadf 1 Reply Last reply Reply Quote 0
                                    • paradadf
                                      paradadf Staff @SkarlosVilliers last edited by paradadf

                                      @SkarlosVilliers ehhh... did you mind reading the title? Or at least the very first post? It is a BATCH file and those work only on Windows.
                                      And again... this is something completely different than the fullscraper, so your post will be disregarded here.

                                      If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                      1 Reply Last reply Reply Quote 0
                                      • johnDoe_1
                                        johnDoe_1 Banned last edited by

                                        Hello,

                                        Nice soft ! 🙂

                                        How to add "Standard (3img)" and "Standard (4img)" to prefer images please ?

                                        1 Reply Last reply Reply Quote 0
                                        • screech
                                          screech last edited by

                                          @Genetik57 not the same soft 😉 here you are in the BATCH version 😉

                                          You refere to 3img or 4img MIX profil, they are only avalaible in universal xml scraper
                                          (And you can change it in the Mix Profil Menu 😉 )

                                          Clean your Romset with Universal ROM Cleaner
                                          Scrape your Romset with Universal XML Scraper

                                          johnDoe_1 1 Reply Last reply Reply Quote 0
                                          • johnDoe_1
                                            johnDoe_1 Banned @screech last edited by

                                            @screech Mince, j'utilise les deux logiciels pour compléter mes scrapes 😕 Fastscraper est rapide comme l'éclaire, dommage qu'il n'y a pas cette fonction

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Want to support us ?

                                            84
                                            Online

                                            99.6k
                                            Users

                                            28.1k
                                            Topics

                                            187.1k
                                            Posts

                                            Copyright © 2021 recalbox.com