Recalbox Forum

    • Register
    • Login
    • Search
    • Recent
    • Tags
    • recalbox.com
    • Gitlab repository
    • Documentation
    • Discord

    [BATCH] Scrape your roms on your PC - fastscraper

    Community projects
    multiconsole scraper fastscraper
    37
    221
    240634
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • paradadf
      paradadf Staff @screech last edited by

      @screech no prob 😉

      If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

      1 Reply Last reply Reply Quote 0
      • The D
        The D Banned last edited by

        Wow! This thing is fast and powerful. I'm glad I stumbled upon it!

        One question- is there a way to prevent the addition of the regions to the display name?

        paradadf 1 Reply Last reply Reply Quote 0
        • paradadf
          paradadf Staff @The D last edited by

          @The-D try editing this to:
          -use_nointro_name=false

          If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

          1 Reply Last reply Reply Quote 0
          • paradadf
            paradadf Staff last edited by

            Little update:

            Now you can type all to scrape all the folders at once.
            fastscraper_console

            I added some extra extension so that, for example, ScummVM can now be scraped, assuming you followed this instructions.

            Please, don't forget to contribute to ScreenScraper and make the database bigger!
            PC DOS, PC Win3.xx, PC Win9X and PC Windows are newly added systems, so you can now scrape Cave Story and Doom games. (Thinking about doxbox and future ports ;))

            Download fastscraper ver. 24.10.2016

            If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

            1 Reply Last reply Reply Quote 0
            • Gonzakpo
              Gonzakpo last edited by

              Hi. Thanks for the script. I've just found a little error on it. If I change the parameter where downloaded images are stored, it just changes the value in the gamelist xml. It doesn't change the actual place where they are downloaded (the command is hardcoded to download always on downloaded_images).

              By the way, two days ago everything was working great. And now most of my roms are giving me "hash not found" although I verified the hashes and they have not changed. Well known games like 1942 are giving me "hash not found". Is something wrong with the scraper.exe ? I'm using the latest one.

              paradadf 1 Reply Last reply Reply Quote 0
              • paradadf
                paradadf Staff @Gonzakpo last edited by paradadf

                @Gonzakpo you can change the folder name and location in the for-loop in the main part. If you need help, tell me where exactly you want to store it and I'll find the correct way (or die trying!).
                Mamedb is down since today so maybe by fba, mame and neogeo was the problem? Or every other system too? sselph's scraper hasn't enabled arcade systems yet.

                If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                voljega Gonzakpo 2 Replies Last reply Reply Quote 0
                • voljega
                  voljega Banned @paradadf last edited by

                  @paradadf Does this script works for Atari2600 scrapping ? And what is the size of the download images ?

                  paradadf 1 Reply Last reply Reply Quote 0
                  • paradadf
                    paradadf Staff @voljega last edited by

                    @voljega it works and right now it is set to 400px width, you can change it on the parameters with any text editor.

                    If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                    1 Reply Last reply Reply Quote 0
                    • Gonzakpo
                      Gonzakpo @paradadf last edited by

                      @paradadf said in [BATCH] Scrape your roms on your PC - fastscraper:

                      @Gonzakpo you can change the folder name and location in the for-loop in the main part. If you need help, tell me where exactly you want to store it and I'll find the correct way (or die trying!).
                      Mamedb is down since today so maybe by fba, mame and neogeo was the problem? Or every other system too? sselph's scraper hasn't enabled arcade systems yet.

                      Yes, the problem is for mame. So I have to wait for mamedb to be up again.

                      About the image folder, I know how to modify the script. I'm just pointing that if I change the variable "imagePath" to anything I want like "game_images" it changes the ppath stored in the gamelist.xml but NOT the actual place where the images are downloaded. I'm just saying that It would be nice if you use the same variable "imagePath" for both things (gamelist path and stored folder) so they match. I know how to modify it, I'm just suggesting you an improvement of the script 😛

                      Anyway, thanks for your help!!

                      paradadf 1 Reply Last reply Reply Quote 0
                      • paradadf
                        paradadf Staff @Gonzakpo last edited by paradadf

                        @Gonzakpo ahh okk, now I understood xD. I'm on my phone right now, but I believe there are two two different variables from scraper.exe. But I'll take a look to see if it's a convinient change to somehow "merge" these. Thanks!
                        You can use the Universal XML Scraper instead... look for it in the forum if you don't know it yet. It has many more features and works with all systems.

                        If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                        1 Reply Last reply Reply Quote 0
                        • paradadf
                          paradadf Staff last edited by

                          @Gonzakpo Thank you very much for your feedback! I found an easy fix... (I hope!).

                          Download fastscraper ver 29.10.2016

                          If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                          Gonzakpo 1 Reply Last reply Reply Quote 0
                          • Gonzakpo
                            Gonzakpo @paradadf last edited by

                            @paradadf said in [BATCH] Scrape your roms on your PC - fastscraper:

                            @Gonzakpo Thank you very much for your feedback! I found an easy fix... (I hope!).

                            Download fastscraper ver 29.10.2016

                            Great! It's working as excepted now 🙂 Thank you.

                            I will try the other scraper you recommended.

                            1 Reply Last reply Reply Quote 0
                            • Yoakin
                              Yoakin last edited by

                              Hi. I'm new to Recalbox so excuse my silly noob quesion. 🙂
                              First of all, this is working great on PC, thanks a million for that. I ran the fastscraper and ES is displaying all game information perfectly on Windows.
                              But when I copy the downloaded images folder and gamelist.xml to the corresponding rom folders on Recalbox (or copy the entire rom folder for that matter) the information doesn't show when I restart. What am I doing wrong?

                              voljega 1 Reply Last reply Reply Quote 0
                              • voljega
                                voljega Banned @Yoakin last edited by

                                @Yoakin you should kill emulation statione before copying tge gamelist.xml. look at wiki

                                1 Reply Last reply Reply Quote 0
                                • SkarlosVilliers
                                  SkarlosVilliers last edited by

                                  why anyone make some video tutorials of this??? im veeeeeeeery noob on this 😞 i´ve been trying with a lot of methods (im in MAC) with no luck at all -.-, i let my computer work for 1 entire night apparently scrapping but after finish.... no images displayed on my recalbox (4.0 with Raspi 3)... any noob help please? last method i use was

                                  Log in your recalbox in SSH like explained on the wiki then type those 2 commands :

                                  wget https://raw.githubusercontent.com/substring/fullscrape/master/fullscrape.sh
                                  chmod u+x ./fullscrape.sh
                                  Now you can run fullscrape.sh :
                                  ./fullscrape.sh
                                  Here are the possible options
                                  -u : update mode only. It will just scrape roms that were not scraped yet. Quite useful if you already spent some time scraping, or if the previous scrape crashed
                                  systemname : you can specify several systems seperated by space (nes snes n64 gb gbc gba megadrive mastersystem sega32x gamegear pcengine atari2600 lynx psx scummvm segacd mame fba fba_libretro neogeo)
                                  Examples :
                                  ./fullscrape.sh : hold tight baby, will scrape everything in its way, dead or alive. You would usually run this only the frist time when you dropped all your roms and want to scrape all
                                  ./fullscrape.sh -u : update mode, only scrape non scraped roms
                                  ./fullscrape.sh nes fba : full rescrape of nes anf fba systems
                                  ./fullscrape.sh -u n64 psx mame : only update n64 psx and mame systems
                                  WARNING : fba_libretro has a little bug, that will be corrected in 4.0.0 : scraping can’t be displayed. This can be manually solved if you really really are desperate …

                                  paradadf 1 Reply Last reply Reply Quote 0
                                  • paradadf
                                    paradadf Staff @SkarlosVilliers last edited by

                                    @SkarlosVilliers wrong thread... this is about the fastscraper, not the fullscraper.

                                    https://forum.recalbox.com/topic/1622/tuto-scraper-ses-roms-depuis-sa-recalbox-en-shell-also-in-english

                                    If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                    SkarlosVilliers 1 Reply Last reply Reply Quote 0
                                    • SkarlosVilliers
                                      SkarlosVilliers @paradadf last edited by

                                      @paradadf
                                      thanks for your answer, i mean i use a lot of methods, no one worked, only post that because is the last method i use u.u and no work. in terminal shows the download of all systems but recalbox doesn´t show nothing 😞 thanks

                                      paradadf 1 Reply Last reply Reply Quote 0
                                      • paradadf
                                        paradadf Staff @SkarlosVilliers last edited by paradadf

                                        @SkarlosVilliers ehhh... did you mind reading the title? Or at least the very first post? It is a BATCH file and those work only on Windows.
                                        And again... this is something completely different than the fullscraper, so your post will be disregarded here.

                                        If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                        1 Reply Last reply Reply Quote 0
                                        • johnDoe_1
                                          johnDoe_1 Banned last edited by

                                          Hello,

                                          Nice soft ! 🙂

                                          How to add "Standard (3img)" and "Standard (4img)" to prefer images please ?

                                          1 Reply Last reply Reply Quote 0
                                          • screech
                                            screech last edited by

                                            @Genetik57 not the same soft 😉 here you are in the BATCH version 😉

                                            You refere to 3img or 4img MIX profil, they are only avalaible in universal xml scraper
                                            (And you can change it in the Mix Profil Menu 😉 )

                                            Clean your Romset with Universal ROM Cleaner
                                            Scrape your Romset with Universal XML Scraper

                                            johnDoe_1 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Want to support us ?

                                            80
                                            Online

                                            99.6k
                                            Users

                                            28.1k
                                            Topics

                                            187.1k
                                            Posts

                                            Copyright © 2021 recalbox.com