Recalbox Forum

    • Register
    • Login
    • Search
    • Recent
    • Tags
    • recalbox.com
    • Gitlab repository
    • Documentation
    • Discord

    [BATCH] Scrape your roms on your PC - fastscraper

    Community projects
    multiconsole scraper fastscraper
    37
    221
    240609
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • johnDoe_1
      johnDoe_1 Banned @screech last edited by

      @screech Mince, j'utilise les deux logiciels pour compléter mes scrapes 😕 Fastscraper est rapide comme l'éclaire, dommage qu'il n'y a pas cette fonction

      1 Reply Last reply Reply Quote 0
      • screech
        screech last edited by

        petite astuce pour UXS V2 : si tu participes à la BDD : http://www.screenscraper.fr/ et que tu t'identifie avec tes identifiants screenscraper sur UXS, tu peux scraper plus vite 😉

        Clean your Romset with Universal ROM Cleaner
        Scrape your Romset with Universal XML Scraper

        1 Reply Last reply Reply Quote 0
        • Anonpebbles
          Anonpebbles last edited by

          This tool is amazing thank you! I was just wondering if there was a way to remove the Region at the end of the Game title? eg. Mario Paint (JU). Thanks!

          Rpi 3 wew

          paradadf 1 Reply Last reply Reply Quote 0
          • paradadf
            paradadf Staff @Anonpebbles last edited by

            @davidwrightini just edit the batch to:
            set useNoIntroName=-use_nointro_name=false

            and you will get the name from SS instead.

            If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

            1 Reply Last reply Reply Quote 0
            • Erinjy
              Erinjy last edited by Erinjy

              I have a problem: i put newest scraper.exe from scraper_windows_amd64.zip and your .bat into the roms folder of my pi3 via wlan. but the bar doesnt find the scraper.exe, although i can normally start the scraper.exe there. Hes saying something about UNC folder.

              Any hints?
              Thx

              paradadf 1 Reply Last reply Reply Quote 0
              • paradadf
                paradadf Staff @Erinjy last edited by

                @Erinjy read the instructions! this works only on WINDOWS!

                If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                Erinjy 1 Reply Last reply Reply Quote 0
                • Erinjy
                  Erinjy @paradadf last edited by Erinjy

                  @paradadf said in [BATCH] Scrape your roms on your PC - fastscraper:

                  @Erinjy read the instructions! this works only on WINDOWS!

                  Thx for the quick reply, that was the failure. I got another problem now though: When i copy the xml and the image folder onto the PI the images arent shown and if i update the gameliste via the ui it always resets the gamelist (your.bat created) and nothing happens...

                  thx

                  Edit: It seems that the gamelist created by your .bat doesnt contain the right path, how can i change that?

                  paradadf 1 Reply Last reply Reply Quote 0
                  • paradadf
                    paradadf Staff @Erinjy last edited by

                    @Erinjy it contains the right path... You must stop EmulationStation before copying the gamelist.xml with the command: /etc/init.d/S31emulationstation stop and start it again after the copy is finished with /etc/init.d/S31emulationstation start

                    If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                    1 Reply Last reply Reply Quote 0
                    • Erinjy
                      Erinjy last edited by

                      that worked, thx alot.

                      1 Reply Last reply Reply Quote 0
                      • slakka
                        slakka last edited by slakka

                        Just tried this yesterday, worked very well but had a few problems.

                        atari5200 and supergrafx had no successful scrapes. ROMs are from No-Intro set.

                        FBA had almost no successful scrapes, only 154 out of 4156 worked, that number should have been several hundred right? Or should it be almost all of them?

                        I thought maybe the directory name causes it to scrape from different sources so I tried fba, fba_libretro, and mame, same results for all. ROMs are from the set called FBA v0.2.97.38 .

                        Maybe there is still a problem with mamedb causing so many failures?

                        paradadf 1 Reply Last reply Reply Quote 0
                        • paradadf
                          paradadf Staff @slakka last edited by paradadf

                          @slakka sselph's scraper doesn't use ScreenScraper as a source for arcade systems and mamedb has been offline for weeks, so your success rate will be very low there.
                          Wirh this batch, as long as your folders have the words fba, fba_libretro, mame or neogeo, it will be recognized as arcade, with the different options currently available. Even, for example, fbaANYTHING_ELSE will recognize the fba from the beginning.

                          About atari 5200... I have never scraped that system and have no idea about how full the database is. The no-intro romset for supergrafx is definitely on the database (there are only 5 games). But if you have problems scraping your roms, then double-check the SHA1 of your files with the ones on SS. If they are not the same, and for the new roms to be added, you need either a software called FCRC-Calculator (check the MD5 hash) or the missing.txt from another scraper called Universal XML Scraper (scraper with much more options and recognizes arcadd systems ;)) to be submitted on IRC at #screenzone.
                          Look for the how to about screenscraper and the tutorials about Universal XML Scraper (short: UXS) on this forum.

                          If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                          slakka 1 Reply Last reply Reply Quote 0
                          • slakka
                            slakka @paradadf last edited by

                            @paradadf Ok so I guess arcade scrape is out for now.

                            I checked a few of the Atari 5200 ROMs, SHA1 values matched those on SS. There's data there, descriptions, box art, etc. and the total number of ROMs from No-Intro's set is the same as the total number of games on SS, 107 games. Maybe my directory name should be different?

                            Thanks.

                            paradadf 1 Reply Last reply Reply Quote 0
                            • paradadf
                              paradadf Staff @slakka last edited by

                              @slakka directory names are only important if you scrape arcade systems. For the rest, you can call your folders whatever you want. The only thing I can think of is that sselph's scraper hashes the unzipped rom, so even if the .zip hash is on the database, the .a56 (or whatever) might not. Those are the ones that need to be added.

                              If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                              1 Reply Last reply Reply Quote 0
                              • eb2016
                                eb2016 last edited by

                                what database/website does it get its data from? I'm keen to have a look.

                                paradadf 1 Reply Last reply Reply Quote 0
                                • paradadf
                                  paradadf Staff @eb2016 last edited by

                                  @eb2016 all the information is here.
                                  For example:
                                  https://forum.recalbox.com/topic/2594/batch-scrape-your-roms-on-your-pc-fastscraper/9

                                  If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                  1 Reply Last reply Reply Quote 0
                                  • eb2016
                                    eb2016 last edited by eb2016

                                    Does this have issues at all with Gameboy Advanced? I just ran it on a bunch of systems and it worked fine but it didn't scrape any of my GBA titles.

                                    1 Reply Last reply Reply Quote 0
                                    • paradadf
                                      paradadf Staff last edited by

                                      Please, read the thread if you want to know how everything work. Just a few messages before I wrote this:
                                      https://forum.recalbox.com/topic/2594/batch-scrape-your-roms-on-your-pc-fastscraper/48
                                      It depends on the data source you choose and if the rom hash is in that database. Like all scrapers, it is always better to use no-intro romsets.

                                      If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                      wggallagher 1 Reply Last reply Reply Quote 1
                                      • wggallagher
                                        wggallagher @paradadf last edited by

                                        @paradadf Can you please explain to me what im doing wrong? Ive downloaded scraper.exe and fastscraper.
                                        Ive put them in a folder called "roms" on my desktop and inside said folder are all the systems with roms that i want to scrap. I click on fast scraper, it starts, asks me "which systems do i want to scrape? All? " i enter "all"
                                        then i append the existing game list. hit enter and nothing happens. What am i doing wrong?

                                        paradadf 1 Reply Last reply Reply Quote 0
                                        • paradadf
                                          paradadf Staff @wggallagher last edited by paradadf

                                          @wggallagher it is impossible that nothing happened... what does the console says? Do you get the duration? Have you downloaded the correct scraper.exe (64bit version on a 32bit computer)?

                                          If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                          wggallagher 1 Reply Last reply Reply Quote 1
                                          • wggallagher
                                            wggallagher @paradadf last edited by

                                            @paradadf I believe so, I'm running Windows 10. I downloaded the windows386 .zip. should be the right one.

                                            paradadf wggallagher 2 Replies Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Want to support us ?

                                            65
                                            Online

                                            99.6k
                                            Users

                                            28.1k
                                            Topics

                                            187.1k
                                            Posts

                                            Copyright © 2021 recalbox.com