Recalbox Forum

    • Register
    • Login
    • Search
    • Recent
    • Tags
    • recalbox.com
    • Gitlab repository
    • Documentation
    • Discord

    [BATCH] Scrape your roms on your PC - fastscraper

    Community projects
    multiconsole scraper fastscraper
    37
    221
    240614
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Gonzakpo
      Gonzakpo @paradadf last edited by

      @paradadf said in [BATCH] Scrape your roms on your PC - fastscraper:

      @Gonzakpo you can change the folder name and location in the for-loop in the main part. If you need help, tell me where exactly you want to store it and I'll find the correct way (or die trying!).
      Mamedb is down since today so maybe by fba, mame and neogeo was the problem? Or every other system too? sselph's scraper hasn't enabled arcade systems yet.

      Yes, the problem is for mame. So I have to wait for mamedb to be up again.

      About the image folder, I know how to modify the script. I'm just pointing that if I change the variable "imagePath" to anything I want like "game_images" it changes the ppath stored in the gamelist.xml but NOT the actual place where the images are downloaded. I'm just saying that It would be nice if you use the same variable "imagePath" for both things (gamelist path and stored folder) so they match. I know how to modify it, I'm just suggesting you an improvement of the script 😛

      Anyway, thanks for your help!!

      paradadf 1 Reply Last reply Reply Quote 0
      • paradadf
        paradadf Staff @Gonzakpo last edited by paradadf

        @Gonzakpo ahh okk, now I understood xD. I'm on my phone right now, but I believe there are two two different variables from scraper.exe. But I'll take a look to see if it's a convinient change to somehow "merge" these. Thanks!
        You can use the Universal XML Scraper instead... look for it in the forum if you don't know it yet. It has many more features and works with all systems.

        If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

        1 Reply Last reply Reply Quote 0
        • paradadf
          paradadf Staff last edited by

          @Gonzakpo Thank you very much for your feedback! I found an easy fix... (I hope!).

          Download fastscraper ver 29.10.2016

          If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

          Gonzakpo 1 Reply Last reply Reply Quote 0
          • Gonzakpo
            Gonzakpo @paradadf last edited by

            @paradadf said in [BATCH] Scrape your roms on your PC - fastscraper:

            @Gonzakpo Thank you very much for your feedback! I found an easy fix... (I hope!).

            Download fastscraper ver 29.10.2016

            Great! It's working as excepted now 🙂 Thank you.

            I will try the other scraper you recommended.

            1 Reply Last reply Reply Quote 0
            • Yoakin
              Yoakin last edited by

              Hi. I'm new to Recalbox so excuse my silly noob quesion. 🙂
              First of all, this is working great on PC, thanks a million for that. I ran the fastscraper and ES is displaying all game information perfectly on Windows.
              But when I copy the downloaded images folder and gamelist.xml to the corresponding rom folders on Recalbox (or copy the entire rom folder for that matter) the information doesn't show when I restart. What am I doing wrong?

              voljega 1 Reply Last reply Reply Quote 0
              • voljega
                voljega Banned @Yoakin last edited by

                @Yoakin you should kill emulation statione before copying tge gamelist.xml. look at wiki

                1 Reply Last reply Reply Quote 0
                • SkarlosVilliers
                  SkarlosVilliers last edited by

                  why anyone make some video tutorials of this??? im veeeeeeeery noob on this 😞 i´ve been trying with a lot of methods (im in MAC) with no luck at all -.-, i let my computer work for 1 entire night apparently scrapping but after finish.... no images displayed on my recalbox (4.0 with Raspi 3)... any noob help please? last method i use was

                  Log in your recalbox in SSH like explained on the wiki then type those 2 commands :

                  wget https://raw.githubusercontent.com/substring/fullscrape/master/fullscrape.sh
                  chmod u+x ./fullscrape.sh
                  Now you can run fullscrape.sh :
                  ./fullscrape.sh
                  Here are the possible options
                  -u : update mode only. It will just scrape roms that were not scraped yet. Quite useful if you already spent some time scraping, or if the previous scrape crashed
                  systemname : you can specify several systems seperated by space (nes snes n64 gb gbc gba megadrive mastersystem sega32x gamegear pcengine atari2600 lynx psx scummvm segacd mame fba fba_libretro neogeo)
                  Examples :
                  ./fullscrape.sh : hold tight baby, will scrape everything in its way, dead or alive. You would usually run this only the frist time when you dropped all your roms and want to scrape all
                  ./fullscrape.sh -u : update mode, only scrape non scraped roms
                  ./fullscrape.sh nes fba : full rescrape of nes anf fba systems
                  ./fullscrape.sh -u n64 psx mame : only update n64 psx and mame systems
                  WARNING : fba_libretro has a little bug, that will be corrected in 4.0.0 : scraping can’t be displayed. This can be manually solved if you really really are desperate …

                  paradadf 1 Reply Last reply Reply Quote 0
                  • paradadf
                    paradadf Staff @SkarlosVilliers last edited by

                    @SkarlosVilliers wrong thread... this is about the fastscraper, not the fullscraper.

                    https://forum.recalbox.com/topic/1622/tuto-scraper-ses-roms-depuis-sa-recalbox-en-shell-also-in-english

                    If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                    SkarlosVilliers 1 Reply Last reply Reply Quote 0
                    • SkarlosVilliers
                      SkarlosVilliers @paradadf last edited by

                      @paradadf
                      thanks for your answer, i mean i use a lot of methods, no one worked, only post that because is the last method i use u.u and no work. in terminal shows the download of all systems but recalbox doesn´t show nothing 😞 thanks

                      paradadf 1 Reply Last reply Reply Quote 0
                      • paradadf
                        paradadf Staff @SkarlosVilliers last edited by paradadf

                        @SkarlosVilliers ehhh... did you mind reading the title? Or at least the very first post? It is a BATCH file and those work only on Windows.
                        And again... this is something completely different than the fullscraper, so your post will be disregarded here.

                        If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                        1 Reply Last reply Reply Quote 0
                        • johnDoe_1
                          johnDoe_1 Banned last edited by

                          Hello,

                          Nice soft ! 🙂

                          How to add "Standard (3img)" and "Standard (4img)" to prefer images please ?

                          1 Reply Last reply Reply Quote 0
                          • screech
                            screech last edited by

                            @Genetik57 not the same soft 😉 here you are in the BATCH version 😉

                            You refere to 3img or 4img MIX profil, they are only avalaible in universal xml scraper
                            (And you can change it in the Mix Profil Menu 😉 )

                            Clean your Romset with Universal ROM Cleaner
                            Scrape your Romset with Universal XML Scraper

                            johnDoe_1 1 Reply Last reply Reply Quote 0
                            • johnDoe_1
                              johnDoe_1 Banned @screech last edited by

                              @screech Mince, j'utilise les deux logiciels pour compléter mes scrapes 😕 Fastscraper est rapide comme l'éclaire, dommage qu'il n'y a pas cette fonction

                              1 Reply Last reply Reply Quote 0
                              • screech
                                screech last edited by

                                petite astuce pour UXS V2 : si tu participes à la BDD : http://www.screenscraper.fr/ et que tu t'identifie avec tes identifiants screenscraper sur UXS, tu peux scraper plus vite 😉

                                Clean your Romset with Universal ROM Cleaner
                                Scrape your Romset with Universal XML Scraper

                                1 Reply Last reply Reply Quote 0
                                • Anonpebbles
                                  Anonpebbles last edited by

                                  This tool is amazing thank you! I was just wondering if there was a way to remove the Region at the end of the Game title? eg. Mario Paint (JU). Thanks!

                                  Rpi 3 wew

                                  paradadf 1 Reply Last reply Reply Quote 0
                                  • paradadf
                                    paradadf Staff @Anonpebbles last edited by

                                    @davidwrightini just edit the batch to:
                                    set useNoIntroName=-use_nointro_name=false

                                    and you will get the name from SS instead.

                                    If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                    1 Reply Last reply Reply Quote 0
                                    • Erinjy
                                      Erinjy last edited by Erinjy

                                      I have a problem: i put newest scraper.exe from scraper_windows_amd64.zip and your .bat into the roms folder of my pi3 via wlan. but the bar doesnt find the scraper.exe, although i can normally start the scraper.exe there. Hes saying something about UNC folder.

                                      Any hints?
                                      Thx

                                      paradadf 1 Reply Last reply Reply Quote 0
                                      • paradadf
                                        paradadf Staff @Erinjy last edited by

                                        @Erinjy read the instructions! this works only on WINDOWS!

                                        If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                        Erinjy 1 Reply Last reply Reply Quote 0
                                        • Erinjy
                                          Erinjy @paradadf last edited by Erinjy

                                          @paradadf said in [BATCH] Scrape your roms on your PC - fastscraper:

                                          @Erinjy read the instructions! this works only on WINDOWS!

                                          Thx for the quick reply, that was the failure. I got another problem now though: When i copy the xml and the image folder onto the PI the images arent shown and if i update the gameliste via the ui it always resets the gamelist (your.bat created) and nothing happens...

                                          thx

                                          Edit: It seems that the gamelist created by your .bat doesnt contain the right path, how can i change that?

                                          paradadf 1 Reply Last reply Reply Quote 0
                                          • paradadf
                                            paradadf Staff @Erinjy last edited by

                                            @Erinjy it contains the right path... You must stop EmulationStation before copying the gamelist.xml with the command: /etc/init.d/S31emulationstation stop and start it again after the copy is finished with /etc/init.d/S31emulationstation start

                                            If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Want to support us ?

                                            68
                                            Online

                                            99.6k
                                            Users

                                            28.1k
                                            Topics

                                            187.1k
                                            Posts

                                            Copyright © 2021 recalbox.com