Recalbox Forum

    • Register
    • Login
    • Search
    • Recent
    • Tags
    • recalbox.com
    • Gitlab repository
    • Documentation
    • Discord

    [BATCH] Scrape your roms on your PC - fastscraper

    Community projects
    multiconsole scraper fastscraper
    37
    221
    240629
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • screech
      screech last edited by

      Normally it's OK now ๐Ÿ˜‰

      Clean your Romset with Universal ROM Cleaner
      Scrape your Romset with Universal XML Scraper

      paradadf 1 Reply Last reply Reply Quote 0
      • paradadf
        paradadf Staff @screech last edited by

        @screech thanks for the heads up!

        If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

        1 Reply Last reply Reply Quote 0
        • rsn8887
          rsn8887 last edited by

          Yup it works just fine again ๐Ÿ™‚

          1 Reply Last reply Reply Quote 0
          • rsn8887
            rsn8887 last edited by

            Well, I was a bit fast now there are problems with N64 scraping. It gives "unknown image format" errors. Worked fine 2 hours ago.

            "GDB" scraping works fine, so it is again some problem with "ss" (maybe ss ist just inherently unstable?)

            1 Reply Last reply Reply Quote 0
            • paradadf
              paradadf Staff last edited by

              I just think they are having dns problems lately. Personally, I'd rather wait until it is working again (usually just a matter of hours) instead of using other sources. No other database can compete with SS in that sense. And gdb is definitely not more stable ๐Ÿ™‚

              If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

              1 Reply Last reply Reply Quote 0
              • faxesystem
                faxesystem last edited by

                I have the following problem. When setting 3dboxart as prefered cover art it get's downloaded when scraping for a single system. When I choose all 3dboxart gets scraped for gba but not for any other system. For all other console systems the 2dboxart gets downloaded. Can anyone confirm this?

                Greetings,

                Faxe

                paradadf 1 Reply Last reply Reply Quote 0
                • paradadf
                  paradadf Staff @faxesystem last edited by

                  @faxesystem have you changed consoleImg=-console_img= to "3b" (mameImg=-mame_img="3b" for neogeo)?
                  Only ScreenScraper retrieves 3d boxes, so you better don't change the source. And important... use .png for 3d boxes, otherwise you'll get a black background.

                  If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                  1 Reply Last reply Reply Quote 0
                  • DavidinCT
                    DavidinCT last edited by

                    I tried this and so far getting no where.... I have maybe 500 roms... The Emulationstation folder is in the user path (c:)but, the roms are located on another drive(g:), so it's kind of broken up trying to keep the ROMS off the ๐Ÿ˜„ drive. With this the system works perfectly fine (config files are set right). I dropped this batch file in the root of the rom folder.

                    The only problem when I run this, I just get a message of
                    Error: The system was unable to find the specified registry key or value, Cant get the PS's language. English will be used.
                    And a blinking _

                    it's been sitting there for over an hour like this, never asked me to do anything. Am I doing something wrong ? Or should I be doing something different for my setup ?

                    paradadf 1 Reply Last reply Reply Quote 0
                    • paradadf
                      paradadf Staff @DavidinCT last edited by paradadf

                      @DavidinCT what do you mean by "the emulationstation folder"?
                      What is your OS's language?
                      What windows version do you have?

                      If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                      DavidinCT 1 Reply Last reply Reply Quote 0
                      • DavidinCT
                        DavidinCT @paradadf last edited by

                        @paradadf

                        Windows 7 x64

                        The install is at C:\users<user name>.emulationstation

                        In the config file, I set the roms and emulators to point to a G:\Emulationstation.Emulationstation

                        So, emulators and roms are not on the OS drive. Like this it does not work (as images and XML files are on the ๐Ÿ˜„ drive). I copied the ROMS over to the ๐Ÿ˜„ drive (as a temp thing)

                        I ended up downloading your one that points to screenscraper.fr and it seems to be working, I think. It's giving an error that API not available to NON-MEMBERS. The site is in French and I cant figure it out to setup an account.

                        I could not find a direct download on
                        https://github.com/paradadf/recaltools/tree/master/fastscraper

                        So, I copied the text and created a batch file, pasted it in...maybe some errors (I viewed as raw).

                        Sigh....

                        paradadf 1 Reply Last reply Reply Quote 0
                        • paradadf
                          paradadf Staff @DavidinCT last edited by paradadf

                          @DavidinCT you have flags on the left corner of the site in order to change the language of screenscraper.

                          Anyway, I don't understand. You installed EmulationStation for Windows? Why? Are you a recalbox user? Or what do you intent to do?

                          (Yes, you can copy the raw code into an empty txt file and change its extension to bat. If you did it wrong, the script won't even start properly. I would say it is pretty evident if everything is right)

                          If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                          DavidinCT 1 Reply Last reply Reply Quote 0
                          • DavidinCT
                            DavidinCT @paradadf last edited by

                            @paradadf I have a Home theater PC that I am using this on, It's based on Windows 7 because it's for TV watching as well (Windows Media Center). So I needed Emulation Station for Windows. Scraping has been a headache so if this works I wanted to use it. And the PC I am using is FAR more powerfull than a Pi is, as it's designed to be able to play 4K video.

                            I don't know, I set to raw, copy to a txt file and drop in the root of the rom folder, renamed to bat, it does not work. I tried it 2 times

                            I dropped one that you linked directly above and it seems to work. but, it does not allow me to set my LOGON info for that site.

                            I hope I am not missing anything by not setting the logon info.

                            paradadf 1 Reply Last reply Reply Quote 0
                            • paradadf
                              paradadf Staff @DavidinCT last edited by

                              @DavidinCT ok, well... lets try to help you with that new info ๐Ÿ˜‰

                              Creating the batch isn't difficult. Just be sure to copy the raw content of the file in github. Always use the latest version of the batch. The console will turn cyan if you did it right.

                              About the windows version of ES... I don't know where the gamelists goes. Maybe you'll need to modify the paths if the don't belong next to the roms itself like on recalbox.
                              About your direct access and links or something, I suppose that could be a problem. So in the worst case, scrape directly the real folder and modify your gamelist.xml afterwards.

                              So... what is the problem again?

                              If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                              DavidinCT 1 Reply Last reply Reply Quote 1
                              • DavidinCT
                                DavidinCT @paradadf last edited by DavidinCT

                                @paradadf Yes, I know a batch file is not too hard. With out looking over it everything in the file, I am not sure. I have one that DOES run that I cant log into but, it is creating XML and images so, what ever on this one...as long as it works, right ?

                                I've been playing with this for a few hours now. I figured out the folder layout in Windows, and there is a

                                \downloaded_images
                                and
                                \gamelists

                                Folders with sub folders named for each system and deleing these folders, and re-running ES, they get re-created on the ๐Ÿ˜„ drive, so now I know what ones mean anything.

                                I copied my 20gb of roms on to the ๐Ÿ˜„ drive (correct folder layout) for this test, so I can rule things out.

                                When I run the fastscraper, I see it creates a gamelist.XML and a downloaded_images folder in the rom folder. So I have just copying them into the correct folder as they are laid out (overwriting the old XML file).

                                Problem is once I open Emulation Station, No changes show in there. Even after a reboot.

                                I figured the Meta data on ES would be the EASY part...in fact it's been the hardest part. Over a week working with itand 1/2 my games don't have meta data.

                                I was very excited to see another meta data option....just wish it was working for me ๐Ÿ˜ž

                                paradadf 1 Reply Last reply Reply Quote 0
                                • paradadf
                                  paradadf Staff @DavidinCT last edited by

                                  @DavidinCT you should open the xml files and check the paths to the images are right.

                                  Wich version of fastscraper do you have? As I said before, always use the last one.

                                  If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                  DavidinCT 1 Reply Last reply Reply Quote 1
                                  • DavidinCT
                                    DavidinCT @paradadf last edited by

                                    @paradadf 4.10.2016 is the one that works...17.02.2017 does not work (something I have to play with)

                                    paradadf 1 Reply Last reply Reply Quote 0
                                    • paradadf
                                      paradadf Staff @DavidinCT last edited by

                                      @DavidinCT waaay to old!

                                      Right click here and download it as file:
                                      https://raw.githubusercontent.com/paradadf/recaltools/master/fastscraper/fastscraper.bat

                                      If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                      DavidinCT 1 Reply Last reply Reply Quote 1
                                      • DavidinCT
                                        DavidinCT @paradadf last edited by

                                        @paradadf It gets to ...

                                        G:\EmulationStation.emulationstation\roms>reg Query "HKLM\Hardware\Description
                                        System\CentralProcessor\0" | find /I "x86" 1>nul && set arch=386 || set a
                                        rch=amd64

                                        And just hangs....

                                        paradadf 1 Reply Last reply Reply Quote 0
                                        • paradadf
                                          paradadf Staff @DavidinCT last edited by paradadf

                                          @DavidinCT weird... it must be because you use a nuc or something similar.

                                          Can you open the command prompt and give the output of:

                                          reg Query "HKLM\Hardware\Description System\CentralProcessor\0"

                                          In the mean time, you can erase that part and just use:
                                          set arch=386
                                          Or whatever platform your pc is.

                                          If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                          DavidinCT 1 Reply Last reply Reply Quote 1
                                          • DavidinCT
                                            DavidinCT @paradadf last edited by

                                            @paradadf

                                            Under a command line...
                                            reg Query "HKLM\Hardware\Description System\CentralProcessor\0"
                                            ERROR: The system was unable to find the specified registry key or value.

                                            Manually checking that key Closest you get to AMD64 is "Intel64 Family 6 Model 60 Stepping 3"

                                            paradadf 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Want to support us ?

                                            71
                                            Online

                                            99.6k
                                            Users

                                            28.1k
                                            Topics

                                            187.1k
                                            Posts

                                            Copyright ยฉ 2021 recalbox.com