Recalbox Forum
    • Register
    • Login
    • Search
    • Recent
    • Tags
    • recalbox.com
    • Gitlab repository
    • Documentation
    • Discord

    [BATCH] Scrape your roms on your PC - fastscraper

    Community projects
    multiconsole scraper fastscraper
    37
    221
    240633
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • paradadf
      paradadf Staff @Keladir last edited by

      @Keladir again, this is the recalbox forum, if you have problems transfering the files, make your question on the retropie forum.

      Your initial post doesn't say where on the SD card to transfer the XML and images folder to.

      Next to your roms is a unique location. Wherever the correct place were you copied your roms for retropie, that's the place! I don't know how retropie works, but my initial post also states that you must kill emulationstation before trying to edit/copy/transfer/touch the gamelist.xml. And that is valid for emulationstation in general.

      Sorry but either you don't want to understand, or you are not paying attention to what you read.

      If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

      1 Reply Last reply Reply Quote 0
      • airart
        airart last edited by

        hi, I copied the roms of my PC, but I get this error
        alt text

        I apologize for my English, but in Italian forum I did not have answers

        paradadf 1 Reply Last reply Reply Quote 0
        • paradadf
          paradadf Staff @airart last edited by

          @airart mamedb is down and thus, unscrapable. I've seen that sselph just added a mirror for it and enabled SS as source for mame as well. He just hasn't compiled and released a new version with all those changes yet so I can test and upgrade the batch.

          If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

          1 Reply Last reply Reply Quote 0
          • paradadf
            paradadf Staff last edited by

            fastscraper has been upgraded and is fully functional again.
            New feature: you can open a folder browser and choose the roms folder of your recalbox directly over the network to scrape from it!
            I have set ScreenScraper as the only source because the quality is superior to any other. You can expand or modify it easily if you wish. Enjoy!

            If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

            1 Reply Last reply Reply Quote 0
            • kevinnash
              kevinnash last edited by

              Hi,

              How do we download it on github ?

              I don't see any download link there.

              1 Reply Last reply Reply Quote 0
              • paradadf
                paradadf Staff last edited by

                You can select RAW and copy the plain text to a txt file and rename the extension to .bat

                If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                1 Reply Last reply Reply Quote 0
                • maximus37
                  maximus37 last edited by paradadf

                  This tool is fantastic!! Nice work!!

                  One problem though, I cannot scrape NeoGeo roms, I get the following output:

                  2017/01/10 10:06:56 arcade  srcs: ss
2017/01/10 10:06:56 console srcs:
2017/01/10 10:06:56 INFO: Starting: C:\Users[...]\Downloads\neogeo\3countb.zip
2017/01/10 10:06:56 INFO: Starting: C:\Users[...]\Downloads\neogeo\2020bba.zip
2017/01/10 10:06:56 INFO: Starting: C:\Users[...]\Downloads\neogeo\2020bbh.zip
2017/01/10 10:06:56 INFO: Starting: C:\Users[...]\Downloads\neogeo\2020bb.zip
2017/01/10 10:06:58 ERR: error processing C:\Users[...]\Downloads\neogeo\2020bb.zip: image: unknown format
2017/01/10 10:06:58 INFO: Starting: C:\Users[...]\Downloads\neogeo\2020bb.zip
2017/01/10 10:06:58 ERR: error processing C:\Users\\Downloads\neogeo\2020bbh.zip: image: unknown format
2017/01/10 10:06:58 INFO: Starting: C:\Users[...]\Downloads\neogeo\2020bbh.zip
2017/01/10 10:06:58 ERR: error processing C:\Users[...]\Downloads\neogeo\3countb.zip: image: unknown format
2017/01/10 10:06:58 INFO: Starting: C:\Users[...]\Downloads\neogeo\3countb.zip
2017/01/10 10:06:58 ERR: error processing C:\Users[...]\Downloads\neogeo\2020bba.zip: image: unknown format
2017/01/10 10:06:58 INFO: Starting: C:\Users[...]\Downloads\neogeo\2020bba.zip
2017/01/10 10:06:58 ERR: error processing C:\Users[...]\Downloads\neogeo\2020bb.zip: image: unknown format
2017/01/10 10:06:58 INFO: Starting: C:\Users[...]\Downloads\neogeo\2020bb.zip
2017/01/10 10:06:58 ERR: error processing C:\Users[...]\Downloads\neogeo\2020bbh.zip: image: unknown format
2017/01/10 10:06:58 INFO: Starting: C:\Users[...]\Downloads\neogeo\2020bbh.zip
2017/01/10 10:06:58 ERR: error processing C:\Users[...]\Downloads\neogeo\3countb.zip: image: unknown format
2017/01/10 10:06:58 INFO: Starting: C:\Users[...]\Downloads\neogeo\3countb.zip
2017/01/10 10:06:58 ERR: error processing C:\Users[...]\Downloads\neogeo\2020bba.zip: image: unknown format
2017/01/10 10:06:58 INFO: Starting: C:\Users[...]\Downloads\neogeo\2020bba.zip
2017/01/10 10:06:58 ERR: error processing C:\Users[...]\Downloads\neogeo\2020bb.zip: image: unknown format
2017/01/10 10:06:58 INFO: Starting: C:\Users[...]\Downloads\neogeo\alpham2.zip
panic: runtime error: invalid memory address or nil pointer dereference
[signal 0xc0000005 code=0x0 addr=0x14 pc=0x408fe7]

goroutine 22 [running]:
panic(0x7e9580, 0x113a0030)
        /usr/local/go/src/runtime/panic.go:500 +0x331
main.crawlROMs.func2(0x11472820, 0x114aa900, 0x0, 0x11472810, 0x114755a0, 0x11475520)
        /home/sselph/go/src/github.com/sselph/scraper/scraper.go:295 +0x527
created by main.crawlROMs
        /home/sselph/go/src/github.com/sselph/scraper/scraper.go:328 +0xbd7

Start    : 10:06:56.62
Finish   : 10:06:58.67
         ---------------
Duration : 00:00:02,05
                  1 Reply Last reply Reply Quote 0
                  • acris
                    acris last edited by

                    Hello @maximus37
                    the server for arcade is down.

                    maximus37 1 Reply Last reply Reply Quote 0
                    • maximus37
                      maximus37 @acris last edited by

                      @acris Oh, well that explains it 🙂

                      How can I check the status of it? How long has it been down? Is there a site I can keep an eye on?

                      Thanks!

                      paradadf 1 Reply Last reply Reply Quote 0
                      • paradadf
                        paradadf Staff @maximus37 last edited by

                        @maximus37 @acris The problem with NEOGEO right now (using SS as source) is explained here: https://github.com/sselph/scraper/issues/128
                        So most likely sselph will need to compile a new version with the corrections to allow us to scrape it.

                        If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                        maximus37 1 Reply Last reply Reply Quote 0
                        • maximus37
                          maximus37 @paradadf last edited by

                          @paradadf Thanks for the link!

                          maximus37 1 Reply Last reply Reply Quote 0
                          • maximus37
                            maximus37 @maximus37 last edited by

                            @paradadf Hi, I noticed the issue was fixed? Do I simply download the latest version of fastscraper? Do I need to include any options for the scraping?

                            paradadf 1 Reply Last reply Reply Quote 0
                            • paradadf
                              paradadf Staff @maximus37 last edited by paradadf

                              @maximus37 it wasn't a problem from sselph's scraper, but from the default used database (SS). So the version you have should work. But it is always better to use the latest 😉

                              About the options, on top of the batch you can modify the different flags to your taste, change sources, type of images, etc. So is up to you which configuration you prefer.

                              If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                              1 Reply Last reply Reply Quote 0
                              • airart
                                airart last edited by

                                I try to download or copy fastscraper.bat new version but server is down

                                1 Reply Last reply Reply Quote 0
                                • kevinnash
                                  kevinnash last edited by

                                  Github is OK on my side : https://raw.githubusercontent.com/paradadf/recaltools/master/fastscraper/fastscraper.bat

                                  airart 1 Reply Last reply Reply Quote 0
                                  • airart
                                    airart @kevinnash last edited by

                                    @kevinnash is new version ? is not working .... i'm so sad

                                    paradadf 1 Reply Last reply Reply Quote 0
                                    • paradadf
                                      paradadf Staff @airart last edited by

                                      @airart it is working... you need scraper v.1.2.0 (latest version).

                                      If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                      airart 1 Reply Last reply Reply Quote 0
                                      • airart
                                        airart @paradadf last edited by

                                        @paradadf said in [BATCH] Scrape your roms on your PC - fastscraper:

                                        scraper v.1.2.0

                                        Can U give me a link please , i've already copy raw fastscraper

                                        paradadf 1 Reply Last reply Reply Quote 0
                                        • paradadf
                                          paradadf Staff @airart last edited by

                                          @airart just delete the scraper.exe you have and launch the batch.

                                          If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

                                          airart 1 Reply Last reply Reply Quote 0
                                          • airart
                                            airart @paradadf last edited by

                                            @paradadf said in [BATCH] Scrape your roms on your PC - fastscraper:

                                            @airart just delete the scraper.exe you have and launch the batch.

                                            Err processing
                                            ....xml syntax error on line 1

                                            paradadf 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Want to support us ?

                                            85
                                            Online

                                            99.6k
                                            Users

                                            28.1k
                                            Topics

                                            187.1k
                                            Posts

                                            Copyright © 2021 recalbox.com