Recalbox Forum

    • Register
    • Login
    • Search
    • Recent
    • Tags
    • recalbox.com
    • Gitlab repository
    • Documentation
    • Discord

    Auto Scrape Your Games FAST!

    Recalbox General
    auto scrape
    4
    4
    6593
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • sikahalv
      sikahalv last edited by

      I've been using @digitalLumberjack guide on how to "Scrape your games with PC (EN)" https://github.com/digitalLumberjack/recalbox-os/wiki/Scrape-your-games-with-your-PC-(EN) https://github.com/sselph/scraper/releases   I discovered in the application scraper.exe that you can use "-help" to discover more commands 🙂 I now use the following: scraper.exe -image_path="~/.emulationstation/downloaded_images/n64" -no_thumb=true -max_width=375 -workers 32 With the command "-workers 32" making the process of scraping much much faster! (beware you will need a Core i5+ and 8GB RAM+ to use 32x workers... I tried with much higher amounts (eg: 48 / 64 / 128) but the process was SOO QUICK that many games did NOT get scraped because the game database continually refused the connection to my IP thinking I was flooding it with requests haha... ^ Hopefully all this information will help and allow you all to scrape your games much faster! 😄

      1 Reply Last reply Reply Quote 0
      • GeneralMilkshake
        GeneralMilkshake last edited by

        Or.... You could drag the scraper.exe to each rom folder on the pi, and run it in there. It's how I scrape them, and it works fine.

        1 Reply Last reply Reply Quote 0
        • screech
          screech last edited by

          And if you want a easyiest way to use scraper.exe, you can use my GUI : http://blog.recalbox.com/forums/topic/tuto-scraper-ses-jeux-depuis-son-pc-plus-efficacement/page/9/#post-19127 Explanations are in french 😉 but the soft is in english and it's very easy to use. All the scraper.exe option are in the GUI and you can see the "help" for each option in TIP with you mouse on the option. just one thing on the "worker 32" I'm not sur, but it may (maybe) ban you from thegamedb (too much request send = attack) for a short time. I never go mor than Worker 10 and it's pretty fast 😉

          Clean your Romset with Universal ROM Cleaner
          Scrape your Romset with Universal XML Scraper

          1 Reply Last reply Reply Quote 0
          • darkbrokenheartz
            darkbrokenheartz last edited by

            Here is my method.  No need to use PC and you can do it all locally on the box.   Source https://github.com/sselph/scraper     Showing simplified method to quickly scrape artwork for Recalbox     Step 1.  Connect to your raspi.  On windows you can use putty  and just open a connection to your ip and use root for username  recalboxroot for password.   Or from a terminal client >ssh root@yourip   Step 2. Paste the following command > wget https://raw.githubusercontent.com/substring/fullscrape/master/fullscrape.sh && chmod u+x ./fullscrape.sh   Step 3.  Initiate an individual scrape request system by system For example to do SNES  see below > ./fullscrape.sh snes -no_thumb=true -max_width=375   To do nes > ./fullscrape.sh nes -no_thumb=true -max_width=375   Using the rom folder name as reference. Just a list of examples of systems you can use are   cavestory fba fbalibretro fds gamegear gb gba gbc gw lutro lynx mame mastersystem megadrive moonlight msx n64 neogeo ngp pcengine prboom psx scummvm sega32x segacd sg1000 snes vectrex virtualboy wswan     If you want to update or only add images that have not already been scraped you can do   > ./fullscrape.sh -u  -no_thumb=true -max_width=375     Things to keep in mind. To run the ./fullscrape.sh script you must be in the directory that you originally downloaded it to in the first step.   Image art is stored in the directory /root/.emulationstation/downloaded_images/ the gamelist.xml file is stored in the directory /root/.emulationstation/gamelists each in their respective named folder   if you run ./fullscrape.sh without the no thumb width flag it will download unvisible art for certain systems and you will need to delete that before scraping again as it will not overwrite correctly.  (This could be added as a pull request to github but may be a security feature)   WARNING : fba_libretro has a little bug, that will be corrected in 4.0.0 : scraping can’t be displayed. This can be manually solved if you really really are desperate …

            1 Reply Last reply Reply Quote 0
            • First post
              Last post

            Want to support us ?

            52
            Online

            90.3k
            Users

            26.3k
            Topics

            181.7k
            Posts

            Copyright © 2021 recalbox.com