Recalbox Forum

    • Register
    • Login
    • Search
    • Recent
    • Tags
    • recalbox.com
    • Gitlab repository
    • Documentation
    • Discord

    [SOFT] Universal XML Scraper V2

    Community projects
    [soft] universal xml scraper
    112
    670
    633135
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • n1md4
      n1md4 last edited by

      Still not working, here is exactly what I've done:

      ScummVM setup:

      i) created a directory for each title
      ii) copy game data into each accordingly
      iii) create a file with the shortname and .scummvm extension
      iv) the content of each .scummvm file has the longname as content

      UXS setup:

      i) create a profile for Recalbox v4 ScummVM MIX
      ii) ensure SSH is set, and ROM paths are correct
      iii) choose 1 game or all to scrape

      Still this is failing, log creation has failed so can't read that either.

      Also, upon a successful scrape, where should there be gamelist.xml and download_pictures ?

      Wish I'd paid attention in school to French lessons!

      paradadf 1 Reply Last reply Reply Quote 0
      • paradadf
        paradadf Staff @n1md4 last edited by

        @n1md4 can you give me an example? Just to test, I'm scraping the whole batch of .scummvm files from the link I posted before and they are scraping perfectly. Isn't your game on that list? If so, you can compare its content with whatever you have been trying to use. If it isn't there... check the database to see if you game exist.

        The gamelist.xml and download_images folder will be inside your scummvm folder.

        If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

        1 Reply Last reply Reply Quote 0
        • n1md4
          n1md4 last edited by

          @paradadf

          cat /recalbox/share/roms/scummvm/Beneath\ a\ Steel\ Sky/sky.scummvm
          Beneath a Steel Sky

          cat /recalbox/share/roms/scummvm/Beneath\ a\ Steel\ Sky/_ScummVM_missing.txt
          Beneath a Steel Sky 12:26.00 2016-08-27

          Wish I'd paid attention in school to French lessons!

          paradadf 1 Reply Last reply Reply Quote 0
          • paradadf
            paradadf Staff @n1md4 last edited by

            @n1md4 there is a bug with that profile. If you use the Recalboxv4(Mix), it will get scraped.

            If your question was answered, please mark it as solved: Topic Tools -> Ask a question + Topic Tools -> Mark as Solved

            1 Reply Last reply Reply Quote 0
            • Ramstatlon
              Ramstatlon @Weedfried last edited by

              @Weedfried said in [SOFT] Universal XML Scraper V2:

              @Takylmor si ça peux te rassurer tu n'es pas un cas isolé. J'éprouve moi aussi des difficultés à scraper depuis hier. Mais ça marchait bien avant, je vais donc attendre patiemment que tout rentre dans l'ordre.

              Tu as toujours ces meme problemes? Impossible de lancer UXML ce week end, la ca marche mais la plupart des img reviennent toutes noires avec la plupart des mix. Pas mieux sur le digimirror.
              Ca marche mieux avec les mix plus simple comme le 2img

              recalboxOS 4.0.0-beta6
              Raspberry pi 3
              manettes 8Bitdo SCF30 & NES30 Pro

              Weedfried 1 Reply Last reply Reply Quote 0
              • screech
                screech last edited by

                Hi, the new 2.1.0.5 just come out.

                A lot's of change :

                • Corrected :

                ° Better stability on downloaded images (Some never download :S and miss in the MIX)

                • Added :

                ° Dynamique Handle to API server, now I can force the server to ask (for the futur when we have a fallback server 😉 or country based server )
                ° Lot's of new Picto media (Nb of player, Notes, Classification, Editor, Developer, Genre) -> Beta it can change soon.
                ° Added 3 news MIX Template for Bigshot Theme with these new picto (1 is directly on local, the 2 other are on the repository, you can download them directly from UXS)

                • WARNING Added things that can "broke" you existing MIX Template

                ° You need to put the full Xpath to the Source_Value node (exemple : Game need to start by 'Data/jeu/' and System by 'Data/systeme [id="%IDSYSTEM%"]')
                ° The CENTER/LEFT/RIGHT/UP/DOWN function in Target_TopLeftX, Target_TopLeftY (and other) now take the "origin" point of the picture (default are TopLeft corner of the Picture)
                ° You can now use Target_OriginPicX and Target_OriginPicY to fixe the origin point of the picture. So now to center a picture you need to put :

                • <Target_TopLeftX>CENTER</Target_TopLeftX>
                • <Target_OriginPicX>CENTER</Target_OriginPicX>
                • <Target_TopLeftY>CENTER</Target_TopLeftY>
                • <Target_OriginPicY>CENTER</Target_OriginPicY>

                (The Origin point of the picture will be the center, and we center this origin point to the final picture)

                This is exemple of the New MIX for BigShot Template :

                text alternatif

                text alternatif

                text alternatif

                Clean your Romset with Universal ROM Cleaner
                Scrape your Romset with Universal XML Scraper

                1 Reply Last reply Reply Quote 0
                • Weedfried
                  Weedfried @Ramstatlon last edited by

                  @Ramstatlon bonjour. J'ai du essayer vendredi dernier. Pas de soucis avec FBA Libretro, pas plus qu'avec la N64 mais toujours rien avec la GBA. Je testerais la mise a jour en fin de semaine.

                  1 Reply Last reply Reply Quote 0
                  • cotedeporc
                    cotedeporc last edited by

                    @screech

                    Est-il possible de modifier la couleur des logos?

                    Thème FoolScreen / Squared

                    1 Reply Last reply Reply Quote 0
                    • screech
                      screech last edited by

                      c'est à dire ?
                      Le fond bleu ?
                      bien sur ^^ regarde dans le mix, tu as un fichier bluesquare.png 😉
                      Les picto sont monochrome sur fond transparent 😉
                      (bientot, quand on aura trouvé un graphiste ^^ on fera des picto couleurs ^^)

                      Clean your Romset with Universal ROM Cleaner
                      Scrape your Romset with Universal XML Scraper

                      cotedeporc 1 Reply Last reply Reply Quote 0
                      • cotedeporc
                        cotedeporc @screech last edited by

                        Ce n'est pas le fond, mais plutôt ce qui est en noir.
                        Comment pourrais-je faire pour afficher le logo du développeur en blanc?

                        L'API ScreenScraper le permet-il?

                        Thème FoolScreen / Squared

                        1 Reply Last reply Reply Quote 0
                        • screech
                          screech last edited by

                          En blanc non 😞 ce n'est pas possible...

                          Actuellement sont récupérable 2 types de logos :

                          Monochrome :

                          text alternatif

                          Couleur :

                          text alternatif

                          à voir si un jour j'ajoute une fonction de "matrice" pour modifier les couleurs à la volée ><

                          Clean your Romset with Universal ROM Cleaner
                          Scrape your Romset with Universal XML Scraper

                          1 Reply Last reply Reply Quote 0
                          • azvarel
                            azvarel last edited by

                            @screech

                            I would like to understand why UXS does not save the screenshots correctly in some roms, example image.

                            alt text

                            The name of the roms is identical to the screenscraper.fr, after many attempts the image of the game The Immortal appeared, but the others I could not

                            My roms are named on no-intro.org which in turn are identical to the relation of screenscraper.fr

                            Any solution?

                            Zodian Theme | #SNESProject

                            1 Reply Last reply Reply Quote 0
                            • screech
                              screech last edited by

                              Unfortunatly it's not a "rom" problem... It's a download problem we are trying to fix with the database Big Boss 😉

                              We have some clue... And working on it 😉

                              Clean your Romset with Universal ROM Cleaner
                              Scrape your Romset with Universal XML Scraper

                              1 Reply Last reply Reply Quote 0
                              • azvarel
                                azvarel last edited by

                                Is there a possibility to choose mirror / server?

                                Zodian Theme | #SNESProject

                                1 Reply Last reply Reply Quote 0
                                • screech
                                  screech last edited by

                                  Not yet... And when it's become possible, it will be automatic...

                                  Clean your Romset with Universal ROM Cleaner
                                  Scrape your Romset with Universal XML Scraper

                                  1 Reply Last reply Reply Quote 0
                                  • stamstamstam
                                    stamstamstam last edited by

                                    Bonjour, est-ce que quelqu'un pourrait ajouter ces jeux dans la base de donnée?
                                    http://pastebin.com/ExHxEfWY
                                    Ce sont tous des jeux PS1.
                                    Merci d'avance.

                                    1 Reply Last reply Reply Quote 0
                                    • yrojoue
                                      yrojoue last edited by

                                      @screech

                                      Bonjour,
                                      Je suis en train de créer les mix en lien avec mon thème mais je n'arrive pas à "télécharger" les photos systèmes, j'utilise la ligne de code suivante: Data/systeme/medias/media_photos/media_photo_%COUNTRY% (comme indiqué sur le wiki).

                                      J'ai cru comprendre qu'il y a des problèmes avec la base de screenscraper. Est ce que ceci explique cela?

                                      merci.

                                      1 Reply Last reply Reply Quote 0
                                      • screech
                                        screech last edited by

                                        @yrojoue désolé, je n'ai pas encore mis le wiki à jour.

                                        Il y a eu quelque modif sur les mix (notamment sur le system ^^)

                                        la ligne (pour les systemes uniquement) doit commencer par : Data/systeme [id="%IDSYSTEM%"]/

                                        pour toi ça fait
                                        Data/systeme [id="%IDSYSTEM%"]/medias/media_photos/media_photo_%COUNTRY%

                                        Clean your Romset with Universal ROM Cleaner
                                        Scrape your Romset with Universal XML Scraper

                                        1 Reply Last reply Reply Quote 0
                                        • yrojoue
                                          yrojoue last edited by

                                          @screech

                                          Je vient de tester (avec plusieurs consoles, avec choix automatique ou manuel) mais je n'ai pas plus de résultat.

                                          <Root>
                                          	<Source_Value>Data</Source_Value>
                                          	<Target_Value>gameList</Target_Value>>
                                          </Root>
                                          <Game>
                                          	<Source_Value>Data/jeu</Source_Value>
                                          	<Target_Value>gameList/game</Target_Value>
                                          </Game>
                                          <Country>
                                          	<Source_Value>Data/jeu/region</Source_Value>
                                          </Country>
                                          <Element>
                                          	<Name>fondecranTEMP</Name>
                                          	<Source_Type>XML_Value</Source_Type>
                                          	<source_Origin>System</source_Origin>
                                          	<Source_Value>Data/systeme [id="%IDSYSTEM%"]/medias/media_photos/media_photo_%COUNTRY%</Source_Value>
                                          

                                          j'ai fait une erreur quelque part?

                                          1 Reply Last reply Reply Quote 0
                                          • screech
                                            screech last edited by

                                            voila un exemple complet :

                                            <Element>
                                            	<Name>fanartTEMP</Name>
                                            	<Source_Type>XML_Value</Source_Type>
                                            	<source_Origin>System</source_Origin>
                                            	<Source_Value>Data/systeme [id="%IDSYSTEM%"]/medias/media_photos/media_photo_%COUNTRY%</Source_Value>
                                            	<Target_Width>%1</Target_Width>
                                            	<Target_Height>%1</Target_Height>
                                            	<Target_TopLeftX>CENTER</Target_TopLeftX> 
                                            	<Target_OriginPicX>CENTER</Target_OriginPicX> 
                                            	<Target_TopLeftY>CENTER</Target_TopLeftY> 
                                            	<Target_OriginPicY>CENTER</Target_OriginPicY> 
                                            	<Target_Maximize>Yes</Target_Maximize> 
                                            </Element>
                                            

                                            Clean your Romset with Universal ROM Cleaner
                                            Scrape your Romset with Universal XML Scraper

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post

                                            Want to support us ?

                                            83
                                            Online

                                            99.6k
                                            Users

                                            28.1k
                                            Topics

                                            187.1k
                                            Posts

                                            Copyright © 2021 recalbox.com