Download personal game history General forum

8 replies. Last post: 2021-09-17

Reply to this topic Return to forum

Download personal game history
  • Maurizio De Leo at 2021-09-07

    I would like to record the games I have played on little golem in a database (BoardGameGeek). However manual data entry is very tedious.

    Is there a way to download our own game history ? The data I would need is

    Game (e.g. Polyomino)
    GIF (eg. #2028057)
    Players
    Date Started
    Date Ended
    Number of Moves

    I have been trying to find a quick way to do this, but the best I managed is the PlayerInfo pages which does not have start and end dates.

    https://www.littlegolem.net/jsp/info/player_game_list.jsp?gtid=chess&plid=3380

  • mmKALLL at 2021-09-08

    After getting the game information, how would you enter it into the BGG database? What kind of format would be preferable for the data?
    I think it might be possible to scrape this information from game SGF files, somewhat similar to how Tasuki's LG ranking got the rating data.

  • Maurizio De Leo at 2021-09-09

    I enter it manually.
    BGG interface is quite quick for the same game, as it will copy the previous info (including location, i.e. Little Golem) and I need to change only the date.
    I basically would just need to have an excel table open on another screen.
    Currently I have to click on each game , read and then close the tab, which takes too much time.

  • Miwarre ★ at 2021-09-10

    The only way I know to gather the info you need (except for the number of moves, which you have to compute yourself in some way) is by scraping the game pages, i.e. those with the URL's like https://www.littlegolem.net/jsp/game/game.jsp?gid=[gameid]. It may depend on the platform you are running on, but under Linux it is relatively easy to put up a script doing it quickly with curl and pup. Tell me if I can be of any help.

  • Maurizio De Leo at 2021-09-15

    I'm on windows.
    I tried with Google sheet and “ImportXML” function, but the page structure is too complex and I don't want to put too much load on the server.
    If you could do it without too much effort, it would be helpful.

  • Nagy Fathy ★ at 2021-09-16

    There is an easy way to download all you games` moves in a single game type (chess for example), by clicking on Player info, then click on the games of that type, then you will find a link named “All games in text” with a URL like: https://www.littlegolem.net/jsp/info/player_game_list_txt.jsp?plid=[playerid]&gtid=chess
    The problem is, the text format varies from game type to another, but you still handle that in many easy ways.

  • Maurizio De Leo at 2021-09-16

    Thanks Nagy.
    I had already found that link. My issue is that there is no “date” neither initial or end, so it doesn't help me in logging my plays.

  • eobllor at 2021-09-17

    Yes, the date is missing from the listing. Nevertheless, you can still scrape the page of each game, knowing its id (https://littlegolem.net/jsp/game/game.jsp?gid={your id here}), and search the content for string “Start time: “, then analyse what follows with a regular expression for a date in format “YYYY-MM-DD HH:mm”.

    Of course, that means you cannot just copy manually from the list, you should have the process automated.

Return to forum

Reply to this topic