MechWarrior: Living Legends

Public Discussion => General Discussion => Topic started by: Spooky on December 29, 2013, 10:56:30 PM

Title: New server list & player graph
Post by: Spooky on December 29, 2013, 10:56:30 PM
Using gslist (http://aluigi.altervista.org/papers.htm#gslist) and GameQ (https://github.com/Austinb/GameQ) (thanks to Burno_007 (http://forum.mechlivinglegends.net/index.php?action=profile;u=12768) aka Str1k3r) I have created a new stats page for MechWarrior: Living Legends under http://stats.spikx.net/mwll.html . It includes a server list that queries the servers directly (and refreshes every 15 seconds for your convenience).

However, not all of the servers can be queried by GameQ (probably due to blocked ports). These servers are marked in light grey in the list. The information for those servers comes from gslist instead (which in turn queries the Gamespy Master Server), so it may not be up to date (the information from gslist is only updated every 10 minutes currently).

(http://stats.spikx.net/files/screenshot.png) (http://stats.spikx.net/)

Title: Re: New server list & player graph
Post by: McGondy on December 29, 2013, 11:28:46 PM
Awesome spook! Now to just wait until my interwebs cap is refreshed...
Title: Re: New server list & player graph
Post by: Defender on December 30, 2013, 04:06:52 AM
Nice!
Title: Re: New server list & player graph
Post by: Bruno_007 on December 30, 2013, 10:44:09 AM
I'll definitly use it in the future. Right now I'm sill in an hiatus about MWLL though. :P
Title: Re: New server list & player graph
Post by: Marlin on December 30, 2013, 01:31:58 PM
Very cool, Spooky.

Title: Re: New server list & player graph
Post by: Chezzar on December 30, 2013, 02:46:47 PM
Thanks for that, will definitely use this.
Title: Re: New server list & player graph
Post by: artem on December 31, 2013, 06:46:25 AM
Great!
Title: Re: New server list & player graph
Post by: artem on December 31, 2013, 02:22:06 PM
Short URL: mwll.su/stats (http://mwll.su/stats)
Title: Re: New server list & player graph
Post by: Fury9er on December 31, 2013, 03:27:07 PM
This is outstanding, really saves time firing the game up to check if anyone is on. Thank you Spooky!
Title: Re: New server list & player graph
Post by: Spooky on December 31, 2013, 09:46:19 PM
Yep :). Though there is one theoretical downside to this: if everyone looks at the stats and only joins when there are players online, no one will ever play :D. But luckily there are some seeders (me included).


Feature to come: Player information on mouse over.
Title: Re: New server list & player graph
Post by: cyofee on January 01, 2014, 05:38:46 PM
Yep :). Though there is one theoretical downside to this: if everyone looks at the stats and only joins when there are players online, no one will ever play :D. But luckily there are some seeders (me included).


Feature to come: Player information on mouse over.
Someone with some time and willpower could make a web-based "lobby" for MWLL.
Title: Re: New server list & player graph
Post by: Spooky on January 03, 2014, 09:18:51 PM
Feature to come: Player information on mouse over.

Done.
Title: Re: New server list & player graph
Post by: Cherno on January 04, 2014, 01:17:11 AM
I approve of this thingy! It inspired me to start up the game after weeks and to my surprise I found a nearly-full All-TC server! Thanks!
Title: Re: New server list & player graph
Post by: Marlin on January 04, 2014, 09:30:54 PM
Holy shit, Spooky, very cool. :)
Title: Re: New server list & player graph
Post by: luxebo on January 10, 2014, 03:25:28 AM
Thank you Spooky.  :D This is awesome!
Title: Re: New server list & player graph
Post by: Fury9er on January 10, 2014, 09:50:59 PM
Well impressed with the mouseover info! Thanks again Spooky!
Title: Re: New server list & player graph
Post by: HAARP on January 15, 2014, 08:04:12 PM
Indeed, this is pretty cool
Title: Re: New server list & player graph
Post by: Spooky on February 11, 2014, 12:08:55 PM
Random data mining: in the last 7 days we had more average players (9.7851) than in the same 7 days exactly one year ago (8.8119).
Title: Re: New server list & player graph
Post by: Spooky on July 21, 2014, 09:51:47 PM
New update: the server list is now acquired from http://www.qtracker.com as well - but the server information is now determined via GameQ only (so if the server cannot be scanned, it won't show up).

Random note: in July TSA_Sandblasted's throne was finally usurped by TC_Thunder Rift in the popular map list ;)
Title: Re: New server list & player graph
Post by: Starch1ld on July 27, 2014, 04:47:58 AM
Hmm, now that we had to move to Qtracker, even Funbox Alpha and Beta are gone from your list...

And that's reeeeally weird, since you already added Qtracker support to your list...
Title: Re: New server list & player graph
Post by: Spooky on July 27, 2014, 10:46:35 AM
Well, I told you that last time in chat. The reason why the servers are not showing up now is because I cannot scan them. gametracker.com (http://www.gametracker.com/search/?search_by=server_variable&search_by2=modname&query=MWLL&sort=&order=&searchipp=50) cannot scan Funbocks (Alpha & Beta) properly now either. game-monitor.com (http://www.game-monitor.com/search.php?search=modname=MWLL&type=variable&&num=100) however can still scan the server normally it seems, so there must be a way.

To me it looks like that the server's response is slightly different when the server is using qtracker and the library I use cannot cope with that.


However, why do we even need qtracker? (On the server.) Last night, before the change presumably, Funbocks Alpha showed up like normal in the in-game server list (when using the edited /etc/hosts file (http://forum.mechlivinglegends.net/index.php/topic,20422.msg351929.html#msg351929)) and it was scannable by my tool and gametracker.com.
Title: Re: New server list & player graph
Post by: Starch1ld on July 27, 2014, 06:40:04 PM
Well my point was that something is weird because Funboxes servers should be correctly set up to be scanned by Gametracker...that's the reason of my concern.
Anyway, now I see that servers are listed in grey in your list...That's good, at least we can see their IP and if there are any players in.

Also, apparently my home servers are not visible in any list anymore  :(
I mean, you should be able to connect manually, but there is no way I can put them in both yours and in-game server list...
Tested with and without gametracker host fix

Strange, last time I used gametracker host fix (less than 2 weeks ago), it worked  ???

Maybe it's because Qtracker needs a port to be forwarded for the query (Gamespy didn't, actually I didn't forward any port for MWLL server, and it always worked)...
Title: Re: New server list & player graph
Post by: Spooky on July 27, 2014, 06:55:03 PM
We did some tests today: Funbocks Alpha Beta and Gamma were scannable at some point before today. However, since today, only Gamma was scannable and as soon as Haarp restarted Gamma too, it wasn't scannable either.

This is how the query protocol works: http://wiki.unrealadmin.org/UT3_query_protocol

What I found out was, that the Funbocks server for instance, does respond to the first query, but the ID it returns is always "0" and thus no additional data can be queried. As soon as the server was unable to make a "real" connection to the gamespy master server, the initial response does not generate a valid ID. For whatever reason.


However, @Starchild: I see that "MWLL Official Free Training Center" is up and running and it is scannable. Does this server run all the time? Has it been restarted recently?
Title: Re: New server list & player graph
Post by: Silvercraft on July 27, 2014, 10:03:51 PM
Not good: there is a game going on right now as I make this post (7-8 players @HuntressA TC_ThunderRift) BUT player graph is not showing it at all   :'(

I was on earlier @FreeTrainingServer and that was recorded   :o 

I have no clue what is going on but flat lined player graph is not good for this game when there actually is action going on.

 
Title: Re: New server list & player graph
Post by: Spooky on July 27, 2014, 10:07:35 PM
Not good: there is a game going on right now as I make this post (7-8 players @HuntressA TC_ThunderRift) BUT player graph is not showing it at all   :'(

I was on earlier @FreeTrainingServer and that was recorded   :o 

I have no clue what is going on but flat lined player graph is not good for this game when there actually is action going on.

Without scannable servers, this information is simply not accessible. The Training server was scannable. Everything that is grey on the list is not scannable.
Title: Re: New server list & player graph
Post by: Starch1ld on July 28, 2014, 02:50:38 AM
What I found out was, that the Funbocks server for instance, does respond to the first query, but the ID it returns is always "0" and thus no additional data can be queried. As soon as the server was unable to make a "real" connection to the gamespy master server, the initial response does not generate a valid ID. For whatever reason.
Did you use qtracker hostfile patch in your tests?

However, @Starchild: I see that "MWLL Official Free Training Center" is up and running and it is scannable. Does this server run all the time? Has it been restarted recently?
I don't use my network anymore to host this server. We are using a hosting company located in Canada. It's not behind a NAT (or I would think so) and the qtracker hostfile patch has been applied on it. I don't know if or when duelist restarted it...I can't do that  :-\
You should ask him.

Not good: there is a game going on right now as I make this post (7-8 players @HuntressA TC_ThunderRift) BUT player graph is not showing it at all   :'(
Qtracker can fetch only the number of the players from a server, not their names.
I guess the only way to know who is actually playing on a server is to set it up correctly so Spooky's server list can always scan it..
Title: Re: New server list & player graph
Post by: Spooky on July 28, 2014, 09:53:26 AM
Did you use qtracker hostfile patch in your tests?

Yes, but that does not matter at all anyway. Only a connection to the server itself is made, there is never any connection to any of the gamespy servers, when querying game servers.


I don't use my network anymore to host this server. We are using a hosting company located in Canada. It's not behind a NAT (or I would think so) and the qtracker hostfile patch has been applied on it. I don't know if or when duelist restarted it...I can't do that  :-\
You should ask him.

Hostfile patch? You mean you edited the /etc/hosts file and did nothing else? The curios thing is, that the Server pops in and out of the list, presumably because it is not running all the time and gets started/restarted on demand. If that is the case, something on your server is making it possible to query it without an initial, valid gamespy master server connection.

Any contact info for duelist? ;)
Title: Re: New server list & player graph
Post by: Starch1ld on July 28, 2014, 11:11:43 AM
Hostfile patch? You mean you edited the /etc/hosts file and did nothing else? The curios thing is, that the Server pops in and out of the list, presumably because it is not running all the time and gets started/restarted on demand. If that is the case, something on your server is making it possible to query it without an initial, valid gamespy master server connection.

Any contact info for duelist? ;)
Yes, duelist just added the lines you see in my guide in the host file. And now it disappeared from your list (but you can still find it in the in-game server list).

I don't really know what's going on...

Anyway, sending contact info via PM.
Title: Re: New server list & player graph
Post by: Spooky on August 21, 2014, 01:11:00 AM
Stats are back up and running. HAARP pointed me to use Wireshark in order to determine how qtracker is actually scanning the server and that helped :). I should have thought of that before :P
Title: Re: New server list & player graph
Post by: Fury9er on August 21, 2014, 01:52:53 PM
Hooray :D its back again!  Nice work :D
Title: Re: New server list & player graph
Post by: Silvercraft on August 21, 2014, 05:09:24 PM
Great work Spooky!
Good to have this outstanding MWLL resource working once more.

In other news: HAARP fixed Funbocks Alpha map vote system (it was not working yesterday), new maps added to Funbocks Alpha, we have seen many new players these past few weeks and next organized event will start soon.

Bottom line: this game is alive and kicking!   8)
Title: Re: New server list & player graph
Post by: Fury9er on August 21, 2014, 09:35:18 PM
I just saw the new maps in rotation tonight but I am having some trouble downloading them via the ingame system - is that still working or do they have to be manually downloaded and put into the right directory now?

Quote
Bottom line: this game is alive and kicking!   

Quoted for truth ;)

Edit:

Manually installing worked fine, but I notice my key bidnings have gone funny, I did have the main number keys as throttle settings but now the number pad ones do it instead which is odd.
Title: Re: New server list & player graph
Post by: Silvercraft on February 15, 2015, 07:18:59 PM
I see your page  http://stats.spikx.net/mwll.html  got updated. It will take me awhile to get used to that new light green color.
Just a minor bug to report: distribution hour numbers '8-14' are overlaid with 'Hour (UTC+01:00)' text. My browser is Firefox 35.0.1.

Thanks for your efforts again.
Title: Re: New server list & player graph
Post by: cest73 on February 16, 2015, 04:43:17 PM
Supreme craft Spooky, very usable and readable.
I just love the hover stats and the graphs.

Being by wizardry already, is it possible to make a hover on the maps which shows an image of and maybe the estimated size of each one?

Do keep up the good work  :)
Title: Re: New server list & player graph
Post by: Spooky on February 16, 2015, 08:53:42 PM
It's a free template from http://html5up.net/ ("Read Only"), nothing original from me :D. I just wanted to try how well a template from html5up.net could be integrated into the Content Management System that I use for the stats. I'll probably change the green colour to something more fitting (either boring grey or may be blueish).

// style changed and distribution graph fixed
Title: Re: New server list & player graph
Post by: Silvercraft on February 28, 2016, 04:35:07 PM
Nice update!   8)
Your continuing work with  http://stats.spikx.net/mwll.html  is highly appreciated.

 
Title: Re: New server list & player graph
Post by: cest73 on March 06, 2016, 06:43:13 PM
It's a free template from http://html5up.net/ ("Read Only"), nothing original from me :D. I just wanted to try how well a template from html5up.net could be integrated into the Content Management System that I use for the stats. I'll probably change the green colour to something more fitting (either boring grey or may be blueish).

// style changed and distribution graph fixed
maybe theme it darkish?  ::)
Title: Re: New server list & player graph
Post by: Spooky on November 09, 2016, 12:31:36 PM
I have made the weapon stats available as a search- and sortable table here: http://stats.spikx.net/mwll/stats.html
Title: Re: New server list & player graph
Post by: Spooky on November 09, 2016, 03:22:31 PM
Variants are also now properly displayed at http://stats.spikx.net/mwll/stats.html
Title: Re: New server list & player graph
Post by: Warlord Kentax on November 09, 2016, 05:25:18 PM
Variants are also now properly displayed at http://stats.spikx.net/mwll/stats.html
Thanks Spooky!
Title: Re: New server list & player graph
Post by: ELH_Sudibor on November 09, 2016, 05:55:13 PM
Thank you so much Spooky!
Title: Re: New server list & player graph
Post by: cest73 on November 09, 2016, 09:19:44 PM
Tanks a gazillion!
but (always butt)
Could You (@Spooky) possibly add a reverse-dns snooped flag to each of the servers?

So players can discern location and pick the nearest server?

It would be more useful than ping, as ping is relative to where?

Would it be a go? ??? :-\
Title: Re: New server list & player graph
Post by: Spooky on November 10, 2016, 08:40:49 AM
Could You (@Spooky) possibly add a reverse-dns snooped flag to each of the servers?

Sure, should be possible, I'll have a look at it when I have the time.


It would be more useful than ping, as ping is relative to where?

Well in the in-game Browser it's relative to you of course ;). On the website it would be relative to a location in Germany...
Title: Re: New server list & player graph
Post by: HAARP on November 10, 2016, 09:13:50 AM
Don't add such a flag, it's completely utterly useless. rdns does not help you discern a location. If you actually want to add a location, go with a geoip database such as maxmind.
Title: Re: New server list & player graph
Post by: Spooky on November 10, 2016, 09:58:23 AM
If you actually want to add a location, go with a geoip database such as maxmind.

Yes, that's how I planned to implement it.
Title: Re: New server list & player graph
Post by: Sxooter on November 10, 2016, 04:11:43 PM
I have made the weapon stats available as a search- and sortable table here: http://stats.spikx.net/mwll/stats.html

Could you add tonnage as a sort catagory, and do an alternating light grey/white per line so we can follow one from left to right and not get lost?
Title: Re: New server list & player graph
Post by: Bruno_007 on November 10, 2016, 06:39:06 PM
I have made the weapon stats available as a search- and sortable table here: http://stats.spikx.net/mwll/stats.html

Could you add tonnage as a sort catagory, and do an alternating light grey/white per line so we can follow one from left to right and not get lost?

Spooky: if you then want better filtering capabilities out of the datatables (like multi-filter) take a look at this to enhance datatables, if you were not aware it existed: https://github.com/vedmack/yadcf
Example: http://yadcf-showcase.appspot.com/DOM_source.html
Title: Re: New server list & player graph
Post by: Sxooter on November 10, 2016, 07:34:34 PM
I have made the weapon stats available as a search- and sortable table here: http://stats.spikx.net/mwll/stats.html

Could you add tonnage as a sort catagory, and do an alternating light grey/white per line so we can follow one from left to right and not get lost?

Spooky: if you then want better filtering capabilities out of the datatables (like multi-filter) take a look at this to enhance datatables, if you were not aware it existed: https://github.com/vedmack/yadcf
Example: http://yadcf-showcase.appspot.com/DOM_source.html

That would be sweet! Oh and I noticed the gray bar effect. It's a little subtle on this crappy laptop screen, but looks great on my much better, other, laptop screen.
Title: Re: New server list & player graph
Post by: Spooky on November 11, 2016, 09:23:15 AM
Could you add tonnage as a sort catagory

It's not available in the export. However, I plan to directly parse the Game XML files at some point in the future. Then I can add whatever I want.



Spooky: if you then want better filtering capabilities out of the datatables (like multi-filter) take a look at this to enhance datatables, if you were not aware it existed: https://github.com/vedmack/yadcf
Example: http://yadcf-showcase.appspot.com/DOM_source.html

Hmm... seems a bit overboard ;). Also currently I generally "do not know" which column is what. I am just displaying the CSV file as it is (with a little bit more processing for the Variants table, to distinguish all the components and weapons).
Title: Re: New server list & player graph
Post by: Starch1ld on November 11, 2016, 10:18:44 AM
Could you add tonnage as a sort catagory

It's not available in the export. However, I plan to directly parse the Game XML files at some point in the future. Then I can add whatever I want.


I am already doing this in the new version of the database that drop calc will use. The new database is a google spreadsheet format, I will publish it maybe today or tomorrow
Title: Re: New server list & player graph
Post by: Starch1ld on November 11, 2016, 05:29:16 PM
There we go

https://docs.google.com/spreadsheets/d/1D1Whk1b7FstZXcP2ewFUQwHi3qIoGoTiV1kZXoL8734/edit?usp=sharing

EDIT: heh weapon tech parsing is a bit messy, going to fix it later

EDIT2: fixed
Title: Re: New server list & player graph
Post by: cest73 on November 12, 2016, 12:42:05 PM
The Alpha strike versus DPS makes for some interesting picks there :)
Title: Re: New server list & player graph
Post by: Spooky on November 14, 2016, 05:28:20 PM
GeoIP check implemented.
Title: Re: New server list & player graph
Post by: benben10 on November 15, 2016, 03:38:40 AM
@spooky-It makes pretty little flags!
Looks awesome spooky.

Now if you could get the column headings to stay visible when using lists 50 entries or longer, but again thank you for all the work.

@Star thanks for all your work too. I still think you are an a****le. :P Ok just kidding.
Title: Re: New server list & player graph
Post by: cest73 on November 15, 2016, 03:10:11 PM
Spooky and Starch1ld:
may You be known only for good ;)
Title: Re: New server list & player graph
Post by: Spooky on November 15, 2016, 03:20:41 PM
Hm, something is wonky with the stats retrieval since I implemented the GeoIP check, I may have to revert that.
Title: Re: New server list & player graph
Post by: cest73 on November 15, 2016, 03:30:05 PM
 :-\ :'( :-\
it takes a while to look it up at first?
(r-dns etc)
Title: Re: New server list & player graph
Post by: Spooky on November 15, 2016, 03:37:16 PM
Meh, seems the \GeoIp2\Database\Reader does not allow concurrent access to the maxmind database file, which might happen every once in a while.
Title: Re: New server list & player graph
Post by: cest73 on November 15, 2016, 07:07:19 PM
As far as I could discern building the GeoIP last time (few days back) it can be build with "minimal" config?
HTH?
Title: Re: New server list & player graph
Post by: HAARP on November 17, 2016, 06:51:06 PM
Meh, seems the \GeoIp2\Database\Reader does not allow concurrent access to the maxmind database file, which might happen every once in a while.
Are you using their API? You can run local services that resolve countries, such as https://github.com/fiorix/freegeoip

Alternatively, you could cache the results. That would be the most sensible solution, I think.
Title: Re: New server list & player graph
Post by: Spooky on November 18, 2016, 01:01:07 AM
I am using the PHP GeoIP2 API from https://github.com/maxmind/GeoIP2-php with the free GeoLite2 Country database from http://dev.maxmind.com/geoip/geoip2/geolite2/
And yes I am caching the results. It's weird though that the reader fails like that.
Title: Re: New server list & player graph
Post by: cest73 on November 18, 2016, 07:39:07 AM
You probably tried geoip-ultralight (https://github.com/danielstjules/geoip-ultralight) ?   ???
Title: Re: New server list & player graph
Post by: Spooky on November 18, 2016, 10:06:10 AM
You probably tried geoip-ultralight (https://github.com/danielstjules/geoip-ultralight) ?   ???

No, also that's a JavaScript API. It creates even more server load, since your browser would access the data file every time you access the site. Not that that would matter that much, but I see no point in using that ;).
Title: Re: New server list & player graph
Post by: cest73 on November 18, 2016, 11:42:32 AM
maybe it's just the sheer traffic?
Title: Re: New server list & player graph
Post by: Spooky on November 18, 2016, 12:49:49 PM
maybe it's just the sheer traffic?

No, there is not a lot of traffic on the site. Even if there was, concurrent read access to a file should not be a problem.
Title: Re: New server list & player graph
Post by: cest73 on November 18, 2016, 07:47:43 PM
then more comprehensive logging to find out the culprit?
Title: Re: New server list & player graph
Post by: Spooky on November 19, 2016, 04:11:20 PM
Meh, I'll just leave it as it is now, the results are cached anyway.
Title: Re: New server list & player graph
Post by: cest73 on November 20, 2016, 05:31:50 PM
I still love it  ;D, immeasurable asset to the community
Title: Re: New server list & player graph
Post by: Silvercraft on September 14, 2017, 05:23:48 PM
Does anyone know what happened to stats page ( http://stats.spikx.net/mwll.html ) ?

It has been down for some time now. Many of us use that page to determine when to play and check it to see how player base is evolving. I sure hope it comes back because losing it would be a big blow to MWLL.
Title: Re: New server list & player graph
Post by: Fury9er on September 14, 2017, 08:49:24 PM
Yes I just saw this is down, its a very useful tool we should keep.

Edit: I just saw on Discord that the server is uses is down and is being replaced :D hooray!
Title: Re: New server list & player graph
Post by: DragonSK on September 15, 2017, 01:45:10 AM
Glad to hear it will be back on again, I was using the site often :)
Title: Re: New server list & player graph
Post by: Spooky on September 15, 2017, 10:37:49 AM
Yeah, hopefully I'll have it running again over the weekend :)
Title: Re: New server list & player graph
Post by: cest73 on September 15, 2017, 01:30:25 PM
Would You happen to need any help, just ask for it, Spooky?
Title: Re: New server list & player graph
Post by: Silvercraft on September 16, 2017, 07:28:26 PM
Great to see stats page back online!
That page has become de facto way to check MWLL online player status.   ;)
Title: Re: New server list & player graph
Post by: cest73 on September 17, 2017, 08:36:09 PM
IF we ever start to be a sane and serious community - this page should be the default page of our main domain IMHO

and link to whatever there is else.

The fact that it isn't speaks for it self quite a lot about it, isn't it?