New time series handling.

I have adjusted the time series handling of gmap-polygon and grid-viewer so that regional collections hold multiple time series lists (differentiated by server).

Right now, it seems that it is building, but when you open the flot plot, all the data is somehow being tagged with one date, and it is not immediately apparent where or how that data is being set like that. I think I might have run into this problem before and it might have to do with how Java Calendars increments... I hope to figure it out later today or tomorrow.

Otherwise, after that is finished tomorrow, I will implement the new caching structure we discussed with Brian, and start publishing arrays so that the drop-downs for indicators and classifiers can be dynamically populated (as discussed with Chris).

After that, I am going to start allowing for multiple polygon loading... thus you can do one search, then another, and click and compare graphs. I might also look into making histograms in addition to line charts (that way, one can see the different data brought back by the different servers)

C2 in popup, attached to Quicksilver

It looks like I have flot powered by the C2 algorithm popping up for states, zip3s and zip5s.

Tomorrow I anticipate some debugging, perhaps changing polygon shading/zooming, and perhaps trying some fixes to see if we can get Internet explorer loading more reliably.

Either way, I am happy that the new graphs are working. They are really neat.

c2 in a popup

So, I got all the mechanics working (I think, I will need Will Duck to go over the mechanics with me to make sure I am doing it right) for the C2 algorithm.

Furthermore, I have tested them and put together the mechanics to deploy javascript arrays for flot... including making sure I have GMT-centered timestamps with my counts (much more annoying than it seems it should be).

I pasted the arrays generated into my flot tester, and the graphs worked :D

Tomorrow, I will work on getting the flotplot.jsp working on fetching the appropriate polygon and forwarding it to the flot JSP to build the arrays.

Then, it's plug it all together, import it into NPDS and modify how the dates are pulled and hopefully.. new charts in Quicksilver.

Yeah, this has been a sentence-paragraph kind of day. It means I have been thinking like a machine for most of the day.

Cheers

Bugfix Thursday.

Yesterday, after playing with the local development versions of Quicksilver, I noticed that when limiting results by condition, some of the results were not being "scrubbed" if the data set came back null.

After a bit, I figured out a good way to clean the time series, and there was a new spate of null-checking and re-testing that had to occur, but I think it is pretty solid.

Otherwise, I got some feedback on my flot example, and people seem to think it's rather cool. Next step is to get it integrated with Java (I am anticipating 4 hours dedicated to "no, Javascript wants it's date in THIS format" tinkering alone...). I am wondering whether I should try and post it to the main page or make a little JSP that can be opened in the google popup window.

Flot is very flot.

So, my goals for flot are rather simple.

Graph two lines (check)
Have a zoom-able overview (check)
Have the x-axis with dates (check)
Have float-over tool-tips that reveal data
Have a legend to distinguish the data points from the average points
highlight points that are outliers in some way.

So, three down, three to go. The interface for flot is very nice, and more importantly, the examples are excellent. They've been helping me tremendously.

Secure Quicksilver, and Flot is neat.

Today I had a good discussion with Brian about how the G2 algorithm is going to work and how it will affect the future graphs. Also, We played with Flot and it looks like it will do what we need to do.

Also, Secure Quicksilver (with better information now) should be deployed tomorrow, thus most of Friday and next week will be getting the new flot charts working and getting the algorithms set up to make the flot charts that much more interesting.

Cheers,
Peter

Security thoughts continued.

Had a lot of people in and out of the lab today.

But I still managed to make some headway on the security stuff. Brian and I switched out from a servlet listener to a servlet filter, moved things we wanted authenticated into the "auth" directory, and then we got the SHA1 algorithm parsing the entered passwords.

After that, I got the parsing to put out readable text using the Apache Commons Codec library to base64 encode the output parse. Then I set up some methods for the login.jsp page to allow for checking and setting the proper variable for actually marking authentication in the session.

Tomorrow, I will set up the database connectivity to a user/passwordHash table. I will probably set up the appropriate table in PostGres and then start wiring it to the SQL Server. I will also be doing some updating of connection code inside Gmap-polygon and moving some code out of the static load for a servlet inside gmap-poly-web and npdsgmaps-web.

All these epiphanies and suggestions from sitting with another coder and having them look at what I've written for about an hour. We need to do this more often.

Otherwise, I met with Will Duck again today, and I think we are settling on Flot as the next thing to draw the NPDS charts. As you can see from the examples there are a lot of really neat things that Flot can do, it's all java script, and it allows for things like zooming and hover-over tips.

It's pretty too.