New Ref

http://sourceforge.net/apps/mediawiki/vivo/index.php?title=Extending_Google_Refine_for_VIVO --- this project is similar yet markedly different than mine.

To do lists

To do: Highest priority: implement other vocab rec. services. 2nd: take all the freebase options out of the GUI. 3rd: start migration over to Tomcat server. Wish List: Link matched vocab terms up to pages with information about the term (our definition) Create some way for a request to be sent to the appropriate person when person adds new term? VERY HIGH PRIORITY: Meet w/ end-users to develop not-self generated use-case. Personal To do: 1.) Get Systems Core requirement figured out. 2.) Work on form. 3.) Meet with appropriate prof to finish paperwork. 4.) Print out papers regarding term projects.

Refining away

So, yeah, now my project is going to focus on Google Refine. I'm honestly kind of exhausted, already in burn out mode. I have too much to do for next week. Right now I just need to figure out why the flask library isn't able to be resolved by eclipse. Ugh!

That took long enough

GWTUpload is a go! The problem was the libraries weren't being included in WEB-INF/lib. I guess I need to figure out what eclipse is putting there and why. Or just double-check to make sure it's the right stuff. At any rate, off to create a custom upload servlet to call the parsing functions I wrote a couple weeks ago.

Weird Errors

So, I posted to the GoogleGroup requesting help for the GWTUpload issues I've been having. Now I suspect that my code is alright, and that it's all Eclipse's fault. I'm updating my blog now because Eclipse decided that the library for GWT has gone "missing" even thought it was right where it has been for as long as I've been working on this project. I'm most of the way through doing the File Upload the less-fun way, but if I can get GWTUpload to work in the future, it's preferable. I like the little upload-tracker bar, but I can't really justify spending time writing that code myself. Anyway, that would totally make sense of why the servlet functions weren't working. To do: - Meet with liaison for project - Meet up with test subjects, make sure that the project will actually help them with their day-to-day lives - finish this stupid backbone.... Here's the grand plan, at least as far as I see it:

Basically the front end is where users add data (right now xls, xlsx, csv- formatted data). That data goes through a parser (which is mostly done), and it is then loaded into the back end mini-database. For the user to see the data, there will be a JSON generator that takes the db-data and sends it to the front end in the format of JSON. The TBA is for the user-directed operations on the data.

Errors

I have them. On the plus side, I now know about a language called "Go", which is only of passing interest. I don't quite see its place unless Google starts pushing it a lot more, and even then...

TOMCAT Works, and I was able to deploy my app to it! Life is good! Now I know that my brilliant uploader doesn't work. Oh well, at least the new Zelda game is coming out soon! :-)

Tomcat

So this weekend, I'm working on setting up tomcat so I can test the upload/parsing functionality. I finally got it to run. :-) Now for the fun part, configuration. I'm glad I have some experience with Apache webserver from my college days.

GWTUpload FTW!

Good news, I have something that resembles an upload doing something that should theoretically be working (right now it's spitting out a 404, but the smart people on the Internet say that's because I'm using Jetty, not Tomcat, so this weekend, I aim to fix that, so that I can do proper testing). Now I need to integrate my uploading of a file with something to check that it's the right type (which is easy enough) and then to go send it into a SQLite file. The proper one. I'm not sure how I want to manage it. For now I think it should be handled by session/user. But thinking realistically, by project makes more sense.

Parsers

I've finished with all my file parsers. I have code to parse xls, xlsx, and csv files. Now to work on the database part of the project. Things are going along swimmingly. :-) I'm probably going to look into posting my code online for the parsers, after I make it pretty. It's not the best-est super genius thing ever (I used POI and Open-CSV), but it is unique (as far as I can tell) in that it handles multiple sheets in a coherent fashion. SQLite is next. I'm not sure if I want to have it as a separate jar, like the parsers, I probably should. keep the server code to just interface stuff. Actually, first is trying to fix the GWT code, it got jacked up somehow and isn't opening an internal jetty server anymore. I had tried to change it so I could just host it locally and set up a php script to do the file upload (it just works better, but I'm guessing I'm going to end up doing it in the hard way with Java because I like testing my code often). TODO: Long term: -Wait for meeting with end users to be set up before I do too much UI work, find out if I can just pass that off to someone else. -Look into the API I want to interface with.

http://www.javaworld.com/javaworld/javaqa/2002-05/01-qa-0503-excel3.html <-- Works!!!! Excel can now be parsed... Now to work on Excel2007 and CSV.