Download continued

I have been doing continued refinement on the reil rets download.  I decided to structure the download so that each ‘Class’ (residential, condo,etc) is downloaded into a separate table -as is. After the download is complete I run updates every 15 minutes. At first I attempted to place data into tables that would be accessed directly by the application, but I decided to change that process and create a final build table.

I added a new step in the process, I create a ‘combo’ table that combines all of the pertinent data from each of the classes/tables into one combined table. The reason for this is so a user can choose to search over any combination of the property types (i.e. residential and condos). Another benefit to this is that my combo table can be de-normalized (containing redundant lookup data) and contains only the data I need. There are a lot of extra empty columns in the dataset.

Leave a Reply

You must be logged in to post a comment.