Does anyone have a recommendation on flexible, intuitive ETL tool?
We are in the process of specking out a data warehouse project that has the following characteristics: • Data warehouse will updated with new data on a monthly basis • Data sets will be decreasing as opposed to increasing in size (excluding ultimate structure of Data warehouse, reporting, etc, we will probably only have about 100 GB – 250 GB in raw data over the next 10 years) • Business rules will need to be applied for both the mapping of the data and the derivation of new data elements; there will be many different sets of business rules • An important function of the data warehouse will be to track actual vs. expected experience – one of the functions of the ETL tool will be to come up with expecteds based on the application of business rules and assumptions against each individual record One of the most important attributes of the ETL tool we use, is that in needs to be very flexible. We are going to want to test how changes in assumptions impact historical periods. Those changes
