rajvja
asked on
Load bulk data using SSIS
Hi Experts,
I want to retrieve data from XML file (typically large data) and need to do so many calculations on that data and finally load into our data warehouse. Data will be very large(every etl run, 200000 rows). What is the best way to ETL this?
How to convert relational database to dimensional model?
I want to retrieve data from XML file (typically large data) and need to do so many calculations on that data and finally load into our data warehouse. Data will be very large(every etl run, 200000 rows). What is the best way to ETL this?
How to convert relational database to dimensional model?
ASKER
HI,
Thanks for the reply.
There is already a relational database. The data coming from external source is growing large and large.
It will be 2m rows per day. It is a bus ticket information.
The requirement is we need to create a dimensional model coz there are many reports to be developed(KPIs).
What are the steps to follow to create a dimensional model from existing relational model.
If the data is 2m rows, what is the best way to do ETL with rich performance?
Thanks for the reply.
There is already a relational database. The data coming from external source is growing large and large.
It will be 2m rows per day. It is a bus ticket information.
The requirement is we need to create a dimensional model coz there are many reports to be developed(KPIs).
What are the steps to follow to create a dimensional model from existing relational model.
If the data is 2m rows, what is the best way to do ETL with rich performance?
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
200,000 rows of data is not very large actually, and you can do any transformation as you need in data flow.
what to you mean by convert OLTP to OLAP? did you designed your data warehouse? did you created dimensions and fact tables?
if yes, you just need to transfer data, you can do this simply by any transformation as your requirements.
of course there are some special transformation for DataWarehouse ( like SCD - Slowly Change Dimension ) which can help you much in dimensions.
let me know what you mean exactly here? and what is the problem you faced in ETL from OLTP to OLAP? I think this way is better to pass this problem.