Many organizations are currently using traditional RDBMS systems for legacy reasons, including for some of their critical business areas. These systems have served well over the past decades when there were controlled data input channels. However, the growth of cloud systems and increased information inflow through social media channels has put a tremendous stress on these traditional systems. The challenges are multifold:
The traditional data warehouse systems have been unable to efficiently handle these changes. A large number of customers have Teradata as the backbone of their data warehouse system and are now struggling to keep up with business demands. The need to migrate to Big Data platforms has never been more critical.
Drivers for moving from legacy systems like Teradata to Big Data platforms like Hadoop
While Teradata implementations across companies differ in many ways, there are some questions that need to be asked before embarking on any migration plan. These include:
The overhead of having a parallel run is offset by the business benefit of cutting the risk of a "big bang" approach. Yes, the data will be duplicated for some time. But with utilities built into the plan, it will reduce the overhead significantly.
Every organization should strive to ensure that all changes are as seamless as possible for business users.
To determine the urgency of a possible data migration, companies with traditional data warehouse platforms need to understand the companies business plan for the next five years. The infrastructure needs should be determined by this, with cost a second tier consideration. A detailed analysis of the current challenges and the changing data storage needs will influence the migration decisions. But it is safe to assume that nearly every company will need to migrate their data to a more robust, scalable, and cost effective solution at some point in the near future.