Clement P
asked on
30 GB MySQL Table import to DynamoDB
Hi,
I've a 30 MySQL table on a AES EC2 Instance that I want to import into DynamoDB.
Could someone help me with the process.
DDL Information
Create Table
CREATE TABLE `AUDIT_ACTIVITY_LOG` (
`ID` int(11) NOT NULL AUTO_INCREMENT,
`ACTIVITY_ID` int(11) NOT NULL COMMENT 'Activity group id',
`LOG_TIME` datetime NOT NULL COMMENT 'Logging time',
`USER_ID` int(11) DEFAULT NULL COMMENT 'User who performed the task can be system performed task',
`MG_ID` int(11) DEFAULT NULL COMMENT 'Merchant Group Id',
`ACTIVITY_TEXT` text COMMENT 'Activity text should be populated form text',
`IP_ADDRESS` varchar(50) DEFAULT NULL COMMENT 'Stores the ip address for the activity.',
`REF_ID` int(11) DEFAULT '0' COMMENT 'The ref id to store some ids like order id or any other id to make search fast',
PRIMARY KEY (`ID`,`LOG_TIME`),
KEY `idx_LOG_TIME` (`LOG_TIME`),
KEY `idx_ACTIVITY_ID` (`ACTIVITY_ID`),
KEY `idx_REF_ID` (`REF_ID`),
KEY `idx_MG_ID` (`MG_ID`)
) ENGINE=InnoDB AUTO_INCREMENT=54920993 DEFAULT CHARSET=utf8
/*!50100 PARTITION BY RANGE (YEAR(LOG_TIME))
SUBPARTITION BY HASH (MONTH(LOG_TIME))
SUBPARTITIONS 12
(PARTITION p2012 VALUES LESS THAN (2012) ENGINE = InnoDB,
PARTITION p2013 VALUES LESS THAN (2013) ENGINE = InnoDB,
PARTITION p2014 VALUES LESS THAN (2014) ENGINE = InnoDB,
PARTITION p2015 VALUES LESS THAN (2015) ENGINE = InnoDB,
PARTITION p2016 VALUES LESS THAN (2016) ENGINE = InnoDB,
PARTITION p2017 VALUES LESS THAN (2017) ENGINE = InnoDB,
PARTITION p2018 VALUES LESS THAN (2018) ENGINE = InnoDB) */
Thanks
Audit_Activity.JPG
Audit_Activity2.jpg
I've a 30 MySQL table on a AES EC2 Instance that I want to import into DynamoDB.
Could someone help me with the process.
DDL Information
Create Table
CREATE TABLE `AUDIT_ACTIVITY_LOG` (
`ID` int(11) NOT NULL AUTO_INCREMENT,
`ACTIVITY_ID` int(11) NOT NULL COMMENT 'Activity group id',
`LOG_TIME` datetime NOT NULL COMMENT 'Logging time',
`USER_ID` int(11) DEFAULT NULL COMMENT 'User who performed the task can be system performed task',
`MG_ID` int(11) DEFAULT NULL COMMENT 'Merchant Group Id',
`ACTIVITY_TEXT` text COMMENT 'Activity text should be populated form text',
`IP_ADDRESS` varchar(50) DEFAULT NULL COMMENT 'Stores the ip address for the activity.',
`REF_ID` int(11) DEFAULT '0' COMMENT 'The ref id to store some ids like order id or any other id to make search fast',
PRIMARY KEY (`ID`,`LOG_TIME`),
KEY `idx_LOG_TIME` (`LOG_TIME`),
KEY `idx_ACTIVITY_ID` (`ACTIVITY_ID`),
KEY `idx_REF_ID` (`REF_ID`),
KEY `idx_MG_ID` (`MG_ID`)
) ENGINE=InnoDB AUTO_INCREMENT=54920993 DEFAULT CHARSET=utf8
/*!50100 PARTITION BY RANGE (YEAR(LOG_TIME))
SUBPARTITION BY HASH (MONTH(LOG_TIME))
SUBPARTITIONS 12
(PARTITION p2012 VALUES LESS THAN (2012) ENGINE = InnoDB,
PARTITION p2013 VALUES LESS THAN (2013) ENGINE = InnoDB,
PARTITION p2014 VALUES LESS THAN (2014) ENGINE = InnoDB,
PARTITION p2015 VALUES LESS THAN (2015) ENGINE = InnoDB,
PARTITION p2016 VALUES LESS THAN (2016) ENGINE = InnoDB,
PARTITION p2017 VALUES LESS THAN (2017) ENGINE = InnoDB,
PARTITION p2018 VALUES LESS THAN (2018) ENGINE = InnoDB) */
Thanks
Audit_Activity.JPG
Audit_Activity2.jpg
If you have an ODBC connection to your DynamoDB then you could use a piece of software that I swear by, it's called Navicat. Yes, it's a commercial license, no I do not get commissions, I've used it on and off for at least 15 years, and it's the most robust tool I've found that can handle database migrations to/from mysql, and includes importing schema and data from spreadsheets, access dbs, etc.
This question needs an answer!
Become an EE member today
7 DAY FREE TRIALMembers can start a 7-Day Free trial then enjoy unlimited access to the platform.
View membership options
or
Learn why we charge membership fees
We get it - no one likes a content blocker. Take one extra minute and find out why we block content.