the transporter 4 mysql
DESCRIPTION
import & exports for MySQL to HDFS (Hadoop), HBase, Hive, csv, sql, tsv, text, xml, installing Apache Sqoop,problems associated with import & exportTRANSCRIPT
![Page 1: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/1.jpg)
The Transporter4
MySQL
A visual Guide 4 Importing & Exporting
csv, xml, tsv, text, sql, MySql, HDFS, Hive, HBase
![Page 2: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/2.jpg)
contents
• Export 2 csv
• Import csv
• Exporting 2 sql
• Importing sql
• Exporting 2 xml
• Importing xml
• Exporting 2 tsv
• Exporting 2 text
• Exporting 2 HDFS
• Installing Apache Sqoop
• exporting 2 HDFS
• Importing 2 MySQL
• Exporting 2 Hive
• Exporting 2 HBase
![Page 3: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/3.jpg)
open MySQL
![Page 4: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/4.jpg)
exporting to CSV
![Page 5: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/5.jpg)
exporting CSV – Problem ?
![Page 6: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/6.jpg)
check Appamor status
![Page 7: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/7.jpg)
AA Status
![Page 8: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/8.jpg)
AA
![Page 9: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/9.jpg)
go to apparmor.d
![Page 10: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/10.jpg)
edit usr.sbin.mysqld
![Page 11: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/11.jpg)
usr.sbin.mysqld
![Page 12: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/12.jpg)
after editing usr.sbin.mysqld
![Page 13: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/13.jpg)
make /tmp/data directory
![Page 14: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/14.jpg)
make /data directory
![Page 15: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/15.jpg)
mounting
![Page 16: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/16.jpg)
reload apparmor
![Page 17: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/17.jpg)
restarting apparmor . . .
![Page 18: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/18.jpg)
exporting .csv
![Page 19: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/19.jpg)
Importing csv
![Page 20: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/20.jpg)
importing .csv – problem ?
![Page 21: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/21.jpg)
importing .csv
![Page 22: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/22.jpg)
edit my.cnf
![Page 23: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/23.jpg)
my.cnf file
![Page 24: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/24.jpg)
after editing my.cnf
![Page 25: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/25.jpg)
importing .csv
![Page 26: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/26.jpg)
exporting sql
![Page 27: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/27.jpg)
view tables
![Page 28: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/28.jpg)
create country table
![Page 29: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/29.jpg)
inserting data into country table
![Page 30: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/30.jpg)
exporting .sql
![Page 31: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/31.jpg)
exported .sql file
![Page 32: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/32.jpg)
Importing sql
![Page 33: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/33.jpg)
importing .sql
![Page 34: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/34.jpg)
exporting xml
![Page 35: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/35.jpg)
exporting .xml
![Page 36: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/36.jpg)
importing xml
![Page 37: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/37.jpg)
importing xml
![Page 38: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/38.jpg)
exporting tsv
![Page 39: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/39.jpg)
exporting .tsv
![Page 40: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/40.jpg)
exported .tsv file
![Page 41: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/41.jpg)
exporting txt
![Page 42: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/42.jpg)
exporting .txt
![Page 43: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/43.jpg)
exported .txt file
![Page 44: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/44.jpg)
exporting to HDFS
![Page 45: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/45.jpg)
installing Apache Sqoop
![Page 46: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/46.jpg)
Apache Sqoop Home Page
![Page 47: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/47.jpg)
Sqoop folder structure
![Page 48: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/48.jpg)
add mysqlJ connector in SqoopHome/lib
![Page 49: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/49.jpg)
export & check version
![Page 50: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/50.jpg)
sqoop help
![Page 51: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/51.jpg)
list databases
![Page 52: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/52.jpg)
make dir in HDFS
![Page 53: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/53.jpg)
check mysql tables
![Page 54: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/54.jpg)
grant permissions
![Page 55: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/55.jpg)
exporting 2 HDFS
![Page 56: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/56.jpg)
exporting completes
![Page 57: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/57.jpg)
Intermediate .java file (mapReduce)
![Page 58: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/58.jpg)
HDFS table
![Page 59: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/59.jpg)
exporting to HDFS
![Page 60: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/60.jpg)
exporting to HDFS
![Page 61: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/61.jpg)
importing to MySQL (4m HDFS)
![Page 62: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/62.jpg)
HDFS table
![Page 63: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/63.jpg)
make MySQL table structure
![Page 64: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/64.jpg)
importing to MySQL
![Page 65: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/65.jpg)
importing completes
![Page 66: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/66.jpg)
imported table
![Page 67: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/67.jpg)
exporting to Hive
![Page 68: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/68.jpg)
check Hive for redundant table
![Page 69: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/69.jpg)
exporting 2 Hive
![Page 70: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/70.jpg)
libthrift version error
![Page 71: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/71.jpg)
export fake HBase_Home
![Page 72: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/72.jpg)
check Hive tables
![Page 73: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/73.jpg)
export to HBase
![Page 74: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/74.jpg)
mysql table
![Page 75: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/75.jpg)
employee table
![Page 76: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/76.jpg)
start HBase daemons
![Page 77: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/77.jpg)
exporting to HBase
![Page 78: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/78.jpg)
exporting completes
![Page 79: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/79.jpg)
all Sqoop queries
![Page 80: The Transporter 4 MySQL](https://reader036.vdocuments.net/reader036/viewer/2022062513/55503f74b4c905b2788b483b/html5/thumbnails/80.jpg)
finish