场景:从TDSQL抽数到hdfs报错,需要指定驱动类名
报错如下:
java.lang.RuntimeException: java.lang.NullPointerException
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
修改前抽数脚本:
#执行sqoop命令
s
q
o
o
p
h
o
m
e
/
s
q
o
o
p
i
m
p
o
r
t
−
D
o
r
g
.
a
p
a
c
h
e
.
s
q
o
o
p
.
s
p
l
i
t
t
e
r
.
a
l
l
o
w
t
e
x
t
s
p
l
i
t
t
e
r
=
t
r
u
e
−
−
c
o
n
n
e
c
t
j
d
b
c
:
m
y
s
q
l
:
/
/
{sqoop_home}/sqoop import \ -Dorg.apache.sqoop.splitter.allow_text_splitter=true \ --connect jdbc:mysql://
sqoophome/sqoopimport −Dorg.apache.sqoop.splitter.allowtextsplitter=true −−connectjdbc:mysql://{ip}:
p
o
r
t
/
{port}/
port/{dbname}
–username ${user}
–password ${passwd}
–fields-terminated-by ‘\001’ \
修改后抽数脚本,指定驱动类名:
#执行sqoop命令
s
q
o
o
p
h
o
m
e
/
s
q
o
o
p
i
m
p
o
r
t
−
D
o
r
g
.
a
p
a
c
h
e
.
s
q
o
o
p
.
s
p
l
i
t
t
e
r
.
a
l
l
o
w
t
e
x
t
s
p
l
i
t
t
e
r
=
t
r
u
e
−
−
c
o
n
n
e
c
t
j
d
b
c
:
m
y
s
q
l
:
/
/
{sqoop_home}/sqoop import \ -Dorg.apache.sqoop.splitter.allow_text_splitter=true \ --connect jdbc:mysql://
sqoophome/sqoopimport −Dorg.apache.sqoop.splitter.allowtextsplitter=true −−connectjdbc:mysql://{ip}:
p
o
r
t
/
{port}/
port/{dbname}
–username ${user}
–password ${passwd}
–fields-terminated-by ‘\001’
–driver com.oceanbase.jdbc.Driver \
可以跑通:
tail c_appeal_init.log
sqoop抽取 c_appeal全量数据完成,耗时236秒