Bigdata Interview

: 3UWFMRS

: https://jobs.toutiao.com/s/eFCv3cB

https://job.toutiao.com/s/eFCPHb6

Hadoop	Hive	Spark	Flink	HBase	Kafka	Zookeeper

Hadoop

1. HDFS

2. Yarn

3. MapReduce

4. Yarn MapReduce

5. hdfs

6. hdfs

7. hdfs

8. hadoop1.x hadoop 2.x

9. hadoop1.x

10. hadoop HA

11. hadoop,?

12. ,?

13. hadoop,

Hive

1. hive

2. hive sort by / order by / cluster by / distribute by

3. hivemetastore

4. hive join

5. Impala hive

6. Hivejoin

7. Hive Sql MR job?

8. Hive UDF

9. SQL: , TopN

10. SQL: 1/4

Spark

1. spark
2. spark
3. sparkshuffle
4. Spark partitioner ?
5. spark join
6. RDD
8. Spark
9. RDD
10. RDD
11. spark
12. spark on yarn cluster client
13. spark,jar,
14. sparkstage
15. sparkrpc: spark2.0akka netty?
16. sparkHA, master/worker/executor/driver/taskha
17. spark,spark 1.6, spark2.0
18. spark
19. ,
20. sparkDriver,Worker

Flink

1. flink

2. flink

3. flinkexactly once

4. flink window

5. flinkwindow

6. flink state

7. flink

8. flink

9. flink on yarn

10. flink , eventTime processTime

11. flinksession Window

HBase

1. Hbase
2. hbase rowkey
3. hbase,
4. hbaseHA,zookeeper
5. HMaster,
6. hbase
7. hbase

Kafka

1. kafka

2. kafka ?

3. kafka

4. kafka

5. kafka

6. kafka spark streaming , exactly once

7. ack , ?

8. offset

10. 1message

11. zookeeperkafka

12. kafka zookeeper

13. kafka

14. kafka710G,510G,kafka?

Zookeeper

1. zookeeper,
2. zk
3. zk
4. zk
5. zk
6. zk ?
7. leader