Etl Processes Using Sqoop Hadoop Hive Spark And Scala
I implemented various ETL processes like loading the data using sqoop from mysql to hdfs, transform the data using Spark and Scala, perform analytics using Spark and Scala and loading the data back to HDFS.
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Bigdata Notes | 14,872 | 4 months ago | 39 | Java | ||||||
| 大数据入门指南 :star: | ||||||||||
| God Of Bigdata | 8,483 | 9 months ago | 3 | |||||||
| 专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive... | ||||||||||
| Tensorflowonspark | 3,851 | 5 | 10 months ago | 32 | April 21, 2022 | 13 | apache-2.0 | Python | ||
| TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters. | ||||||||||
| Ibis | 3,404 |  | 24 | 29 | 3 months ago | 68 | December 10, 2023 | 157 | apache-2.0 | Python |
| The flexibility of Python with the scale and performance of modern SQL. | ||||||||||
| Bigdata Interview | 1,397 | 3 years ago | n,ull | |||||||
| :dart: :star2:[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结 | ||||||||||
| Bigdata Growth | 1,256 | 21 days ago | 1 | mit | Shell | |||||
| 大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。 | ||||||||||
| Devops Python Tools | 709 | 4 months ago | 37 | mit | Python | |||||
| 80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc. | ||||||||||
| Sparta | 526 | 5 years ago | 9 | apache-2.0 | Scala | |||||
| Real Time Analytics and Data Pipelines based on Spark Streaming | ||||||||||
| Docker Hadoop Spark Workbench | 503 | 4 years ago | 18 | Makefile | ||||||
| [EXPERIMENTAL] This repo includes deployment instructions for running HDFS/Spark inside docker containers. Also includes spark-notebook and HDFS FileBrowser. | ||||||||||
| Zdh_web | 379 | 4 months ago | 19 | apache-2.0 | Java | |||||
| 大数据采集,抽取平台,zdh_web是zdh系列服务的可视化管理平台，包含数据采集,调度,权限,审批流,私域营销等模块 | ||||||||||
Alternatives To Etl Processes Using Sqoop Hadoop Hive Spark And ScalaSelect To Compare
Alternative Project Comparisons
Popular Spark Projects
Popular Hdfs Projects
Popular Data Processing Categories
Related Searches
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Scala
Spark
Hive
Etl
Hdfs