Bigdata Playground
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Prettier | 46,693 |  | 184,190 | 225,830 | a day ago | 139 | July 05, 2023 | 1,251 | mit | JavaScript |
| Prettier is an opinionated code formatter. | ||||||||||
| Rxdb | 19,686 |  | 82 | 81 | 7 hours ago | 450 | July 27, 2023 | 15 | apache-2.0 | TypeScript |
| A fast, offline-first, reactive Database for JavaScript Applications https://rxdb.info/ | ||||||||||
| Graphql Code Generator | 10,309 | 3 days ago | 525 | mit | TypeScript | |||||
| A tool for generating code based on a GraphQL schema and GraphQL operations (query/mutation/subscription), with flexible support for custom plugins. | ||||||||||
| Learnapollo | 5,315 | 5 years ago | 10 | mit | TypeScript | |||||
| 👩🏻🏫 Learn Apollo - A hands-on tutorial for Apollo GraphQL Client (created by Graphcool) | ||||||||||
| Altair | 4,836 |  | 7 | 11 | 7 hours ago | 116 | August 05, 2023 | 57 | TypeScript | |
| ✨⚡️ A beautiful feature-rich GraphQL Client for all platforms. | ||||||||||
| Searchkit | 4,650 |  | 143 | 16 | 19 days ago | 114 | July 15, 2023 | 25 | apache-2.0 | TypeScript |
| Search UI for Elasticsearch & Opensearch. Compatible with Algolia's Instantsearch and Autocomplete components. React & Vue support | ||||||||||
| Angular Example App | 1,977 |  | 10 | 2 | 11 days ago | 5 | May 14, 2018 | 1 | TypeScript | |
| Angular 16 Example App + Standalone Components + i18n + GraphQL | ||||||||||
| Apollo Universal Starter Kit | 1,675 | 3 months ago | 1 | August 28, 2023 | 94 | mit | JavaScript | |||
| Apollo Universal Starter Kit is a SEO-friendly, fully-configured, modular starter application that helps developers to streamline web, server, and mobile development with cutting-edge technologies and ultimate code reuse. | ||||||||||
| Ever Demand | 1,563 | 6 days ago | 1 | November 18, 2019 | 120 | other | TypeScript | |||
| Ever® Demand™ - Open Commerce Platform for Collaborative, On-Demand and Sharing Economies | ||||||||||
| Awesome Aws Amplify | 1,529 | 2 years ago | ||||||||
| Curated list of AWS Amplify Resources | ||||||||||
Bigdata Playground
The aim is to create a Batch/Streaming/ML/WebApp stack where you can test your jobs locally or to submit them to the Yarn resource manager. We are using Docker to build the environment and Docker-Compose to provision it with the required components (Next step using Kubernetes). Along with the infrastructure, We are check that it works with 4 projects that just probes everything is working as expected. The boilerplate is based on a sample search flight Web application.
Installation
If you are on mac then, you can use package manager like brew to install sbt on your machine:
$ brew install sbt
For other systems, you can refer to manual instructions from sbt website http://www.scala-sbt.org/0.13/tutorial/Manual-Installation.html.
If you are on mac then, you can use package manager like brew to install maven on your machine:
$ brew install maven
For other systems, you can refer to manual instructions from maven website https://maven.apache.org/install.html.
Install Docker by following the instructions for mac, linux, or windows.
docker network create vnet
npm install yarn -g
cd webapp && yarn && cd client && yarn && cd ../server && yarn && cd ../ && npm run build:dev && cd ../
cd batch/spark && sbt clean package assembly && cd ../..
cd batch/hadoop && mvn clean package && cd ../..
cd streaming/spark && sbt clean assembly && cd ../..
cd streaming/flink && sbt clean assembly && cd ../..
cd streaming/storm && mvn clean package && cd ../..
cd docker
docker-compose -f mongo.yml -f zookeeper.yml -f kafka.yml -f hadoop-hbase.yml -f flink.yml up -d
docker-compose -f dev/webapp.yml up -d
docker-compose -f dev/batch-spark.yml up -d
docker-compose -f dev/batch-hadoop.yml up -d
docker-compose -f dev/streaming-spark.yml up -d
docker-compose -f dev/streaming-flink.yml up -d
docker-compose -f dev/streaming-storm.yml up -d
Create your Twitter app on https://apps.twitter.com
export TWITTER_CONSUMER_KEY=<TWITTER_CONSUMER_KEY>
export TWITTER_CONSUMER_SECRET=<TWITTER_CONSUMER_SECRET>
export TWITTER_CONSUMER_ACCESS_TOKEN=<TWITTER_CONSUMER_ACCESS_TOKEN>
export TWITTER_CONSUMER_ACCESS_TOKEN_SECRET=<TWITTER_CONSUMER_ACCESS_TOKEN_SECRET>
docker-compose -f dev/ml-spark.yml up -d
Interactions / OnGoing
Contributing
Pull requests are welcome.
Support
Please raise tickets for issues and improvements at https://github.com/Chabane/bigdata-playground/issues
License
This example is released under version 2.0 of the Apache License.
