dejavu: The missing Web UI for Elasticsearch

1. Dejavu: Intro
2. Features
   a. Easily Connect to Indices
   b. Visual Filters
   c. Modern UI Elements
   d. Import JSON or CSV Data
   e. Build search UIs
3. Comparison
4. Roadmap
5. Build Locally / Contributing
6. Get Dejavu
   a. Docker Installation
   b. Hosted Alternatives

1. Dejavu Intro

dejavu is the missing web UI for Elasticsearch and OpenSearch. Existing web UIs leave much to be desired or are built with server-side page rendering techniques that make it less responsive and bulkier to run (I am looking at you, Kibana).

We started building dejavu with the goal of creating a modern Web UI (no page reloads, infinite scroll, filtered views, realtime updates, search UI builder) for Elasticsearch with 100% client-side rendering so one can easily run it as a hosted app on github pages, or as a docker image.

Starting v1.0, dejavu is the only Elasticsearch web UI that supports importing data via JSON and CSV files, as well as defining field mappings from the GUI.

Starting with v1.5, we support the ability of creating custom headers so you can easily pass different authentication headers, provide enhanced filtering and bulk updating of data via Elasticsearch's Query DSL.

Starting with v2.0, we support the ability to build faceted search UIs to test relevancy. You can also export the generated code to a codesandbox.

Starting with v3.0, we support the ability to connect to multiple indexes. You can also globally search across your indexes using global search bar.

2. Features

Easily Connect and Remember Indices

Dejavu allows you to connect to any of the indexes present in your cluster and also caches each connected index locally so they are easily accessible when browsing again.

Visual Filters

Sort through the data, find information visually, hide irrelevant data and make sense of all. With all the native data types we have . Global searchbar allows you to perform text search across your dataset.

Moreover, any filtered view can be exported as a JSON or CSV file.

Modern UI elements

It's not uncommon to have thousands of documents in your index. Dejavu supports paginated view which also allows you to change page size.

Dejavu also supports browsing data from multiple indexes and types, updating data either individually or via queries in bulk. Deletions are also supported.

Import JSON or CSV Data

Importer view allows importing CSV or JSON data directly into Elasticsearch through a guided data mappings configuration.

Build Search UIs

With Search Preview, you can now build visual search UIs, test search relevancy and export code to a codesandbox.

3. Comparison with other data browsers

4. Roadmap

Here's a rough roadmap of things to come in the version 1.0.0 release.

We just hit the 1.0.0 roadmap:

• [x] Battle-testing with different datasets
• [x] Feature support for advanced filtering Offline detection and reconnection for realtime updates
• [x] Performance improvements while scrolling
• [x] Support for importing and exporting data
• [x] Support for a continuous query view
• [x] Available as a docker image

We just hit the 2.0.0 release:

• [x] An intuitive data editing experience in tabular mode (v/s JSON edit mode)
• [x] View data types from within the data browser view
• [x] A more streamlined import process
• [x] Refactor codebase to improve hackability (Migrate to React 16+, ES6 syntax)
• [x] Ability to build (and test) search visually

We just hit the 3.0.0 release:

• [x] Rewrite dejavu browser for high performance when browsing large datasets
• [x] Add support for browsing multiple indexes
• [x] Powerful filtering of data with field level facet based filters and a global search
• [x] Built on React 16.6 and future compatible with React 17
• [x] A more intuitive data editing experience (in addition to the raw JSON, we now show a relevant UI field with validations)

Roadmap beyond 3.0.0:

• [ ] Improve test coverage
• [ ] Mobile friendly viewing and editing experience
• [ ] Additional filtering support (add range filters, date filters)

5. Build Locally

See the contributing guidelines.

6. Get Dejavu

Docker Installation

docker run -p 1358:1358 -d appbaseio/dejavu
open http://localhost:1358/

You can also run a specific version of dejavu by specifying a tag. For example, version 3.6.0 can be used by specifying the docker run -p 1358:1358 appbaseio/dejavu:3.6.0 command.

Cross-origin resource sharing (CORS)

To make sure you enable CORS settings for your Elasticsearch instance, add the following lines in the elasticsearch.yml configuration file.

http.port: 9200
http.cors.allow-origin: 'http://localhost:1358'
http.cors.enabled: true
http.cors.allow-headers: X-Requested-With,X-Auth-Token,Content-Type,Content-Length,Authorization
http.cors.allow-credentials: true

If you are running your Elasticsearch with docker-compose, you can refer to the example reference here.

If you are running your Elasticsearch with docker, you can use the following flags to pass the custom CORS configuration:

OpenSearch 1.x

docker run --name opensearch --rm -d -p 9200:9200 -e http.port=9200 -e discovery.type=single-node -e http.max_content_length=10MB -e http.cors.enabled=true -e http.cors.allow-origin=\* -e http.cors.allow-headers=X-Requested-With,X-Auth-Token,Content-Type,Content-Length,Authorization -e http.cors.allow-credentials=true -e plugins.security.disabled=true opensearchproject/opensearch:1.2.4

You can run both Opensearch and Dejavu together with:

docker-compose up -d

Elasticsearch 8.x

docker run -d --rm --name elasticsearch -p 127.0.0.1:9200:9200 -e http.port=9200 -e discovery.type=single-node -e http.max_content_length=10MB -e http.cors.enabled=true -e http.cors.allow-origin=\* -e http.cors.allow-headers=X-Requested-With,X-Auth-Token,Content-Type,Content-Length,Authorization -e http.cors.allow-credentials=true -e network.publish_host=localhost -e xpack.security.enabled=false docker.elastic.co/elasticsearch/elasticsearch:8.1.0

You can run both Elasticsearch 8.1.0 and Dejavu together with:

docker-compose -f docker-compose-v8.yml up -d

Elasticsearch 7.x

docker run -d --rm --name elasticsearch -p 9200:9200 -p 9300:9300 -e "discovery.type=single-node" -e "http.cors.enabled=true" -e "http.cors.allow-origin=*" -e "http.cors.allow-headers=X-Requested-With,X-Auth-Token,Content-Type,Content-Length,Authorization" -e "http.cors.allow-credentials=true" docker.elastic.co/elasticsearch/elasticsearch-oss:7.10.2

You can run both Elasticsearch 7.10.2 and Dejavu together with:

docker-compose -f docker-compose-v7.yml up -d

Hosted Alternatives

dejavu can also be run as a hosted app at https://dejavu.appbase.io.