# Import from BigQuery to Elasticsearch

**URL:** https://discuss.elastic.co/t/import-from-bigquery-to-elasticsearch/155454
**Category:** Elasticsearch
**Created:** [November 5, 2018, 8:42pm UTC](https://discuss.elastic.co/t/import-from-bigquery-to-elasticsearch/155454 "2018-11-05T20:42:31Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![melissachang](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/melissachang/32/36684_2.png) [@melissachang](https://discuss.elastic.co/u/melissachang)
#### Post date: [November 5, 2018, 8:42pm UTC](https://discuss.elastic.co/t/import-from-bigquery-to-elasticsearch/155454/1 "2018-11-05T20:42:31Z")

</div>

This is a follow-up to [Import from BigQuery to Elasticsearch?](https://discuss.elastic.co/t/import-from-bigquery-to-elasticsearch/138448)

In [https://github.com/DataBiosphere/data-explorer-indexers](https://github.com/DataBiosphere/data-explorer-indexers), we're developing a solution that is pretty fast:

- Copy BigQuery table to JSON files on GCS. It only take a couple minutes to load 2G table into python.
- Based on BigQuery schema, supply mappings. Turn off dynamic mappings.

We were able to index a 2G BigQuery table into ES in 4 hours.

If there is interested, we could extract BigQuery -\> Elasticsearch into a separate repo.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [December 3, 2018, 8:42pm UTC](https://discuss.elastic.co/t/import-from-bigquery-to-elasticsearch/155454/2 "2018-12-03T20:42:36Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
