# How can use esrally import data to es cloud?

**URL:** <https://discuss.elastic.co/t/how-can-use-esrally-import-data-to-es-cloud/111467>\
**Category:** Elasticsearch\
**Tags:** rally\
**Created:** [December 13, 2017, 1:29am UTC](https://discuss.elastic.co/t/how-can-use-esrally-import-data-to-es-cloud/111467 "2017-12-13T01:29:42Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![zqc0512](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/zqc0512/32/32141_2.png) [@zqc0512](https://discuss.elastic.co/u/zqc0512)\
**Post date:** [December 13, 2017, 1:29am UTC](https://discuss.elastic.co/t/how-can-use-esrally-import-data-to-es-cloud/111467/1 "2017-12-13T01:29:42Z")

</div>

how can use esrally import data to es cloud ?  
can give a example.  
the host connect internet with proxy  
how can configure about it.

---

<div class="post-metadata">

**Author:** ![zqc0512](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/zqc0512/32/32141_2.png) [@zqc0512](https://discuss.elastic.co/u/zqc0512)\
**Post date:** [December 13, 2017, 2:52am UTC](https://discuss.elastic.co/t/how-can-use-esrally-import-data-to-es-cloud/111467/2 "2017-12-13T02:52:55Z")

</div>

```
2017-12-13 02:48:10,346 PID:22661 elasticsearch WARNING GET https://2588624b8d75420be2c1d6fb31b10fa7.ap-southeast-1.aws.found.io:9243/ 
[status:N/A request:42.529s]
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/urllib3/connection.py", line 141, in _new_conn
    (self.host, self.port), self.timeout, **extra_kw)
  File "/usr/local/lib/python3.6/site-packages/urllib3/util/connection.py", line 83, in create_connection
    raise err
  File "/usr/local/lib/python3.6/site-packages/urllib3/util/connection.py", line 73, in create_connection
    sock.connect(sa)
OSError: [Errno 101] Network is unreachable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/elasticsearch/connection/http_urllib3.py", line 114, in perform_request
    response = self.pool.urlopen(method, url, body, retries=False, headers=self.headers, **kw)
  File "/usr/local/lib/python3.6/site-packages/esrally/client.py", line 47, in urlopen
    return self.pool.urlopen(method, url, body=body, retries=retries, headers=headers, **kw)
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 649, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/site-packages/urllib3/util/retry.py", line 333, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/site-packages/urllib3/packages/six.py", line 686, in reraise
    raise value
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 345, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 844, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.6/site-packages/urllib3/connection.py", line 284, in connect
    conn = self._new_conn()
  File "/usr/local/lib/python3.6/site-packages/urllib3/connection.py", line 150, in _new_conn
    self, "Failed to establish a new connection: %s" % e)
urllib3.exceptions.NewConnectionError: <urllib3.connection.VerifiedHTTPSConnection object at 0x7f8f5e9acef0>: Failed to establish a new
 connection: [Errno 101] Network is unreachable
2017-12-13 02:48:52,409 PID:22661 elasticsearch WARNING GET https://2588624b8d75420be2c1d6fb31b10fa7.ap-southeast-1.aws.found.io:9243/ 
[status:N/A request:42.061s]
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/urllib3/connection.py", line 141, in _new_conn
    (self.host, self.port), self.timeout, **extra_kw)
  File "/usr/local/lib/python3.6/site-packages/urllib3/util/connection.py", line 83, in create_connection
    raise err
  File "/usr/local/lib/python3.6/site-packages/urllib3/util/connection.py", line 73, in create_connection
    sock.connect(sa)
OSError: [Errno 101] Network is unreachable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/elasticsearch/connection/http_urllib3.py", line 114, in perform_request
    response = self.pool.urlopen(method, url, body, retries=False, headers=self.headers, **kw)
  File "/usr/local/lib/python3.6/site-packages/esrally/client.py", line 47, in urlopen
    return self.pool.urlopen(method, url, body=body, retries=retries, headers=headers, **kw)
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 649, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/site-packages/urllib3/util/retry.py", line 333, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/site-packages/urllib3/packages/six.py", line 686, in reraise
    raise value
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 345, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 844, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.6/site-packages/urllib3/connection.py", line 284, in connect
    conn = self._new_conn()
  File "/usr/local/lib/python3.6/site-packages/urllib3/connection.py", line 150, in _new_conn
    self, "Failed to establish a new connection: %s" % e)
urllib3.exceptions.NewConnectionError: <urllib3.connection.VerifiedHTTPSConnection object at 0x7f8f5e9acf60>: Failed to establish a new
 connection: [Errno 101] Network is unreachable
2017-12-13 02:49:34,624 PID:22661 elasticsearch WARNING GET https://2588624b8d75420be2c1d6fb31b10fa7.ap-southeast-1.aws.found.io:9243/ 
[status:N/A request:42.214s]
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/urllib3/connection.py", line 141, in _new_conn
    (self.host, self.port), self.timeout, **extra_kw)
  File "/usr/local/lib/python3.6/site-packages/urllib3/util/connection.py", line 83, in create_connection
    raise err
  File "/usr/local/lib/python3.6/site-packages/urllib3/util/connection.py", line 73, in create_connection
    sock.connect(sa)
OSError: [Errno 101] Network is unreachable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/elasticsearch/connection/http_urllib3.py", line 114, in perform_request
    response = self.pool.urlopen(method, url, body, retries=False, headers=self.headers, **kw)
  File "/usr/local/lib/python3.6/site-packages/esrally/client.py", line 47, in urlopen
    return self.pool.urlopen(method, url, body=body, retries=retries, headers=headers, **kw)
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 649, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/site-packages/urllib3/util/retry.py", line 333, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/site-packages/urllib3/packages/six.py", line 686, in reraise
    raise value
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 345, in _make_request
    self._validate_conn(conn)
```

---

<div class="post-metadata">

**Author:** ![dakrone](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dakrone/32/23351_2.png) [@dakrone](https://discuss.elastic.co/u/dakrone)\
**Post date:** [December 13, 2017, 3:25am UTC](https://discuss.elastic.co/t/how-can-use-esrally-import-data-to-es-cloud/111467/3 "2017-12-13T03:25:44Z")

</div>

Looking at the code for Rally, it appears that it uses its own connection\_class with the elasticsearch-py client, so I don't think there is an existing way to do it.

@danielmitterdorfer does Rally currently have proxy support? If not I don't think it will be too hard to add since it just needs to be added as an option.

---

<div class="post-metadata">

**Author:** ![zqc0512](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/zqc0512/32/32141_2.png) [@zqc0512](https://discuss.elastic.co/u/zqc0512)\
**Post date:** [December 13, 2017, 3:28am UTC](https://discuss.elastic.co/t/how-can-use-esrally-import-data-to-es-cloud/111467/4 "2017-12-13T03:28:09Z")

</div>

yes i don't find where to add the configure with proxy connect to internet.  
thanks..

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [December 13, 2017, 7:02am UTC](https://discuss.elastic.co/t/how-can-use-esrally-import-data-to-es-cloud/111467/5 "2017-12-13T07:02:26Z")

</div>

@zqc0512 there is an entire section in the docs about proxy configuration:

[http://esrally.readthedocs.io/en/stable/configuration.html?highlight=proxy#proxy-configuration](http://esrally.readthedocs.io/en/stable/configuration.html?highlight=proxy#proxy-configuration)

---

<div class="post-metadata">

**Author:** ![zqc0512](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/zqc0512/32/32141_2.png) [@zqc0512](https://discuss.elastic.co/u/zqc0512)\
**Post date:** [December 13, 2017, 7:04am UTC](https://discuss.elastic.co/t/how-can-use-esrally-import-data-to-es-cloud/111467/6 "2017-12-13T07:04:37Z")

</div>

> [@danielmitterdorfer](#):
>
> @zqc0512 there is an entire section in the docs about proxy configuration:
> 
> [Configuration - Rally 2.10.0 documentation](http://esrally.readthedocs.io/en/stable/configuration.html?highlight=proxy#proxy-configuration)

about this ..

**Note:  
Rally will use this proxy server only for downloading benchmark-related data. It will not use this proxy for the actual benchmark.**

it about down data ,but benchmark not use proxy..  
@danielmitterdorfer

---

<div class="post-metadata">

**Author:** ![danielmitterdorfer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danielmitterdorfer/32/110510_2.png) [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Post date:** [December 13, 2017, 9:04am UTC](https://discuss.elastic.co/t/how-can-use-esrally-import-data-to-es-cloud/111467/7 "2017-12-13T09:04:06Z")

</div>

> [@zqc0512](#):
>
> it about down data ,but benchmark not use proxy..

That's correct. As @dakrone has mentioned it is currently not possible to do it. I have raised to [#382](https://github.com/elastic/rally/issues/382) in the Rally repo so we'll add support for that in a future release. Thanks for bringing that up.

---

<div class="post-metadata">

**Author:** ![zqc0512](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/zqc0512/32/32141_2.png) [@zqc0512](https://discuss.elastic.co/u/zqc0512)\
**Post date:** [December 13, 2017, 9:07am UTC](https://discuss.elastic.co/t/how-can-use-esrally-import-data-to-es-cloud/111467/8 "2017-12-13T09:07:26Z")

</div>

thanks so much.  
it about have a time ? when can output ?  
i use this test the es cloud.  
thanks..  
@danielmitterdorfer

---

<div class="post-metadata">

**Author:** ![zqc0512](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/zqc0512/32/32141_2.png) [@zqc0512](https://discuss.elastic.co/u/zqc0512)\
**Post date:** [December 13, 2017, 9:10am UTC](https://discuss.elastic.co/t/how-can-use-esrally-import-data-to-es-cloud/111467/9 "2017-12-13T09:10:57Z")

</div>

thanks so much.  
it about have a time ? when can output ? i see it in Pre 1.0 and now is 0.8.1. that so bad.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [January 10, 2018, 9:11am UTC](https://discuss.elastic.co/t/how-can-use-esrally-import-data-to-es-cloud/111467/10 "2018-01-10T09:11:00Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.