# Big unstructure Text Data Query Problem **URL:** \ **Category:** Elasticsearch\ **Created:** [May 9, 2013, 12:57am UTC](https://discuss.elastic.co/t/big-unstructure-text-data-query-problem/11889 "2013-05-09T00:57:19Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![jj1](https://avatars.discourse-cdn.com/v4/letter/j/c68b51/32.png) [@jj1](https://discuss.elastic.co/u/jj1)\ **Post date:** [May 9, 2013, 12:57am UTC](https://discuss.elastic.co/t/big-unstructure-text-data-query-problem/11889/1 "2013-05-09T00:57:19Z")
Hello,I have a file system.Many unstructure text store in it .For example , ISSUED BY: CHINA EASTERN AIRLINES ORG/DST: SHA/XNN ARL-D E/R: TOUR CODE: PASSENGER: NONAME EXCH: CONJ TKT: 881-88888888/14 O FM:1XIY MU OPEN Q OPEN SUPQ21 20K OPEN FOR USE T3-- RL: TO: XNN FC: 06MAR13SHA MU KMG480.00//XIY MU XNN200.00CNY680.00END FARE: CNY 680.00|FOP:CC TAX: CNY100.00CN|OI: TAX: CNY200.00YQ| TOTAL: CNY 980.00|TKTN: 881-888888888 Now I want to transfer this unstructure text to structure object fot query by field.For exmple, select \* from TKT where TKT.ORG=SHA TKT database may have TB data. I use oracle to do this . But performance is poor. Also I try some object DB like Versant.But performane is sitll poor. Can elasticsearch hold this query with good performance(Query can return result in 2-3 second) -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [May 9, 2013, 2:31am UTC](https://discuss.elastic.co/t/big-unstructure-text-data-query-problem/11889/2 "2013-05-09T02:31:31Z")
IMHO you should think of building a JSon doc from your text files using an ETL tool or your own code. Then you will be able to query it easily (and build facets on top of it BTW) and very fast. My 2 cents. -- David 😉 Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 9 mai 2013 à 02:57, jj [r7raul1984@gmail.com](mailto:r7raul1984@gmail.com) a écrit : Hello,I have a file system.Many unstructure text store in it .For example , ISSUED BY: CHINA EASTERN AIRLINES ORG/DST: SHA/XNN ARL-D E/R: TOUR CODE: PASSENGER: NONAME EXCH: CONJ TKT: 881-88888888/14 O FM:1XIY MU OPEN Q OPEN SUPQ21 20K OPEN FOR USE T3-- RL: TO: XNN FC: 06MAR13SHA MU KMG480.00//XIY MU XNN200.00CNY680.00END FARE: CNY 680.00|FOP:CC TAX: CNY100.00CN|OI: TAX: CNY200.00YQ| TOTAL: CNY 980.00|TKTN: 881-888888888 Now I want to transfer this unstructure text to structure object fot query by field.For exmple, select \* from TKT where TKT.ORG=SHA ## TKT database may have TB data. I use oracle to do this . But performance is poor. Also I try some object DB like Versant.But performane is sitll poor. Can elasticsearch hold this query with good performance(Query can return result in 2-3 second) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![jj1](https://avatars.discourse-cdn.com/v4/letter/j/c68b51/32.png) [@jj1](https://discuss.elastic.co/u/jj1)\ **Post date:** [May 9, 2013, 3:06am UTC](https://discuss.elastic.co/t/big-unstructure-text-data-query-problem/11889/3 "2013-05-09T03:06:37Z")
Thank you～ Where is the ES China company?How to contact ? 在 2013年5月9日星期四UTC+8上午10时31分31秒，David Pilato写道： > IMHO you should think of building a JSon doc from your text files using an > ETL tool or your own code. > Then you will be able to query it easily (and build facets on top of it > BTW) and very fast. > > My 2 cents. > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 9 mai 2013 à 02:57, jj \<[r7rau...@gmail.com](mailto:r7rau...@gmail.com) \\> a écrit : > > Hello,I have a file system.Many unstructure text store in it .For example > , > ISSUED BY: CHINA EASTERN AIRLINES ORG/DST: SHA/XNN > ARL-D > E/R: > TOUR CODE: > > PASSENGER: NONAME > > EXCH: CONJ TKT: 881-88888888/14 > > O FM:1XIY MU OPEN Q OPEN SUPQ21 20K OPEN > FOR USE > T3-- RL: > > TO: XNN > > FC: 06MAR13SHA MU KMG480.00//XIY MU XNN200.00CNY680.00END > > FARE: CNY 680.00|FOP:CC > > TAX: CNY100.00CN|OI: > > TAX: CNY200.00YQ| > > TOTAL: CNY 980.00|TKTN: 881-888888888 > > Now I want to transfer this unstructure text to structure object fot > query by field.For exmple, > select \* from TKT where TKT.ORG=SHA > > TKT database may have TB data. > I use oracle to do this . But performance is poor. Also I try some object > DB like Versant.But performane is sitll poor. > Can elasticsearch hold this query with good performance(Query can return > result in 2-3 second) > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![jj1](https://avatars.discourse-cdn.com/v4/letter/j/c68b51/32.png) [@jj1](https://discuss.elastic.co/u/jj1)\ **Post date:** [May 9, 2013, 3:23am UTC](https://discuss.elastic.co/t/big-unstructure-text-data-query-problem/11889/4 "2013-05-09T03:23:52Z")
Hello，I want to use ES to build index for query. Use Versant to store object. How to write river plugin ? 在 2013年5月9日星期四UTC+8上午8时57分19秒，jj写道： > Hello,I have a file system.Many unstructure text store in it .For example > , > ISSUED BY: CHINA EASTERN AIRLINES ORG/DST: SHA/XNN > ARL-D > E/R: > TOUR CODE: > > PASSENGER: NONAME > > EXCH: CONJ TKT: 881-88888888/14 > > O FM:1XIY MU OPEN Q OPEN SUPQ21 20K OPEN > FOR USE > T3-- RL: > > TO: XNN > > FC: 06MAR13SHA MU KMG480.00//XIY MU XNN200.00CNY680.00END > > FARE: CNY 680.00|FOP:CC > > TAX: CNY100.00CN|OI: > > TAX: CNY200.00YQ| > > TOTAL: CNY 980.00|TKTN: 881-888888888 > > Now I want to transfer this unstructure text to structure object fot > query by field.For exmple, > select \* from TKT where TKT.ORG=SHA > > TKT database may have TB data. > I use oracle to do this . But performance is poor. Also I try some object > DB like Versant.But performane is sitll poor. > Can elasticsearch hold this query with good performance(Query can return > result in 2-3 second) -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [May 9, 2013, 6:01am UTC](https://discuss.elastic.co/t/big-unstructure-text-data-query-problem/11889/5 "2013-05-09T06:01:19Z")
See [http://elasticsearch.com/](http://elasticsearch.com/) -- David 😉 Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 9 mai 2013 à 05:06, jj [r7raul1984@gmail.com](mailto:r7raul1984@gmail.com) a écrit : Thank you～ Where is the ES China company?How to contact ? 在 2013年5月9日星期四UTC+8上午10时31分31秒，David Pilato写道： > IMHO you should think of building a JSon doc from your text files using an ETL tool or your own code. > Then you will be able to query it easily (and build facets on top of it BTW) and very fast. > > My 2 cents. > > -- > David 😉 > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 9 mai 2013 à 02:57, jj [r7rau...@gmail.com](mailto:r7rau...@gmail.com) a écrit : > > Hello,I have a file system.Many unstructure text store in it .For example , > ISSUED BY: CHINA EASTERN AIRLINES ORG/DST: SHA/XNN ARL-D > E/R: > TOUR CODE: > PASSENGER: NONAME > EXCH: CONJ TKT: 881-88888888/14 > O FM:1XIY MU OPEN Q OPEN SUPQ21 20K OPEN FOR USE > T3-- RL: > TO: XNN > FC: 06MAR13SHA MU KMG480.00//XIY MU XNN200.00CNY680.00END > FARE: CNY 680.00|FOP:CC > TAX: CNY100.00CN|OI: > TAX: CNY200.00YQ| > TOTAL: CNY 980.00|TKTN: 881-888888888 > > Now I want to transfer this unstructure text to structure object fot query by field.For exmple, > select \* from TKT where TKT.ORG=SHA > > ## TKT database may have TB data. I use oracle to do this . But performance is poor. Also I try some object DB like Versant.But performane is sitll poor. Can elasticsearch hold this query with good performance(Query can return result in 2-3 second) > > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > -- > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 2:37am UTC](https://discuss.elastic.co/t/big-unstructure-text-data-query-problem/11889/6 "2017-07-06T02:37:24Z")