# Automatically generate search patterns **URL:** \ **Category:** Elasticsearch\ **Created:** [August 26, 2012, 5:33pm UTC](https://discuss.elastic.co/t/automatically-generate-search-patterns/8852 "2012-08-26T17:33:11Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![shawn\_wilson](https://avatars.discourse-cdn.com/v4/letter/s/f07891/32.png) [@shawn\_wilson](https://discuss.elastic.co/u/shawn_wilson)\ **Post date:** [August 26, 2012, 5:33pm UTC](https://discuss.elastic.co/t/automatically-generate-search-patterns/8852/1 "2012-08-26T17:33:11Z")
for over two years, data from a web site was mined by hand. i created a scraper to do it and can search pretty well. however, since i have so much historical data about what i'm interested in, is there anything i can use to generate what search should find data like it? in the reports generated by hand, they put the url the data was grabbed from, so i can use that field to refer to data i want. i'm thinking that fully automating this might be impossible (or more time consuming than figuring out good searches on my own), so maybe some hints as to how i might use the analytics to look into this more might help? -- ---
**Author:** ![otisg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/otisg/32/492_2.png) [@otisg](https://discuss.elastic.co/u/otisg)\ **Post date:** [August 26, 2012, 8:44pm UTC](https://discuss.elastic.co/t/automatically-generate-search-patterns/8852/2 "2012-08-26T20:44:13Z")
Hi Shawn, I don't follow 100% what you are after. Are you after a search analytics tool? If so, see [Cloud Monitoring Tools & Services | Sematext](http://sematext.com/search-analytics/index.html) . If not, please clarify. Otis On Sunday, August 26, 2012 1:33:11 PM UTC-4, shawn wilson wrote: > for over two years, data from a web site was mined by hand. i created > a scraper to do it and can search pretty well. however, since i have > so much historical data about what i'm interested in, is there > anything i can use to generate what search should find data like it? > in the reports generated by hand, they put the url the data was > grabbed from, so i can use that field to refer to data i want. > > i'm thinking that fully automating this might be impossible (or more > time consuming than figuring out good searches on my own), so maybe > some hints as to how i might use the analytics to look into this more > might help? -- ---
**Author:** ![shawn\_wilson](https://avatars.discourse-cdn.com/v4/letter/s/f07891/32.png) [@shawn\_wilson](https://discuss.elastic.co/u/shawn_wilson)\ **Post date:** [August 31, 2012, 7:10pm UTC](https://discuss.elastic.co/t/automatically-generate-search-patterns/8852/3 "2012-08-31T19:10:57Z")
i guess the question is simply, how to predict searches based on a history? or maybe it's a question of doing ai with elasticsearch? i'm not sure. i just know i've got tons of historical data and i figure it would be a decent idea to see if i could use this data to generate searches instead of doing it myself. since this data was generated with a human, i'm guessing there will have to be some fudge factor built in if i can do this. i guess, what i want is a netflix recommendation like solution - i've looked at certain things in the past, i'm likely to like certain things. if someone could explain to me (or reference) what the theory is behind this process, that might help. On Sunday, August 26, 2012 4:44:13 PM UTC-4, Otis Gospodnetic wrote: > Hi Shawn, > > I don't follow 100% what you are after. Are you after a search analytics > tool? If so, see [Cloud Monitoring Tools & Services | Sematext](http://sematext.com/search-analytics/index.html) . If > not, please clarify. > > Otis > > On Sunday, August 26, 2012 1:33:11 PM UTC-4, shawn wilson wrote: > > > for over two years, data from a web site was mined by hand. i created > > a scraper to do it and can search pretty well. however, since i have > > so much historical data about what i'm interested in, is there > > anything i can use to generate what search should find data like it? > > in the reports generated by hand, they put the url the data was > > grabbed from, so i can use that field to refer to data i want. > > > > i'm thinking that fully automating this might be impossible (or more > > time consuming than figuring out good searches on my own), so maybe > > some hints as to how i might use the analytics to look into this more > > might help? -- ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 3:14am UTC](https://discuss.elastic.co/t/automatically-generate-search-patterns/8852/4 "2017-07-06T03:14:22Z")
Closed on July 6, 2017, 3:14am UTC