MyPage is a personalized page based on your interests.The page is customized to help you to find content that matters you the most.


I'm not curious

esProc Helps with Computation in MongoDB ΓΆ€“ Cross Summarizing

Published on 18 December 14
344
0
0

It is difficult for MongoDB to realize the operation of cross summarizing. It is also quite complicated to realize it using high-level languages, like Java, after the desired data is retrieved out. In this case, you can consider using esProc to help MongoDB realize the operation. The following example will teach you how it works in detail.

A collection â student â is given in the following:

db.student.insert ( {school:'school1', sname : 'Sean' , sub1: 4, sub2 :5 })

db.student.insert ( {school:'school1', sname : 'chris' , sub1: 4, sub2 :3 })

db.student.insert ( {school:'school1', sname : 'becky' , sub1: 5, sub2 :4 })

db.student.insert ( {school:'school1', sname : 'sam' , sub1: 5, sub2 :4 })

db.student.insert ( {school:'school2', sname : 'dustin' , sub1: 2, sub2 :2 })

db.student.insert ( {school:'school2', sname : 'greg' , sub1: 3, sub2 :4 })

db.student.insert ( {school:'school2', sname : 'peter' , sub1: 5, sub2 :1 })

db.student.insert ( {school:'school2', sname : 'brad' , sub1: 2, sub2 :2 })

db.student.insert ( {school:'school2', sname : 'liz' , sub1: 3, sub2 :null })

We are expected to produce a cross table as the one in the following, in which each row is a school and the first column holds students whose results of sub1 are a 5 and the second column holds those whose results of sub1 are a 4 and so forth.
esProc Helps with Computation in MongoDB â Cross Summarizing - Image 1
esProc script:
esProc Helps with Computation in MongoDB â Cross Summarizing - Image 2

A1: Connect to MongoDB. Both IP and the port number are localhost:27017. The database name, user name and the password all are test.

A2: Use find function to fetch the collection â student - from MongoDB and create a cursor. Here esProc uses the same parameter format in find function as that in find statement of MongoDB. As esProcâs cursor supports fetching and processing data in batches, the memory overflow caused by importing big data all at once can thus be avoided. In this case, the data can be fetched altogether using fetch function because the size is not big.

A3ï¼Group the data by schools.

A4ï¼Then group each group of data in alignment according to the sequence [1,2,3,4,5] and compute the length of each subgroup.

A5ï¼Put the lengths got in A4 into corresponding positions as required and a record sequence wil be generated as the result.

The result is as follows:
esProc Helps with Computation in MongoDB â Cross Summarizing - Image 3

Noteï¼esProc isnât equipped with a Java driver included in MongoDB. So to access MongoDB using esProc, you must put MongoDBâs Java driver (a version of 2.12.2 or above is required for esProc, e.g. mongo-java-driver-2.12.2.jar) into [esProc installation directory]\common\jdbc beforehand.

The esProc script used to help MongoDB with the computation is easy to be integrated into the Java program. You just need to add another line of code - result A6 to output a result in the form of resultset to Java program. For the detailed code, please refer to esProc Tutorial. In the same way, MongoDBâs Java driver must be put into the classpath of a Java program before the latter accesses MongoDB by calling an esProc program.
It is difficult for MongoDB to realize the operation of cross summarizing. It is also quite complicated to realize it using high-level languages, like Java, after the desired data is retrieved out. In this case, you can consider using esProc to help MongoDB realize the operation. The following example will teach you how it works in detail.

A collection â student â is given in the following:

db.student.insert ( {school:'school1', sname : 'Sean' , sub1: 4, sub2 :5 })

db.student.insert ( {school:'school1', sname : 'chris' , sub1: 4, sub2 :3 })

db.student.insert ( {school:'school1', sname : 'becky' , sub1: 5, sub2 :4 })

db.student.insert ( {school:'school1', sname : 'sam' , sub1: 5, sub2 :4 })

db.student.insert ( {school:'school2', sname : 'dustin' , sub1: 2, sub2 :2 })

db.student.insert ( {school:'school2', sname : 'greg' , sub1: 3, sub2 :4 })

db.student.insert ( {school:'school2', sname : 'peter' , sub1: 5, sub2 :1 })

db.student.insert ( {school:'school2', sname : 'brad' , sub1: 2, sub2 :2 })

db.student.insert ( {school:'school2', sname : 'liz' , sub1: 3, sub2 :null })

We are expected to produce a cross table as the one in the following, in which each row is a school and the first column holds students whose results of sub1 are a 5 and the second column holds those whose results of sub1 are a 4 and so forth.

esProc Helps with Computation in MongoDB â

esProc script:

esProc Helps with Computation in MongoDB â

A1: Connect to MongoDB. Both IP and the port number are localhost:27017. The database name, user name and the password all are test.

A2: Use find function to fetch the collection â student - from MongoDB and create a cursor. Here esProc uses the same parameter format in find function as that in find statement of MongoDB. As esProcâs cursor supports fetching and processing data in batches, the memory overflow caused by importing big data all at once can thus be avoided. In this case, the data can be fetched altogether using fetch function because the size is not big.

A3ï¼Group the data by schools.

A4ï¼Then group each group of data in alignment according to the sequence [1,2,3,4,5] and compute the length of each subgroup.

A5ï¼Put the lengths got in A4 into corresponding positions as required and a record sequence wil be generated as the result.

The result is as follows:

esProc Helps with Computation in MongoDB â

Noteï¼esProc isnât equipped with a Java driver included in MongoDB. So to access MongoDB using esProc, you must put MongoDBâs Java driver (a version of 2.12.2 or above is required for esProc, e.g. mongo-java-driver-2.12.2.jar) into [esProc installation directory]\common\jdbc beforehand.

The esProc script used to help MongoDB with the computation is easy to be integrated into the Java program. You just need to add another line of code - result A6 to output a result in the form of resultset to Java program. For the detailed code, please refer to esProc Tutorial. In the same way, MongoDBâs Java driver must be put into the classpath of a Java program before the latter accesses MongoDB by calling an esProc program.

This blog is listed under Open Source , Development & Implementations and Data & Information Management Community

Related Posts:
Post a Comment

Please notify me the replies via email.

Important:
  • We hope the conversations that take place on MyTechLogy.com will be constructive and thought-provoking.
  • To ensure the quality of the discussion, our moderators may review/edit the comments for clarity and relevance.
  • Comments that are promotional, mean-spirited, or off-topic may be deleted per the moderators' judgment.
You may also be interested in
Awards & Accolades for MyTechLogy
Winner of
REDHERRING
Top 100 Asia
Finalist at SiTF Awards 2014 under the category Best Social & Community Product
Finalist at HR Vendor of the Year 2015 Awards under the category Best Learning Management System
Finalist at HR Vendor of the Year 2015 Awards under the category Best Talent Management Software
Hidden Image Url

Back to Top