Parallel distributed system for social networks streaming data analysis

А.Yu. Doroshenko, D.S. Titov

Abstract


A comparison of the effectiveness of remote procedure call technology (RMI) and the framework for distributed computing (Hazelcast), as a means for the development of the cluster system, is performed. The parallel distributed dynamically scalable faulttolerant system for processing large amount of streaming data is proposed. The inspection and initial study of this system on the example of data from the Twitter social network is performed. The mechanism of the deployment of the created cluster to the cloud platform is examined.

Keywords


network; analysis; fault-tolerance; scaling; cluster

References


Brandwatch Social Listening in Practice. Market Research [Online] Available from: https://www.brandwatch.com/guide-market-research/ [Accessed: 26 September 2015].

Brandwatch Social Listening in Practice. Social customer service [Online] Available from: https://www.brandwatch.com/customer-service-guide/ [Accessed: 26 September 2015].

Titov D.S. & Doroshenko A.Yu. Social networks monitoring in real-time systems. In Scientific discussion: theory, practice, innovation. Kyiv, Wednesday 27th to Thursday 28th March 2015. – Kyiv: IOMP. – P. 93–96 (in Ukrainian).

Intel Intel Core i7-3770k Processor [Online] Available from: http://ark.intel.com/products/65523 [Accessed: 26 September 2015].

Charlie Munger HFT is Legalized Front-Running [Online] Available from: http://blogs.barrons.com/stockstowatchtoday/ 2013/05/03/charlie-munger-hft-is-legalizedfront-running/ [Accessed: 26 September 2015].

Oracle Remote Method Invocation Home [Online] Available from:

http://www.oracle.com/technetwork/java/javase/tech/index-jsp 136424.html [Accessed: 26 September 2015]

Hazelcast Hazelcast [Online] Available from: https://hazelcast.org/ [Accesed: 26 September 2015].

Twitter Public streams [Online] Available from: https://dev.twitter.com/streaming/public [Accessed: 26 September 2015]

Spring Spring Social [Online] Available from: http://projects.spring.io/spring-social/ [Accesed: 26 September 2015].

Amazon Amazon EC2 [Online] Available from: https://aws.amazon.com/ec2/[Accessed: 26 September 2015].

Amazon Amazon EC2 Instances [Online] Available from: http://aws.amazon.com/ec2/instance-types/ [Accessed: 26 September 2015].


Refbacks

  • There are currently no refbacks.