MARATTO

article

An Optimal Method for Testing Jobs' Execution in MapReduce Based Systems

Abstract

Over the past few years, parallel and distributed processing using the MapReduce programming paradigm has gained considerable attention. The purpose of such a model is to ease parallel computing and concurrent processing of large data stored on the Hadoop platform. However, MapReduce may experience performance and timing problems while using more complex and time-consuming data processing jobs. This paper focuses on improving MapReduce's performance. As a first step, we propose optimizing MapReduce jobs. The system conformance is then tested using a distributed test application. Finally, the test process is optimized using the Markov Decision Process.

Research topics

  • Cloud Computing and Resource Management
  • IoT and Edge/Fog Computing
  • Blockchain Technology Applications and Security

Read the original research

This page summarises published work. The authoritative version sits with the publisher.

DOI: 10.1109/codit58514.2023.10284294

Is something wrong with this record? Report it or request removal.

Discussion

Discuss this research

Have you built on this work, tried to replicate it, or seen it applied in practice? Share what you know. Verified researchers and MARATTO™ domain experts can open a discussion, and any member can reply. Contributions are reviewed before they appear.

No discussion yet. Open the first thread.