Reliability Assurance Of Big Data In The Cloud

Book Description :

With the rapid growth of Cloud computing, the size of Cloud data is expanding at a dramatic speed. A huge amount of data is generated and processed by Cloud applications, putting a higher demand on cloud storage. While data reliability should already be a requirement, data in the Cloud needs to be stored in a highly cost-effective manner. This book focuses on the trade-off between data storage cost and data reliability assurance for big data in the Cloud. Throughout the whole Cloud data lifecycle, four major features are presented: first, a novel generic data reliability model for describing data reliability in the Cloud; second, a minimum replication calculation approach for meeting a given data reliability requirement to facilitate data creation; third, a novel cost-effective data reliability assurance mechanism for big data maintenance, which could dramatically reduce the storage space needed in the Cloud; fourth, a cost-effective strategy for facilitating data creation and recovery, which could significantly reduce the energy consumption during data transfer. Captures data reliability with variable disk rates and compares virtual to physical disks Offers methods for reducing cloud-based storage cost and energy consumption Presents a minimum replication benchmark for data reliability requirements to evaluate various replication-based data storage approaches

Book Description :

CLOUD COMPUTING SOLUTIONS The main purpose of this book is to include all the cloud-related technologies in a single platform, so that researchers, academicians, postgraduate students, and those in the industry can easily understand the cloud-based ecosystems. This book discusses the evolution of cloud computing through grid computing and cluster computing. It will help researchers and practitioners to understand grid and distributed computing cloud infrastructure, virtual machines, virtualization, live migration, scheduling techniques, auditing concept, security and privacy, business models, and case studies through the state-of-the-art cloud computing countermeasures. This book covers the spectrum of cloud computing-related technologies and the wide-ranging contents will differentiate this book from others. The topics treated in the book include: The evolution of cloud computing from grid computing, cluster computing, and distributed systems; Covers cloud computing and virtualization environments; Discusses live migration, database, auditing, and applications as part of the materials related to cloud computing; Provides concepts of cloud storage, cloud strategy planning, and management, cloud security, and privacy issues; Explains complex concepts clearly and covers information for advanced users and beginners. Audience The primary audience for the book includes IT, computer science specialists, researchers, graduate students, designers, experts, and engineers who are occupied with research.

Book Description :

With the immense amount of data that is now available online, security concerns have been an issue from the start, and have grown as new technologies are increasingly integrated in data collection, storage, and transmission. Online cyber threats, cyber terrorism, hacking, and other cybercrimes have begun to take advantage of this information that can be easily accessed if not properly handled. New privacy and security measures have been developed to address this cause for concern and have become an essential area of research within the past few years and into the foreseeable future. The ways in which data is secured and privatized should be discussed in terms of the technologies being used, the methods and models for security that have been developed, and the ways in which risks can be detected, analyzed, and mitigated. The Research Anthology on Privatizing and Securing Data reveals the latest tools and technologies for privatizing and securing data across different technologies and industries. It takes a deeper dive into both risk detection and mitigation, including an analysis of cybercrimes and cyber threats, along with a sharper focus on the technologies and methods being actively implemented and utilized to secure data online. Highlighted topics include information governance and privacy, cybersecurity, data protection, challenges in big data, security threats, and more. This book is essential for data analysts, cybersecurity professionals, data scientists, security analysts, IT specialists, practitioners, researchers, academicians, and students interested in the latest trends and technologies for privatizing and securing data.

Book Description :

This book demonstrates the use of a wide range of strategic engineering concepts, theories and applied case studies to improve the safety, security and sustainability of complex and large-scale engineering and computer systems. It first details the concepts of system design, life cycle, impact assessment and security to show how these ideas can be brought to bear on the modeling, analysis and design of information systems with a focused view on cloud-computing systems and big data analytics. This informative book is a valuable resource for graduate students, researchers and industry-based practitioners working in engineering, information and business systems as well as strategy.

Book Description :

In recent years, the fast-paced development of social information and networks has led to the explosive growth of data. A variety of big data have emerged, encouraging researchers to make business decisions by analysing this data. However, many challenges remain, especially concerning data security and privacy. Big data security and privacy threats permeate every link of the big data industry chain, such as data production, collection, processing, and sharing, and the causes of risk are complex and interwoven. Blockchain technology has been highly praised and recognised for its decentralised infrastructure, anonymity, security, and other characteristics, and it will change the way we access and share information. In this book, the author demonstrates how blockchain technology can overcome some limitations in big data technology and can promote the development of big data while also helping to overcome security and privacy challenges. The author investigates research into and the application of blockchain technology in the field of big data and assesses the attendant advantages and challenges while discussing the possible future directions of the convergence of blockchain and big data. After mastering concepts and technologies introduced in this work, readers will be able to understand the technical evolution, similarities, and differences between blockchain and big data technology, allowing them to further apply it in their development and research. Author: Shaoliang Peng is the Executive Director and Professor of the College of Computer Science and Electronic Engineering, National Supercomputing Centre of Hunan University, Changsha, China. His research interests are high-performance computing, bioinformatics, big data, AI, and blockchain.

Book Description :

System Assurances: Modeling and Management updates on system assurance and performance methods using advanced analytics and understanding of software reliability growth modeling from today’s debugging team’s point-of-view, along with information on preventive and predictive maintenance and the efficient use of testing resources. The book presents the rapidly growing application areas of systems and software modeling, including intelligent synthetic characters, human-machine interface, menu generators, user acceptance analysis, picture archiving and software systems. Students, research scholars, academicians, scientists and industry practitioners will benefit from the book as it provides better insights into modern related global trends, issues and practices. Provides software reliability modeling, simulation and optimization Offers methodologies, tools and practical applications of reliability modeling and resources allocation Presents cost modeling and optimization associated with complex systems

Book Description :

This book constitutes the refereed proceedings of the 12th International Conference on Economics of Grids, Clouds, Systems, and Services, GECON 2015, held in Cluj-Napoca, Romania, in September 2015. The 11 revised full papers and 10 paper-in-progress presented were carefully reviewed and selected from 38 submissions. The presentation sessions that have been set up are: resource allocation, service selection in clouds, energy conservation and smart grids, applications: tools and protocols, community networks and legal and socio-economic aspects.

Book Description :

AI Assurance: Towards Trustworthy, Explainable, Safe, and Ethical AI provides readers with solutions and a foundational understanding of the methods that can be applied to test AI systems and provide assurance. Anyone developing software systems with intelligence, building learning algorithms, or deploying AI to a domain-specific problem (such as allocating cyber breaches, analyzing causation at a smart farm, reducing readmissions at a hospital, ensuring soldiers’ safety in the battlefield, or predicting exports of one country to another) will benefit from the methods presented in this book. As AI assurance is now a major piece in AI and engineering research, this book will serve as a guide for researchers, scientists and students in their studies and experimentation. Moreover, as AI is being increasingly discussed and utilized at government and policymaking venues, the assurance of AI systems—as presented in this book—is at the nexus of such debates. Provides readers with an in-depth understanding of how to develop and apply Artificial Intelligence in a valid, explainable, fair and ethical manner Includes various AI methods, including Deep Learning, Machine Learning, Reinforcement Learning, Computer Vision, Agent-Based Systems, Natural Language Processing, Text Mining, Predictive Analytics, Prescriptive Analytics, Knowledge-Based Systems, and Evolutionary Algorithms Presents techniques for efficient and secure development of intelligent systems in a variety of domains, such as healthcare, cybersecurity, government, energy, education, and more Covers complete example datasets that are associated with the methods and algorithms developed in the book

Book Description :

This proceeding features papers discussing big data innovation for sustainable cognitive computing. The papers feature details on cognitive computing and its self-learning systems that use data mining, pattern recognition and natural language processing (NLP) to mirror the way the human brain works. This international conference focuses on cognitive computing technologies, from knowledge representation techniques and natural language processing algorithms to dynamic learning approaches. Topics covered include Data Science for Cognitive Analysis, Real-Time Ubiquitous Data Science, Platform for Privacy Preserving Data Science, and Internet-Based Cognitive Platform. The 2nd EAI International Conference on Big Data Innovation for Sustainable Cognitive Computing (BDCC 2019) took place in Coimbatore, India on December 12-13, 2019. Contains proceedings from 2nd EAI International Conference on Big Data Innovation for Sustainable Cognitive Computing (BDCC 2019), Coimbatore, India, December 12-13, 2019; Features topics ranging from Data Science for Cognitive Analysis to Internet-Based Cognitive Platforms; Includes contributions from researchers, academics, and professionals from around the world.

Book Description :

This book constitutes the refereed conference proceedings of the 5th EAI International Conference on Emerging Technologies in Computing, iCETiC 2022, held in Chester, UK, August 15-16, 2022. The 16 full papers included in this book were carefully reviewed and selected from 54 submissions. They were organized in topical sections as follows: Cloud, IoT and Distributed Computing; and AI, Expert Systems and Big Data Analytics.

Book Description :

Smart Data: State-of-the-Art Perspectives in Computing and Applications explores smart data computing techniques to provide intelligent decision making and prediction services support for business, science, and engineering. It also examines the latest research trends in fields related to smart data computing and applications, including new computing theories, data mining and machine learning techniques. The book features contributions from leading experts and covers cutting-edge topics such as smart data and cloud computing, AI for networking, smart data deep learning, Big Data capture and representation, AI for Big Data applications, and more. Features Presents state-of-the-art research in big data and smart computing Provides a broad coverage of topics in data science and machine learning Combines computing methods with domain knowledge and a focus on applications in science, engineering, and business Covers data security and privacy, including AI techniques Includes contributions from leading researchers

Book Description :

This book focuses on the development and implementation of cloud-based, complex software that allows parallelism, fast processing, and real-time connectivity. Software engineering (SE) is the design, development, testing, and implementation of software applications, and this discipline is as well developed as the practice is well established whereas the Cloud Software Engineering (CSE) is the design, development, testing, and continuous delivery of service-oriented software systems and applications (Software as a Service Paradigm). However, with the emergence of the highly attractive cloud computing (CC) paradigm, the tools and techniques for SE are changing. CC provides the latest software development environments and the necessary platforms relatively easily and inexpensively. It also allows the provision of software applications equally easily and on a pay-as-you-go basis. Business requirements for the use of software are also changing and there is a need for applications in big data analytics, parallel computing, AI, natural language processing, and biometrics, etc. These require huge amounts of computing power and sophisticated data management mechanisms, as well as device connectivity for Internet of Things (IoT) environments. In terms of hardware, software, communication, and storage, CC is highly attractive for developing complex software that is rapidly becoming essential for all sectors of life, including commerce, health, education, and transportation. The book fills a gap in the SE literature by providing scientific contributions from researchers and practitioners, focusing on frameworks, methodologies, applications, benefits and inherent challenges/barriers to engineering software using the CC paradigm.

Book Description :

This book unravels the mystery of Big Data computing and its power to transform business operations. The approach it uses will be helpful to any professional who must present a case for realizing Big Data computing solutions or to those who could be involved in a Big Data computing project. It provides a framework that enables business and technical managers to make optimal decisions necessary for the successful migration to Big Data computing environments and applications within their organizations.

Book Description :

Large Scale and Big Data: Processing and Management provides readers with a central source of reference on the data management techniques currently available for large-scale data processing. Presenting chapters written by leading researchers, academics, and practitioners, it addresses the fundamental challenges associated with Big Data processing t

Book Description :

The digital age has presented an exponential growth in the amount of data available to individuals looking to draw conclusions based on given or collected information across industries. Challenges associated with the analysis, security, sharing, storage, and visualization of large and complex data sets continue to plague data scientists and analysts alike as traditional data processing applications struggle to adequately manage big data. The Handbook of Research on Big Data Storage and Visualization Techniques is a critical scholarly resource that explores big data analytics and technologies and their role in developing a broad understanding of issues pertaining to the use of big data in multidisciplinary fields. Featuring coverage on a broad range of topics, such as architecture patterns, programing systems, and computational energy, this publication is geared towards professionals, researchers, and students seeking current research and application topics on the subject.

Book Description :

Explores key challenges and solutions to assured cloud computing today and provides a provocative look at the face of cloud computing tomorrow This book offers readers a comprehensive suite of solutions for resolving many of the key challenges to achieving high levels of assurance in cloud computing. The distillation of critical research findings generated by the Assured Cloud Computing Center of Excellence (ACC-UCoE) of the University of Illinois, Urbana-Champaign, it provides unique insights into the current and future shape of robust, dependable, and secure cloud-based computing and data cyberinfrastructures. A survivable and distributed cloud-computing-based infrastructure can enable the configuration of any dynamic systems-of-systems that contain both trusted and partially trusted resources and services sourced from multiple organizations. To assure mission-critical computations and workflows that rely on such systems-of-systems it is necessary to ensure that a given configuration does not violate any security or reliability requirements. Furthermore, it is necessary to model the trustworthiness of a workflow or computation fulfillment to a high level of assurance. In presenting the substance of the work done by the ACC-UCoE, this book provides a vision for assured cloud computing illustrating how individual research contributions relate to each other and to the big picture of assured cloud computing. In addition, the book: Explores dominant themes in cloud-based systems, including design correctness, support for big data and analytics, monitoring and detection, network considerations, and performance Synthesizes heavily cited earlier work on topics such as DARE, trust mechanisms, and elastic graphs, as well as newer research findings on topics, including R-Storm, and RAMP transactions Addresses assured cloud computing concerns such as game theory, stream processing, storage, algorithms, workflow, scheduling, access control, formal analysis of safety, and streaming Bringing together the freshest thinking and applications in one of today’s most important topics, Assured Cloud Computing is a must-read for researchers and professionals in the fields of computer science and engineering, especially those working within industrial, military, and governmental contexts. It is also a valuable reference for advanced students of computer science.

Book Description :

Create, deploy, and manage applications at scale using SRE principles Key FeaturesBuild and run highly available, scalable, and secure softwareExplore abstract SRE in a simplified and streamlined wayEnhance the reliability of cloud environments through SRE enhancementsBook Description Site reliability engineering (SRE) is being touted as the most competent paradigm in establishing and ensuring next-generation high-quality software solutions. This book starts by introducing you to the SRE paradigm and covers the need for highly reliable IT platforms and infrastructures. As you make your way through the next set of chapters, you will learn to develop microservices using Spring Boot and make use of RESTful frameworks. You will also learn about GitHub for deployment, containerization, and Docker containers. Practical Site Reliability Engineering teaches you to set up and sustain containerized cloud environments, and also covers architectural and design patterns and reliability implementation techniques such as reactive programming, and languages such as Ballerina and Rust. In the concluding chapters, you will get well-versed with service mesh solutions such as Istio and Linkerd, and understand service resilience test practices, API gateways, and edge/fog computing. By the end of this book, you will have gained experience on working with SRE concepts and be able to deliver highly reliable apps and services. What you will learnUnderstand how to achieve your SRE goalsGrasp Docker-enabled containerization conceptsLeverage enterprise DevOps capabilities and Microservices architecture (MSA)Get to grips with the service mesh concept and frameworks such as Istio and LinkerdDiscover best practices for performance and resiliencyFollow software reliability prediction approaches and enable patternsUnderstand Kubernetes for container and cloud orchestrationExplore the end-to-end software engineering process for the containerized worldWho this book is for Practical Site Reliability Engineering helps software developers, IT professionals, DevOps engineers, performance specialists, and system engineers understand how the emerging domain of SRE comes handy in automating and accelerating the process of designing, developing, debugging, and deploying highly reliable applications and services.

Book Description :

This book presents conjectural advances in big data analysis, machine learning and computational intelligence, as well as their potential applications in scientific computing. It discusses major issues pertaining to big data analysis using computational intelligence techniques, and the conjectural elements are supported by simulation and modelling applications to help address real-world problems. An extensive bibliography is provided at the end of each chapter. Further, the main content is supplemented by a wealth of figures, graphs, and tables, offering a valuable guide for researchers in the field of big data analytics and computational intelligence.

Book Description :

Applications of Big Data in Healthcare: Theory and Practice begins with the basics of Big Data analysis and introduces the tools, processes and procedures associated with Big Data analytics. The book unites healthcare with Big Data analysis and uses the advantages of the latter to solve the problems faced by the former. The authors present the challenges faced by the healthcare industry, including capturing, storing, searching, sharing and analyzing data. This book illustrates the challenges in the applications of Big Data and suggests ways to overcome them, with a primary emphasis on data repositories, challenges, and concepts for data scientists, engineers and clinicians. The applications of Big Data have grown tremendously within the past few years and its growth can not only be attributed to its competence to handle large data streams but also to its abilities to find insights from complex, noisy, heterogeneous, longitudinal and voluminous data. The main objectives of Big Data in the healthcare sector is to come up with ways to provide personalized healthcare to patients by taking into account the enormous amounts of already existing data. Provides case studies that illustrate the business processes underlying the use of big data and deep learning health analytics to improve health care delivery Supplies readers with a foundation for further specialized study in clinical analysis and data management Includes links to websites, videos, articles and other online content to expand and support the primary learning objectives for each major section of the book

Book Description :

This timely text/reference reviews the state of the art of big data analytics, with a particular focus on practical applications. An authoritative selection of leading international researchers present detailed analyses of existing trends for storing and analyzing big data, together with valuable insights into the challenges inherent in current approaches and systems. This is further supported by real-world examples drawn from a broad range of application areas, including healthcare, education, and disaster management. The text also covers, typically from an application-oriented perspective, advances in data science in such areas as big data collection, searching, analysis, and knowledge discovery. Topics and features: Discusses a model for data traffic aggregation in 5G cellular networks, and a novel scheme for resource allocation in 5G networks with network slicing Explores methods that use big data in the assessment of flood risks, and apply neural networks techniques to monitor the safety of nuclear power plants Describes a system which leverages big data analytics and the Internet of Things in the application of drones to aid victims in disaster scenarios Proposes a novel deep learning-based health data analytics application for sleep apnea detection, and a novel pathway for diagnostic models of headache disorders Reviews techniques for educational data mining and learning analytics, and introduces a scalable MapReduce graph partitioning approach for high degree vertices Presents a multivariate and dynamic data representation model for the visualization of healthcare data, and big data analytics methods for software reliability assessment This practically-focused volume is an invaluable resource for all researchers, academics, data scientists and business professionals involved in the planning, designing, and implementation of big data analytics projects. Dr. Mohammed M. Alani is an Associate Professor in Computer Engineering and currently is the Provost at Al Khawarizmi International College, Abu Dhabi, UAE. Dr. Hissam Tawfik is a Professor of Computer Science in the School of Computing, Creative Technologies & Engineering at Leeds Beckett University, UK. Dr. Mohammed Saeed is a Professor in Computing and currently is the Vice President for Academic Affairs and Research at the University of Modern Sciences, Dubai, UAE. Dr. Obinna Anya is a Research Staff Member at IBM Research – Almaden, San Jose, CA, USA.