{"id":4761,"date":"2016-06-14T10:23:53","date_gmt":"2016-06-14T15:23:53","guid":{"rendered":"https:\/\/www.poweradmin.com\/blog\/?p=4761"},"modified":"2016-06-20T22:50:18","modified_gmt":"2016-06-21T03:50:18","slug":"machine-learning-and-infrastructure-analytics-part-1-principles-and-practices","status":"publish","type":"post","link":"https:\/\/www.poweradmin.com\/blog\/machine-learning-and-infrastructure-analytics-part-1-principles-and-practices\/","title":{"rendered":"Machine Learning and Infrastructure Analytics, Part 1: Principles and Practices"},"content":{"rendered":"

\"machinelearning1_popcorn\"<\/a><\/p>\n

Occasionally, parallel strands of technological development come together to yield unanticipated benefits in areas for which the technology was not specifically designed. Think of advances in the textile industry, during the Industrial Revolution. Or the genius of microwave popcorn.<\/span><\/p>\n

\u00a0<\/p>\n

In this first of a two-part report, we\u2019ll be looking at how the development of self-educating algorithms is combining with the emergence of cloud technology as the new medium for data storage and application delivery, to make it possible for network infrastructures to essentially manage themselves, in the near future.<\/span><\/p>\n

Managing Big Data<\/b><\/span><\/h2>\n

We\u2019ve heard a lot in the industry press and the general media, about Big Data: the humongous volumes of structured and largely unstructured information gathered through corporate networks, purchasing chains, biometric recordings, time-tracking and location data, online activities, and any number of other sources with which people interact.<\/span><\/p>\n

\u00a0<\/p>\n

Gathering information is only part of the picture. As Business Intelligence (BI) analysts have come to realise, it\u2019s necessary to perform complex, continuous, and in some cases counter-intuitive analytical processes on Big Data, in order to extract valuable insights from it. And to meet this challenge, conventional software tools and human intelligence simply aren\u2019t enough.<\/span><\/p>\n

Not Managing Big Hardware<\/b><\/span><\/h2>\n

What\u2019s emerged as standard wisdom is that Big Data requires Big Compute<\/a>: processing power that\u2019s of a comparably large scale \u2013 and often distributed \u2013 to cope with the sheer volumes of information and analytical operations.<\/span><\/p>\n

\u00a0<\/p>\n

The industry standard Hadoop analytics platform goes some way towards easing this burden. Its trademark stacks and MapReduce allow data analysis to be spread<\/a> over a large array of cheap generic servers, in a batch-oriented system that reduces some of the donkey work, but doesn\u2019t do so well with real-time functions such as stream processing, interactive applications, or more complex analyses.<\/span><\/p>\n

\u00a0<\/p>\n

At this point, the Cloud comes into the picture, to assist in coping with the scale of what\u2019s involved. Cloud-based infrastructures have emerged, with remotely hosted banks of servers, computational resources and software for data storage and analysis \u2013 with the multiplication factor allowing for the processing power needed to accommodate the multiplying number of data sources.<\/span><\/p>\n

\"machinelearning1_world\"<\/a>Adding IoT to the Mix<\/b><\/span><\/h2>\n

And with the emergence of the Internet of Things or IoT, those data sources just keep coming. Performance-tracking wearables, smart household appliances, communicative self-driving vehicles, consumables that can tell you what they contain, and where they are \u2013 the pool of potentially insightful data is set to grow, rather than diminish. Some figures suggest that the equivalent of the entire Google search engine\u2019s worth of data is being created every four days.<\/span><\/p>\n

\u00a0<\/p>\n

And the analytical tools required to extract value from it will need to step up their game, and become just as smart as the data sources that they\u2019re analysing \u2013 or hopefully smarter.<\/span><\/p>\n

A Dose of Intelligence<\/b><\/span><\/h2>\n

The evolving landscape of smart and responsive devices and technologies demands analytical processes and tools that lend themselves to observations and reactions at the human scale. Data analytics engines will need to be in memory, and in parallel with the data pools that they\u2019re addressing. And analytics systems will have to perform iterations on a continuous basis, and be adaptive and responsive to change, themselves.<\/span><\/p>\n

\u00a0<\/p>\n

In essence, the new breed of analytics tools will need to be capable of learning.<\/span><\/p>\n

Learning Machines<\/b><\/span><\/h2>\n

Machine learning is a term widely used in computer science and other disciplines, describing a process whereby low-level algorithms are employed to uncover patterns implicit within pools of data. It\u2019s analogous to the process that occurs in human thought, where we learn from our life experiences, rather than from specific sets of lessons or instructions.<\/span><\/p>\n

\u00a0<\/p>\n

Information is fed into the system as classifiers, which are represented in some form of language that the computer can understand. Objective or scoring functions<\/a> are applied to these classifiers, to evaluate them as good or bad. Then optimisation techniques are applied to the results, to isolate the highest scoring functions. These may then be carried forward as the basis of further decision-making action, on the part of the system.<\/span><\/p>\n

\u00a0<\/p>\n

It\u2019s machines (systems and software), learning by inference or implication; the machine learning algorithms uncover the best ways to perform complex tasks by generalising from a learned database of examples. Generally speaking, the more data (examples) you have available, the bigger the range of complex tasks that may be performed. So, Big Data working in tandem with Machine Learning may provide analytics with a huge array of tools and techniques.<\/span><\/p>\n

\u00a0<\/p>\n

At the heart of a machine learning process is the system\u2019s ability to make generalisations that go beyond the data in its initial training set. Though having a lot of data available helps, it\u2019s not the crucial factor to a system\u2019s performance. Rather, it is the range of features available to the system as a whole \u2013 and the way these features interact \u2013 that has the greatest impact on its ability to learn.<\/span><\/p>\n

\"machinelearning1_internet\"<\/a>Looking Ahead<\/b><\/span><\/h2>\n

With their ability to adapt to changing conditions, and to respond to activities at the human scale (some in real time), learning machines are well placed to become the basis for analytics tools that can predict the logical outcome of certain sequences of observations and events, from their exploration, visualisation, modelling, querying, and retesting of the data to which they\u2019re exposed.<\/span><\/p>\n

\u00a0<\/p>\n

This predictive analysis may not only extrapolate future outcomes from current information, but also uncover hidden issues or outcomes which may be inferred from known data sources.<\/span><\/p>\n

\u00a0<\/p>\n

It\u2019s this predictive element that has great potential in the management of complex systems such as network infrastructures. And it\u2019s infrastructure analytics using machine intelligence that will be the focus of the concluding part of this report.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

Occasionally, parallel strands of technological development come together to yield unanticipated benefits in areas for which the technology was not specifically designed. Think of advances in the textile industry, during the Industrial Revolution. Or the genius of microwave popcorn. \u00a0 In this first of a two-part report, we\u2019ll be looking at how the development of […]<\/p>\n","protected":false},"author":10,"featured_media":4769,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-4761","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-general-it"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/posts\/4761","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/users\/10"}],"replies":[{"embeddable":true,"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/comments?post=4761"}],"version-history":[{"count":5,"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/posts\/4761\/revisions"}],"predecessor-version":[{"id":4773,"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/posts\/4761\/revisions\/4773"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/media\/4769"}],"wp:attachment":[{"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/media?parent=4761"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/categories?post=4761"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/tags?post=4761"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}