{"id":6993,"date":"2020-07-08T10:07:45","date_gmt":"2020-07-08T15:07:45","guid":{"rendered":"https:\/\/www.poweradmin.com\/blog\/?p=6993"},"modified":"2020-06-17T16:16:33","modified_gmt":"2020-06-17T21:16:33","slug":"monitoring-101-collecting-the-right-data","status":"publish","type":"post","link":"https:\/\/www.poweradmin.com\/blog\/monitoring-101-collecting-the-right-data\/","title":{"rendered":"Monitoring 101: Collecting the Right Data"},"content":{"rendered":"<p>When it comes to business, data is everything. Whether it\u2019s sales, supply, marketing, or your I.T. systems, every day is a constant stream of decisions to be made. To make the right decisions, you need enough knowledge. To have enough knowledge, you need the right data.<\/p>\n<p>What\u2019s the best way to collect all this data? In the information age, there\u2019s so much data out there, all the time. It can be hard to know what you should be looking for and what monitoring and alerting strategy to employ so that you\u2019re getting data that\u2019s actually useful.<\/p>\n<p>In this guide to monitoring data, we\u2019ll walk you through the five basic questions you need to ask\u2014why, what, when, where, and how\u2014that will drive real business insights, intelligent decision making, and rapid disaster response.<\/p>\n<h2><strong>Why Monitor Your Data?<\/strong><\/h2>\n<p>As mentioned above, data drives smart decision making. If you want to know how your network, or supply chain, or sales team is doing\u2014and be able to act accordingly\u2014you\u2019ll need adequate information in the first place. Monitoring data means that you\u2019re collecting data so it\u2019s ready for a decision. It means that when you need to make a decision, you don\u2019t have to scramble to find the right data. You already have it on hand!<\/p>\n<p><a href=\"https:\/\/www.poweradmin.com\/blog\/wp-content\/uploads\/2020\/06\/1-1.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-6994\" src=\"https:\/\/www.poweradmin.com\/blog\/wp-content\/uploads\/2020\/06\/1-1.jpg\" alt=\"\" width=\"1430\" height=\"954\" srcset=\"https:\/\/www.poweradmin.com\/blog\/wp-content\/uploads\/2020\/06\/1-1.jpg 1430w, https:\/\/www.poweradmin.com\/blog\/wp-content\/uploads\/2020\/06\/1-1-300x200.jpg 300w, https:\/\/www.poweradmin.com\/blog\/wp-content\/uploads\/2020\/06\/1-1-1024x683.jpg 1024w, https:\/\/www.poweradmin.com\/blog\/wp-content\/uploads\/2020\/06\/1-1-768x512.jpg 768w\" sizes=\"auto, (max-width: 1430px) 100vw, 1430px\"><\/a><\/p>\n<p>In general, as you monitor, you\u2019ll be collecting data for three types of decisions. These are:<\/p>\n<ul>\n<li>Performance \u2013 The efficiency and effectiveness of your current system, whatever it may be. With good data, you can identify bottlenecks, make sure you\u2019re meeting targets, and make informed decisions on how best to upgrade the system and improve performance.<\/li>\n<li>Diagnostics \u2013 When something in your system goes wrong, you\u2019ll need to rely on the data you\u2019ve got to fix it quickly and at the lowest cost to you. By using a good monitoring and alerting strategy and getting the right data in a timely way, you can make the right decision on current and potential errors.<\/li>\n<li>Security \u2013 Internal and external security of your systems is more important than ever before. Analyzing patterns in data can find unusual activity, improper access, and record manipulation. It can also indicate the best ways to increase security and develop effective security responses.<\/li>\n<\/ul>\n<h2><strong>What Type of Data Should You Monitor?<\/strong><\/h2>\n<p>All data can be divided into two categories: qualitative and quantitative. You will need to collect both in order to get the full picture of your system.<\/p>\n<h3><strong>Quantitative Data<\/strong><\/h3>\n<p>Quantitative data is numerical data. It\u2019s often also called \u201cmetrics\u201d since it consists of numerical measurements. The main benefit of application performance metrics is that, because they\u2019re numbers, it\u2019s easy to compare data against other data or against a set goal. Although metrics may not tell you why something is succeeding or failing, analyzing the data will allow you to quickly see how well your systems are performing.<\/p>\n<p>Examples of quantitative data\u2014or key infrastructure monitoring metrics\u2014for servers and networks include:<\/p>\n<ul>\n<li>Work data \u2013 Such as how much work is being done by the system over time, how quickly something (e.g., a data query) is completed, how often it succeeds, how often it fails, and so on.<\/li>\n<li>Resource data \u2013 Such as how long a resource is used for, how often it\u2019s accessed, how often it\u2019s requested but not available, how often it reports an error, and so on.<\/li>\n<\/ul>\n<h3><strong>Qualitative Data<\/strong><\/h3>\n<p>Qualitative data, on the other hand, is non-numerical data. It describes events, descriptive reports, or changes within a system, and it is most often delivered in log format or as an alert.<\/p>\n<p>While quantitative data doesn\u2019t necessarily tell you about the performance of your system (except in general terms of success\/failure), it can provide excellent insight if something goes wrong, allowing you to diagnose errors, track failures, and be warned against future problems.<\/p>\n<p>All qualitative data should be monitored, with logs stored for future analysis and data alerting prioritized for urgency, and possibly redirected to an appropriate employee.<\/p>\n<p><a href=\"https:\/\/www.poweradmin.com\/blog\/wp-content\/uploads\/2020\/06\/2-1.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-6995\" src=\"https:\/\/www.poweradmin.com\/blog\/wp-content\/uploads\/2020\/06\/2-1.jpg\" alt=\"\" width=\"1430\" height=\"804\" srcset=\"https:\/\/www.poweradmin.com\/blog\/wp-content\/uploads\/2020\/06\/2-1.jpg 1430w, https:\/\/www.poweradmin.com\/blog\/wp-content\/uploads\/2020\/06\/2-1-300x169.jpg 300w, https:\/\/www.poweradmin.com\/blog\/wp-content\/uploads\/2020\/06\/2-1-1024x576.jpg 1024w, https:\/\/www.poweradmin.com\/blog\/wp-content\/uploads\/2020\/06\/2-1-768x432.jpg 768w\" sizes=\"auto, (max-width: 1430px) 100vw, 1430px\"><\/a><\/p>\n<h2><strong>When Should You Collect the Data?<\/strong><\/h2>\n<p>One of the fundamental ideas behind data monitoring is that, as long as you have the resources, it should be done all the time. In many cases, you won\u2019t know what data you need until you need it, and it\u2019s much better to have to sort through too much data than to have not enough data for a decision.<\/p>\n<p>Having said that, there are two important factors to consider that will impact your resources:<\/p>\n<ul>\n<li>Granularity \u2013 In other words, how often the data is collected. Recording application performance every hour, for example, isn\u2019t useful, as use can vary significantly during that hour. On the other hand, recording application performance metrics every millisecond may itself put a heavy burden on the processor, slowing the system down and distorting the data. This is a balance that will have to be determined on a case-by-case basis, depending on the data being monitored.<\/li>\n<li>Length of time \u2013 When will you need to access or analyze the data? How long should you store the recorded data? In most cases the longer the better but, again, it depends on the type of data and available resources (like storage space). It\u2019s normally recommended that you store data for at least a year, so you can perform comparisons that take annual\/seasonal variation into account.<\/li>\n<\/ul>\n<h2><strong>Where Should You Monitor Your Data?<\/strong><\/h2>\n<p>The scope of your data collection is also an important consideration, especially if you manage systems in multiple locations. When it comes to metrics, good data should be easily comparable, either to benchmarks or to similar data from other sources. So, if you\u2019re collecting data from multiple locations, you need to make sure you\u2019re monitoring the same sources in each.<\/p>\n<h2><strong>How Should You Monitor Your Data?<\/strong><\/h2>\n<p>Data becomes important not when you collect it, but when you use it to make a decision. A critical part of your data monitoring, therefore, is to make sure your data is clean, proper, and ready for use as soon as possible before the data is actually needed. That way, when it becomes important, you\u2019re not wasting time or money sorting through data to make it useful or readable.<\/p>\n<p><a href=\"https:\/\/www.poweradmin.com\/blog\/wp-content\/uploads\/2020\/06\/3.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-6996\" src=\"https:\/\/www.poweradmin.com\/blog\/wp-content\/uploads\/2020\/06\/3.jpg\" alt=\"\" width=\"1430\" height=\"953\" srcset=\"https:\/\/www.poweradmin.com\/blog\/wp-content\/uploads\/2020\/06\/3.jpg 1430w, https:\/\/www.poweradmin.com\/blog\/wp-content\/uploads\/2020\/06\/3-300x200.jpg 300w, https:\/\/www.poweradmin.com\/blog\/wp-content\/uploads\/2020\/06\/3-1024x682.jpg 1024w, https:\/\/www.poweradmin.com\/blog\/wp-content\/uploads\/2020\/06\/3-768x512.jpg 768w\" sizes=\"auto, (max-width: 1430px) 100vw, 1430px\"><\/a><\/p>\n<p>In other words, your monitoring and collection techniques need to produce the right data. These techniques should include:<\/p>\n<ul>\n<li>Labeling \u2013 Stored data should be labeled comprehensively, including date of collection, type of data, location of source, and so on. This makes it easier to sort and much easier to find quickly later on.<\/li>\n<li>Categorization \u2013 Like labeling, categorizing your data makes it easier and faster to retrieve at a later date. It also makes it simpler to compare with like data. Use tags for categorization so that the data can belong to multiple scopes and datasets.<\/li>\n<li>Cleaning \u2013 Quantitative data needs to be able to be read by algorithms and other software so that it can be compared and compiled into reports without error. Quantitative data should also be readable by an average user, not just someone with technical knowledge of the system. If either quantitative or qualitative data doesn\u2019t meet these criteria, it should be cleaned up before anyone attempts to use it.<\/li>\n<li>Automation \u2013 Data monitoring, collection, and storage should be automated as much as possible. This removes the possibility of human error (or deliberate actions) tainting the data and making it unusable. Although it may take some effort to set up, automation will save a lot of time in the long run.<\/li>\n<\/ul>\n<h2><strong>System Monitoring Made Simple<\/strong><\/h2>\n<p>With so much data available to today\u2019s administrators, staying on top of your monitoring and alerting strategy can seem overwhelming. Power Admin makes <a href=\"https:\/\/www.poweradmin.com\/products\/server-monitoring\/\">active network monitoring<\/a> rapid and intuitive with PA Server Monitor. Capable of capturing metrics across hundreds of local and remote sites, PA Server Monitor is a versatile, robust <a href=\"https:\/\/www.poweradmin.com\/products\/server-monitoring\/product-information\/pa%20server%20monitor%20datasheet.pdf\">server monitoring service<\/a> that puts the power of data back in your hands.<\/p>\n<p>For an automated solution that gives you both convenience and control, choose <a href=\"https:\/\/www.poweradmin.com\/products\/server-monitoring\/\">PA Server Monitor<\/a>. To see how it can work for you, take a look at a <a href=\"https:\/\/www.poweradmin.com\/products\/server-monitoring\/product-information\/live-demo\/\">live demo<\/a> or <a href=\"https:\/\/www.poweradmin.com\/contact-us\/\">contact us<\/a> today.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>When it comes to business, data is everything. Whether it\u2019s sales, supply, marketing, or your I.T. systems, every day is a constant stream of decisions to be made. To make the right decisions, you need enough knowledge. To have enough knowledge, you need the right data. What\u2019s the best way to collect all this data? [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":6994,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[57],"tags":[],"class_list":["post-6993","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-monitoring"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/posts\/6993","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/comments?post=6993"}],"version-history":[{"count":1,"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/posts\/6993\/revisions"}],"predecessor-version":[{"id":6997,"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/posts\/6993\/revisions\/6997"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/media\/6994"}],"wp:attachment":[{"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/media?parent=6993"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/categories?post=6993"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.poweradmin.com\/blog\/wp-json\/wp\/v2\/tags?post=6993"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}