{"id":6318,"date":"2020-06-19T09:38:05","date_gmt":"2020-06-19T07:38:05","guid":{"rendered":"https:\/\/www.synthesis.co.za\/?p=6318"},"modified":"2022-02-10T09:56:23","modified_gmt":"2022-02-10T07:56:23","slug":"big-data-the-gold-mine-waiting-to-be-mined","status":"publish","type":"post","link":"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/","title":{"rendered":"Big Data: The Gold Mine Waiting to be Mined"},"content":{"rendered":"

By Archana Arakkal, Synthesis Lead Machine Learning Engineer<\/strong><\/h3>\n

Source: Engineer IT<\/a><\/h4>\n

The longer I am in the technology industry, the more I realise that big data is an area that has not been well explored. The capabilities and potential are infinite however why has this not been explored?<\/p>\n

Traditionally Machine Learning (ML) and Artificial Intelligence (AI)<\/strong><\/a> have been preceded with commentary on robots taking over the world and humans becoming prisoned by their thoughts. However, over time we have realised (and are still in the process of realising) that using these concepts is merely a means that can allow one to complement our skills as well as take humanity to the next level. So the question remains: why have these technologies not been exploited? The answer lies in big data.<\/p>\n

The question you might be asking yourself is what big data has to do with using ML and AI. What is big data? The term is loosely used to categorise and analyse large amounts of data that has traditionally been impossible to analyse due to the sheer amounts of computation and processing that is necessary. With the radical advancements that have been made in fields such as AI, ML and general computation \u2013 this problem does not exist anymore.<\/p>\n

I have however still not answered the question of how big data can allow us to leverage off my machine learning and AI capabilities. Take a normal household, for example, let’s imagine that on a day-to-day basis you are trying to manage your grocery list. You are trying to understand what patterns lie in the consumption of your groceries in order to anticipate when you will need to make your next grocery run. Similar to this, every single household in your neighbourhood is trying to understand what their grocery patterns look like and even further to that the entire province is trying to understand these patterns in order to ensure that the grocery stores can be sustainable enough to manage the demands of the region. This is where the true capability of big data can be addressed. Imagine that your regional grocery store provider has been able to tap into these data pools by leveraging a chatbot that you as an individual may communicate with to understand your spend, next step they would be able to understand what your spending and grocery cycles are and after that \u2026 the doorbell rings and there are your groceries waiting for you at your doorstep even before you could begin stressing about supper. Technology to promote human efficiency.<\/p>\n

This is one small example of how big data can be utilised by truly understanding our surroundings and human beings. As a human race, we can begin revolutionising who we are. Preventative medicine is one such area – by utilising big data we can begin understanding and preventing medical conditions even before they occur and this is one of the many reasons why big data is the gold mine waiting to be mined.<\/p>\n","protected":false},"excerpt":{"rendered":"

By Archana Arakkal, Synthesis Lead Machine Learning Engineer Source: Engineer IT The longer I am in the technology industry, the more I realise that big data is an area that has not been well explored. The capabilities and potential are infinite however why has this not been explored? Traditionally Machine Learning (ML) and Artificial Intelligence […]<\/p>\n","protected":false},"author":12,"featured_media":6320,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"episode_type":"","audio_file":"","cover_image":"","cover_image_id":"","duration":"","filesize":"","filesize_raw":"","date_recorded":"","explicit":"","block":"","itunes_episode_number":"","itunes_title":"","itunes_season_number":"","itunes_episode_type":"","footnotes":""},"categories":[34],"tags":[],"ptype":[11],"sectors":[28],"class_list":["post-6318","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-conversation","ptype-articles","sectors-intelligent"],"acf":[],"yoast_head":"\nBig Data: The Gold Mine Waiting to be Mined - Synthesis<\/title>\n<meta name=\"description\" content=\"Archana Arakkal explores Big Data: The Gold Mine Waiting to be Mined and concludes that the potential of big data is infinite.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Big Data: The Gold Mine Waiting to be Mined\" \/>\n<meta property=\"og:description\" content=\"Archana Arakkal explores Big Data: The Gold Mine Waiting to be Mined and concludes that the potential of big data is infinite.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/\" \/>\n<meta property=\"og:site_name\" content=\"Synthesis\" \/>\n<meta property=\"article:published_time\" content=\"2020-06-19T07:38:05+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-02-10T07:56:23+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2020\/06\/dennis-kummer-52gEprMkp7M-unsplash-scaled-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"1708\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Synthesis Staff\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Synthesis Staff\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/\"},\"author\":{\"name\":\"Synthesis Staff\",\"@id\":\"https:\/\/www.synthesis.co.za\/#\/schema\/person\/a1cde004c078942c45be61a61cd6ae2c\"},\"headline\":\"Big Data: The Gold Mine Waiting to be Mined\",\"datePublished\":\"2020-06-19T07:38:05+00:00\",\"dateModified\":\"2022-02-10T07:56:23+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/\"},\"wordCount\":504,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.synthesis.co.za\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2020\/06\/dennis-kummer-52gEprMkp7M-unsplash-scaled-1.jpg\",\"articleSection\":[\"Conversations\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/\",\"url\":\"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/\",\"name\":\"Big Data: The Gold Mine Waiting to be Mined - Synthesis\",\"isPartOf\":{\"@id\":\"https:\/\/www.synthesis.co.za\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2020\/06\/dennis-kummer-52gEprMkp7M-unsplash-scaled-1.jpg\",\"datePublished\":\"2020-06-19T07:38:05+00:00\",\"dateModified\":\"2022-02-10T07:56:23+00:00\",\"description\":\"Archana Arakkal explores Big Data: The Gold Mine Waiting to be Mined and concludes that the potential of big data is infinite.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/#primaryimage\",\"url\":\"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2020\/06\/dennis-kummer-52gEprMkp7M-unsplash-scaled-1.jpg\",\"contentUrl\":\"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2020\/06\/dennis-kummer-52gEprMkp7M-unsplash-scaled-1.jpg\",\"width\":2560,\"height\":1708,\"caption\":\"Big data: the gold mine waiting to be mined\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.synthesis.co.za\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Big Data: The Gold Mine Waiting to be Mined\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.synthesis.co.za\/#website\",\"url\":\"https:\/\/www.synthesis.co.za\/\",\"name\":\"Synthesis\",\"description\":\"Specialized Software Development\",\"publisher\":{\"@id\":\"https:\/\/www.synthesis.co.za\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.synthesis.co.za\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.synthesis.co.za\/#organization\",\"name\":\"Synthesis, a Leading Software Development Company\",\"url\":\"https:\/\/www.synthesis.co.za\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.synthesis.co.za\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2016\/03\/Synthesis-logo.jpg\",\"contentUrl\":\"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2016\/03\/Synthesis-logo.jpg\",\"width\":1036,\"height\":220,\"caption\":\"Synthesis, a Leading Software Development Company\"},\"image\":{\"@id\":\"https:\/\/www.synthesis.co.za\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.synthesis.co.za\/#\/schema\/person\/a1cde004c078942c45be61a61cd6ae2c\",\"name\":\"Synthesis Staff\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.synthesis.co.za\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2020\/03\/cropped-favicon-1-96x96.png\",\"contentUrl\":\"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2020\/03\/cropped-favicon-1-96x96.png\",\"caption\":\"Synthesis Staff\"},\"url\":\"https:\/\/www.synthesis.co.za\/author\/staff\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Big Data: The Gold Mine Waiting to be Mined - Synthesis","description":"Archana Arakkal explores Big Data: The Gold Mine Waiting to be Mined and concludes that the potential of big data is infinite.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/","og_locale":"en_US","og_type":"article","og_title":"Big Data: The Gold Mine Waiting to be Mined","og_description":"Archana Arakkal explores Big Data: The Gold Mine Waiting to be Mined and concludes that the potential of big data is infinite.","og_url":"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/","og_site_name":"Synthesis","article_published_time":"2020-06-19T07:38:05+00:00","article_modified_time":"2022-02-10T07:56:23+00:00","og_image":[{"width":2560,"height":1708,"url":"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2020\/06\/dennis-kummer-52gEprMkp7M-unsplash-scaled-1.jpg","type":"image\/jpeg"}],"author":"Synthesis Staff","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Synthesis Staff","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/#article","isPartOf":{"@id":"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/"},"author":{"name":"Synthesis Staff","@id":"https:\/\/www.synthesis.co.za\/#\/schema\/person\/a1cde004c078942c45be61a61cd6ae2c"},"headline":"Big Data: The Gold Mine Waiting to be Mined","datePublished":"2020-06-19T07:38:05+00:00","dateModified":"2022-02-10T07:56:23+00:00","mainEntityOfPage":{"@id":"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/"},"wordCount":504,"commentCount":0,"publisher":{"@id":"https:\/\/www.synthesis.co.za\/#organization"},"image":{"@id":"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/#primaryimage"},"thumbnailUrl":"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2020\/06\/dennis-kummer-52gEprMkp7M-unsplash-scaled-1.jpg","articleSection":["Conversations"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/","url":"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/","name":"Big Data: The Gold Mine Waiting to be Mined - Synthesis","isPartOf":{"@id":"https:\/\/www.synthesis.co.za\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/#primaryimage"},"image":{"@id":"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/#primaryimage"},"thumbnailUrl":"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2020\/06\/dennis-kummer-52gEprMkp7M-unsplash-scaled-1.jpg","datePublished":"2020-06-19T07:38:05+00:00","dateModified":"2022-02-10T07:56:23+00:00","description":"Archana Arakkal explores Big Data: The Gold Mine Waiting to be Mined and concludes that the potential of big data is infinite.","breadcrumb":{"@id":"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/#primaryimage","url":"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2020\/06\/dennis-kummer-52gEprMkp7M-unsplash-scaled-1.jpg","contentUrl":"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2020\/06\/dennis-kummer-52gEprMkp7M-unsplash-scaled-1.jpg","width":2560,"height":1708,"caption":"Big data: the gold mine waiting to be mined"},{"@type":"BreadcrumbList","@id":"https:\/\/www.synthesis.co.za\/big-data-the-gold-mine-waiting-to-be-mined\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.synthesis.co.za\/"},{"@type":"ListItem","position":2,"name":"Big Data: The Gold Mine Waiting to be Mined"}]},{"@type":"WebSite","@id":"https:\/\/www.synthesis.co.za\/#website","url":"https:\/\/www.synthesis.co.za\/","name":"Synthesis","description":"Specialized Software Development","publisher":{"@id":"https:\/\/www.synthesis.co.za\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.synthesis.co.za\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.synthesis.co.za\/#organization","name":"Synthesis, a Leading Software Development Company","url":"https:\/\/www.synthesis.co.za\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.synthesis.co.za\/#\/schema\/logo\/image\/","url":"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2016\/03\/Synthesis-logo.jpg","contentUrl":"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2016\/03\/Synthesis-logo.jpg","width":1036,"height":220,"caption":"Synthesis, a Leading Software Development Company"},"image":{"@id":"https:\/\/www.synthesis.co.za\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.synthesis.co.za\/#\/schema\/person\/a1cde004c078942c45be61a61cd6ae2c","name":"Synthesis Staff","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.synthesis.co.za\/#\/schema\/person\/image\/","url":"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2020\/03\/cropped-favicon-1-96x96.png","contentUrl":"https:\/\/www.synthesis.co.za\/wp-content\/uploads\/2020\/03\/cropped-favicon-1-96x96.png","caption":"Synthesis Staff"},"url":"https:\/\/www.synthesis.co.za\/author\/staff\/"}]}},"_links":{"self":[{"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/posts\/6318","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/comments?post=6318"}],"version-history":[{"count":1,"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/posts\/6318\/revisions"}],"predecessor-version":[{"id":10695,"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/posts\/6318\/revisions\/10695"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/media\/6320"}],"wp:attachment":[{"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/media?parent=6318"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/categories?post=6318"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/tags?post=6318"},{"taxonomy":"ptype","embeddable":true,"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/ptype?post=6318"},{"taxonomy":"sectors","embeddable":true,"href":"https:\/\/www.synthesis.co.za\/wp-json\/wp\/v2\/sectors?post=6318"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}