Big data cannot be defined in terms of absolute volume, because it increases so quickly. It is easier to define using the 5 v’s (see below)
Moore’s law (1965)
Moore’s law is named after Gordon Moore, the founder of Intel
Note that there is a limit to this self-fulfilling prophecy. By doubling the number of processors on a chip, the distance between transistors decreases. It was 14nanometers (nm) at the times of publication (2017). When it reaches 2-3nm there are quantum uncertainties which might kick in, as predicted by Paolo Gargini.
A lot of data somes from social media and it is a recognized discipline which can be used for eample for real-time epidemiology monitoring. Take a picture of a viral rash being geolocalized to some adjacent are of a cluster of affected individuals.
So a lot of data again is unstructured and no specific questzion is in mind. And the more data we have, the more statistical power we have, and the associations are not always relevant: look at the strange association between “high school basketball” google searches and the flu.
However, I personally believe as a neuroscience fan (after all until the end of medical school, I wanted to become a neurosurgeon) that there is a supratentorial brain concerned with pure intelligence without emotions but there is the limbic brain where signals between external stimuli (or data) simultaneously reach both parts of the brain.
Even with simple visualisation the shear amount of information sources become somewhat overwhelming for a human being, and I am not sure that collective intelligence is an improvement, but rather a herd mentality of a growing crowd made possible through technically.
One concrete example would be the pandemic. There have been various sources of data and the monitoring has been fantastic, these tools have helped elaborate vaccines. However some of the decisions seem irrational especially when the dangers related to COVID have been made excessively visible and I am not sure visualisation is enough.
There is simply too much data thrown at one’s face and I am not sure all the decisions made by those in power were rational or an excess of data thrown into everyone’s face, including the media.
A 6th V: Value
Reference: Big Data: A very short introduction by Dawn E. Holmes. Oxford University Press, 2017