Data mining and data warehousing in the Information Technology Engineer Examination
Questions related to data mining and data warehousing frequently appear in the Information Technology Engineers exam administered by IPA.
Somehow, it feels like the content is the same, but in the exam, there will be questions asking the difference between the two.
This time, I will explain the difference between data mining and data warehouse for the information processing engineer exam.
What is data mining?
First, let’s talk about data mining.
Data mining is a so-called big data analysis, which uses techniques such as neural networks and statistical analysis to extract characteristic patterns from large amounts of data accumulated in the course of normal business operations. is to find
Neural networks may be regarded as “≒artificial intelligence”. Using the power of artificial intelligence and statistics, we search large amounts of data to find out if there are any characteristic patterns or if there are phenomena that have causal relationships.
What is a data warehouse?
On the other hand, let’s take a look at what a data warehouse is.
A data warehouse is said to be a collection of data organized by purpose, integrated chronologically, and never deleted or updated for decision-making. These data will be extracted and analyzed according to the purpose of the analysis.
We use a technique called OLAP (On-Line Analytical Processing) to perform multidimensional analysis and support decision-making.
The difference between data mining and data warehousing is “organization”
What is the difference between data mining and data warehousing, which both deal with large amounts of data?
The difference between the two lies in whether the data is organized or not.
Data mining, as the word “mining” is used, is the work of trying to find valuable features and rules from a large amount of unorganized data.
On the other hand, in a data warehouse, data is organized and stored as the word “warehouse” is used. Even in the Information Technology Engineers Examination, if you are asked about the difference between the two, it may be easier to answer if you pay attention to whether the information is organized.
