The article mainly outlines the methods and processes of data analysis , and uses case studies to illustrate how to conduct operational data analysis. A good and useful article, sharing with everyone.Regarding data analysis, I found that many operations have some confusions:
Don’t know where to get the data from;
I don’t know what tools to use;
Unclear about the methodology and framework of the analysis;
Most data analysis is just a formality.
In fact, data analysis is not as difficult as you think.Concept: Data and Data AnalysisEveryone has been talking about collecting data and data analysis, but it is difficult to give a clear definition of the two. Many people have a preconceived notion that data is various tables and numbers, such as Excel reports and various databases. In fact, this is a wrong or biased understanding, which will make our understanding of data very narrow.1. What is data?Data is a symbolic record that describes things and is the raw material that constitutes information or knowledge. This philosophical definition greatly enriches the scope of data and meets the current needs of the development of "big data".As an operator, the data we come into contact with may not be that complex, but there are also many categories.From the source of the data, it can be divided into external data and internal data of the enterprise. External data mainly includes macroeconomics, news and public opinion, social demographics, and market research data; internal data includes user behavior data, server log data, CRM and transaction data. The ways of acquiring different data, the analysis methods and the analysis purposes are all different. Different industries and enterprises also have their own preferences in actual analysis.2. What is data analysis?Data analysis refers to extracting useful information from data and guiding practice.But it should be noted that:This information needs to be used to guide practice rather than just a formality;what needs to be extracted is useful information rather than just for self-satisfaction.Ideas: Methodology and methodsMany people feel overwhelmed when they first come into contact with data analysis. So we need macro methodology and micro method for guidance. So what is the difference between methodology and method?The methodology is an analytical framework proposed from a macro perspective, from the perspective of management and business, which guides the direction of our subsequent specific analysis.Method is a micro concept, which refers to the method we use in the specific analysis process.1. MethodologyThere are many methodologies for data analysis. Here I will introduce some common frameworks.A AR RR: Pirate’s Law of Growth Hacker, an important framework for lean entrepreneurship , growth from five aspects: acquisition, activation, retention , revenue and referral.4P Theory: A classic marketing theory that holds that product, price, channel and promotion are important factors affecting the market.5W2H analysis method: analyze problems from 7 common dimensions: Why, When, Where, What, Who, How, and How much.PEST analysis method: Analyzes internal and external environments from four aspects: politics, economy, society, and technology. It is suitable for macro analysis.SWOT analysis method: Analyze the internal and external environment from four aspects: Strength, Weakness, Opportunity, and Threat. It is suitable for macro analysis.There are many methodologies for data analysis. There is no best methodology, only the most suitable one. Let me introduce the AARRR methodology in detail. This methodology is very suitable for issues such as lean operations and business growth.For Internet products, users have obvious life cycle characteristics. Let me explain this using an O2O industry APP as an example.Acquire new users through various online and offline channels and have them download and install the APP.After installing the APP, users are activated through operational means; for example, first order free, vouchers, red envelopes, etc.Through a series of operations, some users are retained to bring revenue to the company.If users think the product is good, they may recommend it to people around them; or encourage sharing to their friends circle through incentives such as red envelopes, etc.It should be noted that the above steps are not necessarily in the order above; operations can be applied flexibly according to business needs. The five links of AARRR can all be measured and analyzed through data indicators to achieve the goal of lean operations; the improvement of each link can effectively grow the business.2. MethodsWith the help of common website/APP data analysis products, we can complete these 7 types of analysis very quickly.Trend AnalysisTrend analysis is the simplest, most basic and most common method of data monitoring and data analysis. Usually we create a line graph or bar graph of data indicators in data analysis products, and then continue to observe, focusing on outliers.In this process, we must select the first key indicator (OMTM, One Metric That Matter) and not be confused by vanity metrics.Taking social apps as an example, if we take download volume as the first key indicator, we may go astray; because users downloading the app does not mean that they use your product. In this case, it is recommended to use DAU (Daily Active Users) as the first key indicator, and only users who have initiated and performed a certain operation can be counted; such indicators are of practical significance, and operations personnel should focus on such indicators.Multidimensional decompositionMulti-dimensional decomposition means splitting indicators from multiple dimensions based on business needs; the dimensions here include but are not limited to browsers , access sources, operating systems, advertising content, etc.Sometimes you can't see any problems with a very general or final indicator, but after breaking it down, many detailed problems will emerge.For example, the bounce rate of a certain website is 0.47, the average visit depth is 4.39, and the average visit time is 0.55 minutes. If you want to increase user engagement, obviously such data will make you feel at a loss as to where to start; but once you break down these indicators, you will find many ideas.Shown below is the user engagement metric data for a product on different operating systems.If you look closely, you’ll find that user engagement on mobile platforms (Android, Windows Phone, IOS) is extremely poor, as evidenced by extremely high bounce rates, low visit depth, and low average visit duration. In this case, you will find the problem: is it that our products are not optimized on the mobile side, resulting in poor user experience? In such an era of mobile Internet , this is a very important issue.User SegmentationThere are two main ways to segment users: dimension and behavior combination. The first type is grouping based on user dimensions. For example, based on the region dimension, there are users from Beijing, Shanghai, Guangzhou, Hangzhou and other places; based on the user login platform, there are PC, tablet and mobile phone users. The second method is to group users based on their behavior combinations, such as the difference between users who sign in to the community three times a week and users who sign in less than three times a week. I will introduce this in detail in the retention analysis later.User reviewAs mentioned earlier, user behavior data is also a type of data. Observing the user's behavior path within your product is a very intuitive analysis method. Based on user grouping, generally 3-5 users are selected for detailed investigation, which can cover most of the behavioral patterns of the grouped users.Let’s take the registration process of a product as an example:The user went through the following operation process: [Visit the official website] - [Click to register] - [Enter number] - [Get verification code]. It was supposed to be a very smooth process, but it was found that a user clicked [Get Verification Code] three times in a row and then gave up submitting. This is strange, why would users click the verification code multiple times? At this time, I suggest that you experience your product in person and go through the registration process.You will find that after clicking [Get Verification Code], you often don’t receive the verification code for a long time; then you will continue to click [Get Verification Code], so the above situation occurs. The vast majority of products have some anti-human designs or bugs to a greater or lesser extent. Through careful inspection by users, problems in the products can be easily discovered and resolved in a timely manner.Funnel analysisThe funnel is a tool used to measure conversion efficiency. It gets its name because the model from beginning to end resembles a funnel.There are two key points to note in funnel analysis: First, not only should we look at the overall conversion rate , but also pay attention to the conversion rate of each step in the conversion process; second, funnel analysis also needs to be broken down into multiple dimensions. After the breakdown, you may find that the conversion rates in different dimensions also vary greatly.A certain company's registration process uses email, and the registration conversion rate has always been very low, only 27%. Through funnel analysis, it was found that the main loss was in the [Submit verification code] stage.After investigation, we found that it is very easy for the registered email address to not receive emails during email verification. The reasons include the email agent being blocked, the email containing sensitive words being sent to the spam mailbox, the email taking too long to be delivered, etc. Since so many uncontrollable factors affect the registration conversion rate, let's try a different verification method. After switching to SMS verification, the overall conversion rate increased to 43%, which is a very large increase.Retention AnalysisRetention, as the name suggests, means that new users stay and continue to use the product. Common indicators for measuring retention include: next-day retention rate , 7-day retention rate, 30-day retention rate, etc. We can analyze retention from two aspects, one is the retention rate of new users, and the other is the retention of product functions.Taking community websites as an example, the retention rate of users who "check in three times a week" is significantly higher than that of users who "check in less than three times a week". The sign-in function has invisibly improved the stickiness and retention rate of community users, which is why many groups or communities promote this function.When you register on Weibo for the first time, Weibo will recommend you to follow 10 influencers ; when you register on LinkedIn for the first time, LinkedIn will recommend you 5 colleagues; when you apply for a credit card, the issuer will say that you can enter a draw for a [drone] grand prize if you make 4 or more credit card transactions; many social products stipulate that if you sign in 5 times a week, you can get double points or virtual currency. Among them, "follow 10 big Vs", "follow 5 colleagues", "4 purchases", and "check in 5 times" are the Magic Numbers I want to talk about. These numbers are discovered through long-term data analysis or machine learning. Practice has shown that users who meet these characteristics have the highest retention rate; operations personnel need to constantly push and motivate users to meet this standard, thereby improving retention rate.A/B Testing vs A/A TestingA/B testing is to achieve a goal by adopting two sets of plans, one group of users adopts plan A, and the other group of users adopts plan B. Through experiments, we observe the data effects of the two sets of solutions and judge the pros and cons of the two sets of solutions.When it comes to A/B testing, Google spares no effort in its attempts. For the display of search results, Google will develop a variety of different plans (including copytitles , font size, color, etc.) to continuously optimize the click-through rate of ads in search results.Processes: Macro, Meso and MicroHaving a specific analysis method is not enough. Operations also need a clear process to do a good job of data analysis. Here I will introduce it to you from three levels: macro, meso and micro.1. MacroThe lean startup that is popular in Silicon Valley advocates the concept of MVP (minimum viable product), which aims to continuously optimize products and increase users by taking small steps and running fast.In our operations, we must be bold in experimenting and transforming ideas into products and operations methods . Then analyze the data to measure the effectiveness of the product or operation. If it is good, maintain it and promote it vigorously; if it is not good, summarize the problems and make timely improvements. Gradually optimizing in the continuous cycle of "build" - "measure" - "learn", this process is very suitable for operations work.2. Middle WayWe can try to establish an overall process: 1. Clarify the purpose and ideas of the analysis → 2. Data collection → 3. Data processing → 4. Data analysis → 5. Data presentation → 6. Report writing.This process only explains the previous and subsequent processes from the perspective of "data" and does not combine it with business reality; but it is worth noting that the ultimate goal of data analysis is to guide practice, not to write a report.3. MicroThe following is a very detailed analysis process. With the help of certain analysis tools, we can conduct a detailed analysis of the website/APP according to this idea.However, this process has a prerequisite, which is to use data analysis tools to do a good job of data collection and monitoring and focus on business analysis. The core of this process is the "MVP" concept, "discovering problems" - "designing experiments" - "analyzing results", and continuously optimizing products and operations through data.Application: Systems and Analysis1. Case: Building a data analysis systemYour favorite Easter Egg Man works in new media in the company and is responsible for the daily operations of WeChat . The number of readers fluctuates, but is generally average. I want to find a way to improve WeChat operations and increase the number of WeChat fans and readers;We discussed this problem faced by many operators from the perspective of data analysis:Not clear about which core indicators you need to focus on;not clear about the characteristics of target users (user attributes, user portraits , etc.);lack of systematic analysis of your past work (data collection, monitoring and analysis). From the perspective of business growth, it is crucial to customize an analysis system to support the development of its content work.The first point is content positioning.Operations need to clearly know their goals or KPIs, and then select a core key indicator (OMTM) for monitoring. If it is a startup company, it may need to attract new users in the early stages, so the core indicator is the number of registered users or the number of new visiting users. If it is an information media that focuses on influence and coverage, then the core indicator should be the number of WeChat readings or web page PV.The second point is user portrait.Regardless of which operations position you are in, you need to know clearly who your (target) users are? What are the characteristics of these people, and what are their concerns and pain points? If your user is a product manager , you can try to crawl relevant questions on the product manager's website, and then do text analysis: this is a quantitative analysis. At the same time, more in-depth information on user characteristics can be obtained through surveys and questionnaires: this is an analysis at a qualitative level.Third, continuous monitoring.With the help of data analysis tools, the core key indicators (OMTM) are continuously monitored. For abnormal indicators, we need to analyze and improve them in a timely manner.Fourth, data analysis.Collect and analyze data from past content to find out which content, titles, formats, and channels are more effective, and then continuously optimize in this direction.2. Case: Analyzing core business indicatorsEmail marketing is a marketing and operation method that many companies still use. An Internet financial company sends activation emails to new users (users who have email addresses but are not registered) through EDM. The registration conversion rate has always been maintained between 20% and 30%. On August 18, the registration conversion rate plummeted and has remained at around 10% since then.This is a very serious recession and the causes need to be investigated immediately. The EDM channel registration conversion rate involves too many factors, which need to be checked one by one. We list the possible reasons:Technical reasons: problems with ETL (data extraction, transformation, loading), resulting in the backend data not being presented in the BI report in a timely manner;Macro reasons: seasonal factors (holidays, etc.), other email shocks (other departments also send emails to users, diluting users' attention);Micro reasons: email title, copy, layout design, and registration process design.A simple business indicator may be affected by a variety of factors, so we need to make detailed measurements of the factors involved in order to continuously optimize it. Finally, it was discovered that the product manager added a "credit card binding" step during the registration process, which resulted in a significant drop in the registration conversion rate.
Mobile application product promotion service: APP promotion service Qinggua Media advertising
The author of this article @爱运 is compiled and published by (Qinggua Media). Please indicate the author information and source when reprinting!