The third lecture on application performance management of Tingyun shared practical experience

On May 16, Lingxiu New Silicon Valley welcomed the third Tingyun Application Performance Management Lecture Hall, which attracted nearly 200 partners from different industries to attend. At the same time, more than 300 students watched the entire salon through the Internet. The atmosphere on the scene was very hot, and the appearance of Bird Brother (Hui Xinchen) pushed the atmosphere of the lecture hall to a higher peak.

[[134885]]

With the advent of the mobile Internet era, how to evolve the architecture? How to optimize performance? How to determine the code execution efficiency and locate performance bottlenecks? These are all problems that plague developers. In this lecture on application performance management, Bird Brother, together with technical experts from Tingyun, Lianjia.com, and 58.com, will bring you their most authoritative results and experiences in performance optimization.

Lianjia.com: Evolution of storage systems

The lecture hall was full of useful information. Yin Jifeng, a system engineer from Lianjia.com, brought everyone the evolution of Lianjia.com's storage system, from the initial demand to the continuous attempts of various systems in the process to the final related performance optimization, covering every detail.

Yin Jifeng mentioned that Lianjia.com is a vertical website for real estate, with a lot of house data. Most of the pictures that meet their needs are about 4 megabytes, divided into large, medium and small types. The server has a large amount of high-quality data, as well as very small intermediate data and some large files such as voice/video. They expect to have a PB-level system without a single point and with adjustable file sizes. At first, they chose the lightweight FASTDFS, but there was no real successful example that FASTDFS could reach the PB level. After research and transformation, it basically met the needs.

Then Yin Jifeng talked about the selection of the underlying storage system. After comparison, they finally chose AWS S3 as the storage interface, but they were in a dilemma in the selection of storage solutions: public cloud has low cost but cannot guarantee security; commercial solutions have high cost and cannot be withdrawn after investment; open source technology solutions are cheap but troublesome. After weighing the pros and cons, they finally chose Ceph, the most attractive and recognized cloud computing solution.

Ceph Best Practices

End-to-end application performance management at the code level

Then, Tingyun CTO Wood shared Tingyun's cloud-based end-to-end application performance management (APM) solution and Tingyun APM's practical experience and technology in application performance management, which was also full of practical information.

Wood explained that APM monitors and manages the performance and availability of software applications, and is committed to discovering and locating performance bottlenecks and faults to ensure that applications meet expected service levels. The entire application life cycle, from demand to development to testing and operation, requires monitoring. Traditional IT operations and maintenance have received great challenges under the complex application delivery chain, and APM's top-down monitoring method provides protection for users, businesses, codes, services, and user experience. APM can be implemented by embedding the simplest code possible in locations that may form performance bottleneck codes or may induce other performance problems. Wood then demonstrated real user cases of Tingyun App and Tingyun Server.

The issues that Tingyun App has always been concerned about are: network access (weak 2G/3G network, access by small operators), computer room links, server interfaces, third-party services (CDN, push, cloud services), regional operator issues (hijacking, failures), terminal equipment, system differences, code efficiency (interaction freezes, black and white screens), and code quality (crashes, exceptions, errors).

Tingyun App User Case

Listen to the issues that Cloud Server is concerned about: application response time, business performance, throughput rate, success rate, service performance (SQL, NoSQL, API, external services...), code efficiency (tracing, profiling), and code quality (errors, exceptions).

Listen to Cloud Server user cases

Bird Brother Hui Xinchen: Things about performance optimization

After a short break and Q&A session between the audience and the lecturer, Bird Brother (Hui Xinchen) came on stage and ignited the whole audience. As the most influential PHP technical expert in China, Bird Brother, currently the chief architect of the platform and data department and chief PHP consultant of Sina Weibo, has rich experience in performance optimization in programming language practice and system architecture. Bird Brother's experience in performance optimization gave everyone a lot of inspiration in this lecture.

[[134886]]

Bird said that performance optimization is a multifaceted matter. Before focusing on application performance, you should first consider the correctness, stability, and security of the application. You should proceed after you have determined that optimization is necessary. Performance optimization should not be the work of one person or one team. He warned everyone not to optimize based on subjective assumptions. When optimizing performance, you need a standard to measure the optimization process, and you also need to determine the optimization steps and time period.

Then Bird said that performance optimization should be developed from the business level to the management level, and then to different levels. The optimization benefits of the top business level are often the greatest. It is very necessary for everyone involved in the optimization to write logs. Start with the system environment to optimize. First, check if there are any problems with the configuration, then check if the module is suitable, and finally expand to different levels. This process continues until you are satisfied.

Finally, Bird Brother encourages everyone to build a "system" to optimize your system. The core of operation and maintenance is visualization. It is something that should be done early to bring together various problems in the system into something that is very visual and easy to see. At the same time, Bird Brother also recommends that you use excellent APM products such as Tingyun.

58.com's MongoDB to MySQL migration

At the end of the lecture, 58.com system architect Sun Xuan brought everyone the problems encountered when the amount of data increases and business is concurrent, their solutions, and the migration plan from MongoDB to MySQL.

Sun Xuan mentioned that he chose MongoDB because it is easy to expand, has high performance, rich query support and automatic indexing, and made significant adjustments in usage according to business needs. Then Sun Xuan shared with everyone the deployment of MongoDB and some practical application experience.

Introduction to MongoDB deployment

Finally, Sun Xuan talked about how when the business continued to increase and the data grew, he found that the overall performance was declining. After adding memory and hard disk, the business was temporarily stable, but the problem could not be completely solved.

Because the MongoDB process itself is unstable. Finally, we chose MongoDB+SSD to solve the problem and decided to implement the MongoDB to MySQL migration plan. Different solutions were adopted for two different data types during the migration: simple time-sensitive data was migrated through the dual-head method, and permanent and valid core data was solved through the message queue method to solve the data traction problem.

At this point, the third Tingyun Application Performance Management Lecture Hall has come to an end. After the lecture, the friends were reluctant to leave for a long time. They surrounded the lecturers in groups of three or five, asking technical questions, personal questions, and taking photos with the lecturers. I believe that this lecture hall will not be just a small fragment of everyone's work and life. Let us look forward to the arrival of the next one!