The third episode of the Aiti tribe consultation: Analysis of Python's advantages in big data processing

【51CTO.com original article】 Activity description : Aiti Tribe is a service community that provides core developers with in-depth technical exchanges, solutions to development needs, and resource sharing. Based on this community, we invite industry technology experts to provide one-on-one breakthroughs on development needs and remove stumbling blocks in the development process. We help developers solve development problems with the most professional and efficient answers.

[[183364]]

Python

Topic Keywords : Database Android

Tribe lineup : Hou Shengwen, co-founder of Enmo Academy;

Target audience : mobile developers, IT operations, data analysts

How to participate : Join the 51CTO developer QQ exchange group 370892523. If you have any technical questions, ask in the group or send them to the group owner.

Event Details :

Q: Zhengzhou-Baiyang-Web: Are there any businesses still using SQL2008 or Oracle? The school will have a batch of new systems next year, and is currently considering the proposal of Party A through bidding. The business involved includes one-card system, data of new and old students, dormitory management, finance, etc. Data I/O is relatively frequent. Because our central database currently uses Oracle, the leadership requires development in the direction of data DB to determine which database can ensure that there will not be too much generation gap in the next few years, and it should be considered based on the data sorting and framework of the whole school. The demonstration given by the company also uses Oracle. After all, it can be connected with the current database. The business process is roughly circulated within the school, and it is required to be able to accept data throughput of at least 20,000 people. Additions, deletions, modifications and inquiries are also carried out based on daily finance, consumption, student information, grades, etc.

A: Hou Shengwen | Co-founder of Enmo College: If you have enough money, just use Oracle. There will be no problem with future expansion. If you have enough money, MySQL is OK. Some NewSQL technologies are mature and easy to migrate directly. Schools generally do not use big data platforms yet.

Q: Guangzhou-Diqin dQ-PHP: I would like to ask if Python is feasible for big data processing? What are its advantages and disadvantages? As far as I know, Python cannot run on multiple cores, has low execution efficiency, and may have big problems under concurrency.

Answer: Beijing - Cao Hongwei - Half-baked full-stack craftsman: I think Python is the best choice for processing big data. It can be used for both research and product development. Python has many advantages. It is close to pseudo code. Both data analysts and engineers can use it, which makes communication easier.

Q: Chongqing-zee-terminal: In the video business, from which aspects can we analyze user habits (which will help improve user experience)? Live broadcast and on-demand.

Answer: Xu Tao: User portraits are "labeling" users. User portraits can be divided into static labels and dynamic labels. Static labels are indicators that are rarely updated or almost unchanged, such as user personal information. Dynamic labels are user behavior labels, such as the favorite categories of live broadcast stations. Labels are added through user behavior logs and transaction flow data. Some websites/APPs only have a small amount of user personal information, but through labeling, we can obtain a large amount of user behavior logs. We can predict the user's gender, age group, city type, job type, etc. through cluster analysis. Some of the more characteristic labels of live broadcast stations include: favorite anchors, habitual online time periods, sign-in users, etc.

Q: Hunan-Pian'ao-Operation and Maintenance: The AP for wireless WiFi in a large conference room with a high density of users (large conference rooms) is the AP for conference rooms with more than 300 people. 300 people can attend the meeting and access the Internet via wireless WiFi at the same time. Mobile phones, tablets, and laptops can connect to WiFi at the same time in a large conference room. The problem is that each AP can only connect to 20~30 users, and if too many APs are installed, there will not be enough channels. Ordinary APs cannot support 20 users. The only requirement is that all APs have the same SSID and password.

A: Momo Operations: This scenario is quite common. There are two solutions. One is to use a dedicated high-density AP, and the other is to use a common AP with a semi-directional antenna and tune it. The same SSID and password can be used, which is relatively easy.

Ruijie: Ruijie RG-AP520 router can support it.

Q: Beijing-Android-Yangyang: Regarding the use of WebView controls. How to be compatible with different Android versions when using WebView? WebView controls are different for different Android versions. I want to run H5 applications in WebView.

Answer: 51CTO: This is too general. There are many aspects to compatibility, just like how Android apps are compatible. It depends on the specific problem. If you ask all of them, I can only say to look at the source code of other people's browsers.

Q: Beijing - Song Junjun - Android Development: Packaging problem, I have an Android SDK, and I need to split the SDK into multiple ANRs according to functions. There are some common modules among them. Now after turning on obfuscation, the common will be obfuscated first, and then the function package that depends on it will not be able to find the class. I have many modules, but some modules need to be obfuscated externally, but they need to be referenced by other modules internally. In other words, I have many modules, and these modules need to become 1 SDK. The calls between each other are not obfuscated. After packaging, only a few are not obfuscated.

Answer: 51CTO: You can learn about flavors. Gradle can configure multiple flavors. Each flavor can be configured separately. The internal and external flavors can be configured as a flavor respectively. Multi-engine dependencies are done in this way.

Q: Jiangsu-Untitled-Rookie: How to write a script to pull text data from another Linux server? How to write a script to execute it at a fixed time?

Answer: Guangzhou-Little Star-PHP: Linux has a crontab script, Java Timer, or other timers based on programming languages. There are also separate timers implemented in C.

Q: Guangzhou-Mr. Peng: Does anyone have a video tutorial on WeChat Mini Programs? Please share.

Answer: Nanjing-Android-Li Sansan: I happen to be learning too, share it to Baidu Netdisk, click here>>

Do you still have questions about these solutions? Welcome to join the 51CTO developer QQ exchange group 370892523 for discussion.

Next event: April 7

Keywords: development tools, APP release

Activity review: Aiti Tribe ***: Spark offline analysis dimension

The second issue of Aiti Tribe: Application and practice of big data in the medical field

[51CTO original article, please indicate the original author and source as 51CTO.com when reprinting on partner sites]