FMZ platform Python replicator app for the first time - crawling Binance announcements

FMZ platform Python replicator app for beginners to crawl Binance announcements

Recently I looked at the community, the library has no relevant information about Python reptiles, based on the spirit of being a QUANT comprehensive development. Very, very superficial learning of reptile-related concepts and knowledge. After learning about "Reptile Technology" I found out that the pit is quite large, this article is just a first look at "Reptile Technology".

The need

For new traders, it is always desirable to get the information about the exchange at the first time. It is obviously unrealistic to have people staring at the exchange's website all the time. So on demand, use reptile scripts to monitor the exchange's announcement page, detect new announcements and get notified at the first time.

The first visit

A very simple program is used as an introduction (truly powerful crawler scripts are much more complicated, slowly come first). The program logic is very simple, it allows the program to continuously access the announcement page of the exchange, analyze the HTML content obtained, and detect whether the content of a specific tag is updated.

Implementing code

It is possible to use some useful reptile frameworks. However, it is also possible to write directly, considering the simplicity of the requirements.

The following libraries are required to use Python:requestsThis is a library that is used to access web pages.bs4It can be understood as a library for parsing HTML code on a web page.

The code is:

from bs4 import BeautifulSoup
import requests

urlBinanceAnnouncement = "https://www.binancezh.io/en/support/announcement/c-48?navId=48"  # 币安公告页面地址

def openUrl(url):
    headers = {'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.108 Safari/537.36'}
    r = requests.get(url, headers=headers)     # 使用requests库访问url，即币安的公告网页地址
    if r.status_code == 200:
        r.encoding = 'utf-8'
        # Log("success! {}".format(url))
        return r.text                          # 访问成功的话返回网页内容文本
    else:
        Log("failed {}".format(url))


def main():
    preNews_href = ""
    lastNews = ""
    Log("watching...", urlBinanceAnnouncement, "#FF0000")
    while True:
        ret = openUrl(urlBinanceAnnouncement)
        if ret:
            soup = BeautifulSoup(ret, 'html.parser')                       # 把网页文本解析为对象
            lastNews_href = soup.find('a', class_='css-1ej4hfo')["href"]   # 查找特定的标签，获取href
            lastNews = soup.find('a', class_='css-1ej4hfo').get_text()     # 获取这个标签中的内容
            if preNews_href == "":
                preNews_href = lastNews_href
            if preNews_href != lastNews_href:                              # 检测到标签发生变动，即有新的公告产生
                Log("New Cryptocurrency Listing update!")                  # 打印提示信息
                preNews_href = lastNews_href
        LogStatus(_D(), "\n", "preNews_href:", preNews_href, "\n", "news:", lastNews)
        Sleep(1000 * 10)

Running

It can even be extended to detect new announcements; analyze new currencies in the announcement and automatically place new orders.