Web crawler technology creates its own Youdao dictionary

Here we talk about reptile related technologies , use python Language to achieve .python The powerful library provides us with many conveniences , Its unique language characteristics are deeply loved by the majority of ape friends . today , Introduce how to use python Web crawler technology to input your own Youdao Dictionary . 1： utilize Google Let's check some source code of Youdao official website

First, open Youdao's official website , Right click , There are options to check , We click to check , Click again network, Enter information in the box to translate , On the right network There will be changes in the future . as follows ：

2： Let's look for relevant information , Code blocks related to our input . Let's click on method Here are some ways , Among them is get,post, If you don't find method, stay name Right click under the same box to find method The tab of , Click to . Let's click on a post The name before the method , The following appears , Pictured ：

Let's look at the code taken down here , These include URL, Request header , Requested method , Status code , And the address , These are familiar basic in the field of reptiles Request URL: http://fanyi.youdao.com/translate_o?smartresult=dict&smartresult=rule Request Method: POST Status Code: 200 OK Remote Address: 220.181.76.84:80 Referrer Policy: no-referrer-when-downgrade What do we need ？ Keep looking down , look for fromdata:, Here's what we're looking for , Of course, what we are looking for may be different , But you're looking for post Medium fromdata, Because the program needs i: woaibian from: AUTO to: AUTO smartresult: dict client: fanyideskweb salt: 15971347706367 sign: 6ad80e525096fac4d1d2d8276439147a lts: 1597134770636 bv: 7b07590bbf1761eedb1ff6dbfac3c1f0 doctype: json version: 2.1 keyfrom: fanyi.web action: FY_BY_REALTlME Let's look at the code first ：

"""
designer :  Jiang Guangdao 
function :  Crawl Youdao website content to realize your own dictionary 
version : 1.0
date: 08/08/2020
"""
import urllib.request    # Import urlib Medium request modular 
import urllib.parse   #parse It's analytic 
import json #json It's a format 
text = input(" Please input the content to be translated  ：")
url = "http://fanyi.youdao.com/translate?smartresult=dict&smartresult=rule"# Be careful , This url If there is 0_ Or is it _0 dependent , Can be removed , This seems to be related to the anti reptile mechanism , I've tried it myself .
head={}# Here to simulate the browser 
head["User-Agent"] = "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.105 Safari/537.36"
data = {}#data It's a dictionary form , This is exactly what we need to extract 
data["i"]= text
data["from"]= "AUTO"
data["to"]="AUTO"
data["smartresult"]= "dict"
data["client"]= "fanyideskweb"
data["salt"]= "15968687717172"
data["sign"]= "ffbf6f4c0c2001ae735f6fb95de58a04"
data["lts"]= "1596868771717"
data["bv"]= "7b07590bbf1761eedb1ff6dbfac3c1f0"
data["doctype"]= "json"
data["version"]= "2.1"
data["keyfrom"]="fanyi.web"
data["action"]= "FY_BY_CLICKBUTTION"
data = urllib.parse.urlencode(data).encode("utf-8")#data Switch here 
rep = urllib.request.Request(url,data,head) # Here comes data, The request mode changes to post, Here is the visit 
reponse = urllib.request.urlopen(rep)
html = reponse.read().decode("utf-8")# Set the code 
target = json.loads(html)
html_ = target["translateResult"]
html__ = html_[0][0]
print(" Translation results ",html__["tgt"])

My program tests are as follows ：

The other thing I want to say is this ,python It also has a Translation Library , But its nature has its limitations , Here I also give the code ：

"""
designer :  Jiang Guangdao 
function :  Use of translation module 
version : 1.0
date : 04/08/2020
"""
import os
from translate import Translator
Translator = Translator(from_lang="chinese",to_lang="english")
message__ = input(" Please enter the information to be translated ")
translation = Translator.translate(message__)
print(translation)

See did not think of simple , But in fact, this translation is slow , My tests are as follows ：

Welcome to leave a message , I wish you all learn programming well ！