beautifulsoup


Error whilst requesting a login to a site


last EDIT:
It seems that i am connecting to the website but for some reason i get an error with my code!Probably i do something wrong with BeautifulSouP.I am thinking that i should change somethin on the url variable!
def connect():
with requests.Session() as c:
urll2 = "http://www.oddscheck.net/inc/userlogin.php"
payload= {
'useremail': 'email#gmail.com',
'userpassword':'password',
'PHPSESSID' : 'ih79c4t5srr6p2',
'CF-RAY' : '35f784ad1-ATH'
}
headers = {}
headers['User-Agent'] = 'Mozilla/5.0 (X11; Linux i686; rv:10.0) Gecko/20100101 Firefox/10.0'
c.post(urll2,data=payload,headers={"Referer": "http://www.oddscheck.net/?page=home&cmd=def"})
url = c.get('http://www.oddscheck.net/index.php?page=myaccount')
req = urllib.request.Request(url, headers=headers)
resp = urllib.request.urlopen(req)
soup = BS(resp, "html.parser")
gamesave = ""
for record in soup.find_all("tr"):
game = game1=""
for data in record.find_all("td"):
if data.get('class') == ['centertd', 'col_10']:
for link in data.find_all("a"):
game1 += ", "+"http://www.oddscheck.net/"+link.get('href')
else:
game += ","+data.text
game2 = game+game1
if len(game2) > 40:
gamesave += game[1:]+","+game1[1:]+"\n"
#header = "League,Time,1,X,2,U,O,Link"+"\n"
file = open(os.path.expanduser("Odss.txt"),"wb")
#file.write(bytes(header, encoding="UTF-8",errors="ignore"))
file.write(bytes(gamesave, encoding="UTF-8",errors="ignore"))
file.close()
ERROR I GET:
The error i get:
Traceback (most recent call last):
File "sportingbet.py", line 314, in <module>
connect()
File "sportingbet.py", line 27, in connect
req = urllib.request.Request(url, headers=headers)
File "/usr/lib/python3.5/urllib/request.py", line 269, in __init__
self.full_url = url
File "/usr/lib/python3.5/urllib/request.py", line 295, in full_url
self._parse()
File "/usr/lib/python3.5/urllib/request.py", line 324, in _parse
raise ValueError("unknown url type: %r" % self.full_url)
ValueError: unknown url type: 'Response [200]
urll = "http://www.oddscheck.net/inc/userlogin.php"
I'd take the extra 'l' out in urll
The client-side variable name for your URL must be consistent with that of the variable for the server-side. Assuming you already know the name of it, you should just be able to change it to that and have it run.

Related Links

Extracting data from BeautifulSoup result set [closed]
ImportError: cannot import name 'HTMLAwareEntitySubstitution'
Beautifulsoup extract multiple lines
Encoding error while trying to web scrape with BeautifulSoup
parsing this data with beautiful soup
requests + bs4 no results from pages
How to remove redundant space in BeautifulSoup output
data-lazy beautifulsoup html find
How to parse and find the next 'td' after specific text in HTML
Beautifulsoup xml no data when write()
Using ipython no response
BeautifulSoup is randomly skipping page data
Python3, Beautifulsoup4 tag confusion
Web scraping an address using Beautiful Soup
How to detect captchas when scraping google?
How to extract release year from IMDB data using BeautifulSoup

Categories

HOME
scikit-learn
paraview
spark-streaming
jsf-2.2
vxml
interpolation
android-json
trac
performancepoint
fosrestbundle
ibeacon-android
cmdb
zerobrane
sigma.js
nim
boost-icl
replication
windows-xp
ksh
gulp-watch
pagespeed
visual-studio-extensions
flask-sqlalchemy
xunit
jboss6.x
android-sharedpreferences
subclass
volatile
zend-debugger
dumpbin
spring-security4
linkedhashmap
hard-drive
fossil
nested-lists
python-import
jwplayer6
sql-delete
raft
alphabetical
git-rewrite-history
jpad
odroid
resolution
android-checkbox
drupal-theming
importerror
vaadin-elements
lightning
singleinstance
context-sensitive-grammar
compiler-design
excel-dna
rxtx
testrail
node-request
pytables
stax
omxplayer
pre-build-event
turbo-prolog
cortex-m
blitline
phpgrid
rasterize
libvlc
dynamics-nav-2016
slash
finalbuilder
exceldatareader
iiop
big-ip
device-tree
insight.database
gnumeric
synapse
syndicationfeed
light
kendo-dataviz
abstract-data-type
chart-director
database-create
ie-compatibility-mode
sifr3

Resources

Encrypt Message