beautifulsoup


Error whilst requesting a login to a site


last EDIT:
It seems that i am connecting to the website but for some reason i get an error with my code!Probably i do something wrong with BeautifulSouP.I am thinking that i should change somethin on the url variable!
def connect():
with requests.Session() as c:
urll2 = "http://www.oddscheck.net/inc/userlogin.php"
payload= {
'useremail': 'email#gmail.com',
'userpassword':'password',
'PHPSESSID' : 'ih79c4t5srr6p2',
'CF-RAY' : '35f784ad1-ATH'
}
headers = {}
headers['User-Agent'] = 'Mozilla/5.0 (X11; Linux i686; rv:10.0) Gecko/20100101 Firefox/10.0'
c.post(urll2,data=payload,headers={"Referer": "http://www.oddscheck.net/?page=home&cmd=def"})
url = c.get('http://www.oddscheck.net/index.php?page=myaccount')
req = urllib.request.Request(url, headers=headers)
resp = urllib.request.urlopen(req)
soup = BS(resp, "html.parser")
gamesave = ""
for record in soup.find_all("tr"):
game = game1=""
for data in record.find_all("td"):
if data.get('class') == ['centertd', 'col_10']:
for link in data.find_all("a"):
game1 += ", "+"http://www.oddscheck.net/"+link.get('href')
else:
game += ","+data.text
game2 = game+game1
if len(game2) > 40:
gamesave += game[1:]+","+game1[1:]+"\n"
#header = "League,Time,1,X,2,U,O,Link"+"\n"
file = open(os.path.expanduser("Odss.txt"),"wb")
#file.write(bytes(header, encoding="UTF-8",errors="ignore"))
file.write(bytes(gamesave, encoding="UTF-8",errors="ignore"))
file.close()
ERROR I GET:
The error i get:
Traceback (most recent call last):
File "sportingbet.py", line 314, in <module>
connect()
File "sportingbet.py", line 27, in connect
req = urllib.request.Request(url, headers=headers)
File "/usr/lib/python3.5/urllib/request.py", line 269, in __init__
self.full_url = url
File "/usr/lib/python3.5/urllib/request.py", line 295, in full_url
self._parse()
File "/usr/lib/python3.5/urllib/request.py", line 324, in _parse
raise ValueError("unknown url type: %r" % self.full_url)
ValueError: unknown url type: 'Response [200]
urll = "http://www.oddscheck.net/inc/userlogin.php"
I'd take the extra 'l' out in urll
The client-side variable name for your URL must be consistent with that of the variable for the server-side. Assuming you already know the name of it, you should just be able to change it to that and have it run.

Related Links

Web scraping an address using Beautiful Soup
How to detect captchas when scraping google?
How to extract release year from IMDB data using BeautifulSoup
beautifulsoup, html5lib: module object has no attribute _base
BeautifulSoup/lxml - Extract href, and converting line breaks to to csv columns?
Adding beautifulsoup in pycharm
BS4 - grabbing information from something youve already parsed
Using Mechanize To login to gmail
HOWTO: beautifulsoup4 delete content and tags through find or the find_all
lxml.html working with unicode data
Beautiful Soup 4 Not Working/Consistent
BeautifulSoup, Recursively Address A Tag with String Argument
html5lib makes BeautifulSoup miss an element
Remove duplicate url's python beautifulsoup
Beautiful Soup (Python) : find all kind of div, p, span, etc, with a given class
Beautiful Soup Unicode Encoding Error

Categories

HOME
oracle12c
hyperlink
interface
jwplayer
alarm
ms-access-2016
trac
sendgrid-api-v3
endeca
x-cart
intercom
android-intent
bitnami
intershop
sar
ksh
resourcebundle
inversion-of-control
rpgle
mql
powershell-ise
mustache
testbed
glib
autolisp
jett
engine.io
swagger-php
openproject
ideascript
android-augmented-reality
verifiable-c
demo
jvmti
branching-and-merging
xmldocument
oim
facebook-social-plugins
jboss-4.2.x
opennms
netbeans6.8
openblas
oracleclient
excel-dna
dt
monkey
rackspace-cloud
flac
cpu-cache
cronexpression
chromium-os
reporting-services-2012
redbeard-ios
mapinfo
delta
vorpal.js
refinerycms
query-by-example
bizagi
cda
turbo-prolog
nullable
httpruntime.cache
phpgrid
dynatree
intel-c++
pyobjc
keyup
uvc
gamekit
build-script
personalization
koala
scriptaculous
jammer
asdf
facebook-timeline
epiceditor
idn
tree-balancing
saleslogix
os.system
httponly
kqueue
google-maps-mobile
luabind
flex-mobile
gobject-introspection
ikimagebrowserview
ruby-1.8
resharper-6.0
alsb
fail-fast-fail-early
java1.4

Resources

Mobile Apps Dev
Database Users
javascript
java
csharp
php
android
MS Developer
developer works
python
ios
c
html
jquery
RDBMS discuss
Cloud Virtualization
Database Dev&Adm
javascript
java
csharp
php
python
android
jquery
ruby
ios
html
Mobile App
Mobile App
Mobile App