beautifulsoup


Error whilst requesting a login to a site


last EDIT:
It seems that i am connecting to the website but for some reason i get an error with my code!Probably i do something wrong with BeautifulSouP.I am thinking that i should change somethin on the url variable!
def connect():
with requests.Session() as c:
urll2 = "http://www.oddscheck.net/inc/userlogin.php"
payload= {
'useremail': 'email#gmail.com',
'userpassword':'password',
'PHPSESSID' : 'ih79c4t5srr6p2',
'CF-RAY' : '35f784ad1-ATH'
}
headers = {}
headers['User-Agent'] = 'Mozilla/5.0 (X11; Linux i686; rv:10.0) Gecko/20100101 Firefox/10.0'
c.post(urll2,data=payload,headers={"Referer": "http://www.oddscheck.net/?page=home&cmd=def"})
url = c.get('http://www.oddscheck.net/index.php?page=myaccount')
req = urllib.request.Request(url, headers=headers)
resp = urllib.request.urlopen(req)
soup = BS(resp, "html.parser")
gamesave = ""
for record in soup.find_all("tr"):
game = game1=""
for data in record.find_all("td"):
if data.get('class') == ['centertd', 'col_10']:
for link in data.find_all("a"):
game1 += ", "+"http://www.oddscheck.net/"+link.get('href')
else:
game += ","+data.text
game2 = game+game1
if len(game2) > 40:
gamesave += game[1:]+","+game1[1:]+"\n"
#header = "League,Time,1,X,2,U,O,Link"+"\n"
file = open(os.path.expanduser("Odss.txt"),"wb")
#file.write(bytes(header, encoding="UTF-8",errors="ignore"))
file.write(bytes(gamesave, encoding="UTF-8",errors="ignore"))
file.close()
ERROR I GET:
The error i get:
Traceback (most recent call last):
File "sportingbet.py", line 314, in <module>
connect()
File "sportingbet.py", line 27, in connect
req = urllib.request.Request(url, headers=headers)
File "/usr/lib/python3.5/urllib/request.py", line 269, in __init__
self.full_url = url
File "/usr/lib/python3.5/urllib/request.py", line 295, in full_url
self._parse()
File "/usr/lib/python3.5/urllib/request.py", line 324, in _parse
raise ValueError("unknown url type: %r" % self.full_url)
ValueError: unknown url type: 'Response [200]
urll = "http://www.oddscheck.net/inc/userlogin.php"
I'd take the extra 'l' out in urll
The client-side variable name for your URL must be consistent with that of the variable for the server-side. Assuming you already know the name of it, you should just be able to change it to that and have it run.

Related Links

BeautifulSoup get_text() not returning all text
BeautifulSoup not getting entirety of extracted class
BeautifulSoup4: how to find a HTML element whose text contains an accented character?
Beautifulsoup replace colspan=2 with single col
How to search by name attribute?
What's the meaning of 'soup' in jsoup and Beautiful Soup?
Is there a shorter syntax than soup.select(“#visitor_stats”)[0]?
Why is this BeautifulSoup result []?
python 3.3 and beautifulsoup4-4.3.2
Py2exe doesn't find bs4
if else in FindAll using beautifulsoup
Is there any way to keep calling findChildren in BeautifulSoup with more concision?
How to get contents of nested tag using BeautifulSoup
BeautifulSoup parsing nested div tags
Passing results from mechanize to BeautifulSoup
Beautiful Soup, Ignoring Everything After A Comma

Categories

HOME
httparty
api
design-patterns
checkstyle
ggplot2
css3
nunit
pda
jmx
toolbox
battery
permissions
settings
vert.x
odoo-8
pkcs#11
sendgrid-api-v3
spin
fosrestbundle
gson
code-generation
comsol
package.json
mapstruct
sencha-touch
breadth-first-search
licensing
outliers
carrierwave
record
mailkit
getpixel
pdw-file-browser
sharepoint-workflow
reason
password-protection
xv6
plaintext
dcmtk
wmp
congestion-control
jide
singleinstance
carrot2
libjpeg
django-1.10
ampps
rxtx
juice-ui
reachability
cvxpy
vcloud-director-rest-api
slackware
simplepie
meteor-packages
adafruit
watch-os-2
dup
respondcms
kiosk
phpwebsocket
findfirst
jaunt-api
vhosts
assertion
fiware-monitoring
vigenere
fuelcms
batik
mraid
uvc
zend-currency
variadic-templates
jbake
imagefilter
encryption-asymmetric
parallel-testing
authlogic
menubar
cfcache
high-resolution
mvc-editor-templates
asdf
nevron
flex++
virtual-pc
twisted.web
joomla3.1
panda3d
extreme-programming
boost-signals
objectquery
azman
stress
saxparseexception
update-statement
webdev.webserver
jqote
tournament
quotation-marks
cdonts
cruisecontrol.rb
folding
web-garden
isapi-extension
zend-rest
scrollbars
mathematical-notation
visualj#
int64

Resources

Database Users
RDBMS discuss
Database Dev&Adm
javascript
java
csharp
php
android
javascript
java
csharp
php
python
android
jquery
ruby
ios
html
Mobile App
Mobile App
Mobile App