beautifulsoup


Error whilst requesting a login to a site


last EDIT:
It seems that i am connecting to the website but for some reason i get an error with my code!Probably i do something wrong with BeautifulSouP.I am thinking that i should change somethin on the url variable!
def connect():
with requests.Session() as c:
urll2 = "http://www.oddscheck.net/inc/userlogin.php"
payload= {
'useremail': 'email#gmail.com',
'userpassword':'password',
'PHPSESSID' : 'ih79c4t5srr6p2',
'CF-RAY' : '35f784ad1-ATH'
}
headers = {}
headers['User-Agent'] = 'Mozilla/5.0 (X11; Linux i686; rv:10.0) Gecko/20100101 Firefox/10.0'
c.post(urll2,data=payload,headers={"Referer": "http://www.oddscheck.net/?page=home&cmd=def"})
url = c.get('http://www.oddscheck.net/index.php?page=myaccount')
req = urllib.request.Request(url, headers=headers)
resp = urllib.request.urlopen(req)
soup = BS(resp, "html.parser")
gamesave = ""
for record in soup.find_all("tr"):
game = game1=""
for data in record.find_all("td"):
if data.get('class') == ['centertd', 'col_10']:
for link in data.find_all("a"):
game1 += ", "+"http://www.oddscheck.net/"+link.get('href')
else:
game += ","+data.text
game2 = game+game1
if len(game2) > 40:
gamesave += game[1:]+","+game1[1:]+"\n"
#header = "League,Time,1,X,2,U,O,Link"+"\n"
file = open(os.path.expanduser("Odss.txt"),"wb")
#file.write(bytes(header, encoding="UTF-8",errors="ignore"))
file.write(bytes(gamesave, encoding="UTF-8",errors="ignore"))
file.close()
ERROR I GET:
The error i get:
Traceback (most recent call last):
File "sportingbet.py", line 314, in <module>
connect()
File "sportingbet.py", line 27, in connect
req = urllib.request.Request(url, headers=headers)
File "/usr/lib/python3.5/urllib/request.py", line 269, in __init__
self.full_url = url
File "/usr/lib/python3.5/urllib/request.py", line 295, in full_url
self._parse()
File "/usr/lib/python3.5/urllib/request.py", line 324, in _parse
raise ValueError("unknown url type: %r" % self.full_url)
ValueError: unknown url type: 'Response [200]
urll = "http://www.oddscheck.net/inc/userlogin.php"
I'd take the extra 'l' out in urll
The client-side variable name for your URL must be consistent with that of the variable for the server-side. Assuming you already know the name of it, you should just be able to change it to that and have it run.

Related Links

parsing this data with beautiful soup
requests + bs4 no results from pages
How to remove redundant space in BeautifulSoup output
data-lazy beautifulsoup html find
How to parse and find the next 'td' after specific text in HTML
Beautifulsoup xml no data when write()
Using ipython no response
BeautifulSoup is randomly skipping page data
Python3, Beautifulsoup4 tag confusion
Web scraping an address using Beautiful Soup
How to detect captchas when scraping google?
How to extract release year from IMDB data using BeautifulSoup
beautifulsoup, html5lib: module object has no attribute _base
BeautifulSoup/lxml - Extract href, and converting line breaks to to csv columns?
Adding beautifulsoup in pycharm
BS4 - grabbing information from something youve already parsed

Categories

HOME
service-worker
httparty
delphi-7
apache-jena
ecmascript-6
hessian
owl-carousel
opendj
xbee
permissions
trac
okhttp
dkim
openpyxl
libc
internationalization
powershell-v5.0
fileserver
symfony-console
connector
jquery-callback
froala
linked-data
gp
twiml
magento-1.8
volatile
recurring-events
dst
paragraph
sharding
baidu-map
openalpr
numberpicker
ogc
preloader
chronicle-map
uiimage
double-click
wcftestclient
spring-integration-sftp
mschart
avx
jqchart
css-transforms
seq
cmp
mathcad
rxtx
branch-prediction
materialized-path-pattern
visual-studio-2008-sp1
ziparchive
preprocessor
segment-io
spring-cloud-feign
udpclient
spreadjs
turbo-prolog
relativelayout
libvlc
r-package
django-urls
amiga
haskell-warp
entity-framework-4.3
zend-currency
android-broadcast
shopizer
malformedurlexception
xml-dsig
wxformbuilder
jquery-slider
mt4j
inputmismatchexception
isqlquery
merb
actiondispatch
onload-event
frameworkelementfactory
listitem
screen-size
workflow-services
filemerge
ruby-1.8
delimited-text
updatesourcetrigger
interprocess
lalr
complex-event-processing
change-management
netbeans6.1

Resources

Encrypt Message



code
soft
python
ios
c
html
jquery
cloud
mobile