beautifulsoup


Error whilst requesting a login to a site


last EDIT:
It seems that i am connecting to the website but for some reason i get an error with my code!Probably i do something wrong with BeautifulSouP.I am thinking that i should change somethin on the url variable!
def connect():
with requests.Session() as c:
urll2 = "http://www.oddscheck.net/inc/userlogin.php"
payload= {
'useremail': 'email#gmail.com',
'userpassword':'password',
'PHPSESSID' : 'ih79c4t5srr6p2',
'CF-RAY' : '35f784ad1-ATH'
}
headers = {}
headers['User-Agent'] = 'Mozilla/5.0 (X11; Linux i686; rv:10.0) Gecko/20100101 Firefox/10.0'
c.post(urll2,data=payload,headers={"Referer": "http://www.oddscheck.net/?page=home&cmd=def"})
url = c.get('http://www.oddscheck.net/index.php?page=myaccount')
req = urllib.request.Request(url, headers=headers)
resp = urllib.request.urlopen(req)
soup = BS(resp, "html.parser")
gamesave = ""
for record in soup.find_all("tr"):
game = game1=""
for data in record.find_all("td"):
if data.get('class') == ['centertd', 'col_10']:
for link in data.find_all("a"):
game1 += ", "+"http://www.oddscheck.net/"+link.get('href')
else:
game += ","+data.text
game2 = game+game1
if len(game2) > 40:
gamesave += game[1:]+","+game1[1:]+"\n"
#header = "League,Time,1,X,2,U,O,Link"+"\n"
file = open(os.path.expanduser("Odss.txt"),"wb")
#file.write(bytes(header, encoding="UTF-8",errors="ignore"))
file.write(bytes(gamesave, encoding="UTF-8",errors="ignore"))
file.close()
ERROR I GET:
The error i get:
Traceback (most recent call last):
File "sportingbet.py", line 314, in <module>
connect()
File "sportingbet.py", line 27, in connect
req = urllib.request.Request(url, headers=headers)
File "/usr/lib/python3.5/urllib/request.py", line 269, in __init__
self.full_url = url
File "/usr/lib/python3.5/urllib/request.py", line 295, in full_url
self._parse()
File "/usr/lib/python3.5/urllib/request.py", line 324, in _parse
raise ValueError("unknown url type: %r" % self.full_url)
ValueError: unknown url type: 'Response [200]
urll = "http://www.oddscheck.net/inc/userlogin.php"
I'd take the extra 'l' out in urll
The client-side variable name for your URL must be consistent with that of the variable for the server-side. Assuming you already know the name of it, you should just be able to change it to that and have it run.

Related Links

Mobile Site not giving correct Data - Beautiful Soup
Beautifulsoup Table Scraping table navigation
Beautiful Soup Scrape not showing properly
Retrieving table data from the <description> of multiple points in a kml file
beautifulsoup find_all bug?
Parse and remove HTML tags using Google Refine/OpenRefine & Jsoup/BeautifulSoup
How can I do a diff between two webpages with Beautiful Soup
BeautifulSoup get_text() not returning all text
BeautifulSoup not getting entirety of extracted class
BeautifulSoup4: how to find a HTML element whose text contains an accented character?
Beautifulsoup replace colspan=2 with single col
How to search by name attribute?
What's the meaning of 'soup' in jsoup and Beautiful Soup?
Is there a shorter syntax than soup.select(“#visitor_stats”)[0]?
Why is this BeautifulSoup result []?
python 3.3 and beautifulsoup4-4.3.2

Categories

HOME
android
design-patterns
deep-learning
pyqt
rsa
solver
owl-carousel
grafana
rendering
permissions
hugo
echo
nfs
teechart
32bit-64bit
jquery-ui-sortable
reactive-programming
scsi
job-scheduling
video-editing
production
sar
jquery-ias
jboss6.x
mount
definitelytyped
android-sharedpreferences
firebase-analytics
spotipy
exchangewebservices
uitapgesturerecognizer
magento-1.8
left-join
hreflang
vue-chartjs
getpixel
baidu-map
numpy-broadcasting
searchkit
mcustomscrollbar
skylink
dynamic-linq
gitlist
spring-integration-sftp
fclose
payara-micro
tinkerpop
wpas
compiler-design
trigger.io
pure-css
reporting-services-2012
hadoop-2.7.2
pre-build-event
ascii-art
relativelayout
spring-retry
grgit
rewrite
toolkit
mod-proxy
airbrake
snoop
git-ftp
kubuntu
fits
umlgraph
broadband
jama
trdion2011
create.js
named-parameters
cancellation
malformedurlexception
jjaql
file-not-found
decoupling
square-bracket
drupal-nodes
sphinxql
ui-select2
octal
chart-director
wimax
cuda-gdb
ikimagebrowserview
landscape-portrait
event-receiver
twitterizer
cloudfiles
resharper-6.0
silent
dot-emacs
addchild
folding
pos-for-.net
silverlight-oob
lalr
tui
asynchronous-wcf-call
software-lifecycle
int64
entitykey
blind
cardspace

Resources

Mobile Apps Dev
Database Users
javascript
java
csharp
php
android
MS Developer
developer works
python
ios
c
html
jquery
RDBMS discuss
Cloud Virtualization
Database Dev&Adm
javascript
java
csharp
php
python
android
jquery
ruby
ios
html
Mobile App
Mobile App
Mobile App