beautifulsoup


Error whilst requesting a login to a site


last EDIT:
It seems that i am connecting to the website but for some reason i get an error with my code!Probably i do something wrong with BeautifulSouP.I am thinking that i should change somethin on the url variable!
def connect():
with requests.Session() as c:
urll2 = "http://www.oddscheck.net/inc/userlogin.php"
payload= {
'useremail': 'email#gmail.com',
'userpassword':'password',
'PHPSESSID' : 'ih79c4t5srr6p2',
'CF-RAY' : '35f784ad1-ATH'
}
headers = {}
headers['User-Agent'] = 'Mozilla/5.0 (X11; Linux i686; rv:10.0) Gecko/20100101 Firefox/10.0'
c.post(urll2,data=payload,headers={"Referer": "http://www.oddscheck.net/?page=home&cmd=def"})
url = c.get('http://www.oddscheck.net/index.php?page=myaccount')
req = urllib.request.Request(url, headers=headers)
resp = urllib.request.urlopen(req)
soup = BS(resp, "html.parser")
gamesave = ""
for record in soup.find_all("tr"):
game = game1=""
for data in record.find_all("td"):
if data.get('class') == ['centertd', 'col_10']:
for link in data.find_all("a"):
game1 += ", "+"http://www.oddscheck.net/"+link.get('href')
else:
game += ","+data.text
game2 = game+game1
if len(game2) > 40:
gamesave += game[1:]+","+game1[1:]+"\n"
#header = "League,Time,1,X,2,U,O,Link"+"\n"
file = open(os.path.expanduser("Odss.txt"),"wb")
#file.write(bytes(header, encoding="UTF-8",errors="ignore"))
file.write(bytes(gamesave, encoding="UTF-8",errors="ignore"))
file.close()
ERROR I GET:
The error i get:
Traceback (most recent call last):
File "sportingbet.py", line 314, in <module>
connect()
File "sportingbet.py", line 27, in connect
req = urllib.request.Request(url, headers=headers)
File "/usr/lib/python3.5/urllib/request.py", line 269, in __init__
self.full_url = url
File "/usr/lib/python3.5/urllib/request.py", line 295, in full_url
self._parse()
File "/usr/lib/python3.5/urllib/request.py", line 324, in _parse
raise ValueError("unknown url type: %r" % self.full_url)
ValueError: unknown url type: 'Response [200]
urll = "http://www.oddscheck.net/inc/userlogin.php"
I'd take the extra 'l' out in urll
The client-side variable name for your URL must be consistent with that of the variable for the server-side. Assuming you already know the name of it, you should just be able to change it to that and have it run.

Related Links

BeautifulSoup Nested class selector
Beautiful Soup get the second attribute from element
beautiful soup parse a tags with inconsistent hrefs
How to crawl a website that uses dot.js using beautifulsoup?
Python BeautifulSoup how to extract/find
HOW DO I PARSE THE DATA IN THESE HTML TAGS?
BeautifulSoup's find method returns Tag item, but call string get 'NoneType' Error
Why is Beautifulsoup find_all not returning complete results?
How to iterate the tags under same tag?
How to scrape a tag under javascript tag?
Find productID with beautifulsoup
python: beautifulsoup4: scrapping: Unable to figure out the Error
Extracting data from BeautifulSoup result set [closed]
ImportError: cannot import name 'HTMLAwareEntitySubstitution'
Beautifulsoup extract multiple lines
Encoding error while trying to web scrape with BeautifulSoup

Categories

HOME
google-spreadsheet
jax-rs
mjml
rsa
youtube-data-api-v3
sh
bitbucket-api
limit
tvos
modal-dialog
dkim
stellar.js
favicon
code-generation
capistrano3
null-pointer
google-content-api
pyramid
windows-xp
rubymotion
blade
spring-async
babel
imageresizer
object-storage
stackexchange
angularjs-components
appirater
scatter3d
record
rselenium
vue-chartjs
html-encode
z-notation
verifiable-c
cin
opensmpp
visa
congestion-control
contract
apache-directory
flask-login
sonarlint-eclipse
configurationmanager
openblas
zenhub
stdmap
otp
pocketsphinx-android
restore
donations
node-request
redistributable
lrs
signalr.client
delta
dimension
udpclient
riot
php-socket
spreadjs
redis-cluster
np-spring
blitline
asyncdisplaykit
maybe
state-restoration
dynamics-nav-2016
boomerang
linklabel
opl
java-money
ess
ons-api
evolus-pencil
atoi
sql-server-data-tools
rdflib
actionfilterattribute
document-repository
cosine-similarity
metatrader5
paw
codeplex
tinyxml
vbe
conditionaltagsupport
windows-embedded-standard
rfc5322
artemis
gd-graph
breakout
model-driven-development
unit-of-work
gpars
css-reset
video-codecs
http-status-code-410
monotouch.dialog
multiplexing
httponly
hibernateexception
jqote
strsep
quotation-marks
delimited-text
maven-1
application-verifier
java1.4
business-model
netbeans6.1

Resources

Mobile Apps Dev
Database Users
javascript
java
csharp
php
android
MS Developer
developer works
python
ios
c
html
jquery
RDBMS discuss
Cloud Virtualization
Database Dev&Adm
javascript
java
csharp
php
python
android
jquery
ruby
ios
html
Mobile App
Mobile App
Mobile App