beautifulsoup


Error whilst requesting a login to a site


last EDIT:
It seems that i am connecting to the website but for some reason i get an error with my code!Probably i do something wrong with BeautifulSouP.I am thinking that i should change somethin on the url variable!
def connect():
with requests.Session() as c:
urll2 = "http://www.oddscheck.net/inc/userlogin.php"
payload= {
'useremail': 'email#gmail.com',
'userpassword':'password',
'PHPSESSID' : 'ih79c4t5srr6p2',
'CF-RAY' : '35f784ad1-ATH'
}
headers = {}
headers['User-Agent'] = 'Mozilla/5.0 (X11; Linux i686; rv:10.0) Gecko/20100101 Firefox/10.0'
c.post(urll2,data=payload,headers={"Referer": "http://www.oddscheck.net/?page=home&cmd=def"})
url = c.get('http://www.oddscheck.net/index.php?page=myaccount')
req = urllib.request.Request(url, headers=headers)
resp = urllib.request.urlopen(req)
soup = BS(resp, "html.parser")
gamesave = ""
for record in soup.find_all("tr"):
game = game1=""
for data in record.find_all("td"):
if data.get('class') == ['centertd', 'col_10']:
for link in data.find_all("a"):
game1 += ", "+"http://www.oddscheck.net/"+link.get('href')
else:
game += ","+data.text
game2 = game+game1
if len(game2) > 40:
gamesave += game[1:]+","+game1[1:]+"\n"
#header = "League,Time,1,X,2,U,O,Link"+"\n"
file = open(os.path.expanduser("Odss.txt"),"wb")
#file.write(bytes(header, encoding="UTF-8",errors="ignore"))
file.write(bytes(gamesave, encoding="UTF-8",errors="ignore"))
file.close()
ERROR I GET:
The error i get:
Traceback (most recent call last):
File "sportingbet.py", line 314, in <module>
connect()
File "sportingbet.py", line 27, in connect
req = urllib.request.Request(url, headers=headers)
File "/usr/lib/python3.5/urllib/request.py", line 269, in __init__
self.full_url = url
File "/usr/lib/python3.5/urllib/request.py", line 295, in full_url
self._parse()
File "/usr/lib/python3.5/urllib/request.py", line 324, in _parse
raise ValueError("unknown url type: %r" % self.full_url)
ValueError: unknown url type: 'Response [200]
urll = "http://www.oddscheck.net/inc/userlogin.php"
I'd take the extra 'l' out in urll
The client-side variable name for your URL must be consistent with that of the variable for the server-side. Assuming you already know the name of it, you should just be able to change it to that and have it run.

Related Links

BeautifulSoup's find method returns Tag item, but call string get 'NoneType' Error
Why is Beautifulsoup find_all not returning complete results?
How to iterate the tags under same tag?
How to scrape a tag under javascript tag?
Find productID with beautifulsoup
python: beautifulsoup4: scrapping: Unable to figure out the Error
Extracting data from BeautifulSoup result set [closed]
ImportError: cannot import name 'HTMLAwareEntitySubstitution'
Beautifulsoup extract multiple lines
Encoding error while trying to web scrape with BeautifulSoup
parsing this data with beautiful soup
requests + bs4 no results from pages
How to remove redundant space in BeautifulSoup output
data-lazy beautifulsoup html find
How to parse and find the next 'td' after specific text in HTML
Beautifulsoup xml no data when write()

Categories

HOME
batch-file
httparty
scikit-learn
deep-learning
time-complexity
codenvy
apache-flink
github-for-windows
google-spreadsheet
twig
hessian
jsf-2.2
spring-data-redis
spring-data-mongodb
angularfire2
fabric.io
jquery-ui-sortable
rtf
code-generation
comsol
docx
bitnami
modbus-tcp
chargify
google-container-registry
cfml
googlebot
pchart
event-store
object-storage
surveymonkey
amazon-quicksight
genexus-sd
iis-express
browser-sync
sqlpackage
sendbird
browser-extension
lint
password-protection
jvmti
watchface
portforwarding
android-ibeacon
logback-groovy
file-sharing
stylecop
jboss-4.2.x
chai-as-promised
podscms
carrot2
ngmaterial
universal-analytics
restore
lrs
signalr.client
swizzling
nservicebus5
deep
spreadjs
false-sharing
atan2
linklabel
sciruby
java-money
qt5.2
jdi
ember-cli-rails
snackbar
rrule
post-commit-hook
mintty
grails-plugin-rabbitmq
jjaql
twitter-bootstrap-rails
gae-quotas
gwt-openlayers
mongohq
cffile
actiondispatch
cardreader
android-sdk-2.3
onmousemove
patricia-trie
xcode3.2
iboutlet
cuteeditor
tmx
appledoc
nhprof
timertask
load-time
resharper-6.0
easyb
binomial-heap
web-garden
blender-2.49
business-model

Resources

Mobile Apps Dev
Database Users
javascript
java
csharp
php
android
MS Developer
developer works
python
ios
c
html
jquery
RDBMS discuss
Cloud Virtualization
Database Dev&Adm
javascript
java
csharp
php
python
android
jquery
ruby
ios
html
Mobile App
Mobile App
Mobile App