beautifulsoup


Error whilst requesting a login to a site


last EDIT:
It seems that i am connecting to the website but for some reason i get an error with my code!Probably i do something wrong with BeautifulSouP.I am thinking that i should change somethin on the url variable!
def connect():
with requests.Session() as c:
urll2 = "http://www.oddscheck.net/inc/userlogin.php"
payload= {
'useremail': 'email#gmail.com',
'userpassword':'password',
'PHPSESSID' : 'ih79c4t5srr6p2',
'CF-RAY' : '35f784ad1-ATH'
}
headers = {}
headers['User-Agent'] = 'Mozilla/5.0 (X11; Linux i686; rv:10.0) Gecko/20100101 Firefox/10.0'
c.post(urll2,data=payload,headers={"Referer": "http://www.oddscheck.net/?page=home&cmd=def"})
url = c.get('http://www.oddscheck.net/index.php?page=myaccount')
req = urllib.request.Request(url, headers=headers)
resp = urllib.request.urlopen(req)
soup = BS(resp, "html.parser")
gamesave = ""
for record in soup.find_all("tr"):
game = game1=""
for data in record.find_all("td"):
if data.get('class') == ['centertd', 'col_10']:
for link in data.find_all("a"):
game1 += ", "+"http://www.oddscheck.net/"+link.get('href')
else:
game += ","+data.text
game2 = game+game1
if len(game2) > 40:
gamesave += game[1:]+","+game1[1:]+"\n"
#header = "League,Time,1,X,2,U,O,Link"+"\n"
file = open(os.path.expanduser("Odss.txt"),"wb")
#file.write(bytes(header, encoding="UTF-8",errors="ignore"))
file.write(bytes(gamesave, encoding="UTF-8",errors="ignore"))
file.close()
ERROR I GET:
The error i get:
Traceback (most recent call last):
File "sportingbet.py", line 314, in <module>
connect()
File "sportingbet.py", line 27, in connect
req = urllib.request.Request(url, headers=headers)
File "/usr/lib/python3.5/urllib/request.py", line 269, in __init__
self.full_url = url
File "/usr/lib/python3.5/urllib/request.py", line 295, in full_url
self._parse()
File "/usr/lib/python3.5/urllib/request.py", line 324, in _parse
raise ValueError("unknown url type: %r" % self.full_url)
ValueError: unknown url type: 'Response [200]
urll = "http://www.oddscheck.net/inc/userlogin.php"
I'd take the extra 'l' out in urll
The client-side variable name for your URL must be consistent with that of the variable for the server-side. Assuming you already know the name of it, you should just be able to change it to that and have it run.

Related Links

Beautiful Soup Unicode Encoding Error
scrape multiple pages website with python and beautifulsoup
BeautifulSoup 4: select all divs with at least one child p tag with specific class
“No module named urllib2” after installed “urllib2” using pip in Visual Studio 2015
beautifulsoup always returns NoneType
Python web crawler using urllib
scraping an iframe with beautifulsoup and python
Combining separate tags in beautiful soup for find methods
Beautifulsoup extract string between BR but include <B>string</B>
missing links from soup object
Login to a website using python
beautifulsoup get an element without using select
Run a python script whenever the user selects refresh in his android app
Mobile Site not giving correct Data - Beautiful Soup
Beautifulsoup Table Scraping table navigation
Beautiful Soup Scrape not showing properly

Categories

HOME
django
phpword
pagination
apiblueprint
solver
spring-data-redis
rendering
opendj
tivoli
rom
google-apps
tail
hpc
polling
spring-session
azure-container-service
jquery-ui-sortable
openpyxl
mel
redis-sentinel
x-cart
datastage
bitnami
internationalization
foreign-keys
articulate-storyline
rubymotion
ember-cli
windows-server-2003
moses
jackson-modules
amazon-quicksight
mat
kudu
memory-address
erb
code-snippets
hard-drive
activexobject
raft
setup.py
branching-and-merging
softmax
subclipse
microsoft-metro
glm-math
signal-strength
oim
facebook-social-plugins
getchar
dotnet-httpclient
wcftestclient
user-defined-fields
geotiff
launchctl
custom-font
jqchart
arules
polyline
vcloud-director-rest-api
smartfoxserver
usart
angular2-testing
custom-lists
rspec2
drawstring
i386
udpclient
tracker-enabled-dbcontext
gcloud-ruby
fuzzywuzzy
fink
findfirst
contentcontrol
jbase
directdraw
assertion
rubaxa-sortable
typemock
apache-commons-daemon
telepat
dot.js
phpldapadmin
apache-spark-1.3
theos
structuremap3
nsmenu
mobility
ray
gnumeric
rfc5322
wimax
web-notifications
redis-py
onmousemove
cuda-gdb
extconf.rb
listactivity
cgbitmapcontextcreate
photolibrary
presentation-layer
cfwindow
data-mapping
glui
purepdf
web-application-project
great-circle

Resources

Mobile Apps Dev
Database Users
javascript
java
csharp
php
android
MS Developer
developer works
python
ios
c
html
jquery
RDBMS discuss
Cloud Virtualization
Database Dev&Adm
javascript
java
csharp
php
python
android
jquery
ruby
ios
html
Mobile App
Mobile App
Mobile App