google-app-engine


Google Cloud Search API - is there a limit to number of document puts per second?


With the Google Cloud Search API is there a limit or restriction to how many documents you can add to a search index per second?
I know the Search API is great for querying and scales well that way, but what about many individual document puts per second? Would using a unique index for each document put improve performance?
The reason I ask is because of an application I will be building that will have many Datastore puts with one respective Search document put right after the Datastore entity gets put. I am wondering if the Search API is as robust as the Datastore when it comes to many puts per second. I'd like to scale both linearly as the application grows rather than use a Task Queue to sync the Search document with the Datastore entity later.
The nature of my application calls for both the entity and document to be put at the same time.
Found this at the bottom of the docs:
The Search API imposes these limits to ensure the reliability of the
service. These apply to both free and paid apps:
Maximum query usage: 100 aggregated minutes of query execution time per
minute
Maximum documents added or deleted: 15,000 per minute
So it looks like there is a safety limit that works out to be about 250 writes/deletes per second. That would not be able to keep up with the Datastore if the app kept growing and growing.
If anyone has any more information on this please comment/answer. Thank you :)

Related Links

Google datastore backup to local dev_appserver
Drive api: file.list returning inconsistent result when corpus='user'
Uploading Storing and Linking to Images on Google Container Engine
In Google app engine only one instance handling most of requests
NullPointerException with JDBC and App Engine
How do I create push queue tasks for multiple queues
GAE Custom domain mapping failure after adding SSL Wildcard certificate
Is it possible for Google App Engine string and integer datastore keys to clash? [duplicate]
How do I query in Google Datastore Viewer where table or column name has slash in it?
App Engine Google Console Dashboard
Jinja2 install issue
Firebase access within GAE
GAE: multiple modules vs. multiple applications
Builds at commandline but fails to build as gae app
Handle schema change in Google datastore with Go?
Wipe clean all data from GAE datastore

Categories

HOME
embedded
google-cloud-platform
checkstyle
time-complexity
fpga
redux-form
android-studio-2.2
nunit
seo
soa
alsa
google-apps
android-json
little-proxy
mel
zerobrane
dynamic-sql
intershop
oledb
database-connection
squashfs
hta
php-mysqlidb
moses
underscore.js
mql
mustache
jbutton
activexobject
nested-lists
getlasterror
google-earth-engine
connection-pool
stringtokenizer
plaintext
watchface
softmax
preloader
linqpad
x++
zenhub
arq
azure-cli
skin
cup
mouseleave
cmp
polyline
change-tracking
flex4.6
eigenvector
udpclient
freepbx
aurora
html-to-pdf
nullable
contentcontrol
r-package
forwarding
ocra
alloy-ui
aspectj-maven-plugin
entity-framework-4.3
j-security-check
webmatrix-3
jbake
contrast
webfinger
grails-plugin-rabbitmq
memset
rfc5322
kendo-dataviz
ie8-compatibility-mode
inputmismatchexception
process-explorer
time.h
octal
alice
paginator
database-create
azman
stress
convention
role
squishit
eclipse-marketplace
isapi-extension
filesystemobject
web-application-project
tui
perl5.12
pnrp

Resources

Encrypt Message