-
Notifications
You must be signed in to change notification settings - Fork 79
Speeds up ASG syncing and Querying #344
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
src/code.cloudfoundry.org/policy-server/store/security_groups_store.go
Outdated
Show resolved
Hide resolved
0838ace to
cb63480
Compare
|
Perf Testing Environment: policy-server-asg-syncer results: vxlan-policy-server sync results (when cells were limited to having 200k iptables rules): Overall results will depend on cloud controller + database load, as this deployment was isolated for testing just ASG performance. When no changes are occuring, sync times are ~100ms for each process. |
src/code.cloudfoundry.org/policy-server/store/migrations/migrator_test.go
Outdated
Show resolved
Hide resolved
src/code.cloudfoundry.org/policy-server/store/migrations/migrator_test.go
Outdated
Show resolved
Hide resolved
src/code.cloudfoundry.org/policy-server/store/security_groups_store.go
Outdated
Show resolved
Hide resolved
- Normalizes DB data with join tables associating security_groups and spaces - Adds a migration to prepopulate associations prior to the next sync - When syncing, asg-syncer only updates security groups in the database that have changed compared to the existing data - Database updates are done in bulk to speed up transaction time - Significantly speeds up the database query for retrieving security groups by space guid using the normalized tables for filtering
cb63480 to
9980949
Compare
bc64b90 to
64de98a
Compare
Summary
Backward Compatibility
Breaking Change? No