This repository was archived by the owner on Aug 20, 2025. It is now read-only.

usergrid import utility tool for collections,users,applications keeping same UUID - #627

Open

ajitintelli wants to merge 2774 commits into

apache:masterfrom

ajitintelli:master

This pull request is big! We're only showing the most recent 250 commits

Commits on Oct 11, 2016

Use CQL batch statement for timeout operation as well.
snoopdave
committed
2afaa92

Commits on Oct 12, 2016

Adding concurrent tests for shard and message counters.
snoopdave
committed
f56e1b0

Commits on Oct 13, 2016

Minor refactoring, renaming and debug logging changes.
snoopdave
committed
f8c3a2d

Commits on Oct 19, 2016

Configurable Password Policy and 5 supporting JUnit tests.
snoopdave
committed
a30e1a5

Commits on Oct 20, 2016

Tools to remove an Admin User from an Organization using the management service and the graph manager to remove any lingering edges.
snoopdave
committed
9c5f599
Merge commit 'refs/pull/560/head' of github.com:apache/usergrid
Michael Russo
committed
04e49da
Ensure the admin invited to org email is sent even when external SSO is enabled.
Michael Russo
committed
48d306f
Add missing bad_confirmation_token.jsp
snoopdave
committed
1abafe7
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/usergrid
snoopdave
committed
cb0dc69

Commits on Oct 24, 2016

Commits on Oct 25, 2016

Add key freshness and full set of tests
snoopdave
committed
f0c9d44

Commits on Oct 28, 2016

Fix typo and unused reference
snoopdave
committed
fe3bf56
Add missing bad_confirmation_token.jsp

snoopdave
authored and
Michael Russo
committed
8921850
Ensure the admin invited to org email is sent even when external SSO is enabled.
Michael Russo
committed
73de903
If claims cannot be parsed, fetch new JWT token

snoopdave
authored and
Michael Russo
committed
e0eb11c
Add key freshness and full set of tests

snoopdave
authored and
Michael Russo
committed
efa65ac
Fix typo and unused reference

snoopdave
authored and
Michael Russo
committed
406a742

Commits on Oct 31, 2016

Merge branch 'master' into usergrid-1318-queue
snoopdave
committed
7cc5c1c

Commits on Nov 2, 2016

Implemented queue clear (with test) and added some trace level logging
snoopdave
committed
1980562

Commits on Nov 3, 2016

Commits on Nov 5, 2016

Fix issue where accidental empty property for SMTP still causes authentication to be attempted.
Michael Russo
committed
cdc417d

Commits on Nov 6, 2016

Merge branch 'hotfix-20160819'
Michael Russo
committed
689c450

Commits on Nov 11, 2016

Merge commit 'refs/pull/562/head' of github.com:apache/usergrid
Michael Russo
committed
fb62629
Update datastax driver to 2.1.10
Michael Russo
committed
8f7e079
Fix typo in password policy properties.
Michael Russo
committed
2108f6d
Test fixes in queue module only.
snoopdave
committed
c62a348
Align legacy queue setup with Qakka
snoopdave
committed
d1ac184
Increase test cassandra connections per host as we test with only 1 host.
Michael Russo
committed
1ef3920
Revert "Increase test cassandra connections per host as we test with only 1 host."
Michael Russo
committed
9192095
Reduce load on datastax control connection ( mostly for tests because the interact with the schema A LOT).
Michael Russo
committed
cd7e803

Commits on Nov 12, 2016

Set core and max connections to be the same for the datastax driver.
Michael Russo
committed
0dc7d03
Better tune connection pool with the datastax driver.
Michael Russo
committed
a8b3e79
Increase database connection pools for persistence tests.
Michael Russo
committed
daf608e
Add more database connections for the tests ( single database host being used in CI jobs ).
Michael Russo
committed
84af161
Still tweaking tests for CI environments.
Michael Russo
committed
2389c20
Additional test adjustments to better work with CI environments.
Michael Russo
committed
a31fa45
Synchronize creation/connecting of datastax cluster and sessions.
Michael Russo
committed
b895260
Update timeout configurations.
Michael Russo
committed
664a2cf
Fix conversion to seconds.
Michael Russo
committed
ac28b8f
Add reconnection policy.
Michael Russo
committed
ce9d66c
Remove reuse address.
Michael Russo
committed
b418451

Commits on Nov 14, 2016

Add database connection closing to shutdown listener and again tweak test properties.
Michael Russo
committed
bb5d3f5
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/usergrid
snoopdave
committed
fbd73cd
Optimization: don’t check that queue exists on every call
snoopdave
committed
9ee4288

Commits on Nov 15, 2016

Use one injector in tests and, at most, one Akka cluster per test class.
snoopdave
committed
58c1d09
Use one injector in tests and, at most, one Akka cluster per test class. For real this time ;-)
snoopdave
committed
e83b54e
Use one and only one Akka cluster for all queue tests.
snoopdave
committed
14b5fe0
See if longer waits fix tests on Jenkins.
snoopdave
committed
80369b9
Ignore QueueResource test as it may be interfering with other tests.
snoopdave
committed
be7c2d1
Update Elasticsearch client version to 1.7.5.
Michael Russo
committed
f4dca5d

Commits on Nov 16, 2016

Fix Core Tests.
Michael Russo
committed
edbda93
Set the default elasticsearch cluster name via fig only.
Michael Russo
committed
6e5978b

Commits on Nov 17, 2016

Fix cassandra properties that are used during setup and bootstrap.
Michael Russo
committed
e504aae

Commits on Nov 18, 2016

Commits on Nov 19, 2016

Fix log binding and reduce long poll timeout for tests to reduce time spent validating index data.
Michael Russo
committed
61878c0
For tests, ensure we clear the in memory set of queues that exist as keyspaces get dropped w/o new class instantiation.
Michael Russo
committed
9b12299
Fix issue with updated LocalQueueManager creation.
Michael Russo
committed
432a8f8
Call clearQueueNameCache during test database schema destruction.
Michael Russo
committed
7464167
Tests use a different injector, clear the queue name cache using other means.
Michael Russo
committed
eaf3b52
Don’t attempt to create queue until actor system is started.
snoopdave
committed
dcf38be
In tests, schema already setup before populateDataBase is called.
Michael Russo
committed
0736478
Reduce queue long polling timeout for tests.
Michael Russo
committed
66c1b0d
Add logging and wait for schema agreement in tests that drop the keyspace.
Michael Russo
committed
6bd4a20
Use direct queries to cassandra to see if a keyspace exists vs. the driver's cached metadata.
Michael Russo
committed
40e1c06
Give CoreSchemaManager in tests the ability to force check if keyspaces are created while normal runtime classes can rely on the driver's cached metadata.
Michael Russo
committed
2578e93
Reduce retries in refreshIndex() and tone down exceptions that occur when keyspace or table not yet created.
snoopdave
committed
20c425b
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/usergrid
snoopdave
committed
dd46ebe

Commits on Nov 20, 2016

Rely less on the datastax driver's metadata configuration as tests modify schema too much currently.
Michael Russo
committed
0a83ee4
Stop using hector for schema deletion in tests and move to the datastax driver.
Michael Russo
committed
ad9d607
Increase database connections for Collection module as there are a lot of async workers doing IO.
Michael Russo
committed
f0ec3a9
Reduce long polling time in tests and switch back to database driver metadata now that Hector is no longer used for altering test schema.
Michael Russo
committed
cae0605
Tune test properties.
Michael Russo
committed
a77b1f4
Further test tuning.
Michael Russo
committed
a7cf58c
Enable Akka for all tests.
snoopdave
committed
9364496
Reduce number of actors in hopes of getting collections tests passing on Jenkins.
snoopdave
committed
229a13a
Standardize the collection test properties.
Michael Russo
committed
8587735
Add ability to force check database schema with Tables in addition to Keyspaces.
Michael Russo
committed
f49fe0a
Add retry logic to initial session connections to the database.
Michael Russo
committed
0ada637

Commits on Nov 21, 2016

Clear up some potential netty dependency conflicts by widening the range in inclusion. Go back to datastax driver version 2.1.9 for now, and fix loading of log4j.properties in corepersistence tests.
Michael Russo
committed
3d60145
Make sure to create keyspaces on initialization before trying to obtain sessions to the keyspaces.
Michael Russo
committed
2af22a8
Fix more netty dependency exclusions.
Michael Russo
committed
8fda937
Increase # of database connections for collection tests.
Michael Russo
committed
fab971d
Additional test tuning for Collection module.
Michael Russo
committed
cb41a0a
Services module test tuning.
Michael Russo
committed
4584787
Set smaller thread counts in tests.
Michael Russo
committed
fcd3bd7
More Collection test tuning.
Michael Russo
committed
447aaa1
Use defaults always for max requests per connection for datastax driver.
Michael Russo
committed
ebab21e
Fix log4j props in Services and destroy db session before re-creating schema to make sure meta gets refreshed.
Michael Russo
committed
cf06b4e

Commits on Dec 8, 2016

Commits on Dec 9, 2016

New "re-persist all entities in named list of apps" tool, plus fixes to other toosl. ExportAppTest still failing tho.
snoopdave
committed
8444687

Commits on Dec 13, 2016

Add option to update each entity.
snoopdave
committed
33fe480
Fix the rarely used getConnectionTypes() method to use Graph rather than Dictionary.
snoopdave
committed
cb95ce5
Fix ExportAppTest
snoopdave
committed
79492c2

Commits on Dec 21, 2016

Fix cassandra transport frame size exceptions due to numeric overflow causing incorrect calucations of batch loading of entities from cassandra.
Michael Russo
committed
ff574d3
Merge branch 'hotfix-20160819'
Michael Russo
committed
2f7b0ee

Commits on Jan 23, 2017

Add configuration to disable unique value verification using Akka clustering.
Michael Russo
committed
e3ab255
Add client side timestamp generator to Datastax cluster client.
Michael Russo
committed
303661c
Stop parallel execution of tests in EntityCollectionManagerIT temporarily.
Michael Russo
committed
bb5f2fb
Add logging to AbstractServiceNotificationIT
Michael Russo
committed
2fe81cd
Remove call to .duplicate on the BB in serialization classes and lower number of database connections on collection tests.
Michael Russo
committed
9f63dcc
Set default to UniqueValue verification for UG clustering.
Michael Russo
committed
2f25e9c
Add logging to tests.
Michael Russo
committed
7125899
Set test timeouts higher due to schema changes taking awhile, and there are frequent schema changes in the test suites.
Michael Russo
committed
cf81679
Temporarily disabling tools build from main pom as it's failing to exit properly causing the fully build to fail even though all tests pass.
Michael Russo
committed
7134d34
Revert "Temporarily disabling tools build from main pom as it's failing to exit properly causing the fully build to fail even though all tests pass."
Michael Russo
committed
8e7aff3
Temporarily disabling tools tests as it's failing to exit properly causing the build to fail even though all tests pass.
Michael Russo
committed
280ac8b

Commits on Jan 25, 2017

Make Locks keyspace creation more robust ( IF NOT EXISTS sometimes has problems ).
Michael Russo
committed
691d6b2

Commits on Feb 10, 2017

Fixes issue with organization credentials using the same cache key when the credentials cache is enabled.
Michael Russo
committed
cf0b653

Commits on Feb 22, 2017

Commits on Feb 23, 2017

Slight refactor of visting the parsed query such that a correct determination if Elasticsearch response sortValues have geo distance contained within.
michaelarusso
committed
f8e644d

Commits on Feb 24, 2017

[USERGRID-1336] Initial commit of a simple query analyzer feature.
michaelarusso
committed
a494146

Commits on Feb 25, 2017

Add query analyzer condition for full collection sorts when the collection size exceeds the limit. Add QueryAnalyzer tests.
michaelarusso
committed
f556e42

Commits on Feb 28, 2017

Add some additional logging around flaky test setup.
michaelarusso
committed
761aa44

Commits on Mar 2, 2017

Add UTF-8 sourceEncoding, without it build fails on some platforms.
snoopdave
committed
104f64e

Commits on Mar 21, 2017

Commits on Mar 23, 2017

Commits on Mar 24, 2017

Fixes a handful of issues around single quotes and plus symbols in queries and email addresses. See: USERGRID-29 USERGRID-1041 USERGRID-1117 USERGRID-1338
michaelarusso
committed
8917832

Commits on Mar 26, 2017

Default disable the query breaker enforcement.
michaelarusso
committed
ea1ba36

Commits on Mar 27, 2017

Initial commit of export application API.
michaelarusso
committed
82e7ec5

Commits on Mar 28, 2017

Batch write to the export stream and use a cleaner filename.
michaelarusso
committed
2d56d81

Commits on Mar 31, 2017

Commits on Apr 2, 2017

Switch DISTRIBUTED database queueing to default not cache in memory as the in memory impl causes duplicate messgae processing quite often at the moment.
michaelarusso
committed
d3e988b

Commits on Apr 6, 2017

Add new push notification test and remove duplicate index processing on entity create/update.
michaelarusso
committed
949b465

Commits on Apr 26, 2017

Add a new Asset binary provider for Google Cloud Storage. Refactor the BinaryStore implementation to follow a Factory pattern.
michaelarusso
committed
bafd462

Commits on May 17, 2017

Allow name and any property set with aliasProperty to be changed.
michaelarusso
committed
3f819dc

Commits on Jun 14, 2017

dead letter queue handling
mdunker
committed
5935460

Commits on Jun 16, 2017

Initial commit of new token module to replace Hector for access token storage.
michaelarusso
committed
179f12d

Commits on Jun 18, 2017

Commits on Jun 19, 2017

Commits on Aug 17, 2017

increase test cassandra.timeout settings
mdunker
committed
f22c6c4
change test collection names so no race condition conflicts
mdunker
committed
7d9cc89
add a little more wait time
mdunker
committed
36e28a8
Add new parameter that can be used in the JSP viewables.

michaelarusso
authored and
mdunker
committed
068263e
fix html encode in jsp
mdunker
committed
be2f69c
fix broken recaptcha
mdunker
committed
459163b
add password complexity check before submitting during reset password flow
mdunker
committed
70de6fd
more cassandra.timeout increases for tests
mdunker
committed
4b916c4
change test collection names so no race condition conflicts
mdunker
committed
d06dbc9
add a little more wait time
mdunker
committed
25f1b0e
Basic code improvements
mdunker
committed
400365c

Commits on Aug 18, 2017

Commits on Aug 19, 2017

Converts de-indexing of edges and entities to identify documents in the index to delete based on data in Cassandra vs. resource intensive queries to the index. Fixes issue where nodes were not actu…

michaelarusso
authored and
mdunker
committed
c201f1f

Commits on Aug 22, 2017

1. Add missing start for delete queue workers.
mdunker
committed
3f7afcd

Commits on Aug 28, 2017

Commits on Aug 29, 2017

Give entity creation time to finish during collection delete test.
mdunker
committed
3d3ba49

Commits on Sep 1, 2017

Change collection clear from PUT to POST.
mdunker
committed
c860521

Commits on Sep 13, 2017

Handle IndexMissingException when fetching the index size for an application.
michaelarusso
committed
4170295

Commits on Sep 14, 2017

Bypass check of app APM setting if APM not enabled
mdunker
committed
9e16e2f

Commits on Sep 21, 2017

add missing fn reference in jsps
mdunker
committed
7f40d68

Commits on Sep 26, 2017

add reset_url as field in admin confirmation email
mdunker
committed
173be8a

Commits on Sep 27, 2017

Allow submission to SNS/SQS via sync client
peterj99a
committed
9a15108
code review changes
peterj99a
committed
4a65910

Commits on Oct 13, 2017

Remove orphaned collection edges with no target entity
mdunker
committed
f4842b0
changes to orphaned edge code from code review
mdunker
committed
1a02bb3
Merge branch 'fixOrphanedEdges'
mdunker
committed
b93f8d4

Commits on Oct 17, 2017

add extra logging for orphaned connection repair
mdunker
committed
a769f30

Commits on Oct 18, 2017

Updates website content to reference community maintained buttons
Todd Nine
committed
893a04d

Commits on Nov 2, 2017

Allow index requests to be sent directly to ES
peterj99a
committed
7139781

Commits on Nov 13, 2017

Add option to include old version in result
peterj99a
committed
296a4ee
Merge commit 'refs/pull/584/head' of github.com:apache/usergrid
mdunker
committed
1d7785b

Commits on Nov 14, 2017

Add option to include old version in result
peterj99a
committed
000eaaa
Merge commit 'refs/pull/586/head' of github.com:apache/usergrid
mdunker
committed
8b945c6

Commits on Nov 17, 2017

Commits on Dec 6, 2017

Change swapped config items
mdunker
committed
cda4d20

Commits on Dec 7, 2017

Fix test to use Akka region config instead of SQS region config
mdunker
committed
71169f8

Commits on Dec 11, 2017

update SNS topic permissions for SQS queues when necessary
mdunker
committed
2b35733

Commits on Dec 13, 2017

Merge commit 'refs/pull/594/head' of github.com:apache/usergrid
mdunker
committed
a88a875

Commits on Dec 15, 2017

Merge branch 'asf-site'
mdunker
committed
c2a0303
add ability for sysadmin to return ES query instead of results
mdunker
committed
bd2385d

Commits on Feb 24, 2018

Fix NPE for push notification processing.
michaelarusso
committed
0635958

Commits on Aug 28, 2018

Minor updates that prevent deployment errors
jvanulden
committed
0755778
Minor updates that prevent deployment errors

jvanulden
authored and
rodsimpson
committed
3b0376b
Initial commit for exposing collection re-index to non sysadmin users.

michaelarusso
authored and
rodsimpson
committed
8913e43
fix NPE with push notifications and sendMessageToLocalRegion

mdunker
authored and
keyurkarnik
committed
455bdde
bypass ES for push notification devices specified by UUID

mdunker
authored and
keyurkarnik
committed
e8dc09b
update to later tomcat version

mdunker
authored and
keyurkarnik
committed
ec7c6b4
check for deleted entity candidates before checking for stale candidates

mdunker
authored and
keyurkarnik
committed
a4f32fa
exclude CollectionDeleteTest for now

mdunker
authored and
keyurkarnik
committed
35a22ed
Several indexing fixes:

mdunker
authored and
keyurkarnik
committed
1feb3db
fix deindex on update -- was deindexing current version along with old versions

mdunker
authored and
keyurkarnik
committed
c98a5e9
improvements to CollectionIterator tool for duplicate and orphaned connections

mdunker
authored and
keyurkarnik
committed
0632cef
Add password when soft deleting an application

mdunker
authored and
keyurkarnik
committed
38c7313
Add ability to query by name/uuid without using Elasticsearch

mdunker
authored and
keyurkarnik
committed
57afad2
Create AppDeleter tool to delete data for an application

mdunker
authored and
keyurkarnik
committed
59e7a24
fix NPE for missing names in direct queries and block requests based on direct query count before deduping

mdunker
authored and
keyurkarnik
committed
98a2f5d
return 400 when direct query has too many items

mdunker
authored and
keyurkarnik
committed
0a3333c

Commits on Aug 29, 2018

PATCH - Updated Portal Dependencies
jvanulden
committed
4fd27f1
Fixed queryindex test to match new operands
keyurkarnik
committed
1c3fbe4

Commits on Sep 5, 2018

Fixed failing tests and bugs
keyurkarnik
committed
faafed8
Merge pull request #1 from keyurkarnik/master
keyurkarnik
authored
749a97f

Commits on Sep 25, 2018

Fixed failing tests and bugs
keyurkarnik
committed
5fc3c50

Commits on Oct 3, 2018

stack REDME link type fixed
mddanishyusuf
committed
71c43df

Commits on Nov 7, 2018

Revamped Export code to be more efficient
keyurkarnik
committed
abec1d9

Commits on Dec 14, 2018

Commits on Dec 20, 2018

Fixed shiro cache to ensure 1:1 mapping between token and principal
keyurkarnik
committed
8b7aa27

Commits on Jan 29, 2019

Fixed akka cluster issue to support more than 2 regions
keyurkarnik
committed
ce8db89
WIP: Attempting to reduce Akka chatter
keyurkarnik
committed
6115b96

Commits on Jan 30, 2019

Commits on Mar 22, 2019

Added entity id and type to dictionary object in export.
cburse
committed
ad552de
Merge pull request #624 from bursech/master
keyurkarnik
authored
ac1e6e4

Commits on Apr 8, 2019

app import utility first commit /usergrid/tools/ImportAdmins
ajitintelli
authored
924b74f

Commits on Jul 31, 2019

usergrid import tools for collections,users,applications with same UUID and secret keys
Ajit Kulkarni
committed
854d7c8

Commits on Aug 1, 2019

update test cases file read path
Ajit Kulkarni
committed
1de5b32
update test cases file read path and reverted OmportAdmin.java changes
Ajit Kulkarni
committed
613cea2
Merge branch 'master' of github.com:ajitintelli/usergrid
Ajit Kulkarni
committed
081d69b

Commits on Aug 9, 2019

code formating and imports optimization
Ajit Kulkarni
committed
93ccbc8