Commit Graph

588 Commits

Author SHA1 Message Date
jerlendds
e56652ecb1 Updated gh/workflows 2021-10-05 15:33:43 -06:00
jerlendds
36cbbf3297 Merge pull request #11 from jerlendds/development
Updated Crawler, UI
2021-10-05 12:38:11 -07:00
jerlendds
0f053bebea Updated Crawler, UI 2021-10-05 13:36:12 -06:00
jerlendds
0376b29634 Fix README links 2021-10-01 11:53:59 -06:00
jerlendds
9208d57d88 Merge pull request #10 from jerlendds/development
Development
2021-10-01 10:51:09 -07:00
jerlendds
982b5d4460 Changed logo color 2021-10-01 11:49:55 -06:00
jerlendds
2634b544b4 Updated UI, Code cleanup 2021-10-01 11:45:51 -06:00
jerlendds
aeb4fd1531 Merge pull request #9 from jerlendds/development
Added infinite scrolling, Updated results endpoint
2021-09-28 14:00:54 -07:00
jerlendds
582384a7ce Added infinite scrolling, Fixed brightdata proxy support, Updated search endpoint 2021-09-28 14:58:44 -06:00
jerlendds
9f9f87a54e Merged file cleanup
- Changed crawler .gitignore
- Removed __pycache__
2021-09-28 05:27:06 -07:00
jerlendds
0be410dc02 Changed crawler .gitignore 2021-09-28 06:25:02 -06:00
jerlendds
9204eade1c Merge pull request #7 from jerlendds/UI
Major Crawler Updates
2021-09-27 19:06:58 -07:00
jerlendds
817fc4dbe1 Major crawler updates, added proxy support, increased efficieny 40% 2021-09-27 19:41:38 -06:00
jerlendds
ba30e4418b Merge pull request #6 from jerlendds/dev
Fixed communication between crawler and backend
2021-09-26 09:40:33 -07:00
jerlendds
385646d4dc Fixed communication between crawler and backend 2021-09-26 10:37:26 -06:00
jerlendds
c7d6b97c5a Merge pull request #5 from jerlendds/dev
Dev
2021-09-25 19:30:36 -07:00
jerlendds
0a39de7e8f Update README 2021-09-25 20:28:31 -06:00
jerlendds
a83707cbe1 Refactored crawler, connected crawler service start to endpoint 2021-09-25 20:27:02 -06:00
jerlendds
28f7ec5c8b Configured internal network for communication with crawler 2021-09-25 08:22:04 -06:00
jerlendds
08507bfd51 Updated crawler service 2021-09-24 22:49:48 -06:00
jerlendds
32f3c4d6b1 Merge pull request #4 from jerlendds/dev
Dev
2021-09-24 20:36:10 -07:00
jerlendds
ec3d72e19f Changed docker config and crawler 2021-09-24 21:32:59 -06:00
jerlendds
3f5f660a60 Updated crawler, database, search endpoint 2021-09-24 20:26:23 -06:00
jerlendds
6aee1c1687 Updated crawler to work with database 2021-09-24 05:45:42 -06:00
jerlendds
2209bf1d69 Merge pull request #3 from jerlendds/dev
Added docker config for Scrapy, Changed readme
2021-09-21 07:07:01 -07:00
jerlendds
952a16d651 Added docker config for Scrapy, Changed readme 2021-09-21 08:04:57 -06:00
jerlendds
3986108e3c Merge pull request #2 from jerlendds/dev
Changed logo
2021-09-20 18:27:47 -07:00
jerlendds
e4e203306a Changed logo 2021-09-20 19:25:13 -06:00
jerlendds
a0623eb20c Merge pull request #1 from jerlendds/dev
Dev
2021-09-20 18:05:50 -07:00
jerlendds
9313e563a9 Changed db models, search crud, readme 2021-09-20 19:04:19 -06:00
jerlendds
1c37e5df05 Fixed celeryworker, flower 2021-09-20 08:29:08 -06:00
jerlendds
fbee95d3ae Changed: database, search endpoints, frontend 2021-09-20 04:39:07 -06:00
jerlendds
e1a9e0db42 Added db demo to docs 2021-09-08 15:44:21 -06:00
jerlendds
3905f20b5a Added crawler, Changed Frontend, Added docs pictures, Added Data Models 2021-09-08 15:39:11 -06:00
jerlendds
f65578d113 Removed __pycache__ folder, Added .gitignore 2021-08-26 16:00:03 -06:00
jerlendds
07f2c55dd2 Added database tables 2021-08-26 15:50:16 -06:00
jerlendds
2efa5a7cac Added projects table 2021-08-26 12:36:16 -06:00
jerlendds
54a339d661 Added browserless Google API crawler 2021-08-25 13:10:40 -06:00