Joshua Coles joshuacoles
0 Followers · 0 Following
  • Joined on 2023-01-20
Repositories
14
 Projects Packages Public Activity Starred Repositories
joshuacoles pushed to main at personal/monzo-ingestion 2024-06-03 19:14:53 +00:00
b37273cfbe Fix Dockerfile.cache glibc version
f344d69419 Fix Dockerfile.cache
901aba9c7f Fix Dockerfile.cache
Compare 3 commits »
joshuacoles pushed to main at personal/monzo-ingestion 2024-06-03 19:09:10 +00:00
d7d7fa9718 Investigate cargo-chef to cache things
b8c1faced2 Update Dockerfile to match new command structure
b563bbd02c Add a little more CLI structure for local runs
Compare 3 commits »
joshuacoles pushed to main at personal/monzo-ingestion 2024-06-03 18:20:01 +00:00
7fd85550ea Try to improve caching?
joshuacoles pushed to main at personal/monzo-ingestion 2024-06-03 18:04:52 +00:00
97f57803e5 Expose more information in logging and improve error handling
joshuacoles pushed to main at personal/monzo-ingestion 2024-06-03 17:41:40 +00:00
046ce44d23 rustfmt
f70d844ff3 Fix ORM failing to handle empty lists...
Compare 2 commits »
joshuacoles pushed to main at personal/monzo-ingestion 2024-06-03 16:41:56 +00:00
61de38b9bf Add monzo-row parsing testcases
6c5d3910dc Make title optional in db
Compare 2 commits »
joshuacoles pushed to main at personal/monzo-ingestion 2024-06-03 11:13:56 +00:00
4bb9f2813d Move transaction whittling out of the database
joshuacoles pushed to main at personal/monzo-ingestion 2024-05-29 20:09:00 +00:00
3df05b2d9c Add identity_hash column
f19f861297 Introduce MonzoRow as an intermediary between json/csv and the database entities. This will allow for hashing to perform identity checks
Compare 2 commits »
joshuacoles pushed to main at personal/monzo-ingestion 2024-05-29 19:12:50 +00:00
89d0d12e26 Make SQLx logging debug level and add tower-http traces
joshuacoles pushed to main at personal/monzo-ingestion 2024-05-29 19:01:05 +00:00
62d5ad8dc2 Add testing for notify behaviour
a2a47b276a I forgot to wrap the string... damn. God, I really need a test suite
Compare 2 commits »
joshuacoles pushed to main at personal/monzo-ingestion 2024-05-28 16:38:51 +00:00
8ce60ce278 rustfmt
fbf473b3b4 Split up the db methods and move to unprepared statements for the notify call
Compare 2 commits »
joshuacoles pushed to main at personal/monzo-ingestion 2024-05-28 14:49:01 +00:00
848da0f5f3 Notify monzo_new_transactions with a list of IDs when we insert new transactions
11fa106cf5 Return newly inserted transaction ids
e375e7d9dc Bump versions
660b7b8676 Rustfmt
Compare 4 commits »
joshuacoles pushed to main at joshuacoles/arc-ingester 2024-04-26 20:44:12 +00:00
e73123b7f9 Add SQL mode and make it use the query! macro for type checking
ef15a630d6 Add some logging
56829cfa58 Use ? operator for errors
Compare 3 commits »
joshuacoles pushed to main at joshuacoles/arc-ingester 2024-04-25 13:16:33 +00:00
56a60d969d Fix issue
joshuacoles pushed to main at joshuacoles/arc-ingester 2024-04-25 13:15:00 +00:00
e0806a2c94 Filter for only gzip files, this should be done better
joshuacoles pushed to main at joshuacoles/arc-ingester 2024-04-25 13:09:39 +00:00
9985485e83 Fix compiliation issue
joshuacoles pushed to main at joshuacoles/arc-ingester 2024-04-25 13:08:50 +00:00
261baa6b5b Add a little bit of tracing
joshuacoles pushed to main at joshuacoles/arc-ingester 2024-04-25 12:57:42 +00:00
8cf9d86f32 Add some additional error logging
48f4614b1c Add test containers to allow for unit testing SQL files
bcfa0c2d89 Simplify code to determine if files need to be changed and prep to move data transformation into PSQL
Compare 3 commits »
joshuacoles pushed to main at personal/lecture-attendance-manager 2024-04-09 16:14:18 +00:00
090ffe93ca And lang en
joshuacoles pushed to main at joshuacoles/arc-ingester 2024-04-04 10:18:42 +00:00
99523430c6 Update lockfile