kosiakkatrina
07a6e5a719
Add more logging for the exports ( #1862 )
1 year ago
kosiakkatrina
e88e1bae8a
CLDC-2684 Retrieve recent export before creating new one ( #1860 )
...
* Retrieve recent export before creating new ones
* remove comment
1 year ago
kosiakkatrina
d6d34a3063
CLDC-2684 Keep fewer logs in memory when running exports ( #1859 )
...
* Keep fewer logs in memory
* refactor write_export_archive to only hold MAX_XML_RECORDS in memory at a time
1 year ago
kosiakkatrina
91424c9049
CLDC-2684 Add some logging to export ( #1856 )
...
* Add some logging to export
* lint
1 year ago
kosiakkatrina
b922752cea
Export additional id fields ( #1841 )
1 year ago
Arthur Campbell
d0801c723a
ensure new date field converted to ISO 8601 format ( #1807 )
1 year ago
Arthur Campbell
99a4e91824
add fields to the export constants, amend the test fixtures accordingly to reflect changed expectations ( #1757 )
1 year ago
Jack
7950f2ae14
CLDC 2286 Delete logs ( #1620 )
...
* Add LogPolicy
* Add letting log delete flow
* Add delete sales log flow
* Test for presence of buttons
* Use govuk_button_link_to
* Move actions to helper
* Allow deletion of delete and in progress logs
* better handle 500 error
* Soft delete logs
* Move specs to shared spec file
* Address comments
* Add scoping for data coordinators
2 years ago
James Rose
f6033b64c0
Build master manifest file properly when exporting to CDS ( #1548 )
...
- Internally we building an array of hashes internally, when we should have just built one hash.
- This was formatting the master file CSV poorly.
2 years ago
James Rose
6564ca3587
CDS: Update export functionality to allow for multiple collection years at once ( #1491 )
...
* Remove CSV export
* Add collection to lettings export
* Use staging bucket
2 years ago
Phil Lee
454df8389e
CLDC-2135 Bulk upload resume with how fix ( #1503 )
...
* add first page for bulk upload resume journey
* bulk upload resume handles upload again
* add confirm page to bulk upload resume journey
* replace placeholder count with correct value
* apply recommendation for bulk upload resume choice
* add how to fix bulk upload mailer
* integrate new bulk upload approve journey
* add missing bulk upload error mappings
* remove test
* prevent approve being called multiple times
* bulk upload creates invisible logs ahead of time
* work invisible logs into bulk upload flow
* sort errors so deterministic
* remove unused ensure
* remove expected_log_count and processed
- these fields are no longer used or needed
* introduce pending status
* swap visible for pending logs
* only show visible lettings logs
* hard code status filters
* remove unused model methods
* only show visible sales logs
* form controller ignores hidden logs
* locations and schemes only affect visible logs
2 years ago
kosiakkatrina
ba03b9f157
CLDC-2145 Export UPRN fields ( #1485 )
...
* Export uprn fields
* Fix remaining tests
2 years ago
James Rose
7c62d8b4a6
Change CDS export archive names from quarter to financial year ( #1309 )
...
- We previously pushed logs into archives categorised by the quarter that they were created for.
- CDS requested that instead we push everything into a larger bucket seperated by FY.
2 years ago
James Rose
2b918a09d7
Rename lettings log export field `form` to `formid` ( #1306 )
2 years ago
kosiakkatrina
0ff387ad84
Remove nils before adding up location units ( #1290 )
2 years ago
kosiakkatrina
2bff6e8092
Do not error if owning_organisation is nil ( #1280 )
2 years ago
kosiakkatrina
f8b3b195df
CLDC-1941 Only add existing location and scheme fields to the export ( #1279 )
...
* Only add location and scheme fields to the export if the location and scheme exists
* Add supported housing as one of the logs in export tests
2 years ago
James Rose
20159bba13
Ensure that logs exported with datetimes are local times ( #965 )
...
Follows on from https://github.com/communitiesuk/submit-social-housing-lettings-and-sales-data/pull/960
2 years ago
James Rose
0b91bafee1
Export logs with datetimes formatted as ISO 8601 ( #960 )
2 years ago
Dushan
be7677ddb9
Rename case log to lettings log ( #840 )
...
This renames the case_log to lettings_log as everything we've written so
far has been geared towards lettings of social housing so it makes sense to
have the name describe this. This is also a precursor to adding in stuff for
sales logs (whatever shape that takes)
Co-authored-by: James Rose <james@jbpr.net>
2 years ago
Stéphane Meny
4cd5b519b5
CLDC-1228: SH export ( #764 )
...
* Add new export fields for supported housing
* Makes unitletas (most recent let type) general needs only
2 years ago
kosiakkatrina
ecf222335a
update unittype mapping when infering the case log value ( #735 )
...
* remove unittype_sh column, use a method to access the value instead
* remove inferring builtype
* remove return
2 years ago
Stéphane Meny
4fa32a1619
CLDC-1304: Export changes needed by CDS ( #650 )
3 years ago
baarkerlounger
8986896288
Fix lettings allocation (cbl, chr, cap) import ( #665 )
...
* Fix lettings allocation (cbl, chr, cap) import
* Add task to fix existing logs
* Map value on export
* Run workflow on push to PR
3 years ago
Stéphane Meny
9241a53818
Fixes import and export for tenant code ( #617 )
3 years ago
Stéphane Meny
b834e0eeb1
Avoid variable number of columns during CSV export ( #614 )
3 years ago
Stéphane Meny
e0385abad1
Updates exported fields based on May 25th feedback ( #613 )
3 years ago
Stéphane Meny
135bae2f58
Add support for CSV export ( #598 )
3 years ago
Stéphane Meny
ea2fd1b6c2
Removing gaps caused by empty exports ( #591 )
3 years ago
Stéphane Meny
7b8f996969
Attempt at fixing S3 error when saving Zip file ( #590 )
3 years ago
Stéphane Meny
f31c2be851
CLDC-1118: Implement data export structure (CDS) ( #587 )
...
Co-authored-by: Dushan Despotovic <dushan@madetech.com>
3 years ago
Ted-U
3c8959e4b2
Export improvements ( #581 )
...
* improved export - set start point for reference
* remove completed status from exports
* Added exception handling to export
* Improved tests, replaced rescue block with Sentry
Co-authored-by: Kat <katrina@madetech.com>
3 years ago
baarkerlounger
ad12b8e4dc
Set case log ID offset at export ( #562 )
3 years ago
Stéphane Meny
5af5088c15
CLDC-1118: Implement empty master manifest ( #450 )
...
CLDC-1118: Implement empty daily master manifest
3 years ago
baarkerlounger
be1417307c
CLDC-649: Export provider type from owning organisation ( #436 )
...
* Export provider type from owning org
* Export DB value rather than string
3 years ago
kiddhustle
7c228417a8
CLDC-959: add multiple tenant flow
3 years ago
Stéphane Meny
9545122114
Replaces enum text values in export by related numbers ( #310 )
3 years ago
Stéphane Meny
55a29832a3
Case logs export ( #288 )
3 years ago