Robert Sullivan
845065d2d3
CLDC-3297: Add assigned to field to xml exports ( #2345 )
...
* feat: add fields to xml for 24/25 on
* CLDC-3297: Add empty assigned to column to XML exports
---------
Co-authored-by: natdeanlewissoftwire <nat.dean-lewis@softwire.com>
9 months ago
natdeanlewissoftwire
24dfdbe5eb
CLDC-3271 Add address fields as entered in bulk upload to support csv downloads ( #2322 )
...
* feat: add bulk upload address info to lettings csv download
* feat: add bulk upload address info to sales csv download
* refactor: lint
* feat: fix typo
* feat: update tests
* feat: add to non question fields
* feat: update tests
* feat: add sales tests
* feat: add as entered fields to xml export for 2024 only (#2324 )
* feat: update schema
10 months ago
kosiakkatrina
60a810aa84
CLDC-3197 Export correct fields based on year ( #2230 )
...
* Export correct fields based on year
* Fix export test file
* Remove default value
11 months ago
kosiakkatrina
62e4352176
Set export base number depending on the year ( #2224 )
11 months ago
kosiakkatrina
04ecd7bed2
CLDC-2995 Update renttype_detail export csv ( #2132 ) ( #2208 )
...
* Update renttype_detail export csv
* Export renttype_detail in xml
* Add renttype labels
11 months ago
kosiakkatrina
7d3dc560c0
Revert "CLDC-2995 Update renttype_detail export csv ( #2132 )" ( #2195 )
...
This reverts commit b3e68693d2
.
11 months ago
kosiakkatrina
b3e68693d2
CLDC-2995 Update renttype_detail export csv ( #2132 )
...
* Update renttype_detail export csv
* Export renttype_detail in xml
* Add test expectation
* Add renttype labels
11 months ago
kosiakkatrina
52be9734ce
Export la and postcode for logs with locations ( #1985 )
1 year ago
kosiakkatrina
2ab79b2f3e
Keep the logs in memory ( #1955 )
1 year ago
kosiakkatrina
fd149de15b
CLDC-2747 Export details not known values ( #1938 )
...
* Adjust xml export to export refused details, update refused to take into account details_unknown
* Recalculate refused values for lettings logs with unknown person details
* Export refused values in the csv
* Update file names
1 year ago
kosiakkatrina
d44f00c4ef
Fix logs count variable names ( #1937 )
1 year ago
kosiakkatrina
101fa7d33e
Count lettings logs after writting export files ( #1934 )
...
* Count lettings logs after writting export files
* lint
1 year ago
kosiakkatrina
4d275a5c02
CLDC-2689 Export migrated logs ( #1873 )
...
* Add imported_at columns
* Set imported at date for lettings logs
* Set imported at for sales logs
* Export logs migrated since the previous partial export
* Rename column
* rebase changes
* Re-add test
1 year ago
kosiakkatrina
3bd6cab5c5
CLDC-2684 Allow full export per year ( #1875 )
...
* Allow full export for specific year
* Update production manifest
* Call export_xml_lettings_logs with nil if no year is given
* Rename method
1 year ago
kosiakkatrina
07a6e5a719
Add more logging for the exports ( #1862 )
1 year ago
kosiakkatrina
e88e1bae8a
CLDC-2684 Retrieve recent export before creating new one ( #1860 )
...
* Retrieve recent export before creating new ones
* remove comment
1 year ago
kosiakkatrina
d6d34a3063
CLDC-2684 Keep fewer logs in memory when running exports ( #1859 )
...
* Keep fewer logs in memory
* refactor write_export_archive to only hold MAX_XML_RECORDS in memory at a time
1 year ago
kosiakkatrina
91424c9049
CLDC-2684 Add some logging to export ( #1856 )
...
* Add some logging to export
* lint
1 year ago
kosiakkatrina
b922752cea
Export additional id fields ( #1841 )
1 year ago
Arthur Campbell
d0801c723a
ensure new date field converted to ISO 8601 format ( #1807 )
1 year ago
Jack
7950f2ae14
CLDC 2286 Delete logs ( #1620 )
...
* Add LogPolicy
* Add letting log delete flow
* Add delete sales log flow
* Test for presence of buttons
* Use govuk_button_link_to
* Move actions to helper
* Allow deletion of delete and in progress logs
* better handle 500 error
* Soft delete logs
* Move specs to shared spec file
* Address comments
* Add scoping for data coordinators
2 years ago
James Rose
f6033b64c0
Build master manifest file properly when exporting to CDS ( #1548 )
...
- Internally we building an array of hashes internally, when we should have just built one hash.
- This was formatting the master file CSV poorly.
2 years ago
James Rose
6564ca3587
CDS: Update export functionality to allow for multiple collection years at once ( #1491 )
...
* Remove CSV export
* Add collection to lettings export
* Use staging bucket
2 years ago
Phil Lee
454df8389e
CLDC-2135 Bulk upload resume with how fix ( #1503 )
...
* add first page for bulk upload resume journey
* bulk upload resume handles upload again
* add confirm page to bulk upload resume journey
* replace placeholder count with correct value
* apply recommendation for bulk upload resume choice
* add how to fix bulk upload mailer
* integrate new bulk upload approve journey
* add missing bulk upload error mappings
* remove test
* prevent approve being called multiple times
* bulk upload creates invisible logs ahead of time
* work invisible logs into bulk upload flow
* sort errors so deterministic
* remove unused ensure
* remove expected_log_count and processed
- these fields are no longer used or needed
* introduce pending status
* swap visible for pending logs
* only show visible lettings logs
* hard code status filters
* remove unused model methods
* only show visible sales logs
* form controller ignores hidden logs
* locations and schemes only affect visible logs
2 years ago
James Rose
7c62d8b4a6
Change CDS export archive names from quarter to financial year ( #1309 )
...
- We previously pushed logs into archives categorised by the quarter that they were created for.
- CDS requested that instead we push everything into a larger bucket seperated by FY.
2 years ago
James Rose
2b918a09d7
Rename lettings log export field `form` to `formid` ( #1306 )
2 years ago
kosiakkatrina
0ff387ad84
Remove nils before adding up location units ( #1290 )
2 years ago
kosiakkatrina
2bff6e8092
Do not error if owning_organisation is nil ( #1280 )
2 years ago
kosiakkatrina
f8b3b195df
CLDC-1941 Only add existing location and scheme fields to the export ( #1279 )
...
* Only add location and scheme fields to the export if the location and scheme exists
* Add supported housing as one of the logs in export tests
2 years ago
James Rose
20159bba13
Ensure that logs exported with datetimes are local times ( #965 )
...
Follows on from https://github.com/communitiesuk/submit-social-housing-lettings-and-sales-data/pull/960
2 years ago
James Rose
0b91bafee1
Export logs with datetimes formatted as ISO 8601 ( #960 )
2 years ago
Dushan
be7677ddb9
Rename case log to lettings log ( #840 )
...
This renames the case_log to lettings_log as everything we've written so
far has been geared towards lettings of social housing so it makes sense to
have the name describe this. This is also a precursor to adding in stuff for
sales logs (whatever shape that takes)
Co-authored-by: James Rose <james@jbpr.net>
2 years ago
Stéphane Meny
4cd5b519b5
CLDC-1228: SH export ( #764 )
...
* Add new export fields for supported housing
* Makes unitletas (most recent let type) general needs only
2 years ago
kosiakkatrina
ecf222335a
update unittype mapping when infering the case log value ( #735 )
...
* remove unittype_sh column, use a method to access the value instead
* remove inferring builtype
* remove return
3 years ago
Stéphane Meny
4fa32a1619
CLDC-1304: Export changes needed by CDS ( #650 )
3 years ago
baarkerlounger
8986896288
Fix lettings allocation (cbl, chr, cap) import ( #665 )
...
* Fix lettings allocation (cbl, chr, cap) import
* Add task to fix existing logs
* Map value on export
* Run workflow on push to PR
3 years ago
Stéphane Meny
9241a53818
Fixes import and export for tenant code ( #617 )
3 years ago
Stéphane Meny
b834e0eeb1
Avoid variable number of columns during CSV export ( #614 )
3 years ago
Stéphane Meny
e0385abad1
Updates exported fields based on May 25th feedback ( #613 )
3 years ago
Stéphane Meny
135bae2f58
Add support for CSV export ( #598 )
3 years ago
Stéphane Meny
ea2fd1b6c2
Removing gaps caused by empty exports ( #591 )
3 years ago
Stéphane Meny
7b8f996969
Attempt at fixing S3 error when saving Zip file ( #590 )
3 years ago
Stéphane Meny
f31c2be851
CLDC-1118: Implement data export structure (CDS) ( #587 )
...
Co-authored-by: Dushan Despotovic <dushan@madetech.com>
3 years ago
Ted-U
3c8959e4b2
Export improvements ( #581 )
...
* improved export - set start point for reference
* remove completed status from exports
* Added exception handling to export
* Improved tests, replaced rescue block with Sentry
Co-authored-by: Kat <katrina@madetech.com>
3 years ago
baarkerlounger
ad12b8e4dc
Set case log ID offset at export ( #562 )
3 years ago
Stéphane Meny
5af5088c15
CLDC-1118: Implement empty master manifest ( #450 )
...
CLDC-1118: Implement empty daily master manifest
3 years ago
baarkerlounger
be1417307c
CLDC-649: Export provider type from owning organisation ( #436 )
...
* Export provider type from owning org
* Export DB value rather than string
3 years ago
kiddhustle
7c228417a8
CLDC-959: add multiple tenant flow
3 years ago
Stéphane Meny
9545122114
Replaces enum text values in export by related numbers ( #310 )
3 years ago
Stéphane Meny
55a29832a3
Case logs export ( #288 )
3 years ago