Tree:
79c19d9eab
1200-inputmode
2021-2022-json-updates
2308-migrated-locations-not-confirmed-automatically
AwsInsecure
AwsProdDeploy
AwsRunDbMigrations
CLDC-1049-autocomplete-improvements
CLDC-1183-assistive-tech
CLDC-1219-create-single-org-migration-task
CLDC-122-experimental-background-job-lettings-log-import-with-report
CLDC-1222-improve-case-log-import-performance
CLDC-1249-data-inputters-can-select-supported-housing-schemes
CLDC-1263-create-org-logs
CLDC-1324
CLDC-1324-remove-not-started
CLDC-1324-remove-not-started-status
CLDC-1324-remove-not-started-status-no-rebase
CLDC-1348-basic-validation-for-scheme-and-location-refactor
CLDC-1390-la-lookup-fallback-WIP
CLDC-1468-add-postcode-to-sales-property-info-journey
CLDC-1469-local-authority-question-sales
CLDC-1474-sales-setup-ownership-scheme
CLDC-1482-sales-log-buyer-company
CLDC-1528-person-1-relationship-to-buyer-1
CLDC-1530-working-situation
CLDC-1533-is-resale
CLDC-1537-details-for-person-1
CLDC-1586-spike
CLDC-1627-check-your-answers-page-changes
CLDC-1661-new-page-for-housing-providers
CLDC-1665-add-scheme-status
CLDC-1671-deactivate-scheme
CLDC-1672-reactivate-scheme
CLDC-1672-scheme-reactivation-review-app
CLDC-1730-stock-owning-validation2
CLDC-1741-scheme-attributes-bug-fix
CLDC-1750-po-fixes
CLDC-1787-bulk-upload-column-ordering
CLDC-1790-sales-validation-content-updates
CLDC-1820-allow-deactivation-or-reactivation-of-last-year-schemes-and-locations-in-crossover-period
CLDC-1864-question-numbering
CLDC-1864-question-numbering-too
CLDC-1880-mortgage-length-validations
CLDC-1917-allow-23-24-form
CLDC-1917-allow-23/24-form
CLDC-1963-fix-reset-password-bugs
CLDC-20-more-ac-fixes2
CLDC-20-more-ac-fixes3
CLDC-2019-UPRN-search
CLDC-2055-which-organisations-are-merging
CLDC-2068-request-and-validate-UPRN
CLDC-2105-merge-orgs-owning-org-dropdown
CLDC-2213-do-not-display-local-authority-question-if-inferred
CLDC-2227-move-uprn-questions
CLDC-2252-homepage-task-section
CLDC-2257-refactor-filters
CLDC-2322-read-and-sign-data-sharing-agreement
CLDC-2349-scientific-notation-uprn-error
CLDC-2390-town-not-given
CLDC-2412-data-privacy-bu
CLDC-2454-add-q90-based-on-q78
CLDC-2459-review-branch
CLDC-2460-review-app
CLDC-2491-Change-address-bug
CLDC-2492-create-rake-task-to-set-creation-method-for-existing-logs
CLDC-2505-bulk-upload-pages
CLDC-2545-add-q90-based-on-q78
CLDC-2585-mandatory
CLDC-2632.2-set-uprn-known-no
CLDC-2640-location-guidance
CLDC-2672-duplicate-logs-question-page-button
CLDC-2831-page-load
CLDC-2835-review-app-branch
CLDC-2896-pipes-in-bu
CLDC-2995-add-renttype-detail-column
CLDC-3014-schemes-locations-csv-download
CLDC-3025-leading-zeroes-in-old-visible-id-lookup-bug
CLDC-3091-asset-paths
CLDC-3132-24-25-reason-for-vacancy-update
CLDC-3147-update-pregnancy-for-24-25
CLDC-3152-update-ppostcode-hint-for-23-24
CLDC-3196-update-bu-resources-link
CLDC-3229-review-app-for-bu-testing
CLDC-3233-address-uprn-lookup-spike
CLDC-3292-staircase-validation
CLDC-3305-postcode-routing
CLDC-3339-update-selcet-correct-address-error
CLDC-3345-populate-assigned-to
CLDC-3345-rename-created-by-new
CLDC-3345-replace-created-by
CLDC-3345-save-created-by-values
CLDC-3345-test-branch
CLDC-3345-update-created-by-values
CLDC-3414-update-homepage
CLDC-3465-hard-validation-updates
CLDC-3465-update-setup-question-link
CLDC-3611-performance
CLDC-3611-performance-testing
CLDC-3740-Replace-you-didnt-answer-with-link
CLDC-3788-export-sales-logs
CLDC-3790-continued
CLDC-559-printed-form
CLDC-846-demographic-gender-validation
CLDC-858-no-of-beds-validation-sales
CLDC-858-update-sales-property-information
CLDC-858-validate-beds
CLDC-869-add-validations-for-initial-equity-for-shared-ownership
CLDC-898-monthly-charges-validation
CLDC-908-add-validation-mortgage-lender-name-provided-if-other
CLDC-933-update-household-income-questions
CLDC-allow-23-24-form-new
CLDc-3391-add-51-weeks-rent-period
CacheAssets
DO_NOT_MERGE
ForceAwsTaskFailure
MigrationEmailsFix
Prototyping
ReviewAppsAssets
active-admin-theme
after-demo
answer
before-demo
bu-sales-23-v3
bulk-upload-duplicates-bkup
bulk-upload-owning-org
bulk-upload-resume
bulk-upload-resume-v2
bulk-upload-sentence-case
cds-exports
chloe-1
chloe-2
chloe-3
chloe-4
chloe-5
cldc-1228-organisation-fixes-juris
cldc-1688-deactivation-affected-logs
cldc-1888-bulk-upload-duplicate-log-validation
cldc-2563-aws-production-pipeline-backup
cldc-2610-aws-migration-dry-run
cldc-2812-run-app-from-relative-url
cldc-2865-create-aws-only-pipeline
cldc-2865-enable-paas-maintenance-page
cldc-2865-remove-paas-from-prod-pipeline
cldc-875-sales-validations-shared-ownership-cash-deposit-amount
collection-resources-demo
cucumber-rails
data-export-jobs
deduplication-demo
demo-branch
demo-branch-0
demo-branch-08-01
demo-equations
demo-previous-period-edit-logs-closed
demo-previous-period-new-logs-closed
demo-previous-period-open
duplicate-bu-testing
duplicate-spike
empty
empty-pull-request
equation-before-demo
equation-demo-before
feature/CLDC-1057-ie-polyfills
fix-filter-service-bug
fix-order-export
fix-remove-attr-accessors-from-questions-in-cldc-1723
fix-test-dates
fix-test-on-main
flaky_tests_testing
full-import-optimisation
further-bulk-upload-year-fixes
homepage-not-in-crossover
jsbundling-with-webpack-modernizr
juris_katrina_test
key-issue
load-time-test
logs-status-on-log
main
merge-orgs-demo-2
merge-orgs-demo-branch
merge-test
more-bulk-upload-year
move-users-demo
new-core-ids
new-year-bulk-fixes
parallelize-tests
prod-pipeline-testing
quickfix/no_values_error
quickfix/providertype-mappings
quickfix/reasonpref-validation
remove-deprecated-config
revert-1378-CLDC-1917-startdate-validation
revert-2161-CLDC-3132-24-25-reason-for-vacancy-update
revert-2177-MoveInterviewQuestion
revert-CLDC-2310
revert-additional-export-fields
revert-s3-errors
review-app-deployment-test
review-app-for-23-24-mobbing
review-apps2
review-branch
rita-review
routes-to-csv
sales-collection-year-test-fixes
show-and-tell-28-3-24
show-and-tell-temp-branch
spike-a11y-testing-in-ci
test-6-months-ago
test-branch
test-branch-1
test-key-branch
test-merge-dpo-emails
test-review-app-access
testing-github-action-conditionals
update-rails-version
update-version-test
validations-copy
validations-spike
webinar-demo
v.0.3.25
v.0.3.26
v0.0.1
v0.0.2
v0.0.3
v0.0.4
v0.0.5
v0.0.6
v0.0.7
v0.0.8
v0.0.9
v0.1.0
v0.1.1
v0.1.10
v0.1.11
v0.1.12
v0.1.13
v0.1.14
v0.1.15
v0.1.16
v0.1.17
v0.1.18
v0.1.19
v0.1.2
v0.1.20
v0.1.21
v0.1.22
v0.1.23
v0.1.24
v0.1.25
v0.1.26
v0.1.27
v0.1.28
v0.1.29
v0.1.3
v0.1.30
v0.1.31
v0.1.4
v0.1.5
v0.1.6
v0.1.7
v0.1.8
v0.1.9
v0.2.0
v0.2.1
v0.2.10
v0.2.11
v0.2.12
v0.2.13
v0.2.14
v0.2.15
v0.2.16
v0.2.17
v0.2.18
v0.2.19
v0.2.2
v0.2.20
v0.2.21
v0.2.22
v0.2.23
v0.2.24
v0.2.25
v0.2.26
v0.2.27
v0.2.28
v0.2.29
v0.2.3
v0.2.30
v0.2.31
v0.2.32
v0.2.33
v0.2.34
v0.2.35
v0.2.36
v0.2.37
v0.2.38
v0.2.39
v0.2.4
v0.2.40
v0.2.5
v0.2.6
v0.2.7
v0.2.8
v0.2.9
v0.3.0
v0.3.1
v0.3.10
v0.3.11
v0.3.12
v0.3.13
v0.3.14
v0.3.15
v0.3.16
v0.3.17
v0.3.18
v0.3.19
v0.3.2
v0.3.20
v0.3.21
v0.3.22
v0.3.23
v0.3.24
v0.3.27
v0.3.28
v0.3.29
v0.3.3
v0.3.30
v0.3.31
v0.3.32
v0.3.33
v0.3.34
v0.3.35
v0.3.36
v0.3.37
v0.3.38
v0.3.39
v0.3.4
v0.3.40
v0.3.41
v0.3.42
v0.3.43
v0.3.44
v0.3.45
v0.3.46
v0.3.47
v0.3.48
v0.3.49
v0.3.5
v0.3.50
v0.3.51
v0.3.52
v0.3.53
v0.3.54
v0.3.55
v0.3.56
v0.3.57
v0.3.58
v0.3.59
v0.3.6
v0.3.60
v0.3.61
v0.3.62
v0.3.63
v0.3.64
v0.3.65
v0.3.66
v0.3.67
v0.3.68
v0.3.69
v0.3.7
v0.3.70
v0.3.71
v0.3.72
v0.3.73
v0.3.74
v0.3.75
v0.3.76
v0.3.77
v0.3.78
v0.3.79
v0.3.8
v0.3.80
v0.3.81
v0.3.82
v0.3.83
v0.3.84
v0.3.9
v0.4.0
v0.4.1
v0.4.10
v0.4.11
v0.4.12
v0.4.13
v0.4.14
v0.4.15
v0.4.16
v0.4.17
v0.4.18
v0.4.19
v0.4.2
v0.4.20
v0.4.21
v0.4.22
v0.4.23
v0.4.24
v0.4.25
v0.4.26
v0.4.27
v0.4.28
v0.4.29
v0.4.3
v0.4.30
v0.4.31
v0.4.32
v0.4.33
v0.4.34
v0.4.35
v0.4.36
v0.4.37
v0.4.38
v0.4.39
v0.4.4
v0.4.40
v0.4.41
v0.4.42
v0.4.43
v0.4.44
v0.4.45
v0.4.46
v0.4.47
v0.4.48
v0.4.49
v0.4.5
v0.4.50
v0.4.51
v0.4.52
v0.4.53
v0.4.54
v0.4.55
v0.4.56
v0.4.57
v0.4.58
v0.4.59
v0.4.6
v0.4.60
v0.4.61
v0.4.62
v0.4.63
v0.4.64
v0.4.65
v0.4.66
v0.4.67
v0.4.68
v0.4.69
v0.4.7
v0.4.70
v0.4.71
v0.4.72
v0.4.73
v0.4.74
v0.4.75
v0.4.76
v0.4.77
v0.4.78
v0.4.79
v0.4.8
v0.4.80
v0.4.81
v0.4.82
v0.4.83
v0.4.84
v0.4.85
v0.4.86
v0.4.87
v0.4.88
v0.4.89
v0.4.9
v0.4.90
v0.4.90.1
v0.4.91
${ noResults }
3 Commits (79c19d9eab31be77e52adcbed704419d79af1b41)
| Author | SHA1 | Message | Date |
|---|---|---|---|
Phil Lee
|
0009d535fe
|
CLDC-1896 Bulk upload line endings (#1208)
* add class to create logs from bulk upload * create logs when processing bulk uploads * remove bulk_upload_id from csv output * create bulk upload logs only if all valid - this will be changed later to allow for partial logs - and only to create logs when a threshold has been met * add method to blank invalid non setup fields * bulk upload log creation blanks invalid fields * fix incorrect logic for bulk upload renewal * fix linting * bulk upload log creation fail logs to sentry * fix bulk upload line ending parsing * extract bulk uploading csv parsing to class * use csv parser in log creator * change handle line endings mechanism - we now strip all windows line endings for unix based line endings - this normalises things making it simpler |
2 years ago |
|
Phil Lee
|
90480d1af5
|
CLDC-1779 Bulk upload lettings validation (#1148)
* able to view lettings bulk upload errors * fix linting * call service correctly in test * add bulk upload sales questions mapping * appease linter * bulk upload error shows correct question - depending on log type it will show relevant question for the field concerned * improve namespacing of classes * add job to process bulk uploads * move validation from parser to model * add validations for field_1 * add validation for field_4 * pending tests for field_4 * convert field_mapping to array of hashes * validate nulls based on form question * actually load forms when toggling between forms * validate null for startdate * row parser has access to bulk upload * csv upload validates first form section * add postcode validation * Refactor error mappings for row parser * Add unittype question * Fix null error setting and add builtype * add wchair to bulk upload * Add beds to bulk upload * Add joint to bulk upload * Add startertenancy to the bulk upload * Add tenancy for bulk upload * Add declaration to the bulk upload * Add age1 and age1_known to bulk upload * add ages to bulk upload * add sex1 to bulk upload * add ethnic_group and ethnic to bulk upload * add national to bulk upload * add ecstat1 to bulk upload * add military related fields to bulk upload * add preg_occ to bulk upload * add housingneeds to bulk upload * add illness to bulk upload * add layear to bulk upload * add waityear to bulk upload * add reason to bulk upload * add prevten to bulk upload * add homeless to bulk upload * add previous postcode to bulk upload * add reasonable preferences to bulk upload * add allocations system to bulk upload * add referral to bulk upload * add net_income_known to bulk upload * add hb to bulk upload * add benefits to bulk upload * add rent fields to bulk upload * add hhmemb to bulk upload * use 2022 csv fixtures for bulk upload * fix renewal mapping for bulk upload * placeholder test for bulk upload validation * fix bulk upload mapping for homeless field * fix leftreg mapping for bulk upload * fix user associations in bulk upload tests * add gender fields for bulk upload * add ecstatN fields to bulk upload * add #relatN fields to bulk upload * extract old_visible_id in factory to trait * map net_income_known correctly for bulk upload * fix income bugs for bulk upload * add unitletas to bulk upload * add #rsnvac to bulk upload * add #sheltered to bulk upload * add illness fields to bulk upload * add #irproduct_other to bulk upload * infer renewal from rsnvac for bulk upload * add #tenancyother to bulk upload * add #tenancylength to bulk upload * bulk upload earnings accepts pennies but rounds * add #reasonother to bulk upload * fix mapping of #ppcodenk for bulk upload * add #household_charge to bulk upload * add #chcharge to bulk upload * add #tcharge to bulk upload * add #supcharg to bulk upload * add pscharge to bulk upload * add #scharge to bulk upload * use case statement for bulk upload allocation * add offered to bulk upload * add propcode to bulk upload * add major repair fields to bulk upload * add #voiddate to bulk upload * support YY year format for bulk upload * test postcode strips whitespace for bulk upload * add #la to bulk upload * add previous la to bulk upload * fix failing test * remove duplicate line from rebase * add first time social housing to bulk upload * make methods private * fix field_4 validation for bulk upload - the null check was inverted by mistake Co-authored-by: Kat <katrina@kosiak.co.uk> |
2 years ago |
|
Phil Lee
|
197e2ae4cb
|
[1778] Bulk upload errors (#1091)
* lockdown bulk upload routes * able to view lettings bulk upload errors * add error count to bulk upload results * coverage for bulk upload filename on results * group bulk upload errors by row on results * able to view bulk upload sales results * scope lettings and sales bulk upload results * fix linting * call service correctly in test * add bulk upload sales questions mapping * appease linter * bulk upload error shows correct question - depending on log type it will show relevant question for the field concerned * use local disk for bulk upload for dev env - this saves the need to connect to S3 to play with bulk upload in dev environment * improve namespacing of classes * add job to process bulk uploads * use local disk storage for dev file upload * fix test * use inline active job queue_adapter for dev * use test active job queue adapter for test env * remove rubocop violation * delete bulk upload from disk after processing * populate errors with cell, row + metadata * update error message with something meaningful * shim in sales validator * able to parse sales bulk uploads * change migration to add purchase_code to errors * bulk upload error component renders purchaser code - when a sales log * populate purchaser_code for bulk upload errors - when log type is sales * remove superfluous private method |
2 years ago |