動作
Develop #253
進行中KAFKA 監聽 DB 架構 Phase.3
是由 andy chiang 於 8 個月 前加入. 於 3 個月 前更新.
開始日期:
2025-07-09
完成日期:
2025-10-28 (逾期 約 4 個月)
完成百分比:
100%
概述
調研如何用 k8s 架構,架在 AWS MIX 優先
是由 martin zhuo 於 6 個月 前更新
dev 環境
確認寫入模型index資料無缺漏
目前待辦issue有:
- 寫入時產生多餘的資料欄位 待去除:
"event.original.keyword"
"create_time_ms"
"event": {
"original": "{"id":58710,"create_datetime":1757484513417554,"update_datetime":1757484520821440,"acct_number":"y74bWBsLzBv2Kw2dfRTE3mg8zm4w1Go7nYVpNV1Zjmg/UoepjHTlTq1srdwnrak5GV+w0RulMVtoxotUupS7Ew==","acquirer_bin":"1231234","acquirer_merchant_id":"8909191","auth_code":"250278","auth_response_code":"00","auth_result":"0","authentication_type":"","cb_message":null,"cb_reason":null,"conn_id_mapping_ak":null,"connector_id":"ACQFD_TEST_1","decision_code":"low","ds_trans_id":null,"dsn":"f72ad703b4dc357fb212fd0cf5ac899a","inbound_id":108148,"institute_id":"12001","mer_trans_id":"edb246c5-b184-4a71-b5b7-f1ab7209c514","merchant_name":"HiTRUST ACQFD Merchant Simulator","operator_id":"O000","purchase_amount":"300","purchase_currency":"901","purchase_date":"20250910060832","purchase_exponent":2,"review_message":null,"review_result":null,"sn":"testZWRiMjQ2YzUtYjE4NC00YTcxLWI1YjctZjFhYjcyMDljNTE0","status":"0","status_code":"0000","status_detail":null,"three_ds_server_trans_id":null,"threeds_result":"Y","trans_status":"Y","trans_status_reason":"01","true_label_auth":"N","true_label_chargeback":null,"true_label_last":"N","true_label_threeds":"N","veriid_trans_id":"74c3662a-5ac8-45ea-b7af-f22d9ddda3ae","cif_number":null,"acct_number_mask":"51535200****0123","decision_name":"low","processtype":"01","real_amount":"3.00","udid":"U1963116453386846208","request_ip":"59.125.100.237","request_country":"Taiwan","request_source_ip":"59.125.100.237","request_source_country":"Taiwan","mcc":"5661","card_bin":"515352","is_friction_less":"Y","interactionmode":"01","acct_number_encode":null,"custom_y_value":"N","custom_y_comment":null,"merchant_id":null,"__source_table":"t_inbound_acqfd"}"
}, - 壓力測試確認效能
- index 確認mapping哪些不需要建keyword
- sit布署
是由 martin zhuo 於 5 個月 前更新
DEV 壓力測試 600s 32 threads
資料loss rate < 0.1%,在可接受範圍
模型 ES DB TPS loss rate
CA2 32464 32477 54.091 0.040%
ATO 114098 114192 190.429 0.082%
CT 19109 19109 31.822 0.0%
FD 48463 48483 80.777 0.041%
建議可佈署SIT,進行資料驗證及壓力測試¶
是由 martin zhuo 於 3 個月 前更新
PRD:
模型 card testing / fraud detect / account takeover 正式關閉datasync 啟用kafka寫進資料庫
新設定 會在下次更新佈署時生效
動作