專案

一般

配置概況

動作

Develop #253

進行中

KAFKA 監聽 DB 架構 Phase.3

是由 andy chiang8 個月 前加入. 於 3 個月 前更新.

狀態:
Test
優先權:
LOW
被分派者:
開始日期:
2025-07-09
完成日期:
2025-10-28 (逾期 約 4 個月)
完成百分比:

100%


概述

調研如何用 k8s 架構,架在 AWS MIX 優先


子任務 4 (0 進行中4 已結束)

Develop #254: kafka取代datasync機制Closeandy chiang2025-07-092025-10-14

動作
工作單 #255: 彙整模型postgresql報表Closemartin zhuo2025-07-092025-10-14

動作
Develop #331: Kafka SIT 部屬Closeandy chiang2025-10-142025-10-27

動作
Develop #343: PRD 建置上線Closeandy chiang2025-10-282025-10-28

動作

是由 andy chiang8 個月 前更新

  • 子任務 #254 已新增

是由 martin zhuo6 個月 前更新

dev 環境
確認寫入模型index資料無缺漏
目前待辦issue有:

  1. 寫入時產生多餘的資料欄位 待去除:
    "event.original.keyword"
    "create_time_ms"
    "event": {
    "original": "{"id":58710,"create_datetime":1757484513417554,"update_datetime":1757484520821440,"acct_number":"y74bWBsLzBv2Kw2dfRTE3mg8zm4w1Go7nYVpNV1Zjmg/UoepjHTlTq1srdwnrak5GV+w0RulMVtoxotUupS7Ew==","acquirer_bin":"1231234","acquirer_merchant_id":"8909191","auth_code":"250278","auth_response_code":"00","auth_result":"0","authentication_type":"","cb_message":null,"cb_reason":null,"conn_id_mapping_ak":null,"connector_id":"ACQFD_TEST_1","decision_code":"low","ds_trans_id":null,"dsn":"f72ad703b4dc357fb212fd0cf5ac899a","inbound_id":108148,"institute_id":"12001","mer_trans_id":"edb246c5-b184-4a71-b5b7-f1ab7209c514","merchant_name":"HiTRUST ACQFD Merchant Simulator","operator_id":"O000","purchase_amount":"300","purchase_currency":"901","purchase_date":"20250910060832","purchase_exponent":2,"review_message":null,"review_result":null,"sn":"testZWRiMjQ2YzUtYjE4NC00YTcxLWI1YjctZjFhYjcyMDljNTE0","status":"0","status_code":"0000","status_detail":null,"three_ds_server_trans_id":null,"threeds_result":"Y","trans_status":"Y","trans_status_reason":"01","true_label_auth":"N","true_label_chargeback":null,"true_label_last":"N","true_label_threeds":"N","veriid_trans_id":"74c3662a-5ac8-45ea-b7af-f22d9ddda3ae","cif_number":null,"acct_number_mask":"51535200****0123","decision_name":"low","processtype":"01","real_amount":"3.00","udid":"U1963116453386846208","request_ip":"59.125.100.237","request_country":"Taiwan","request_source_ip":"59.125.100.237","request_source_country":"Taiwan","mcc":"5661","card_bin":"515352","is_friction_less":"Y","interactionmode":"01","acct_number_encode":null,"custom_y_value":"N","custom_y_comment":null,"merchant_id":null,"__source_table":"t_inbound_acqfd"}"
    },
  2. 壓力測試確認效能
  3. index 確認mapping哪些不需要建keyword
  4. sit布署

是由 andy chiang6 個月 前更新

9/12 keyword 優化暫不處裡,需耗時大量時間調研。排定於後續優化項目中

是由 martin zhuo5 個月 前更新

DEV 壓力測試 600s 32 threads
資料loss rate < 0.1%,在可接受範圍

模型 ES DB TPS loss rate
CA2 32464 32477 54.091 0.040%
ATO 114098 114192 190.429 0.082%
CT 19109 19109 31.822 0.0%
FD 48463 48483 80.777 0.041%

建議可佈署SIT,進行資料驗證及壓力測試

是由 andy chiang5 個月 前更新

  • 子任務 #331 已新增

是由 andy chiang4 個月 前更新

  • 子任務 #343 已新增

是由 martin zhuo3 個月 前更新

PRD:
模型 card testing / fraud detect / account takeover 正式關閉datasync 啟用kafka寫進資料庫

新設定 會在下次更新佈署時生效

是由 martin zhuo3 個月 前更新

  • 狀態Ongoing 變更為 Test
動作

匯出至 Atom PDF