專案

一般

配置概況

動作

工作單 #255

已結束

Develop #253: KAFKA 監聽 DB 架構 Phase.3

Develop #254: kafka取代datasync機制

彙整模型postgresql報表

是由 martin zhuo8 個月 前加入. 於 5 個月 前更新.

狀態:
Close
優先權:
LOW
被分派者:
開始日期:
2025-07-09
完成日期:
2025-10-14
完成百分比:

100%


概述

彙整veriid 模型使用哪些postgresql table 及 elasticsearch index有哪些資料需修改
表有部分column名稱重複、牽涉學習系統使用的column名稱、配合台北時區時間欄位需+8

account takeover:

postgresql table:

  • tb_account_takeover_info

logstash:
remove_field => ["@version","@timestamp"]
gsub => ["create_time","Z",""]
update => {"create_time" => "%{create_time}+08:00"}

  • tb_account_takeover_predict_abnormalLogin_result

logstash:
rename => {"account_takeover_aph_score" => "abnormalLogin_account_takeover_aph_score"}
rename => {"account_takeover_reason" => "abnormalLogin_account_takeover_reason"}
rename => {"account_takeover_return_code" => "abnormalLogin_account_takeover_return_code"}
rename => {"account_takeover_score" => "abnormalLogin_account_takeover_score"}
rename => {"account_takeover_weight" => "abnormalLogin_account_takeover_weight"}
rename => {"ato_info_id" => "abnormalLogin_ato_info_id"}
rename => {"pk_id" => "abnormalLogin_pk_id"}
rename => {"policy_score" => "abnormalLogin_policy_score"}
rename => {"total_score" => "abnormalLogin_total_score"}

  • tb_account_takeover_predict_accountTest_result

logstash:
rename => {"account_takeover_aph_score" => "accountTest_account_takeover_aph_score"}
rename => {"account_takeover_reason" => "accountTest_account_takeover_reason"}
rename => {"account_takeover_return_code" => "accountTest_account_takeover_return_code"}
rename => {"account_takeover_score" => "accountTest_account_takeover_score"}
rename => {"account_takeover_weight" => "accountTest_account_takeover_weight"}
rename => {"ato_info_id" => "accountTest_ato_info_id"}
rename => {"pk_id" => "accountTest_pk_id"}
rename => {"policy_score" => "accountTest_policy_score"}
rename => {"total_score" => "accountTest_total_score"}

elasticsearch index:

veri_id_aws_prd_tb_model_account_takeover_predict_data_v2.0

fraud detect:

postgresql table:

tb_fraud_detect_info
tb_fraud_detect_predict_result

elasticsearch index:

veri_id_aws_prd_tb_model_fraud_detect_predict_data_v2.0

card abnormal:

postgresql table:

tb_card_abnormal_v2
tb_card_abnormal_info
tb_card_abnormal_predict_result

elasticsearch index:

veri_id_aws_prd_tb_model_card_abnormal_predict_data_v2.0

card testing:

postgresql table:

tb_card_testing_info
tb_card_testing_predict_result

elasticsearch index:

veri_id_aws_prd_tb_model_card_testing_predict_data_v2.0

smartfds

postgresql table:

t_inbound_isrfd
t_inbound_acqfd

logstash抓取以下:
resultInfo_trueLabelAuth
resultInfo_trueLabelThreeDS
resultInfo_trueLabelLast
resultInfo_trueLabelChargeback

依據 veriid_trans_id 寫入以下 elasticsearch index:
veri_id_aws_prd_tb_model_card_abnormal_predict_data_v2.0
veri_id_aws_prd_tb_model_card_testing_predict_data_v2.0
veri_id_aws_prd_tb_model_fraud_detect_predict_data_v2.0


檔案

clipboard-202507161756-idfhw.png (58.9 KB) clipboard-202507161756-idfhw.png andy chiang, 2025-07-16 09:56
clipboard-202507211747-elmeg.png (12.5 KB) clipboard-202507211747-elmeg.png andy chiang, 2025-07-21 09:47
clipboard-202507211747-ujczl.png (26.3 KB) clipboard-202507211747-ujczl.png andy chiang, 2025-07-21 09:47
clipboard-202507211748-1dgig.png (39 KB) clipboard-202507211748-1dgig.png andy chiang, 2025-07-21 09:48
clipboard-202507211748-znwtv.png (32.2 KB) clipboard-202507211748-znwtv.png andy chiang, 2025-07-21 09:48
clipboard-202507211749-9zczp.png (31.3 KB) clipboard-202507211749-9zczp.png andy chiang, 2025-07-21 09:49
clipboard-202507251751-wtpu4.png (172 KB) clipboard-202507251751-wtpu4.png martin zhuo, 2025-07-25 09:51
clipboard-202507251755-spjuy.png (196 KB) clipboard-202507251755-spjuy.png martin zhuo, 2025-07-25 09:55
clipboard-202507301350-d3jhe.png (3.63 KB) clipboard-202507301350-d3jhe.png andy chiang, 2025-07-30 05:50
clipboard-202507301351-itfcw.png (35.9 KB) clipboard-202507301351-itfcw.png andy chiang, 2025-07-30 05:51
clipboard-202508211701-anmhj.png (71.2 KB) clipboard-202508211701-anmhj.png andy chiang, 2025-08-21 09:02
clipboard-202508211702-pv3nu.png (31.2 KB) clipboard-202508211702-pv3nu.png andy chiang, 2025-08-21 09:02
clipboard-202508211702-fvexl.png (60.1 KB) clipboard-202508211702-fvexl.png andy chiang, 2025-08-21 09:02
clipboard-202509051353-hlupm.png (177 KB) clipboard-202509051353-hlupm.png andy chiang, 2025-09-05 05:54
clipboard-202509051411-scw0r.png (31.1 KB) clipboard-202509051411-scw0r.png andy chiang, 2025-09-05 06:12
clipboard-202509051534-g8wet.png (10.7 KB) clipboard-202509051534-g8wet.png andy chiang, 2025-09-05 07:35
clipboard-202509051536-zeeuk.png (3.36 KB) clipboard-202509051536-zeeuk.png andy chiang, 2025-09-05 07:36
clipboard-202509081022-0zih2.png (170 KB) clipboard-202509081022-0zih2.png andy chiang, 2025-09-08 02:23
clipboard-202509081436-lqiwq.png (191 KB) clipboard-202509081436-lqiwq.png andy chiang, 2025-09-08 06:36
clipboard-202509081740-lm5jp.png (18.8 KB) clipboard-202509081740-lm5jp.png andy chiang, 2025-09-08 09:40
clipboard-202509101406-typlh.png (67.4 KB) clipboard-202509101406-typlh.png andy chiang, 2025-09-10 06:07
動作

匯出至 Atom PDF