工作單 #255
已結束Develop #253: KAFKA 監聽 DB 架構 Phase.3
Develop #254: kafka取代datasync機制
彙整模型postgresql報表
100%
概述
彙整veriid 模型使用哪些postgresql table 及 elasticsearch index有哪些資料需修改
表有部分column名稱重複、牽涉學習系統使用的column名稱、配合台北時區時間欄位需+8
account takeover:¶
postgresql table:¶
- tb_account_takeover_info
logstash:
remove_field => ["@version","@timestamp"]
gsub => ["create_time","Z",""]
update => {"create_time" => "%{create_time}+08:00"}
- tb_account_takeover_predict_abnormalLogin_result
logstash:
rename => {"account_takeover_aph_score" => "abnormalLogin_account_takeover_aph_score"}
rename => {"account_takeover_reason" => "abnormalLogin_account_takeover_reason"}
rename => {"account_takeover_return_code" => "abnormalLogin_account_takeover_return_code"}
rename => {"account_takeover_score" => "abnormalLogin_account_takeover_score"}
rename => {"account_takeover_weight" => "abnormalLogin_account_takeover_weight"}
rename => {"ato_info_id" => "abnormalLogin_ato_info_id"}
rename => {"pk_id" => "abnormalLogin_pk_id"}
rename => {"policy_score" => "abnormalLogin_policy_score"}
rename => {"total_score" => "abnormalLogin_total_score"}
- tb_account_takeover_predict_accountTest_result
logstash:
rename => {"account_takeover_aph_score" => "accountTest_account_takeover_aph_score"}
rename => {"account_takeover_reason" => "accountTest_account_takeover_reason"}
rename => {"account_takeover_return_code" => "accountTest_account_takeover_return_code"}
rename => {"account_takeover_score" => "accountTest_account_takeover_score"}
rename => {"account_takeover_weight" => "accountTest_account_takeover_weight"}
rename => {"ato_info_id" => "accountTest_ato_info_id"}
rename => {"pk_id" => "accountTest_pk_id"}
rename => {"policy_score" => "accountTest_policy_score"}
rename => {"total_score" => "accountTest_total_score"}
elasticsearch index:¶
veri_id_aws_prd_tb_model_account_takeover_predict_data_v2.0
fraud detect:¶
postgresql table:¶
tb_fraud_detect_info
tb_fraud_detect_predict_result
elasticsearch index:¶
veri_id_aws_prd_tb_model_fraud_detect_predict_data_v2.0
card abnormal:¶
postgresql table:¶
tb_card_abnormal_v2
tb_card_abnormal_info
tb_card_abnormal_predict_result
elasticsearch index:¶
veri_id_aws_prd_tb_model_card_abnormal_predict_data_v2.0
card testing:¶
postgresql table:¶
tb_card_testing_info
tb_card_testing_predict_result
elasticsearch index:¶
veri_id_aws_prd_tb_model_card_testing_predict_data_v2.0
smartfds¶
postgresql table:¶
t_inbound_isrfd
t_inbound_acqfd
logstash抓取以下:
resultInfo_trueLabelAuth
resultInfo_trueLabelThreeDS
resultInfo_trueLabelLast
resultInfo_trueLabelChargeback
依據 veriid_trans_id 寫入以下 elasticsearch index:
veri_id_aws_prd_tb_model_card_abnormal_predict_data_v2.0
veri_id_aws_prd_tb_model_card_testing_predict_data_v2.0
veri_id_aws_prd_tb_model_fraud_detect_predict_data_v2.0
檔案



















